System

The system enhances data management by receiving, analyzing, and processing terminal data for reliable and rapid storage and retrieval, addressing inconsistencies and fault tolerance issues.

JP2026038191APending Publication Date: 2026-03-06SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-22
Publication Date
2026-03-06

AI Technical Summary

Technical Problem

Conventional data management systems lack reliability and availability, leading to inconsistent data storage and retrieval, delayed responses, and insufficient fault tolerance.

Method used

A system that receives, analyzes, and processes data from terminals, saves or retrieves it based on selected actions, and transmits results, ensuring data consistency and rapid access while handling errors.

Benefits of technology

Improves data management reliability and availability, enabling efficient and fault-tolerant data storage and retrieval processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026038191000001_ABST
    Figure 2026038191000001_ABST
Patent Text Reader

Abstract

A system is provided.SOLUTION: The system includes a means for receiving data from a terminal, a means for analyzing the received data and selecting processing according to an action, a means for storing or acquiring the data based on the selected processing, and a means for transmitting a processing result to the terminal.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional data management systems lack sufficient reliability and availability, making it difficult to ensure data consistency and rapid access. In particular, these systems often fail to function properly in situations where efficient data storage and retrieval are required. Furthermore, they lack sufficient error response capabilities, resulting in low overall system fault tolerance. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides a system that receives data from a terminal, analyzes the received data, selects processing according to the action, saves or retrieves the data based on the selected processing, and transmits the processing results to the terminal. Specifically, when saving data, the system reads an existing database file, adds new data, and rewrites it to maintain data consistency. When retrieving data, the system reads data from the database file and quickly returns it to the terminal, achieving efficient data access. In this way, the system of the present invention can improve reliability and availability, and increase the efficiency and fault tolerance of data management.

[0006] "Terminal" means a computer or device connected to a network to send and receive data.

[0007] "Data" means information expressed by electromagnetic, optical, or mechanical means, and includes various forms such as text, audio, images, and numbers.

[0008] "Means for receiving" refers to a function or device for receiving data transmitted from a terminal.

[0009] "Means of analysis" refers to the function or process that understands the content of the received data and determines the appropriate action to take.

[0010] An "action" is a specific operation or process that is performed based on data.

[0011] "Means of storage" refers to the function or device that adds new data to an existing database and makes it permanent.

[0012] "Means of acquisition" refers to the function or device that reads the necessary data from the database and returns it to the terminal.

[0013] "Means for sending" refers to the functions and processes for sending the processing results to the terminal.

[0014] "Database file" refers to a file-format storage used to manage data systematically and efficiently.

[0015] "Rewriting" refers to the operation of updating data by adding new data to an existing database file.

[0016] "Response" refers to a message that contains the results of processing a particular request.

[0017] "Consistency" refers to the data in a system being consistent and in a consistent state.

[0018] "Fault tolerance" refers to the ability of a system to continue operating even when a failure or error occurs. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9]1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0021] First, the terms used in the following description will be explained.

[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0027] [First embodiment]

[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0040] The present invention is a control system for improving the reliability and availability of data. The system in this specification is for efficiently exchanging data between servers, terminals, and users, and for storing and retrieving data.

[0041] System Overview

[0042] In this system, the server plays the main role, providing secure and reliable communication between the server and the terminal. The user sends data to the server through the terminal and retrieves the data as needed. The server analyzes the received data, performs appropriate processing, and returns the results to the terminal.

[0043] Data storage process

[0044] When a user inputs new data through a terminal and tries to save it, the terminal sends the data to the server. The server receives the data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the terminal notifying that the data was successfully saved.

[0045] Data Acquisition Process

[0046] When a user requests data acquisition through a terminal, the terminal sends the request to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The user can check the acquired data through the terminal and use it as needed.

[0047] Specific examples

[0048] Example of saving data

[0049] Suppose a user enters the following data at a terminal:

[0050] ID:1

[0051] Name: "Example Data"

[0052] Timestamp: "2023-10-14T12:00:00"

[0053] To save this, the device sends a request to the server like this:

[0054] Action:store

[0055] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[0056] The server receives this request, reads the database file, adds the new data, and rewrites it. After the process is completed, the server sends a response message to the terminal indicating that the data has been saved successfully, so the user can confirm that the data has been saved successfully.

[0057] Data retrieval operation example

[0058] If a user requests data retrieval through a device, the device sends the following request to the server:

[0059] Action: retrieve

[0060] When the server receives this request, it reads the data from the database file and returns the entire contents to the terminal, where the user can receive and check the acquired data on the terminal.

[0061] Error Handling

[0062] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it will return an error message and prompt the user to re-enter the appropriate information. In this way, the system achieves high reliability and fault tolerance.

[0063] The above is a specific embodiment of the control system of the present invention. By using this system, users can efficiently store and retrieve data, improving the reliability and availability of the system as a whole.

[0064] The processing flow will be explained below.

[0065] Data saving process flow

[0066] Step 1:

[0067] A user inputs new data on the terminal. For example, the data is "ID: 1, Name: 'Example Data', Timestamp: '2023-10-14T12:00:00'".

[0068] Step 2:

[0069] The terminal sends the entered data to the server in JSON format.

[0070] Step 3:

[0071] The server receives the data sent from the terminal and temporarily stores the data in a buffer using the recv function.

[0072] Step 4:

[0073] The server decodes the received data into JSON format and converts it into a dictionary object.

[0074] Step 5:

[0075] The server checks that the decoded data is a "store" action by looking at the "action" key in the data.

[0076] Step 6:

[0077] The server opens the database file (for example, 'data_store.json') in read mode. If the data already exists, it is read.

[0078] Step 7:

[0079] The server adds new data to the data it reads, specifically by appending the new data to the existing data list.

[0080] Step 8:

[0081] The server writes the updated data list to the database file, rewriting it from the beginning of the file.

[0082] Step 9:

[0083] The server creates a response message in JSON format indicating that the data saving process was successful and sends it to the terminal.

[0084] Step 10:

[0085] The terminal receives the response from the server and notifies the user that the data has been successfully saved.

[0086] Data acquisition process flow

[0087] Step 1:

[0088] The user operates the device and sends a data retrieval request to the server. The request format is "action: 'retrieve'".

[0089] Step 2:

[0090] The terminal sends a data acquisition request to the server.

[0091] Step 3:

[0092] The server receives the request sent from the terminal, retrieves the data using the recv function, and temporarily stores it in a buffer.

[0093] Step 4:

[0094] The server decodes the received request into JSON format and converts it into a dictionary object.

[0095] Step 5:

[0096] The server verifies that the decoded request is a "retrieve" action by looking at the "action" key in the data.

[0097] Step 6:

[0098] The server opens the database file in read mode, reading all data from the file.

[0099] Step 7:

[0100] The server creates a response message in JSON format from the data it reads.

[0101] Step 8:

[0102] The server sends the created response message to the terminal.

[0103] Step 9:

[0104] The terminal receives the response from the server and displays the acquired data to the user, who then checks the displayed data.

[0105] Error handling flow

[0106] Step 1:

[0107] If the server encounters an error receiving the data, it generates an error message.

[0108] Step 2:

[0109] The server converts the generated error message into JSON format and sends it to the terminal.

[0110] Step 3:

[0111] The terminal receives the error message from the server and notifies the user that an error has occurred.

[0112] These steps enable the system of the present invention to perform data storage and retrieval processes efficiently and reliably.

[0113] Example 1

[0114] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0115] Conventional data management systems did not ensure sufficient data reliability and availability, and responses to user operations were often delayed. Furthermore, the system's response to errors was insufficient, resulting in problems with system reliability.

[0116] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0117] In this invention, the server includes means for receiving data from a terminal, means for analyzing the received data and selecting processing according to the action, means for saving or retrieving data based on the selected processing, means for transmitting the processing results to the terminal, means for communicating with a database to read and write data, means for detecting and responding to errors, and means for displaying information through a user interface, thereby improving the reliability and availability of data and ensuring quick responses and high reliability.

[0118] A "terminal" is a device that is operated by a user to input and obtain data.

[0119] A "server" is a device or system for analyzing, storing, and retrieving data received from a terminal, and returning the processing results.

[0120] A "database" is a file system or data structure used by a server to store and retrieve data.

[0121] The "receiving means" is a function for acquiring data sent from the terminal to the server.

[0122] The "analysis means" is a function for analyzing the contents of received data and selecting an appropriate action.

[0123] The "means for selecting processing" is a function that determines the processing content to be performed based on the content of the data.

[0124] A "means for storing or retrieving data" is a function for storing new data in a database or retrieving existing data based on a selected operation.

[0125] The "means for transmitting processing results" is a function for returning the results of processing performed by the server to the terminal.

[0126] "Means for communicating with a database and reading and writing data" refers to the function of reading and writing data from and to a database.

[0127] "Means for error detection and response" refers to the function of detecting errors that occur during data analysis and processing, and generating and sending appropriate error messages.

[0128] The "means for displaying information through a user interface" is a function for displaying information such as processing results and error messages returned by the server to the user.

[0129] The present invention is a control system for efficiently exchanging data between servers, terminals, and users, and for storing and retrieving data. The purpose of this system is to improve the reliability and availability of data.

[0130] First, the main components of this system will be described. This system includes a server, a terminal, a database, and user operations.

[0131] The server plays a central role in data management and uses the following hardware and software:

[0132] Hardware: General-purpose computer or cloud service (e.g., Amazon Web Services EC2 instance)

[0133] Software: Python programs, web frameworks such as Flask, and database management systems such as MySQL (registered trademark).

[0134] A terminal is a device used by a user to enter or obtain data, and uses the following hardware and software:

[0135] Hardware: PCs, tablets, smartphones, etc.

[0136] Software: Web browser or mobile application

[0137] A database is a file system or data structure that a server uses to store and retrieve data. Specifically, we will use a MySQL database.

[0138] Next, the operation of the system will be specifically described.

[0139] Data storage process

[0140] When a user inputs new data through the device and tries to save it, the device first sends the data in JSON format to the server. The server analyzes the received data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the device indicating that the data was successfully saved. The user can view the message through the device.

[0141] For example, if a user enters the following data:

[0142] ID:1

[0143] Name: "Example Data"

[0144] Timestamp: "2023-10-14T12:00:00"

[0145] The terminal sends a request including the action (store) and the data content to the server. After receiving this request, the server reads the database file, adds new data, and rewrites it. After the process is completed, the server sends a response message to the terminal indicating that the data has been successfully saved, allowing the user to confirm that the data has been saved successfully.

[0146] Data Acquisition Process

[0147] When a user requests data acquisition through a terminal, the terminal sends a data acquisition request to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The user can check the acquired data through the terminal and use it as needed.

[0148] For example, suppose a user requests to retrieve data. In this case, the device sends a request including an action (retrieve) to the server. When the server receives this request, it reads the data from the database file and returns the entire contents to the device in JSON format. The user can then receive and check the retrieved data on the device.

[0149] Error handling process

[0150] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it will return an error message and prompt the user to re-enter the appropriate information. In this way, the system achieves high reliability and fault tolerance.

[0151] Example prompts for generative AI models

[0152] Here are some example prompts to input to the generative AI model:

[0153] "Please give me a concrete example of how to save data. For example, if you want to save data in the form of ID, name, and timestamp, please explain the process in detail."

[0154] "Please give me a specific example of a request to perform a data retrieval operation. Please explain the format in which the request should be sent from the terminal to the server."

[0155] The above is a specific embodiment of the control system of the present invention. By using this system, users can efficiently store and retrieve data, improving the reliability and availability of the system as a whole.

[0156] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0157] Data storage process

[0158] Step 1:

[0159] The user inputs data on the device. Specifically, the user inputs data such as ID, name, timestamp, etc. into the input form on the device. The input data is in the following format:

[0160] ID:1

[0161] Name: "Example Data"

[0162] Timestamp: "2023-10-14T12:00:00"

[0163] input:

[0164] User-entered data

[0165] output:

[0166] Data displayed on the device's input form

[0167] Step 2:

[0168] The device sends data to the server. The device uses an HTTP POST request to send data to the server in JSON format. The data sent must be in the following format:

[0169] json

[0170] {

[0171] "action": "store",

[0172] "data": {

[0173] "id": 1,

[0174] "name": "Example Data",

[0175] "timestamp": "2023-10-14T12:00:00"

[0176] }

[0177] }

[0178] input:

[0179] Data entered by the user into the terminal

[0180] output:

[0181] JSON format data sent to the server

[0182] Step 3:

[0183] The server receives the data. The server uses a web framework such as Flask to receive the HTTP POST request and extracts the data sent. Specifically, the server extracts the JSON data from the body of the request.

[0184] input:

[0185] JSON format data sent from the device

[0186] output:

[0187] Data content extracted by the server

[0188] Step 4:

[0189] The server analyzes the data. The server determines that the received data should be stored. Specifically, it checks the validity of the data format and content (e.g., ID, name, timestamp).

[0190] input:

[0191] Data content extracted by the server

[0192] output:

[0193] That the data is valid

[0194] Step 5:

[0195] The server saves the data to the database. The server connects to the MySQL database and adds the new data. Specifically, it executes the following SQL statement:

[0196] sql

[0197] INSERT INTO datatable (id, name, timestamp) VALUES (1, 'Example Data', '2023-10-14T12:00:00');

[0198] input:

[0199] Validated data

[0200] output:

[0201] Data stored in a database

[0202] Step 6:

[0203] The server sends a response message to the device. If the save to the database is successful, the server returns a message in JSON format indicating that the save was successful to the device. Specifically, it sends the following message:

[0204] json

[0205] {

[0206] "status": "success",

[0207] "message": "Data stored successfully"

[0208] }

[0209] input:

[0210] Results of saving to database

[0211] output:

[0212] Response message sent to the terminal

[0213] Step 7:

[0214] The user confirms the save result. The device receives the response message from the server and displays a success message to the user. Specifically, the device displays the following message on the screen:

[0215] "Data stored successfully"

[0216] input:

[0217] Response message from the server

[0218] output:

[0219] A success message for the user to see

[0220] Data Acquisition Process

[0221] Step 1:

[0222] The user requests data acquisition on the terminal. Specifically, the user clicks a button on the terminal to instruct data acquisition.

[0223] input:

[0224] User's data request

[0225] output:

[0226] Device data acquisition request event

[0227] Step 2:

[0228] The device sends a request to the server. The device uses an HTTP GET request to send a data retrieval request to the server in JSON format. The data sent is in the following format:

[0229] json

[0230] {

[0231] "action": "retrieve"

[0232] }

[0233] input:

[0234] User's data request

[0235] output:

[0236] The request sent to the server

[0237] Step 3:

[0238] The server receives the request. The server receives the HTTP GET request and analyzes the request. Specifically, the server extracts the JSON data from the request body.

[0239] input:

[0240] Requests sent from the device

[0241] output:

[0242] The request content parsed by the server

[0243] Step 4:

[0244] The server retrieves data from the database. The server connects to the MySQL database and retrieves all records. Specifically, it executes the following SQL statement:

[0245] sql

[0246] SELECT FROM datatable;

[0247] input:

[0248] The requested data retrieval request

[0249] output:

[0250] All data retrieved from the database

[0251] Step 5:

[0252] The server returns the data to the device. The acquired data is converted to JSON format and returned to the device. Specifically, the following data is returned:

[0253] json

[0254] {

[0255] "status": "success",

[0256] "data": [

[0257] {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"},

[0258] {"id": 2, "name": "Another Data", "timestamp": "2023-10-15T12:00:00"}

[0259] ]

[0260] }

[0261] input:

[0262] All data retrieved from the database

[0263] output:

[0264] Data sent back to the device

[0265] Step 6:

[0266] The user checks the acquired data. The terminal receives the response data from the server and displays it to the user. Specifically, the user can check each piece of acquired data on the terminal screen.

[0267] input:

[0268] Data retrieved from the server

[0269] output:

[0270] Retrieved data displayed to the user

[0271] Error handling process

[0272] Step 1:

[0273] A user may enter data, but may enter incorrect data, for example, leaving the name field empty.

[0274] input:

[0275] Incorrect data

[0276] output:

[0277] Incorrect data displayed on the device

[0278] Step 2:

[0279] The device sends the data to the server. The device uses an HTTP POST request to send the erroneous data to the server in JSON format.

[0280] input:

[0281] Incorrect data entered by the user

[0282] output:

[0283] Incorrect data sent to the server

[0284] Step 3:

[0285] The server receives the data. The server receives the request and extracts the content of the data sent.

[0286] input:

[0287] Incorrect data sent from the device

[0288] output:

[0289] Data content extracted by the server

[0290] Step 4:

[0291] The server analyzes the data and detects errors. The server analyzes the format and content of the data to detect invalid data. Specifically, it checks that the name field is empty.

[0292] input:

[0293] Data content extracted by the server

[0294] output:

[0295] Presence or absence of errors

[0296] Step 5:

[0297] The server sends an error message to the terminal. If an error is detected, the server returns an error message in JSON format to the terminal. Specifically, it sends the following message:

[0298] json

[0299] {

[0300] "status": "error",

[0301] "message": "Name field is empty. Please re-enter."

[0302] }

[0303] input:

[0304] Error Information

[0305] output:

[0306] Error messages sent to the terminal

[0307] Step 6:

[0308] The user confirms the error and re-enters the data. The terminal receives the error message and displays it to the user. The user confirms the error message and re-enters the correct data.

[0309] input:

[0310] Error messages from the server

[0311] output:

[0312] Correct data to be re-entered

[0313] This concludes the explanation of the specific operations and inputs / outputs of each processing step in this system, which improves the reliability and availability of data and achieves fast response and high reliability.

[0314] (Application example 1)

[0315] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0316] Inventory management and shipping status tracking at logistics centers require the exchange of reliable data in real time to maximize efficiency. However, existing systems have issues with data reliability, availability, and operational efficiency, making management tasks cumbersome. In particular, updating inventory information and checking shipping status takes time, making errors and work delays more likely to occur. This reduces the operational efficiency of the entire logistics center, posing a challenge.

[0317] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0318] In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and selecting processing according to the action, means for saving or retrieving data based on the selected processing, means for transmitting the processing results to the terminal, means for tracking inventory management and shipping status at the logistics center, means for receiving and saving inventory information (identifier, name, quantity, date and time), and means for confirming inventory and retrieving shipping status and returning it to the terminal. This enables real-time monitoring of inventory management and shipping status at the logistics center, increases data reliability and availability, improves work efficiency, and reduces errors.

[0319] A "terminal" is a device for inputting and displaying data, and for transmitting data between a user and a system.

[0320] A "server" is a central device that receives data sent from a terminal, analyzes, saves, retrieves, and returns the processing results.

[0321] The "data receiving means" is a mechanism by which the server receives data sent from the terminal.

[0322] The "data analysis means" is a mechanism for analyzing received data and selecting an appropriate process based on the data's contents.

[0323] A "data storage means" is a mechanism for adding and storing data in an existing database file based on selected processing.

[0324] The "data acquisition means" is a mechanism for reading the necessary data from the database file and returning it to the terminal.

[0325] The "processing result transmission means" is a mechanism for transmitting the processing results performed by the server to the terminal.

[0326] A "distribution center" is a facility that stores and manages inventory and ships products.

[0327] "Inventory control" is the activity of recording and managing inventory of goods at a logistics center.

[0328] "Shipping status tracking" is the activity of tracking and managing the current status and location information of shipped goods.

[0329] "Inventory information" is data related to product identifiers, names, quantities, and the dates and times of stocking and shipping.

[0330] MODE FOR CARRYING OUT THE INVENTION

[0331] System Overview

[0332] As an embodiment of the present invention, the system of the present invention efficiently and reliably manages inventory at a logistics center and tracks shipping status. The system is configured as follows.

[0333] Hardware and Software

[0334] The main hardware components of this system are:

[0335] Terminal: A device used to enter and check inventory information and shipping status. For example, a smartphone.

[0336] Server: The main component that receives, analyzes, stores, retrieves data, and returns the processed results.

[0337] Database: A storage system for storing data. An example is SQLite.

[0338] The following software is used:

[0339] Flask: A Python framework that implements server-side processing.

[0340] SQLite: A lightweight database management system for managing inventory and shipping data.

[0341] Data processing and calculation

[0342] Receiving and storing data

[0343] 1. The user uses a terminal to enter new inventory information, including the identifier, name, quantity, and date and time.

[0344] 2. The device sends the entered data to the server, which analyzes the received data and selects the process for saving it.

[0345] 3. The server reads the existing data from the database and rewrites it with the new data.

[0346] Getting and returning data

[0347] 1. The user uses the terminal to request stock availability or shipping status.

[0348] 2. The device sends this request to the server, which retrieves the necessary information from the database based on the received request.

[0349] 3. The read data is sent back from the server to the device, where the user can view it.

[0350] Specific examples

[0351] Example of saving inventory information

[0352] For example, when a new item arrives at a distribution center, an associate enters the following information into their smartphone:

[0353] Identifier: 123

[0354] Name: "Product A"

[0355] Quantity:50

[0356] Date and time: "2023-10-22T09:00:00"

[0357] Once staff enter this information, the smartphone sends the data to a server, which stores it in a database.

[0358] Example of checking shipping status

[0359] When a user wants to check the status of a shipped item, the user sends a request to check the shipping status using the smartphone app. The server receives this request, retrieves the shipping status from the database, and sends it back to the smartphone. The user can then check the current status of the shipped item based on the returned data.

[0360] Prompt Sentence Examples

[0361] The following prompts can be used for the generative AI model:

[0362] "Write Python code to store data received by the server in a database and retrieve it as needed for an inventory management system used in a distribution center. Specifically, you will use Flask and SQLite."

[0363] In this way, the system of the present invention can efficiently and reliably realize inventory management and shipping status tracking in a logistics center.

[0364] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0365] Step 1:

[0366] The user uses a terminal to input new inventory information. The user inputs an identifier, name, quantity, and date and time. This input data is sent from the terminal to the server. The input data is expressed in JSON format.

[0367] Step 2:

[0368] The terminal sends the input data in JSON format to the server. The sent data includes the identifier, name, quantity, and date and time. The server receives this data.

[0369] Step 3:

[0370] The server analyzes the received data and determines whether it is information that should be saved. Specifically, it checks whether the data format and required fields (identifier, name, quantity, date and time) are complete. If the data is in the appropriate format, it prepares the data for saving.

[0371] Step 4:

[0372] The server reads existing data from the database by opening a database connection using SQLite and executing an SQL query to retrieve existing inventory data, where the input is the user data received by the server and the output is the result of the SQL query.

[0373] Step 5:

[0374] The server appends the new data to the existing data and rewrites it to the database. Using SQLite, it executes an SQL query to insert the new data. Once the data update is complete, it generates a message that the data was saved successfully.

[0375] Step 6:

[0376] The server sends a data saving success message to the terminal, and the terminal receives this message and notifies the user that the data has been saved successfully, completing the inventory information saving process.

[0377] Step 7:

[0378] The user uses the device to request stock availability or shipping status. The device sends a request to the server. This request is also in JSON format, and the action is "retrieve."

[0379] Step 8:

[0380] The server receives the request sent from the device and prepares to retrieve the necessary information from the database. Specifically, it uses SQLite to create SQL queries to retrieve inventory and shipping status.

[0381] Step 9:

[0382] The server executes SQL queries to retrieve inventory and shipping status data from the database. The input is the request data received by the server, and the output is the result of the SQL query. The retrieved data is then converted to JSON format and ready to be sent back.

[0383] Step 10:

[0384] The server returns the acquired data in JSON format to the device. The device receives this data and the user can check the stock status and shipping status on the device. This completes the data acquisition process.

[0385] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0386] The present invention combines a control system for improving data reliability and availability with an emotion engine that recognizes user emotions. The system in this specification not only efficiently exchanges data between servers, terminals, and users, and stores and retrieves data, but also responds by reflecting the user's emotions.

[0387] System Overview

[0388] The system is primarily based on a server, which provides secure and reliable communication between the server and the device. Users send data to the server via their device and retrieve data as needed. Furthermore, the system incorporates an emotion engine that recognizes the user's emotions, adjusting response content and data processing priority.

[0389] Emotion recognition processing

[0390] The emotion engine analyzes user input and behavior to recognize emotions. For example, it can determine whether a user is stressed based on the context of text input. This information is used by the server for data processing.

[0391] Data storage process

[0392] When a user inputs new data through the terminal and tries to save it, the terminal sends the data along with the user's emotional information to the server. The server receives the data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the terminal notifying that the data was successfully saved.

[0393] Data Acquisition Process

[0394] When a user requests data through a terminal, the terminal sends the request along with the user's emotional information to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The returned data and response message are adjusted according to the user's emotional state. For example, if the user is feeling stressed, a more friendly response will be returned.

[0395] Specific examples

[0396] Example of saving data

[0397] Suppose a user enters the following data at a terminal:

[0398] ID:1

[0399] Name: "Example Data"

[0400] Timestamp: "2023-10-14T12:00:00"

[0401] Emotions: Stress

[0402] To save this, the device sends a request to the server like this:

[0403] Action:store

[0404] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[0405] Emotional information: Stress

[0406] The server receives this request, reads the database file, adds the new data, and rewrites it. After the process is complete, the server sends a response message to the terminal indicating that the data has been successfully saved, and notifies the user with a friendly tone.

[0407] Data retrieval operation example

[0408] If a user requests data retrieval through a device, the device sends the following request to the server:

[0409] Action: retrieve

[0410] Emotional information: Relaxation

[0411] When the server receives this request, it reads the data from the database file and returns the entire contents to the terminal. The server recognizes that the user is relaxed and sends a standard response message. The user can receive and check the retrieved data on the terminal.

[0412] Error Handling

[0413] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it returns an error message and prompts the user to re-enter the appropriate information. In this case, it utilizes an emotion engine to provide an error message in a way that reflects the user's emotions. For example, if the user is irritated, it will request the user to re-enter the information in a very polite tone.

[0414] These features enable the system of the present invention to improve the user experience and increase the reliability and efficiency of data management. By combining it with an emotion engine, flexible responses that are in tune with the user's emotions become possible.

[0415] The processing flow will be explained below.

[0416] Data storage process flow incorporating emotion recognition

[0417] Step 1:

[0418] A user inputs new data on the terminal. For example, the data is "ID: 1, Name: 'Example Data', Timestamp: '2023-10-14T12:00:00'".

[0419] Step 2:

[0420] The user is analyzed by the device's emotion engine, and the emotion is recognized as "stress."

[0421] Step 3:

[0422] The device sends the input data and emotion information to the server in JSON format.

[0423] Step 4:

[0424] The server receives the data sent from the terminal and temporarily stores the data in a buffer using the recv function.

[0425] Step 5:

[0426] The server decodes the received data into JSON format and converts it into a dictionary object.

[0427] Step 6:

[0428] The server checks that the decoded data is a "store" action by looking at the "action" key in the data.

[0429] Step 7:

[0430] The server checks the emotion information provided by the emotion engine and adjusts the data processing priority based on this emotion: if the user is feeling stressed, the processing priority is set high.

[0431] Step 8:

[0432] The server opens the database file (for example, 'data_store.json') in read mode. If the data already exists, it is read.

[0433] Step 9:

[0434] The server adds new data to the data it reads, specifically by appending the new data to the existing data list.

[0435] Step 10:

[0436] The server writes the updated data list to the database file, rewriting it from the beginning of the file.

[0437] Step 11:

[0438] The server creates a response message in JSON format indicating that the data saving process was successful, and sends it to the device along with a response based on the user's emotion. For example, if the user is "stressed," a message is sent in a more friendly tone.

[0439] Step 12:

[0440] The terminal receives the response from the server and notifies the user that the data has been successfully saved.

[0441] Data acquisition process flow incorporating emotion recognition

[0442] Step 1:

[0443] The user operates the device and sends a data retrieval request to the server. The request format is "action: 'retrieve'".

[0444] Step 2:

[0445] The user is analyzed by the device's emotion engine, and the emotion is recognized as "relaxed."

[0446] Step 3:

[0447] The device sends a data acquisition request and emotion information to the server.

[0448] Step 4:

[0449] The server receives the request sent from the terminal, retrieves the data using the recv function, and temporarily stores it in a buffer.

[0450] Step 5:

[0451] The server decodes the received request into JSON format and converts it into a dictionary object.

[0452] Step 6:

[0453] The server verifies that the decoded request is a "retrieve" action by looking at the "action" key in the data.

[0454] Step 7:

[0455] The server checks the emotion information provided by the emotion engine and adjusts the content of the response message based on this emotion: if the user is relaxed, it generates a standard response message;

[0456] Step 8:

[0457] The server opens the database file in read mode, reading all data from the file.

[0458] Step 9:

[0459] The server creates a response message in JSON format from the data it reads.

[0460] Step 10:

[0461] The server sends the created response message to the terminal.

[0462] Step 11:

[0463] The terminal receives the response from the server and displays the acquired data to the user, who then checks the displayed data.

[0464] Error handling flow

[0465] Step 1:

[0466] If an error occurs when the server receives data, an emotion engine is utilized to generate an error message based on the user's emotion.

[0467] Step 2:

[0468] The server generates an error message, converts it to JSON format, and sends it to the terminal, and if the user is annoyed, politely asks them to re-enter the information.

[0469] Step 3:

[0470] The terminal receives the error message from the server and notifies the user that an error has occurred.

[0471] These steps enable the system of the present invention to efficiently and reliably store and retrieve data, and by utilizing the emotion engine, it is possible to respond flexibly to the user's emotions.

[0472] Example 2

[0473] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0474] Conventional data management systems do not process data with consideration for user emotions, resulting in poor user experience. In particular, systems often lack appropriate responses for users who feel stressed or irritated when entering or retrieving data, which can impair system usability. In addition, data storage and retrieval processes must be efficient and reliable.

[0475] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0476] In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and extracting user emotion information, means for selecting a process corresponding to an action based on the emotion information, means for saving or retrieving data based on the selected process, and means for transmitting the processing result to the terminal together with a response message based on the emotion information. This enables data processing and response messages that take the user's emotion into consideration, improving system usability and the user experience. Furthermore, data saving and retrieval processes are performed efficiently and reliably.

[0477] A "terminal" is a computer or device through which a user inputs data and communicates with a server.

[0478] A "server" is a computer system that receives, analyzes, stores, retrieves data, extracts emotion information, and generates response messages.

[0479] The "means for receiving data" is a function for taking data sent from a terminal into the server.

[0480] "Means for analyzing data" refers to the function of understanding the content of received data, breaking it down into individual elements, and processing them.

[0481] The "means for extracting emotional information" is a function for identifying the emotional state of the user from the analyzed data.

[0482] The "means for selecting processing according to an action" is a function for determining an appropriate data processing method based on the user's emotional information and the data content.

[0483] "Means for saving data" is a function that adds new data to the database and rewrites existing data files.

[0484] "Means for obtaining data" is a function that reads the necessary data from the database and returns it to the terminal.

[0485] The "means for generating a response message" is a function for forming an appropriate message based on the results of data processing and the user's emotional information.

[0486] The "means for transmitting to the terminal" is a function for transmitting the generated response message and the data processing results from the server to the terminal.

[0487] The "measures to be taken when an abnormality occurs" is a function that detects that the received data is incomplete, formulates an error message corresponding to the user's feelings, and sends it to the terminal.

[0488] An "emotion engine" is a software component that analyzes user input data and behavior to recognize emotions.

[0489] MODE FOR CARRYING OUT THE INVENTION

[0490] This invention is a data management system that takes user emotions into consideration and aims to improve the reliability and availability of data. This system not only efficiently exchanges data between servers, terminals, and users, and stores and retrieves data, but also responds in a way that reflects the user's emotions.

[0491] System Configuration

[0492] The system consists of three main components:

[0493] 1. Server

[0494] 2. Terminal

[0495] 3. Users

[0496] 1. Server:

[0497] The server receives, analyzes, stores, and retrieves data, extracts emotion information, and generates response messages. The server includes an emotion engine and a database.

[0498] The emotion engine is a software component that analyzes user input data and behavior to recognize emotions, and can use, for example, text analysis algorithms.

[0499] 2. Terminal:

[0500] A terminal is a computer or device through which a user inputs data and communicates with a server. The user sends data through the terminal and retrieves the data as needed.

[0501] Examples of terminals include PCs, tablets, and smartphones.

[0502] 3. User:

[0503] Users input, save, and retrieve data through their terminals, and the user's emotional information is reflected in the overall processing of the system.

[0504] Examples of data storage

[0505] The user enters the following data at the terminal:

[0506] ID:1

[0507] Name: "Example Data"

[0508] Timestamp: "2023-10-14T12:00:00"

[0509] Emotions: Stress

[0510] To save this, the device sends the following request to the server:

[0511] Action:store

[0512] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[0513] Emotional information: Stress

[0514] The server receives this request and does the following:

[0515] 1. Analyze the incoming data and use the emotion engine to identify the user's emotion as "stress."

[0516] 2. Access the database and read the existing data file.

[0517] 3. Append the new data to the existing data and rewrite the database file.

[0518] 4. Generate a message of successful saving and send a friendly tone message to the terminal, such as "The data has been saved successfully. Thank you," depending on the user's emotion.

[0519] 5. The terminal displays this message to the user, who confirms that the save process was successful.

[0520] Specific examples of data acquisition

[0521] When a user requests data retrieval through a device, the following request is sent:

[0522] Action: retrieve

[0523] Emotional information: Relaxation

[0524] The server receives this request and does the following:

[0525] 1. Read all the data from the database file.

[0526] 2. The read data is returned to the terminal as a response.

[0527] 3. Consider that the user is relaxed and send a standard response message.

[0528] 4. The terminal displays the data to the user, who then checks the data.

[0529] Example of error handling

[0530] The system also has the ability to react when an anomaly occurs. For example, if it detects that the received data is incomplete, it will:

[0531] 1. The server generates an error message and announces it in a tone that corresponds to the user's emotion. For example, for an annoyed user, it generates a message saying, "We apologize for the inconvenience, but please enter your data again. Confirmation is required."

[0532] 2. The terminal displays this error message to the user and prompts them to re-enter the appropriate information.

[0533] Prompt Sentence Examples

[0534] Here are some example prompts to input to a generative AI model:

[0535] > "The user wants to save new data. The data is as follows:

[0536] > - ID:1

[0537] - Name: "Example Data"

[0538] - Timestamp: "2023-10-14T12:00:00"

[0539] - Emotions: Stress

[0540] > Consider this data and sentiment information to generate an appropriate response message.

[0541] > "The user is requesting data retrieval. The user's emotional information is relaxed. Please generate an appropriate response message taking this emotional information into account."

[0542] As a result, it becomes possible to respond in a way that takes into account the user's emotions, improving the ease of use and reliability of the system.

[0543] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0544] Step 1:

[0545] The user inputs data through the terminal and sends it to the server.

[0546] What happens: A user accesses a data entry form and enters new data (e.g., ID, name, timestamp). Emotional information is also entered.

[0547] Input: User-entered data and emotion information (e.g., {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00", "emotion": "Stress"}).

[0548] Output: The device generates a request to send this to the server (e.g., {"action": "store", "data": {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}, "emotion": "stress"}).

[0549] Step 2:

[0550] The server receives the data and analyzes the user's emotional information using an emotion engine.

[0551] Specific operation: The server receives a request sent from the terminal, first analyzes the request content, and then identifies emotion information using the emotion engine.

[0552] Input: Request data received from the device (e.g., {"action": "store", "data": {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}, "emotion": "stress"}).

[0553] Output: As a result of the analysis, emotional information (e.g., "stress") is extracted.

[0554] Step 3:

[0555] The server accesses the database and saves the new data.

[0556] Specific operation: The server accesses the database, reads the current data file, appends the new data to the existing data, and rewrites the updated data to the database file.

[0557] Input: Parsed data and emotion information (e.g., {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00", "emotion": "stress"}).

[0558] Output: The updated database file.

[0559] Step 4:

[0560] The server generates a message indicating that the save was successful and sends it to the terminal.

[0561] Specific operation: The server generates a message to inform the user that the save process was successful. This message is generated in a tone that takes into account the user's stress.

[0562] Input: Successful data storage process and emotional information (e.g., "stress").

[0563] Output: A response message for successful save based on emotion information (e.g., "Your data has been saved successfully. Thank you.").

[0564] Step 5:

[0565] The device will display a successful save message to the user.

[0566] Specific operation: The device displays the message received from the server to the user, allowing the user to confirm that the data has been successfully saved.

[0567] Input: Response message from the server (e.g. "Data saved successfully. Thank you.").

[0568] Output: A successful save message displayed on the terminal.

[0569] Step 6:

[0570] The user requests data acquisition through the terminal.

[0571] Specific operation: The user accesses the data acquisition screen on the device and requests data acquisition. At this time, emotion information is also sent.

[0572] Input: User request (e.g. {"action": "retrieve", "emotion": "relax"}).

[0573] Output: A request sent from the device to the server (e.g., {"action": "retrieve", "emotion": "relax"}).

[0574] Step 7:

[0575] The server processes the data retrieval request and reads the data from the database.

[0576] What happens: The server receives the request and reads all the data from the database file.

[0577] Input: A request from the device (e.g., {"action": "retrieve", "emotion": "relax"}).

[0578] Output: The data read (e.g. the entire contents of the database).

[0579] Step 8:

[0580] The server generates a response message based on the acquired data and emotion information and sends it to the terminal.

[0581] Specific operation: The server takes into account the user's emotional information when generating a response message. For a relaxed user, it generates a standard response message and sends it to the device along with the acquired data.

[0582] Input: Acquired data and emotional information (e.g., "Relaxed").

[0583] Output: A response message based on the acquired data and emotional information (e.g., "Here is the data you requested.").

[0584] Step 9:

[0585] The terminal displays the acquired data and a response message to the user.

[0586] Specific operation: The terminal displays the response message from the server and the acquired data to the user, so that the user can check the acquired data.

[0587] Input: Response message from the server and retrieved data (e.g., "This is the data you requested," database contents).

[0588] Output: Data and response messages displayed on the terminal.

[0589] The above is the specific processing flow of the program of this system.

[0590] (Application example 2)

[0591] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0592] Conventional food delivery systems have the problem of not improving the user experience because they process data and respond without considering the user's emotions. In particular, they are unable to respond appropriately to stressed or irritated users, which leads to a decrease in satisfaction.

[0593] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and selecting processing according to the action, means for saving or acquiring data based on the selected processing, means for transmitting the processing results to the terminal, means for adjusting response content and data processing priority based on the user's emotions using an emotion engine that recognizes the user's emotions, and means for suggesting personalized menus based on the user's emotions. This enables appropriate and flexible responses according to the user's emotional state, improving the user experience.

[0594] A "terminal" is an interface device used by a user, and is a device that transmits and receives data via communication with a server.

[0595] "Saving data" is the process of adding new data received to an existing database file and rewriting the database file.

[0596] "Data acquisition" is the process of reading all data from the database file and returning the requested data to the terminal.

[0597] The "processing result" is the result after the server has saved or retrieved the data, and includes information or messages to be sent to the terminal.

[0598] A "server" is a computer system that analyzes data received from a terminal, selects the appropriate processing, and returns the results.

[0599] An "emotion engine" is a technological element that analyzes user input and behavior to recognize emotions, and adjusts response content and data processing priority based on that information.

[0600] "Personalized menu suggestions" refers to a process of suggesting menu items and services that are optimal for a user based on the user's emotional data.

[0601] The recommender system for implementing the present invention can recognize the user's emotions and adjust data processing and response content accordingly. Specific embodiments are described below.

[0602] System configuration

[0603] The system mainly consists of two main components: a server and a terminal. The terminal receives user input, the server analyzes the input and takes appropriate action, and the emotion engine recognizes emotions and adjusts data processing accordingly.

[0604] Hardware and software used

[0605] The hardware required is a user device (smartphone or smart glasses) and a server. The software consists of the following main modules:

[0606] 1. Data receiving module: A communication module for receiving data sent by a terminal.

[0607] 2. Data analysis module: The processing logic for analyzing the received data and selecting the necessary actions. This includes the Python requests library.

[0608] 3. Data storage and retrieval module: A data management module for storing and retrieving data in a database. For database management, a database management system such as MySQL or PostgreSQL is used.

[0609] 4. Emotion Engine: An engine for recognizing and analyzing user emotions in real time. In this part, the generative AI model uses NLP techniques to recognize emotions from the user's input text.

[0610] 5. Personalization module: The logic for making personalized menu suggestions based on user sentiment.

[0611] Explanation of program processing

[0612] The server first receives data from the device through the data reception module. The data analysis module then analyzes the received data and uses the emotion engine to recognize the user's emotions. The emotion engine applies NLP technology, and if a user enters, for example, "I'm very busy at work and I'm frustrated," it will recognize this as "stress." Based on this information, the personalization module makes appropriate menu suggestions.

[0613] Next, if data storage or retrieval is required, the data storage and retrieval module interacts with the database on the server and performs the necessary operations. Finally, the server sends the processing results to the terminal and displays them to the user in an appropriate content according to their emotions.

[0614] Specific examples

[0615] For example, if a user inputs "I'm so busy at work and I'm frustrated," the emotion engine will recognize it as "stress," and the server will recommend "Sushi" as a personalized menu item. Also, when a data saving operation is performed, the operation result is sent to the device along with a user-friendly message.

[0616] Prompt Sentence Examples

[0617] Here is an example prompt:

[0618] Analyze the user's sentiment from the input sentence and recommend appropriate menu items based on that sentiment.

[0619] example:

[0620] Enter: "I'm so busy at work and it's frustrating."

[0621] Emotion: "Stress"

[0622] Recommended Menu: "Sushi"

[0623] In this way, the system aims to improve the user experience by responding appropriately and flexibly to the user's emotional state.

[0624] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0625] Step 1:

[0626] The terminal receives input data from the user (e.g., text such as "I'm so busy at work and I'm frustrated"), which is sent in a comma-separated format for further processing.

[0627] Step 2:

[0628] The terminal sends the received user input data to the server. The data includes text information and basic user information. The server receives the data using the requests module.

[0629] Step 3:

[0630] The server passes the received data to the data analysis module, which analyzes the text information and selects the necessary action, such as "save" or "get."

[0631] Step 4:

[0632] The data analysis module passes the analysis results to the emotion engine, which uses a generative AI model to recognize user emotions from the context of the text. This emotion recognition process utilizes natural language processing (NLP) techniques to classify the input data into various emotion labels.

[0633] Step 5:

[0634] Once the emotion engine recognizes the user's emotion, it returns the result to the main processing logic on the server. For example, it may recognize that the user is feeling "stressed." This result is used in the next processing step for personalized services and suggestions.

[0635] Step 6:

[0636] Based on the results of the emotion engine, the server calls the personalization module, which then suggests a menu item that matches the user's emotions. For example, if the user is feeling stressed, "Sushi" will be selected as the suggested menu item.

[0637] Step 7:

[0638] If necessary, the server saves or retrieves the data. In the case of saving data, it calls the data saving module to add the received data to the database file, or rewrites the existing database file.

[0639] Step 8:

[0640] In the case of data acquisition, the server calls the data acquisition module, reads the necessary data from the database, and returns it to the terminal. The returned data includes a response message according to the user's emotion.

[0641] Step 9:

[0642] The server then sends the appropriate response message or data to the device as the final processing result. The device then displays the received content to the user and performs the corresponding action, such as suggesting menu items to the user based on their emotions.

[0643] Step 10:

[0644] The terminal feeds back the data and response messages received from the server to the user, and the user can select the next action based on that.

[0645] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0646] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0647] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0648] [Second embodiment]

[0649] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0650] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0651] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0652] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0653] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0654] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0655] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0656] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0657] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0658] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0659] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0660] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0661] The present invention is a control system for improving the reliability and availability of data. The system in this specification is for efficiently exchanging data between servers, terminals, and users, and for storing and retrieving data.

[0662] System Overview

[0663] In this system, the server plays the main role, providing secure and reliable communication between the server and the terminal. The user sends data to the server through the terminal and retrieves the data as needed. The server analyzes the received data, performs appropriate processing, and returns the results to the terminal.

[0664] Data storage process

[0665] When a user inputs new data through a terminal and tries to save it, the terminal sends the data to the server. The server receives the data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the terminal notifying that the data was successfully saved.

[0666] Data Acquisition Process

[0667] When a user requests data acquisition through a terminal, the terminal sends the request to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The user can check the acquired data through the terminal and use it as needed.

[0668] Specific examples

[0669] Example of saving data

[0670] Suppose a user enters the following data at a terminal:

[0671] ID:1

[0672] Name: "Example Data"

[0673] Timestamp: "2023-10-14T12:00:00"

[0674] To save this, the device sends a request to the server like this:

[0675] Action:store

[0676] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[0677] The server receives this request, reads the database file, adds the new data, and rewrites it. After the process is completed, the server sends a response message to the terminal indicating that the data has been saved successfully, so the user can confirm that the data has been saved successfully.

[0678] Data retrieval operation example

[0679] If a user requests data retrieval through a device, the device sends the following request to the server:

[0680] Action: retrieve

[0681] When the server receives this request, it reads the data from the database file and returns the entire contents to the terminal, where the user can receive and check the acquired data on the terminal.

[0682] Error Handling

[0683] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it will return an error message and prompt the user to re-enter the appropriate information. In this way, the system achieves high reliability and fault tolerance.

[0684] The above is a specific embodiment of the control system of the present invention. By using this system, users can efficiently store and retrieve data, improving the reliability and availability of the system as a whole.

[0685] The processing flow will be explained below.

[0686] Data saving process flow

[0687] Step 1:

[0688] A user inputs new data on the terminal. For example, the data is "ID: 1, Name: 'Example Data', Timestamp: '2023-10-14T12:00:00'".

[0689] Step 2:

[0690] The terminal sends the entered data to the server in JSON format.

[0691] Step 3:

[0692] The server receives the data sent from the terminal and temporarily stores the data in a buffer using the recv function.

[0693] Step 4:

[0694] The server decodes the received data into JSON format and converts it into a dictionary object.

[0695] Step 5:

[0696] The server checks that the decoded data is a "store" action by looking at the "action" key in the data.

[0697] Step 6:

[0698] The server opens the database file (for example, 'data_store.json') in read mode. If the data already exists, it is read.

[0699] Step 7:

[0700] The server adds new data to the data it reads, specifically by appending the new data to the existing data list.

[0701] Step 8:

[0702] The server writes the updated data list to the database file, rewriting it from the beginning of the file.

[0703] Step 9:

[0704] The server creates a response message in JSON format indicating that the data saving process was successful and sends it to the terminal.

[0705] Step 10:

[0706] The terminal receives the response from the server and notifies the user that the data has been successfully saved.

[0707] Data acquisition process flow

[0708] Step 1:

[0709] The user operates the device and sends a data retrieval request to the server. The request format is "action: 'retrieve'".

[0710] Step 2:

[0711] The terminal sends a data acquisition request to the server.

[0712] Step 3:

[0713] The server receives the request sent from the terminal, retrieves the data using the recv function, and temporarily stores it in a buffer.

[0714] Step 4:

[0715] The server decodes the received request into JSON format and converts it into a dictionary object.

[0716] Step 5:

[0717] The server verifies that the decoded request is a "retrieve" action by looking at the "action" key in the data.

[0718] Step 6:

[0719] The server opens the database file in read mode, reading all data from the file.

[0720] Step 7:

[0721] The server creates a response message in JSON format from the data it reads.

[0722] Step 8:

[0723] The server sends the created response message to the terminal.

[0724] Step 9:

[0725] The terminal receives the response from the server and displays the acquired data to the user, who then checks the displayed data.

[0726] Error handling flow

[0727] Step 1:

[0728] If the server encounters an error receiving the data, it generates an error message.

[0729] Step 2:

[0730] The server converts the generated error message into JSON format and sends it to the terminal.

[0731] Step 3:

[0732] The terminal receives the error message from the server and notifies the user that an error has occurred.

[0733] These steps enable the system of the present invention to perform data storage and retrieval processes efficiently and reliably.

[0734] Example 1

[0735] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0736] Conventional data management systems did not ensure sufficient data reliability and availability, and responses to user operations were often delayed. Furthermore, the system's response to errors was insufficient, resulting in problems with system reliability.

[0737] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0738] In this invention, the server includes means for receiving data from a terminal, means for analyzing the received data and selecting processing according to the action, means for saving or retrieving data based on the selected processing, means for transmitting the processing results to the terminal, means for communicating with a database to read and write data, means for detecting and responding to errors, and means for displaying information through a user interface, thereby improving the reliability and availability of data and ensuring quick responses and high reliability.

[0739] A "terminal" is a device that is operated by a user to input and obtain data.

[0740] A "server" is a device or system for analyzing, storing, and retrieving data received from a terminal, and returning the processing results.

[0741] A "database" is a file system or data structure used by a server to store and retrieve data.

[0742] The "receiving means" is a function for acquiring data sent from the terminal to the server.

[0743] The "analysis means" is a function for analyzing the contents of received data and selecting an appropriate action.

[0744] The "means for selecting processing" is a function that determines the processing content to be performed based on the content of the data.

[0745] A "means for storing or retrieving data" is a function for storing new data in a database or retrieving existing data based on a selected operation.

[0746] The "means for transmitting processing results" is a function for returning the results of processing performed by the server to the terminal.

[0747] "Means for communicating with a database and reading and writing data" refers to the function of reading and writing data from and to a database.

[0748] "Means for error detection and response" refers to the function of detecting errors that occur during data analysis and processing, and generating and sending appropriate error messages.

[0749] The "means for displaying information through a user interface" is a function for displaying information such as processing results and error messages returned by the server to the user.

[0750] The present invention is a control system for efficiently exchanging data between servers, terminals, and users, and for storing and retrieving data. The purpose of this system is to improve the reliability and availability of data.

[0751] First, the main components of this system will be described. This system includes a server, a terminal, a database, and user operations.

[0752] The server plays a central role in data management and uses the following hardware and software:

[0753] Hardware: General-purpose computer or cloud service (e.g., Amazon Web Services EC2 instance)

[0754] Software: Python programs, web frameworks such as Flask, and database management systems such as MySQL

[0755] A terminal is a device used by a user to enter or obtain data, and uses the following hardware and software:

[0756] Hardware: PCs, tablets, smartphones, etc.

[0757] Software: Web browser or mobile application

[0758] A database is a file system or data structure that a server uses to store and retrieve data. Specifically, we will use a MySQL database.

[0759] Next, the operation of the system will be specifically described.

[0760] Data storage process

[0761] When a user inputs new data through the device and tries to save it, the device first sends the data in JSON format to the server. The server analyzes the received data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the device indicating that the data was successfully saved. The user can view the message through the device.

[0762] For example, if a user enters the following data:

[0763] ID:1

[0764] Name: "Example Data"

[0765] Timestamp: "2023-10-14T12:00:00"

[0766] The terminal sends a request including the action (store) and the data content to the server. After receiving this request, the server reads the database file, adds new data, and rewrites it. After the process is completed, the server sends a response message to the terminal indicating that the data has been successfully saved, allowing the user to confirm that the data has been saved successfully.

[0767] Data Acquisition Process

[0768] When a user requests data acquisition through a terminal, the terminal sends a data acquisition request to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The user can check the acquired data through the terminal and use it as needed.

[0769] For example, suppose a user requests to retrieve data. In this case, the device sends a request including an action (retrieve) to the server. When the server receives this request, it reads the data from the database file and returns the entire contents to the device in JSON format. The user can then receive and check the retrieved data on the device.

[0770] Error handling process

[0771] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it will return an error message and prompt the user to re-enter the appropriate information. In this way, the system achieves high reliability and fault tolerance.

[0772] Example prompts for generative AI models

[0773] Here are some example prompts to input to the generative AI model:

[0774] "Please give me a concrete example of how to save data. For example, if you want to save data in the form of ID, name, and timestamp, please explain the process in detail."

[0775] "Please give me a specific example of a request to perform a data retrieval operation. Please explain the format in which the request should be sent from the terminal to the server."

[0776] The above is a specific embodiment of the control system of the present invention. By using this system, users can efficiently store and retrieve data, improving the reliability and availability of the system as a whole.

[0777] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0778] Data storage process

[0779] Step 1:

[0780] The user inputs data on the device. Specifically, the user inputs data such as ID, name, timestamp, etc. into the input form on the device. The input data is in the following format:

[0781] ID:1

[0782] Name: "Example Data"

[0783] Timestamp: "2023-10-14T12:00:00"

[0784] input:

[0785] User-entered data

[0786] output:

[0787] Data displayed on the device's input form

[0788] Step 2:

[0789] The device sends data to the server. The device uses an HTTP POST request to send data to the server in JSON format. The data sent must be in the following format:

[0790] json

[0791] {

[0792] "action": "store",

[0793] "data": {

[0794] "id": 1,

[0795] "name": "Example Data",

[0796] "timestamp": "2023-10-14T12:00:00"

[0797] }

[0798] }

[0799] input:

[0800] Data entered by the user into the terminal

[0801] output:

[0802] JSON format data sent to the server

[0803] Step 3:

[0804] The server receives the data. The server uses a web framework such as Flask to receive the HTTP POST request and extracts the data sent. Specifically, the server extracts the JSON data from the body of the request.

[0805] input:

[0806] JSON format data sent from the device

[0807] output:

[0808] Data content extracted by the server

[0809] Step 4:

[0810] The server analyzes the data. The server determines that the received data should be stored. Specifically, it checks the validity of the data format and content (e.g., ID, name, timestamp).

[0811] input:

[0812] Data content extracted by the server

[0813] output:

[0814] That the data is valid

[0815] Step 5:

[0816] The server saves the data to the database. The server connects to the MySQL database and adds the new data. Specifically, it executes the following SQL statement:

[0817] sql

[0818] INSERT INTO datatable (id, name, timestamp) VALUES (1, 'Example Data', '2023-10-14T12:00:00');

[0819] input:

[0820] Validated data

[0821] output:

[0822] Data stored in a database

[0823] Step 6:

[0824] The server sends a response message to the device. If the save to the database is successful, the server returns a message in JSON format indicating that the save was successful to the device. Specifically, it sends the following message:

[0825] json

[0826] {

[0827] "status": "success",

[0828] "message": "Data stored successfully"

[0829] }

[0830] input:

[0831] Results of saving to database

[0832] output:

[0833] Response message sent to the terminal

[0834] Step 7:

[0835] The user confirms the save result. The device receives the response message from the server and displays a success message to the user. Specifically, the device displays the following message on the screen:

[0836] "Data stored successfully"

[0837] input:

[0838] Response message from the server

[0839] output:

[0840] A success message for the user to see

[0841] Data Acquisition Process

[0842] Step 1:

[0843] The user requests data acquisition on the terminal. Specifically, the user clicks a button on the terminal to instruct data acquisition.

[0844] input:

[0845] User's data request

[0846] output:

[0847] Device data acquisition request event

[0848] Step 2:

[0849] The device sends a request to the server. The device uses an HTTP GET request to send a data retrieval request to the server in JSON format. The data sent is in the following format:

[0850] json

[0851] {

[0852] "action": "retrieve"

[0853] }

[0854] input:

[0855] User's data request

[0856] output:

[0857] The request sent to the server

[0858] Step 3:

[0859] The server receives the request. The server receives the HTTP GET request and analyzes the request. Specifically, the server extracts the JSON data from the request body.

[0860] input:

[0861] Requests sent from the device

[0862] output:

[0863] The request content parsed by the server

[0864] Step 4:

[0865] The server retrieves data from the database. The server connects to the MySQL database and retrieves all records. Specifically, it executes the following SQL statement:

[0866] sql

[0867] SELECT FROM datatable;

[0868] input:

[0869] The requested data retrieval request

[0870] output:

[0871] All data retrieved from the database

[0872] Step 5:

[0873] The server returns the data to the device. The acquired data is converted to JSON format and returned to the device. Specifically, the following data is returned:

[0874] json

[0875] {

[0876] "status": "success",

[0877] "data": [

[0878] {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"},

[0879] {"id": 2, "name": "Another Data", "timestamp": "2023-10-15T12:00:00"}

[0880] ]

[0881] }

[0882] input:

[0883] All data retrieved from the database

[0884] output:

[0885] Data sent back to the device

[0886] Step 6:

[0887] The user checks the acquired data. The terminal receives the response data from the server and displays it to the user. Specifically, the user can check each piece of acquired data on the terminal screen.

[0888] input:

[0889] Data retrieved from the server

[0890] output:

[0891] Retrieved data displayed to the user

[0892] Error handling process

[0893] Step 1:

[0894] A user may enter data, but may enter incorrect data, for example, leaving the name field empty.

[0895] input:

[0896] Incorrect data

[0897] output:

[0898] Incorrect data displayed on the device

[0899] Step 2:

[0900] The device sends the data to the server. The device uses an HTTP POST request to send the erroneous data to the server in JSON format.

[0901] input:

[0902] Incorrect data entered by the user

[0903] output:

[0904] Incorrect data sent to the server

[0905] Step 3:

[0906] The server receives the data. The server receives the request and extracts the content of the data sent.

[0907] input:

[0908] Incorrect data sent from the device

[0909] output:

[0910] Data content extracted by the server

[0911] Step 4:

[0912] The server analyzes the data and detects errors. The server analyzes the format and content of the data to detect invalid data. Specifically, it checks that the name field is empty.

[0913] input:

[0914] Data content extracted by the server

[0915] output:

[0916] Presence or absence of errors

[0917] Step 5:

[0918] The server sends an error message to the terminal. If an error is detected, the server returns an error message in JSON format to the terminal. Specifically, it sends the following message:

[0919] json

[0920] {

[0921] "status": "error",

[0922] "message": "Name field is empty. Please re-enter."

[0923] }

[0924] input:

[0925] Error Information

[0926] output:

[0927] Error messages sent to the terminal

[0928] Step 6:

[0929] The user confirms the error and re-enters the data. The terminal receives the error message and displays it to the user. The user confirms the error message and re-enters the correct data.

[0930] input:

[0931] Error messages from the server

[0932] output:

[0933] Correct data to be re-entered

[0934] This concludes the explanation of the specific operations and inputs / outputs of each processing step in this system, which improves the reliability and availability of data and achieves fast response and high reliability.

[0935] (Application example 1)

[0936] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0937] Inventory management and shipping status tracking at logistics centers require the exchange of reliable data in real time to maximize efficiency. However, existing systems have issues with data reliability, availability, and operational efficiency, making management tasks cumbersome. In particular, updating inventory information and checking shipping status takes time, making errors and work delays more likely to occur. This reduces the operational efficiency of the entire logistics center, posing a challenge.

[0938] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0939] In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and selecting processing according to the action, means for saving or retrieving data based on the selected processing, means for transmitting the processing results to the terminal, means for tracking inventory management and shipping status at the logistics center, means for receiving and saving inventory information (identifier, name, quantity, date and time), and means for confirming inventory and retrieving shipping status and returning it to the terminal. This enables real-time monitoring of inventory management and shipping status at the logistics center, increases data reliability and availability, improves work efficiency, and reduces errors.

[0940] A "terminal" is a device for inputting and displaying data, and for transmitting data between a user and a system.

[0941] A "server" is a central device that receives data sent from a terminal, analyzes, saves, retrieves, and returns the processing results.

[0942] The "data receiving means" is a mechanism by which the server receives data sent from the terminal.

[0943] The "data analysis means" is a mechanism for analyzing received data and selecting an appropriate process based on the data's contents.

[0944] A "data storage means" is a mechanism for adding and storing data in an existing database file based on selected processing.

[0945] The "data acquisition means" is a mechanism for reading the necessary data from the database file and returning it to the terminal.

[0946] The "processing result transmission means" is a mechanism for transmitting the processing results performed by the server to the terminal.

[0947] A "distribution center" is a facility that stores and manages inventory and ships products.

[0948] "Inventory control" is the activity of recording and managing inventory of goods at a logistics center.

[0949] "Shipping status tracking" is the activity of tracking and managing the current status and location information of shipped goods.

[0950] "Inventory information" is data related to product identifiers, names, quantities, and the dates and times of stocking and shipping.

[0951] MODE FOR CARRYING OUT THE INVENTION

[0952] System Overview

[0953] As an embodiment of the present invention, the system of the present invention efficiently and reliably manages inventory at a logistics center and tracks shipping status. The system is configured as follows.

[0954] Hardware and Software

[0955] The main hardware components of this system are:

[0956] Terminal: A device used to enter and check inventory information and shipping status. For example, a smartphone.

[0957] Server: The main component that receives, analyzes, stores, retrieves data, and returns the processed results.

[0958] Database: A storage system for storing data. An example is SQLite.

[0959] The following software is used:

[0960] Flask: A Python framework that implements server-side processing.

[0961] SQLite: A lightweight database management system for managing inventory and shipping data.

[0962] Data processing and calculation

[0963] Receiving and storing data

[0964] 1. The user uses a terminal to enter new inventory information, including the identifier, name, quantity, and date and time.

[0965] 2. The device sends the entered data to the server, which analyzes the received data and selects the process for saving it.

[0966] 3. The server reads the existing data from the database and rewrites it with the new data.

[0967] Getting and returning data

[0968] 1. The user uses the terminal to request stock availability or shipping status.

[0969] 2. The device sends this request to the server, which retrieves the necessary information from the database based on the received request.

[0970] 3. The read data is sent back from the server to the device, where the user can view it.

[0971] Specific examples

[0972] Example of saving inventory information

[0973] For example, when a new item arrives at a distribution center, an associate enters the following information into their smartphone:

[0974] Identifier: 123

[0975] Name: "Product A"

[0976] Quantity:50

[0977] Date and time: "2023-10-22T09:00:00"

[0978] Once staff enter this information, the smartphone sends the data to a server, which stores it in a database.

[0979] Example of checking shipping status

[0980] When a user wants to check the status of a shipped item, the user sends a request to check the shipping status using the smartphone app. The server receives this request, retrieves the shipping status from the database, and sends it back to the smartphone. The user can then check the current status of the shipped item based on the returned data.

[0981] Prompt Sentence Examples

[0982] The following prompts can be used for the generative AI model:

[0983] "Write Python code to store data received by the server in a database and retrieve it as needed for an inventory management system used in a distribution center. Specifically, you will use Flask and SQLite."

[0984] In this way, the system of the present invention can efficiently and reliably realize inventory management and shipping status tracking in a logistics center.

[0985] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0986] Step 1:

[0987] The user uses a terminal to input new inventory information. The user inputs an identifier, name, quantity, and date and time. This input data is sent from the terminal to the server. The input data is expressed in JSON format.

[0988] Step 2:

[0989] The terminal sends the input data in JSON format to the server. The sent data includes the identifier, name, quantity, and date and time. The server receives this data.

[0990] Step 3:

[0991] The server analyzes the received data and determines whether it is information that should be saved. Specifically, it checks whether the data format and required fields (identifier, name, quantity, date and time) are complete. If the data is in the appropriate format, it prepares the data for saving.

[0992] Step 4:

[0993] The server reads existing data from the database by opening a database connection using SQLite and executing an SQL query to retrieve existing inventory data, where the input is the user data received by the server and the output is the result of the SQL query.

[0994] Step 5:

[0995] The server appends the new data to the existing data and rewrites it to the database. Using SQLite, it executes an SQL query to insert the new data. Once the data update is complete, it generates a message that the data was saved successfully.

[0996] Step 6:

[0997] The server sends a data saving success message to the terminal, and the terminal receives this message and notifies the user that the data has been saved successfully, completing the inventory information saving process.

[0998] Step 7:

[0999] The user uses the device to request stock availability or shipping status. The device sends a request to the server. This request is also in JSON format, and the action is "retrieve."

[1000] Step 8:

[1001] The server receives the request sent from the device and prepares to retrieve the necessary information from the database. Specifically, it uses SQLite to create SQL queries to retrieve inventory and shipping status.

[1002] Step 9:

[1003] The server executes SQL queries to retrieve inventory and shipping status data from the database. The input is the request data received by the server, and the output is the result of the SQL query. The retrieved data is then converted to JSON format and ready to be sent back.

[1004] Step 10:

[1005] The server returns the acquired data in JSON format to the device. The device receives this data and the user can check the stock status and shipping status on the device. This completes the data acquisition process.

[1006] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1007] The present invention combines a control system for improving data reliability and availability with an emotion engine that recognizes user emotions. The system in this specification not only efficiently exchanges data between servers, terminals, and users, and stores and retrieves data, but also responds by reflecting the user's emotions.

[1008] System Overview

[1009] The system is primarily based on a server, which provides secure and reliable communication between the server and the device. Users send data to the server via their device and retrieve data as needed. Furthermore, the system incorporates an emotion engine that recognizes the user's emotions, adjusting response content and data processing priority.

[1010] Emotion recognition processing

[1011] The emotion engine analyzes user input and behavior to recognize emotions. For example, it can determine whether a user is stressed based on the context of text input. This information is used by the server for data processing.

[1012] Data storage process

[1013] When a user inputs new data through the terminal and tries to save it, the terminal sends the data along with the user's emotional information to the server. The server receives the data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the terminal notifying that the data was successfully saved.

[1014] Data Acquisition Process

[1015] When a user requests data through a terminal, the terminal sends the request along with the user's emotional information to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The returned data and response message are adjusted according to the user's emotional state. For example, if the user is feeling stressed, a more friendly response will be returned.

[1016] Specific examples

[1017] Example of saving data

[1018] Suppose a user enters the following data at a terminal:

[1019] ID:1

[1020] Name: "Example Data"

[1021] Timestamp: "2023-10-14T12:00:00"

[1022] Emotions: Stress

[1023] To save this, the device sends a request to the server like this:

[1024] Action:store

[1025] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[1026] Emotional information: Stress

[1027] The server receives this request, reads the database file, adds the new data, and rewrites it. After the process is complete, the server sends a response message to the terminal indicating that the data has been successfully saved, and notifies the user with a friendly tone.

[1028] Data retrieval operation example

[1029] If a user requests data retrieval through a device, the device sends the following request to the server:

[1030] Action: retrieve

[1031] Emotional information: Relaxation

[1032] When the server receives this request, it reads the data from the database file and returns the entire contents to the terminal. The server recognizes that the user is relaxed and sends a standard response message. The user can receive and check the retrieved data on the terminal.

[1033] Error Handling

[1034] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it returns an error message and prompts the user to re-enter the appropriate information. In this case, it utilizes an emotion engine to provide an error message in a way that reflects the user's emotions. For example, if the user is irritated, it will request the user to re-enter the information in a very polite tone.

[1035] These features enable the system of the present invention to improve the user experience and increase the reliability and efficiency of data management. By combining it with an emotion engine, flexible responses that are in tune with the user's emotions become possible.

[1036] The processing flow will be explained below.

[1037] Data storage process flow incorporating emotion recognition

[1038] Step 1:

[1039] A user inputs new data on the terminal. For example, the data is "ID: 1, Name: 'Example Data', Timestamp: '2023-10-14T12:00:00'".

[1040] Step 2:

[1041] The user is analyzed by the device's emotion engine, and the emotion is recognized as "stress."

[1042] Step 3:

[1043] The device sends the input data and emotion information to the server in JSON format.

[1044] Step 4:

[1045] The server receives the data sent from the terminal and temporarily stores the data in a buffer using the recv function.

[1046] Step 5:

[1047] The server decodes the received data into JSON format and converts it into a dictionary object.

[1048] Step 6:

[1049] The server checks that the decoded data is a "store" action by looking at the "action" key in the data.

[1050] Step 7:

[1051] The server checks the emotion information provided by the emotion engine and adjusts the data processing priority based on this emotion: if the user is feeling stressed, the processing priority is set high.

[1052] Step 8:

[1053] The server opens the database file (for example, 'data_store.json') in read mode. If the data already exists, it is read.

[1054] Step 9:

[1055] The server adds new data to the data it reads, specifically by appending the new data to the existing data list.

[1056] Step 10:

[1057] The server writes the updated data list to the database file, rewriting it from the beginning of the file.

[1058] Step 11:

[1059] The server creates a response message in JSON format indicating that the data saving process was successful, and sends it to the device along with a response based on the user's emotion. For example, if the user is "stressed," a message is sent in a more friendly tone.

[1060] Step 12:

[1061] The terminal receives the response from the server and notifies the user that the data has been successfully saved.

[1062] Data acquisition process flow incorporating emotion recognition

[1063] Step 1:

[1064] The user operates the device and sends a data retrieval request to the server. The request format is "action: 'retrieve'".

[1065] Step 2:

[1066] The user is analyzed by the device's emotion engine, and the emotion is recognized as "relaxed."

[1067] Step 3:

[1068] The device sends a data acquisition request and emotion information to the server.

[1069] Step 4:

[1070] The server receives the request sent from the terminal, retrieves the data using the recv function, and temporarily stores it in a buffer.

[1071] Step 5:

[1072] The server decodes the received request into JSON format and converts it into a dictionary object.

[1073] Step 6:

[1074] The server verifies that the decoded request is a "retrieve" action by looking at the "action" key in the data.

[1075] Step 7:

[1076] The server checks the emotion information provided by the emotion engine and adjusts the content of the response message based on this emotion: if the user is relaxed, it generates a standard response message;

[1077] Step 8:

[1078] The server opens the database file in read mode, reading all data from the file.

[1079] Step 9:

[1080] The server creates a response message in JSON format from the data it reads.

[1081] Step 10:

[1082] The server sends the created response message to the terminal.

[1083] Step 11:

[1084] The terminal receives the response from the server and displays the acquired data to the user, who then checks the displayed data.

[1085] Error handling flow

[1086] Step 1:

[1087] If an error occurs when the server receives data, an emotion engine is utilized to generate an error message based on the user's emotion.

[1088] Step 2:

[1089] The server generates an error message, converts it to JSON format, and sends it to the terminal, and if the user is annoyed, politely asks them to re-enter the information.

[1090] Step 3:

[1091] The terminal receives the error message from the server and notifies the user that an error has occurred.

[1092] These steps enable the system of the present invention to efficiently and reliably store and retrieve data, and by utilizing the emotion engine, it is possible to respond flexibly to the user's emotions.

[1093] Example 2

[1094] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1095] Conventional data management systems do not process data with consideration for user emotions, resulting in poor user experience. In particular, systems often lack appropriate responses for users who feel stressed or irritated when entering or retrieving data, which can impair system usability. In addition, data storage and retrieval processes must be efficient and reliable.

[1096] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1097] In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and extracting user emotion information, means for selecting a process corresponding to an action based on the emotion information, means for saving or retrieving data based on the selected process, and means for transmitting the processing result to the terminal together with a response message based on the emotion information. This enables data processing and response messages that take the user's emotion into consideration, improving system usability and the user experience. Furthermore, data saving and retrieval processes are performed efficiently and reliably.

[1098] A "terminal" is a computer or device through which a user inputs data and communicates with a server.

[1099] A "server" is a computer system that receives, analyzes, stores, retrieves data, extracts emotion information, and generates response messages.

[1100] The "means for receiving data" is a function for taking data sent from a terminal into the server.

[1101] "Means for analyzing data" refers to the function of understanding the content of received data, breaking it down into individual elements, and processing them.

[1102] The "means for extracting emotional information" is a function for identifying the emotional state of the user from the analyzed data.

[1103] The "means for selecting processing according to an action" is a function for determining an appropriate data processing method based on the user's emotional information and the data content.

[1104] "Means for saving data" is a function that adds new data to the database and rewrites existing data files.

[1105] "Means for obtaining data" is a function that reads the necessary data from the database and returns it to the terminal.

[1106] The "means for generating a response message" is a function for forming an appropriate message based on the results of data processing and the user's emotional information.

[1107] The "means for transmitting to the terminal" is a function for transmitting the generated response message and the data processing results from the server to the terminal.

[1108] The "measures to be taken when an abnormality occurs" is a function that detects that the received data is incomplete, formulates an error message corresponding to the user's feelings, and sends it to the terminal.

[1109] An "emotion engine" is a software component that analyzes user input data and behavior to recognize emotions.

[1110] MODE FOR CARRYING OUT THE INVENTION

[1111] This invention is a data management system that takes user emotions into consideration and aims to improve the reliability and availability of data. This system not only efficiently exchanges data between servers, terminals, and users, and stores and retrieves data, but also responds in a way that reflects the user's emotions.

[1112] System Configuration

[1113] The system consists of three main components:

[1114] 1. Server

[1115] 2. Terminal

[1116] 3. Users

[1117] 1. Server:

[1118] The server receives, analyzes, stores, and retrieves data, extracts emotion information, and generates response messages. The server includes an emotion engine and a database.

[1119] The emotion engine is a software component that analyzes user input data and behavior to recognize emotions, and can use, for example, text analysis algorithms.

[1120] 2. Terminal:

[1121] A terminal is a computer or device through which a user inputs data and communicates with a server. The user sends data through the terminal and retrieves the data as needed.

[1122] Examples of terminals include PCs, tablets, and smartphones.

[1123] 3. User:

[1124] Users input, save, and retrieve data through their terminals, and the user's emotional information is reflected in the overall processing of the system.

[1125] Examples of data storage

[1126] The user enters the following data at the terminal:

[1127] ID:1

[1128] Name: "Example Data"

[1129] Timestamp: "2023-10-14T12:00:00"

[1130] Emotions: Stress

[1131] To save this, the device sends the following request to the server:

[1132] Action:store

[1133] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[1134] Emotional information: Stress

[1135] The server receives this request and does the following:

[1136] 1. Analyze the incoming data and use the emotion engine to identify the user's emotion as "stress."

[1137] 2. Access the database and read the existing data file.

[1138] 3. Append the new data to the existing data and rewrite the database file.

[1139] 4. Generate a message of successful saving and send a friendly tone message to the terminal, such as "The data has been saved successfully. Thank you," depending on the user's emotion.

[1140] 5. The terminal displays this message to the user, who confirms that the save process was successful.

[1141] Specific examples of data acquisition

[1142] When a user requests data retrieval through a device, the following request is sent:

[1143] Action: retrieve

[1144] Emotional information: Relaxation

[1145] The server receives this request and does the following:

[1146] 1. Read all the data from the database file.

[1147] 2. The read data is returned to the terminal as a response.

[1148] 3. Consider that the user is relaxed and send a standard response message.

[1149] 4. The terminal displays the data to the user, who then checks the data.

[1150] Example of error handling

[1151] The system also has the ability to react when an anomaly occurs. For example, if it detects that the received data is incomplete, it will:

[1152] 1. The server generates an error message and announces it in a tone that corresponds to the user's emotion. For example, for an annoyed user, it generates a message saying, "We apologize for the inconvenience, but please enter your data again. Confirmation is required."

[1153] 2. The terminal displays this error message to the user and prompts them to re-enter the appropriate information.

[1154] Prompt Sentence Examples

[1155] Here are some example prompts to input to a generative AI model:

[1156] > "The user wants to save new data. The data is as follows:

[1157] > - ID:1

[1158] - Name: "Example Data"

[1159] - Timestamp: "2023-10-14T12:00:00"

[1160] - Emotions: Stress

[1161] > Consider this data and sentiment information to generate an appropriate response message.

[1162] > "The user is requesting data retrieval. The user's emotional information is relaxed. Please generate an appropriate response message taking this emotional information into account."

[1163] As a result, it becomes possible to respond in a way that takes into account the user's emotions, improving the ease of use and reliability of the system.

[1164] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1165] Step 1:

[1166] The user inputs data through the terminal and sends it to the server.

[1167] What happens: A user accesses a data entry form and enters new data (e.g., ID, name, timestamp). Emotional information is also entered.

[1168] Input: User-entered data and emotion information (e.g., {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00", "emotion": "Stress"}).

[1169] Output: The device generates a request to send this to the server (e.g., {"action": "store", "data": {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}, "emotion": "stress"}).

[1170] Step 2:

[1171] The server receives the data and analyzes the user's emotional information using an emotion engine.

[1172] Specific operation: The server receives a request sent from the terminal, first analyzes the request content, and then identifies emotion information using the emotion engine.

[1173] Input: Request data received from the device (e.g., {"action": "store", "data": {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}, "emotion": "stress"}).

[1174] Output: As a result of the analysis, emotional information (e.g., "stress") is extracted.

[1175] Step 3:

[1176] The server accesses the database and saves the new data.

[1177] Specific operation: The server accesses the database, reads the current data file, appends the new data to the existing data, and rewrites the updated data to the database file.

[1178] Input: Parsed data and emotion information (e.g., {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00", "emotion": "stress"}).

[1179] Output: The updated database file.

[1180] Step 4:

[1181] The server generates a message indicating that the save was successful and sends it to the terminal.

[1182] Specific operation: The server generates a message to inform the user that the save process was successful. This message is generated in a tone that takes into account the user's stress.

[1183] Input: Successful data storage process and emotional information (e.g., "stress").

[1184] Output: A response message for successful save based on emotion information (e.g., "Your data has been saved successfully. Thank you.").

[1185] Step 5:

[1186] The device will display a successful save message to the user.

[1187] Specific operation: The device displays the message received from the server to the user, allowing the user to confirm that the data has been successfully saved.

[1188] Input: Response message from the server (e.g. "Data saved successfully. Thank you.").

[1189] Output: A successful save message displayed on the terminal.

[1190] Step 6:

[1191] The user requests data acquisition through the terminal.

[1192] Specific operation: The user accesses the data acquisition screen on the device and requests data acquisition. At this time, emotion information is also sent.

[1193] Input: User request (e.g. {"action": "retrieve", "emotion": "relax"}).

[1194] Output: A request sent from the device to the server (e.g., {"action": "retrieve", "emotion": "relax"}).

[1195] Step 7:

[1196] The server processes the data retrieval request and reads the data from the database.

[1197] What happens: The server receives the request and reads all the data from the database file.

[1198] Input: A request from the device (e.g., {"action": "retrieve", "emotion": "relax"}).

[1199] Output: The data read (e.g. the entire contents of the database).

[1200] Step 8:

[1201] The server generates a response message based on the acquired data and emotion information and sends it to the terminal.

[1202] Specific operation: The server takes into account the user's emotional information when generating a response message. For a relaxed user, it generates a standard response message and sends it to the device along with the acquired data.

[1203] Input: Acquired data and emotional information (e.g., "Relaxed").

[1204] Output: A response message based on the acquired data and emotional information (e.g., "Here is the data you requested.").

[1205] Step 9:

[1206] The terminal displays the acquired data and a response message to the user.

[1207] Specific operation: The terminal displays the response message from the server and the acquired data to the user, so that the user can check the acquired data.

[1208] Input: Response message from the server and retrieved data (e.g., "This is the data you requested," database contents).

[1209] Output: Data and response messages displayed on the terminal.

[1210] The above is the specific processing flow of the program of this system.

[1211] (Application example 2)

[1212] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1213] Conventional food delivery systems have the problem of not improving the user experience because they process data and respond without considering the user's emotions. In particular, they are unable to respond appropriately to stressed or irritated users, which leads to a decrease in satisfaction.

[1214] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and selecting processing according to the action, means for saving or acquiring data based on the selected processing, means for transmitting the processing results to the terminal, means for adjusting response content and data processing priority based on the user's emotions using an emotion engine that recognizes the user's emotions, and means for suggesting personalized menus based on the user's emotions. This enables appropriate and flexible responses according to the user's emotional state, improving the user experience.

[1215] A "terminal" is an interface device used by a user, and is a device that transmits and receives data via communication with a server.

[1216] "Saving data" is the process of adding new data received to an existing database file and rewriting the database file.

[1217] "Data acquisition" is the process of reading all data from the database file and returning the requested data to the terminal.

[1218] The "processing result" is the result after the server has saved or retrieved the data, and includes information or messages to be sent to the terminal.

[1219] A "server" is a computer system that analyzes data received from a terminal, selects the appropriate processing, and returns the results.

[1220] An "emotion engine" is a technological element that analyzes user input and behavior to recognize emotions, and adjusts response content and data processing priority based on that information.

[1221] "Personalized menu suggestions" refers to a process of suggesting menu items and services that are optimal for a user based on the user's emotional data.

[1222] The recommender system for implementing the present invention can recognize the user's emotions and adjust data processing and response content accordingly. Specific embodiments are described below.

[1223] System configuration

[1224] The system mainly consists of two main components: a server and a terminal. The terminal receives user input, the server analyzes the input and takes appropriate action, and the emotion engine recognizes emotions and adjusts data processing accordingly.

[1225] Hardware and software used

[1226] The hardware required is a user device (smartphone or smart glasses) and a server. The software consists of the following main modules:

[1227] 1. Data receiving module: A communication module for receiving data sent by a terminal.

[1228] 2. Data analysis module: The processing logic for analyzing the received data and selecting the necessary actions. This includes the Python requests library.

[1229] 3. Data storage and retrieval module: A data management module for storing and retrieving data in a database. For database management, a database management system such as MySQL or PostgreSQL is used.

[1230] 4. Emotion Engine: An engine for recognizing and analyzing user emotions in real time. In this part, the generative AI model uses NLP techniques to recognize emotions from the user's input text.

[1231] 5. Personalization module: The logic for making personalized menu suggestions based on user sentiment.

[1232] Explanation of program processing

[1233] The server first receives data from the device through the data reception module. The data analysis module then analyzes the received data and uses the emotion engine to recognize the user's emotions. The emotion engine applies NLP technology, and if a user enters, for example, "I'm very busy at work and I'm frustrated," it will recognize this as "stress." Based on this information, the personalization module makes appropriate menu suggestions.

[1234] Next, if data storage or retrieval is required, the data storage and retrieval module interacts with the database on the server and performs the necessary operations. Finally, the server sends the processing results to the terminal and displays them to the user in an appropriate content according to their emotions.

[1235] Specific examples

[1236] For example, if a user inputs "I'm so busy at work and I'm frustrated," the emotion engine will recognize it as "stress," and the server will recommend "Sushi" as a personalized menu item. Also, when a data saving operation is performed, the operation result is sent to the device along with a user-friendly message.

[1237] Prompt Sentence Examples

[1238] Here is an example prompt:

[1239] Analyze the user's sentiment from the input sentence and recommend appropriate menu items based on that sentiment.

[1240] example:

[1241] Enter: "I'm so busy at work and it's frustrating."

[1242] Emotion: "Stress"

[1243] Recommended Menu: "Sushi"

[1244] In this way, the system aims to improve the user experience by responding appropriately and flexibly to the user's emotional state.

[1245] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1246] Step 1:

[1247] The terminal receives input data from the user (e.g., text such as "I'm so busy at work and I'm frustrated"), which is sent in a comma-separated format for further processing.

[1248] Step 2:

[1249] The terminal sends the received user input data to the server. The data includes text information and basic user information. The server receives the data using the requests module.

[1250] Step 3:

[1251] The server passes the received data to the data analysis module, which analyzes the text information and selects the necessary action, such as "save" or "get."

[1252] Step 4:

[1253] The data analysis module passes the analysis results to the emotion engine, which uses a generative AI model to recognize user emotions from the context of the text. This emotion recognition process utilizes natural language processing (NLP) techniques to classify the input data into various emotion labels.

[1254] Step 5:

[1255] Once the emotion engine recognizes the user's emotion, it returns the result to the main processing logic on the server. For example, it may recognize that the user is feeling "stressed." This result is used in the next processing step for personalized services and suggestions.

[1256] Step 6:

[1257] Based on the results of the emotion engine, the server calls the personalization module, which then suggests a menu item that matches the user's emotions. For example, if the user is feeling stressed, "Sushi" will be selected as the suggested menu item.

[1258] Step 7:

[1259] If necessary, the server saves or retrieves the data. In the case of saving data, it calls the data saving module to add the received data to the database file, or rewrites the existing database file.

[1260] Step 8:

[1261] In the case of data acquisition, the server calls the data acquisition module, reads the necessary data from the database, and returns it to the terminal. The returned data includes a response message according to the user's emotion.

[1262] Step 9:

[1263] The server then sends the appropriate response message or data to the device as the final processing result. The device then displays the received content to the user and performs the corresponding action, such as suggesting menu items to the user based on their emotions.

[1264] Step 10:

[1265] The terminal feeds back the data and response messages received from the server to the user, and the user can select the next action based on that.

[1266] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1267] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1268] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1269] [Third embodiment]

[1270] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1271] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1272] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1273] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1274] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1275] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1276] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1277] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1278] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1279] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1280] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1281] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1282] The present invention is a control system for improving the reliability and availability of data. The system in this specification is for efficiently exchanging data between servers, terminals, and users, and for storing and retrieving data.

[1283] System Overview

[1284] In this system, the server plays the main role, providing secure and reliable communication between the server and the terminal. The user sends data to the server through the terminal and retrieves the data as needed. The server analyzes the received data, performs appropriate processing, and returns the results to the terminal.

[1285] Data storage process

[1286] When a user inputs new data through a terminal and tries to save it, the terminal sends the data to the server. The server receives the data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the terminal notifying that the data was successfully saved.

[1287] Data Acquisition Process

[1288] When a user requests data acquisition through a terminal, the terminal sends the request to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The user can check the acquired data through the terminal and use it as needed.

[1289] Specific examples

[1290] Example of saving data

[1291] Suppose a user enters the following data at a terminal:

[1292] ID:1

[1293] Name: "Example Data"

[1294] Timestamp: "2023-10-14T12:00:00"

[1295] To save this, the device sends a request to the server like this:

[1296] Action:store

[1297] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[1298] The server receives this request, reads the database file, adds the new data, and rewrites it. After the process is completed, the server sends a response message to the terminal indicating that the data has been saved successfully, so the user can confirm that the data has been saved successfully.

[1299] Data retrieval operation example

[1300] If a user requests data retrieval through a device, the device sends the following request to the server:

[1301] Action: retrieve

[1302] When the server receives this request, it reads the data from the database file and returns the entire contents to the terminal, where the user can receive and check the acquired data on the terminal.

[1303] Error Handling

[1304] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it will return an error message and prompt the user to re-enter the appropriate information. In this way, the system achieves high reliability and fault tolerance.

[1305] The above is a specific embodiment of the control system of the present invention. By using this system, users can efficiently store and retrieve data, improving the reliability and availability of the system as a whole.

[1306] The processing flow will be explained below.

[1307] Data saving process flow

[1308] Step 1:

[1309] A user inputs new data on the terminal. For example, the data is "ID: 1, Name: 'Example Data', Timestamp: '2023-10-14T12:00:00'".

[1310] Step 2:

[1311] The terminal sends the entered data to the server in JSON format.

[1312] Step 3:

[1313] The server receives the data sent from the terminal and temporarily stores the data in a buffer using the recv function.

[1314] Step 4:

[1315] The server decodes the received data into JSON format and converts it into a dictionary object.

[1316] Step 5:

[1317] The server checks that the decoded data is a "store" action by looking at the "action" key in the data.

[1318] Step 6:

[1319] The server opens the database file (for example, 'data_store.json') in read mode. If the data already exists, it is read.

[1320] Step 7:

[1321] The server adds new data to the data it reads, specifically by appending the new data to the existing data list.

[1322] Step 8:

[1323] The server writes the updated data list to the database file, rewriting it from the beginning of the file.

[1324] Step 9:

[1325] The server creates a response message in JSON format indicating that the data saving process was successful and sends it to the terminal.

[1326] Step 10:

[1327] The terminal receives the response from the server and notifies the user that the data has been successfully saved.

[1328] Data acquisition process flow

[1329] Step 1:

[1330] The user operates the device and sends a data retrieval request to the server. The request format is "action: 'retrieve'".

[1331] Step 2:

[1332] The terminal sends a data acquisition request to the server.

[1333] Step 3:

[1334] The server receives the request sent from the terminal, retrieves the data using the recv function, and temporarily stores it in a buffer.

[1335] Step 4:

[1336] The server decodes the received request into JSON format and converts it into a dictionary object.

[1337] Step 5:

[1338] The server verifies that the decoded request is a "retrieve" action by looking at the "action" key in the data.

[1339] Step 6:

[1340] The server opens the database file in read mode, reading all data from the file.

[1341] Step 7:

[1342] The server creates a response message in JSON format from the data it reads.

[1343] Step 8:

[1344] The server sends the created response message to the terminal.

[1345] Step 9:

[1346] The terminal receives the response from the server and displays the acquired data to the user, who then checks the displayed data.

[1347] Error handling flow

[1348] Step 1:

[1349] If the server encounters an error receiving the data, it generates an error message.

[1350] Step 2:

[1351] The server converts the generated error message into JSON format and sends it to the terminal.

[1352] Step 3:

[1353] The terminal receives the error message from the server and notifies the user that an error has occurred.

[1354] These steps enable the system of the present invention to perform data storage and retrieval processes efficiently and reliably.

[1355] Example 1

[1356] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1357] Conventional data management systems did not ensure sufficient data reliability and availability, and responses to user operations were often delayed. Furthermore, the system's response to errors was insufficient, resulting in problems with system reliability.

[1358] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1359] In this invention, the server includes means for receiving data from a terminal, means for analyzing the received data and selecting processing according to the action, means for saving or retrieving data based on the selected processing, means for transmitting the processing results to the terminal, means for communicating with a database to read and write data, means for detecting and responding to errors, and means for displaying information through a user interface, thereby improving the reliability and availability of data and ensuring quick responses and high reliability.

[1360] A "terminal" is a device that is operated by a user to input and obtain data.

[1361] A "server" is a device or system for analyzing, storing, and retrieving data received from a terminal, and returning the processing results.

[1362] A "database" is a file system or data structure used by a server to store and retrieve data.

[1363] The "receiving means" is a function for acquiring data sent from the terminal to the server.

[1364] The "analysis means" is a function for analyzing the contents of received data and selecting an appropriate action.

[1365] The "means for selecting processing" is a function that determines the processing content to be performed based on the content of the data.

[1366] A "means for storing or retrieving data" is a function for storing new data in a database or retrieving existing data based on a selected operation.

[1367] The "means for transmitting processing results" is a function for returning the results of processing performed by the server to the terminal.

[1368] "Means for communicating with a database and reading and writing data" refers to the function of reading and writing data from and to a database.

[1369] "Means for error detection and response" refers to the function of detecting errors that occur during data analysis and processing, and generating and sending appropriate error messages.

[1370] The "means for displaying information through a user interface" is a function for displaying information such as processing results and error messages returned by the server to the user.

[1371] The present invention is a control system for efficiently exchanging data between servers, terminals, and users, and for storing and retrieving data. The purpose of this system is to improve the reliability and availability of data.

[1372] First, the main components of this system will be described. This system includes a server, a terminal, a database, and user operations.

[1373] The server plays a central role in data management and uses the following hardware and software:

[1374] Hardware: General-purpose computer or cloud service (e.g., Amazon Web Services EC2 instance)

[1375] Software: Python programs, web frameworks such as Flask, and database management systems such as MySQL

[1376] A terminal is a device used by a user to enter or obtain data, and uses the following hardware and software:

[1377] Hardware: PCs, tablets, smartphones, etc.

[1378] Software: Web browser or mobile application

[1379] A database is a file system or data structure that a server uses to store and retrieve data. Specifically, we will use a MySQL database.

[1380] Next, the operation of the system will be specifically described.

[1381] Data storage process

[1382] When a user inputs new data through the device and tries to save it, the device first sends the data in JSON format to the server. The server analyzes the received data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the device indicating that the data was successfully saved. The user can view the message through the device.

[1383] For example, if a user enters the following data:

[1384] ID:1

[1385] Name: "Example Data"

[1386] Timestamp: "2023-10-14T12:00:00"

[1387] The terminal sends a request including the action (store) and the data content to the server. After receiving this request, the server reads the database file, adds new data, and rewrites it. After the process is completed, the server sends a response message to the terminal indicating that the data has been successfully saved, allowing the user to confirm that the data has been saved successfully.

[1388] Data Acquisition Process

[1389] When a user requests data acquisition through a terminal, the terminal sends a data acquisition request to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The user can check the acquired data through the terminal and use it as needed.

[1390] For example, suppose a user requests to retrieve data. In this case, the device sends a request including an action (retrieve) to the server. When the server receives this request, it reads the data from the database file and returns the entire contents to the device in JSON format. The user can then receive and check the retrieved data on the device.

[1391] Error handling process

[1392] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it will return an error message and prompt the user to re-enter the appropriate information. In this way, the system achieves high reliability and fault tolerance.

[1393] Example prompts for generative AI models

[1394] Here are some example prompts to input to the generative AI model:

[1395] "Please give me a concrete example of how to save data. For example, if you want to save data in the form of ID, name, and timestamp, please explain the process in detail."

[1396] "Please give me a specific example of a request to perform a data retrieval operation. Please explain the format in which the request should be sent from the terminal to the server."

[1397] The above is a specific embodiment of the control system of the present invention. By using this system, users can efficiently store and retrieve data, improving the reliability and availability of the system as a whole.

[1398] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1399] Data storage process

[1400] Step 1:

[1401] The user inputs data on the device. Specifically, the user inputs data such as ID, name, timestamp, etc. into the input form on the device. The input data is in the following format:

[1402] ID:1

[1403] Name: "Example Data"

[1404] Timestamp: "2023-10-14T12:00:00"

[1405] input:

[1406] User-entered data

[1407] output:

[1408] Data displayed on the device's input form

[1409] Step 2:

[1410] The device sends data to the server. The device uses an HTTP POST request to send data to the server in JSON format. The data sent must be in the following format:

[1411] json

[1412] {

[1413] "action": "store",

[1414] "data": {

[1415] "id": 1,

[1416] "name": "Example Data",

[1417] "timestamp": "2023-10-14T12:00:00"

[1418] }

[1419] }

[1420] input:

[1421] Data entered by the user into the terminal

[1422] output:

[1423] JSON format data sent to the server

[1424] Step 3:

[1425] The server receives the data. The server uses a web framework such as Flask to receive the HTTP POST request and extracts the data sent. Specifically, the server extracts the JSON data from the body of the request.

[1426] input:

[1427] JSON format data sent from the device

[1428] output:

[1429] Data content extracted by the server

[1430] Step 4:

[1431] The server analyzes the data. The server determines that the received data should be stored. Specifically, it checks the validity of the data format and content (e.g., ID, name, timestamp).

[1432] input:

[1433] Data content extracted by the server

[1434] output:

[1435] That the data is valid

[1436] Step 5:

[1437] The server saves the data to the database. The server connects to the MySQL database and adds the new data. Specifically, it executes the following SQL statement:

[1438] sql

[1439] INSERT INTO datatable (id, name, timestamp) VALUES (1, 'Example Data', '2023-10-14T12:00:00');

[1440] input:

[1441] Validated data

[1442] output:

[1443] Data stored in a database

[1444] Step 6:

[1445] The server sends a response message to the device. If the save to the database is successful, the server returns a message in JSON format indicating that the save was successful to the device. Specifically, it sends the following message:

[1446] json

[1447] {

[1448] "status": "success",

[1449] "message": "Data stored successfully"

[1450] }

[1451] input:

[1452] Results of saving to database

[1453] output:

[1454] Response message sent to the terminal

[1455] Step 7:

[1456] The user confirms the save result. The device receives the response message from the server and displays a success message to the user. Specifically, the device displays the following message on the screen:

[1457] "Data stored successfully"

[1458] input:

[1459] Response message from the server

[1460] output:

[1461] A success message for the user to see

[1462] Data Acquisition Process

[1463] Step 1:

[1464] The user requests data acquisition on the terminal. Specifically, the user clicks a button on the terminal to instruct data acquisition.

[1465] input:

[1466] User's data request

[1467] output:

[1468] Device data acquisition request event

[1469] Step 2:

[1470] The device sends a request to the server. The device uses an HTTP GET request to send a data retrieval request to the server in JSON format. The data sent is in the following format:

[1471] json

[1472] {

[1473] "action": "retrieve"

[1474] }

[1475] input:

[1476] User's data request

[1477] output:

[1478] The request sent to the server

[1479] Step 3:

[1480] The server receives the request. The server receives the HTTP GET request and analyzes the request. Specifically, the server extracts the JSON data from the request body.

[1481] input:

[1482] Requests sent from the device

[1483] output:

[1484] The request content parsed by the server

[1485] Step 4:

[1486] The server retrieves data from the database. The server connects to the MySQL database and retrieves all records. Specifically, it executes the following SQL statement:

[1487] sql

[1488] SELECT FROM datatable;

[1489] input:

[1490] The requested data retrieval request

[1491] output:

[1492] All data retrieved from the database

[1493] Step 5:

[1494] The server returns the data to the device. The acquired data is converted to JSON format and returned to the device. Specifically, the following data is returned:

[1495] json

[1496] {

[1497] "status": "success",

[1498] "data": [

[1499] {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"},

[1500] {"id": 2, "name": "Another Data", "timestamp": "2023-10-15T12:00:00"}

[1501] ]

[1502] }

[1503] input:

[1504] All data retrieved from the database

[1505] output:

[1506] Data sent back to the device

[1507] Step 6:

[1508] The user checks the acquired data. The terminal receives the response data from the server and displays it to the user. Specifically, the user can check each piece of acquired data on the terminal screen.

[1509] input:

[1510] Data retrieved from the server

[1511] output:

[1512] Retrieved data displayed to the user

[1513] Error handling process

[1514] Step 1:

[1515] A user may enter data, but may enter incorrect data, for example, leaving the name field empty.

[1516] input:

[1517] Incorrect data

[1518] output:

[1519] Incorrect data displayed on the device

[1520] Step 2:

[1521] The device sends the data to the server. The device uses an HTTP POST request to send the erroneous data to the server in JSON format.

[1522] input:

[1523] Incorrect data entered by the user

[1524] output:

[1525] Incorrect data sent to the server

[1526] Step 3:

[1527] The server receives the data. The server receives the request and extracts the content of the data sent.

[1528] input:

[1529] Incorrect data sent from the device

[1530] output:

[1531] Data content extracted by the server

[1532] Step 4:

[1533] The server analyzes the data and detects errors. The server analyzes the format and content of the data to detect invalid data. Specifically, it checks that the name field is empty.

[1534] input:

[1535] Data content extracted by the server

[1536] output:

[1537] Presence or absence of errors

[1538] Step 5:

[1539] The server sends an error message to the terminal. If an error is detected, the server returns an error message in JSON format to the terminal. Specifically, it sends the following message:

[1540] json

[1541] {

[1542] "status": "error",

[1543] "message": "Name field is empty. Please re-enter."

[1544] }

[1545] input:

[1546] Error Information

[1547] output:

[1548] Error messages sent to the terminal

[1549] Step 6:

[1550] The user confirms the error and re-enters the data. The terminal receives the error message and displays it to the user. The user confirms the error message and re-enters the correct data.

[1551] input:

[1552] Error messages from the server

[1553] output:

[1554] Correct data to be re-entered

[1555] This concludes the explanation of the specific operations and inputs / outputs of each processing step in this system, which improves the reliability and availability of data and achieves fast response and high reliability.

[1556] (Application example 1)

[1557] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1558] Inventory management and shipping status tracking at logistics centers require the exchange of reliable data in real time to maximize efficiency. However, existing systems have issues with data reliability, availability, and operational efficiency, making management tasks cumbersome. In particular, updating inventory information and checking shipping status takes time, making errors and work delays more likely to occur. This reduces the operational efficiency of the entire logistics center, posing a challenge.

[1559] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1560] In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and selecting processing according to the action, means for saving or retrieving data based on the selected processing, means for transmitting the processing results to the terminal, means for tracking inventory management and shipping status at the logistics center, means for receiving and saving inventory information (identifier, name, quantity, date and time), and means for confirming inventory and retrieving shipping status and returning it to the terminal. This enables real-time monitoring of inventory management and shipping status at the logistics center, increases data reliability and availability, improves work efficiency, and reduces errors.

[1561] A "terminal" is a device for inputting and displaying data, and for transmitting data between a user and a system.

[1562] A "server" is a central device that receives data sent from a terminal, analyzes, saves, retrieves, and returns the processing results.

[1563] The "data receiving means" is a mechanism by which the server receives data sent from the terminal.

[1564] The "data analysis means" is a mechanism for analyzing received data and selecting an appropriate process based on the data's contents.

[1565] A "data storage means" is a mechanism for adding and storing data in an existing database file based on selected processing.

[1566] The "data acquisition means" is a mechanism for reading the necessary data from the database file and returning it to the terminal.

[1567] The "processing result transmission means" is a mechanism for transmitting the processing results performed by the server to the terminal.

[1568] A "distribution center" is a facility that stores and manages inventory and ships products.

[1569] "Inventory control" is the activity of recording and managing inventory of goods at a logistics center.

[1570] "Shipping status tracking" is the activity of tracking and managing the current status and location information of shipped goods.

[1571] "Inventory information" is data related to product identifiers, names, quantities, and the dates and times of stocking and shipping.

[1572] MODE FOR CARRYING OUT THE INVENTION

[1573] System Overview

[1574] As an embodiment of the present invention, the system of the present invention efficiently and reliably manages inventory at a logistics center and tracks shipping status. The system is configured as follows.

[1575] Hardware and Software

[1576] The main hardware components of this system are:

[1577] Terminal: A device used to enter and check inventory information and shipping status. For example, a smartphone.

[1578] Server: The main component that receives, analyzes, stores, retrieves data, and returns the processed results.

[1579] Database: A storage system for storing data. An example is SQLite.

[1580] The following software is used:

[1581] Flask: A Python framework that implements server-side processing.

[1582] SQLite: A lightweight database management system for managing inventory and shipping data.

[1583] Data processing and calculation

[1584] Receiving and storing data

[1585] 1. The user uses a terminal to enter new inventory information, including the identifier, name, quantity, and date and time.

[1586] 2. The device sends the entered data to the server, which analyzes the received data and selects the process for saving it.

[1587] 3. The server reads the existing data from the database and rewrites it with the new data.

[1588] Getting and returning data

[1589] 1. The user uses the terminal to request stock availability or shipping status.

[1590] 2. The device sends this request to the server, which retrieves the necessary information from the database based on the received request.

[1591] 3. The read data is sent back from the server to the device, where the user can view it.

[1592] Specific examples

[1593] Example of saving inventory information

[1594] For example, when a new item arrives at a distribution center, an associate enters the following information into their smartphone:

[1595] Identifier: 123

[1596] Name: "Product A"

[1597] Quantity:50

[1598] Date and time: "2023-10-22T09:00:00"

[1599] Once staff enter this information, the smartphone sends the data to a server, which stores it in a database.

[1600] Example of checking shipping status

[1601] When a user wants to check the status of a shipped item, the user sends a request to check the shipping status using the smartphone app. The server receives this request, retrieves the shipping status from the database, and sends it back to the smartphone. The user can then check the current status of the shipped item based on the returned data.

[1602] Prompt Sentence Examples

[1603] The following prompts can be used for the generative AI model:

[1604] "Write Python code to store data received by the server in a database and retrieve it as needed for an inventory management system used in a distribution center. Specifically, you will use Flask and SQLite."

[1605] In this way, the system of the present invention can efficiently and reliably realize inventory management and shipping status tracking in a logistics center.

[1606] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1607] Step 1:

[1608] The user uses a terminal to input new inventory information. The user inputs an identifier, name, quantity, and date and time. This input data is sent from the terminal to the server. The input data is expressed in JSON format.

[1609] Step 2:

[1610] The terminal sends the input data in JSON format to the server. The sent data includes the identifier, name, quantity, and date and time. The server receives this data.

[1611] Step 3:

[1612] The server analyzes the received data and determines whether it is information that should be saved. Specifically, it checks whether the data format and required fields (identifier, name, quantity, date and time) are complete. If the data is in the appropriate format, it prepares the data for saving.

[1613] Step 4:

[1614] The server reads existing data from the database by opening a database connection using SQLite and executing an SQL query to retrieve existing inventory data, where the input is the user data received by the server and the output is the result of the SQL query.

[1615] Step 5:

[1616] The server appends the new data to the existing data and rewrites it to the database. Using SQLite, it executes an SQL query to insert the new data. Once the data update is complete, it generates a message that the data was saved successfully.

[1617] Step 6:

[1618] The server sends a data saving success message to the terminal, and the terminal receives this message and notifies the user that the data has been saved successfully, completing the inventory information saving process.

[1619] Step 7:

[1620] The user uses the device to request stock availability or shipping status. The device sends a request to the server. This request is also in JSON format, and the action is "retrieve."

[1621] Step 8:

[1622] The server receives the request sent from the device and prepares to retrieve the necessary information from the database. Specifically, it uses SQLite to create SQL queries to retrieve inventory and shipping status.

[1623] Step 9:

[1624] The server executes SQL queries to retrieve inventory and shipping status data from the database. The input is the request data received by the server, and the output is the result of the SQL query. The retrieved data is then converted to JSON format and ready to be sent back.

[1625] Step 10:

[1626] The server returns the acquired data in JSON format to the device. The device receives this data and the user can check the stock status and shipping status on the device. This completes the data acquisition process.

[1627] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1628] The present invention combines a control system for improving data reliability and availability with an emotion engine that recognizes user emotions. The system in this specification not only efficiently exchanges data between servers, terminals, and users, and stores and retrieves data, but also responds by reflecting the user's emotions.

[1629] System Overview

[1630] The system is primarily based on a server, which provides secure and reliable communication between the server and the device. Users send data to the server via their device and retrieve data as needed. Furthermore, the system incorporates an emotion engine that recognizes the user's emotions, adjusting response content and data processing priority.

[1631] Emotion recognition processing

[1632] The emotion engine analyzes user input and behavior to recognize emotions. For example, it can determine whether a user is stressed based on the context of text input. This information is used by the server for data processing.

[1633] Data storage process

[1634] When a user inputs new data through the terminal and tries to save it, the terminal sends the data along with the user's emotional information to the server. The server receives the data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the terminal notifying that the data was successfully saved.

[1635] Data Acquisition Process

[1636] When a user requests data through a terminal, the terminal sends the request along with the user's emotional information to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The returned data and response message are adjusted according to the user's emotional state. For example, if the user is feeling stressed, a more friendly response will be returned.

[1637] Specific examples

[1638] Example of saving data

[1639] Suppose a user enters the following data at a terminal:

[1640] ID:1

[1641] Name: "Example Data"

[1642] Timestamp: "2023-10-14T12:00:00"

[1643] Emotions: Stress

[1644] To save this, the device sends a request to the server like this:

[1645] Action:store

[1646] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[1647] Emotional information: Stress

[1648] The server receives this request, reads the database file, adds the new data, and rewrites it. After the process is complete, the server sends a response message to the terminal indicating that the data has been successfully saved, and notifies the user with a friendly tone.

[1649] Data retrieval operation example

[1650] If a user requests data retrieval through a device, the device sends the following request to the server:

[1651] Action: retrieve

[1652] Emotional information: Relaxation

[1653] When the server receives this request, it reads the data from the database file and returns the entire contents to the terminal. The server recognizes that the user is relaxed and sends a standard response message. The user can receive and check the retrieved data on the terminal.

[1654] Error Handling

[1655] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it returns an error message and prompts the user to re-enter the appropriate information. In this case, it utilizes an emotion engine to provide an error message in a way that reflects the user's emotions. For example, if the user is irritated, it will request the user to re-enter the information in a very polite tone.

[1656] These features enable the system of the present invention to improve the user experience and increase the reliability and efficiency of data management. By combining it with an emotion engine, flexible responses that are in tune with the user's emotions become possible.

[1657] The processing flow will be explained below.

[1658] Data storage process flow incorporating emotion recognition

[1659] Step 1:

[1660] A user inputs new data on the terminal. For example, the data is "ID: 1, Name: 'Example Data', Timestamp: '2023-10-14T12:00:00'".

[1661] Step 2:

[1662] The user is analyzed by the device's emotion engine, and the emotion is recognized as "stress."

[1663] Step 3:

[1664] The device sends the input data and emotion information to the server in JSON format.

[1665] Step 4:

[1666] The server receives the data sent from the terminal and temporarily stores the data in a buffer using the recv function.

[1667] Step 5:

[1668] The server decodes the received data into JSON format and converts it into a dictionary object.

[1669] Step 6:

[1670] The server checks that the decoded data is a "store" action by looking at the "action" key in the data.

[1671] Step 7:

[1672] The server checks the emotion information provided by the emotion engine and adjusts the data processing priority based on this emotion: if the user is feeling stressed, the processing priority is set high.

[1673] Step 8:

[1674] The server opens the database file (for example, 'data_store.json') in read mode. If the data already exists, it is read.

[1675] Step 9:

[1676] The server adds new data to the data it reads, specifically by appending the new data to the existing data list.

[1677] Step 10:

[1678] The server writes the updated data list to the database file, rewriting it from the beginning of the file.

[1679] Step 11:

[1680] The server creates a response message in JSON format indicating that the data saving process was successful, and sends it to the device along with a response based on the user's emotion. For example, if the user is "stressed," a message is sent in a more friendly tone.

[1681] Step 12:

[1682] The terminal receives the response from the server and notifies the user that the data has been successfully saved.

[1683] Data acquisition process flow incorporating emotion recognition

[1684] Step 1:

[1685] The user operates the device and sends a data retrieval request to the server. The request format is "action: 'retrieve'".

[1686] Step 2:

[1687] The user is analyzed by the device's emotion engine, and the emotion is recognized as "relaxed."

[1688] Step 3:

[1689] The device sends a data acquisition request and emotion information to the server.

[1690] Step 4:

[1691] The server receives the request sent from the terminal, retrieves the data using the recv function, and temporarily stores it in a buffer.

[1692] Step 5:

[1693] The server decodes the received request into JSON format and converts it into a dictionary object.

[1694] Step 6:

[1695] The server verifies that the decoded request is a "retrieve" action by looking at the "action" key in the data.

[1696] Step 7:

[1697] The server checks the emotion information provided by the emotion engine and adjusts the content of the response message based on this emotion: if the user is relaxed, it generates a standard response message;

[1698] Step 8:

[1699] The server opens the database file in read mode, reading all data from the file.

[1700] Step 9:

[1701] The server creates a response message in JSON format from the data it reads.

[1702] Step 10:

[1703] The server sends the created response message to the terminal.

[1704] Step 11:

[1705] The terminal receives the response from the server and displays the acquired data to the user, who then checks the displayed data.

[1706] Error handling flow

[1707] Step 1:

[1708] If an error occurs when the server receives data, an emotion engine is utilized to generate an error message based on the user's emotion.

[1709] Step 2:

[1710] The server generates an error message, converts it to JSON format, and sends it to the terminal, and if the user is annoyed, politely asks them to re-enter the information.

[1711] Step 3:

[1712] The terminal receives the error message from the server and notifies the user that an error has occurred.

[1713] These steps enable the system of the present invention to efficiently and reliably store and retrieve data, and by utilizing the emotion engine, it is possible to respond flexibly to the user's emotions.

[1714] Example 2

[1715] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1716] Conventional data management systems do not process data with consideration for user emotions, resulting in poor user experience. In particular, systems often lack appropriate responses for users who feel stressed or irritated when entering or retrieving data, which can impair system usability. In addition, data storage and retrieval processes must be efficient and reliable.

[1717] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1718] In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and extracting user emotion information, means for selecting a process corresponding to an action based on the emotion information, means for saving or retrieving data based on the selected process, and means for transmitting the processing result to the terminal together with a response message based on the emotion information. This enables data processing and response messages that take the user's emotion into consideration, improving system usability and the user experience. Furthermore, data saving and retrieval processes are performed efficiently and reliably.

[1719] A "terminal" is a computer or device through which a user inputs data and communicates with a server.

[1720] A "server" is a computer system that receives, analyzes, stores, retrieves data, extracts emotion information, and generates response messages.

[1721] The "means for receiving data" is a function for taking data sent from a terminal into the server.

[1722] "Means for analyzing data" refers to the function of understanding the content of received data, breaking it down into individual elements, and processing them.

[1723] The "means for extracting emotional information" is a function for identifying the emotional state of the user from the analyzed data.

[1724] The "means for selecting processing according to an action" is a function for determining an appropriate data processing method based on the user's emotional information and the data content.

[1725] "Means for saving data" is a function that adds new data to the database and rewrites existing data files.

[1726] "Means for obtaining data" is a function that reads the necessary data from the database and returns it to the terminal.

[1727] The "means for generating a response message" is a function for forming an appropriate message based on the results of data processing and the user's emotional information.

[1728] The "means for transmitting to the terminal" is a function for transmitting the generated response message and the data processing results from the server to the terminal.

[1729] The "measures to be taken when an abnormality occurs" is a function that detects that the received data is incomplete, formulates an error message corresponding to the user's feelings, and sends it to the terminal.

[1730] An "emotion engine" is a software component that analyzes user input data and behavior to recognize emotions.

[1731] MODE FOR CARRYING OUT THE INVENTION

[1732] This invention is a data management system that takes user emotions into consideration and aims to improve the reliability and availability of data. This system not only efficiently exchanges data between servers, terminals, and users, and stores and retrieves data, but also responds in a way that reflects the user's emotions.

[1733] System Configuration

[1734] The system consists of three main components:

[1735] 1. Server

[1736] 2. Terminal

[1737] 3. Users

[1738] 1. Server:

[1739] The server receives, analyzes, stores, and retrieves data, extracts emotion information, and generates response messages. The server includes an emotion engine and a database.

[1740] The emotion engine is a software component that analyzes user input data and behavior to recognize emotions, and can use, for example, text analysis algorithms.

[1741] 2. Terminal:

[1742] A terminal is a computer or device through which a user inputs data and communicates with a server. The user sends data through the terminal and retrieves the data as needed.

[1743] Examples of terminals include PCs, tablets, and smartphones.

[1744] 3. User:

[1745] Users input, save, and retrieve data through their terminals, and the user's emotional information is reflected in the overall processing of the system.

[1746] Examples of data storage

[1747] The user enters the following data at the terminal:

[1748] ID:1

[1749] Name: "Example Data"

[1750] Timestamp: "2023-10-14T12:00:00"

[1751] Emotions: Stress

[1752] To save this, the device sends the following request to the server:

[1753] Action:store

[1754] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[1755] Emotional information: Stress

[1756] The server receives this request and does the following:

[1757] 1. Analyze the incoming data and use the emotion engine to identify the user's emotion as "stress."

[1758] 2. Access the database and read the existing data file.

[1759] 3. Append the new data to the existing data and rewrite the database file.

[1760] 4. Generate a message of successful saving and send a friendly tone message to the terminal, such as "The data has been saved successfully. Thank you," depending on the user's emotion.

[1761] 5. The terminal displays this message to the user, who confirms that the save process was successful.

[1762] Specific examples of data acquisition

[1763] When a user requests data retrieval through a device, the following request is sent:

[1764] Action: retrieve

[1765] Emotional information: Relaxation

[1766] The server receives this request and does the following:

[1767] 1. Read all the data from the database file.

[1768] 2. The read data is returned to the terminal as a response.

[1769] 3. Consider that the user is relaxed and send a standard response message.

[1770] 4. The terminal displays the data to the user, who then checks the data.

[1771] Example of error handling

[1772] The system also has the ability to react when an anomaly occurs. For example, if it detects that the received data is incomplete, it will:

[1773] 1. The server generates an error message and announces it in a tone that corresponds to the user's emotion. For example, for an annoyed user, it generates a message saying, "We apologize for the inconvenience, but please enter your data again. Confirmation is required."

[1774] 2. The terminal displays this error message to the user and prompts them to re-enter the appropriate information.

[1775] Prompt Sentence Examples

[1776] Here are some example prompts to input to a generative AI model:

[1777] > "The user wants to save new data. The data is as follows:

[1778] > - ID:1

[1779] - Name: "Example Data"

[1780] - Timestamp: "2023-10-14T12:00:00"

[1781] - Emotions: Stress

[1782] > Consider this data and sentiment information to generate an appropriate response message.

[1783] > "The user is requesting data retrieval. The user's emotional information is relaxed. Please generate an appropriate response message taking this emotional information into account."

[1784] As a result, it becomes possible to respond in a way that takes into account the user's emotions, improving the ease of use and reliability of the system.

[1785] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1786] Step 1:

[1787] The user inputs data through the terminal and sends it to the server.

[1788] What happens: A user accesses a data entry form and enters new data (e.g., ID, name, timestamp). Emotional information is also entered.

[1789] Input: User-entered data and emotion information (e.g., {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00", "emotion": "Stress"}).

[1790] Output: The device generates a request to send this to the server (e.g., {"action": "store", "data": {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}, "emotion": "stress"}).

[1791] Step 2:

[1792] The server receives the data and analyzes the user's emotional information using an emotion engine.

[1793] Specific operation: The server receives a request sent from the terminal, first analyzes the request content, and then identifies emotion information using the emotion engine.

[1794] Input: Request data received from the device (e.g., {"action": "store", "data": {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}, "emotion": "stress"}).

[1795] Output: As a result of the analysis, emotional information (e.g., "stress") is extracted.

[1796] Step 3:

[1797] The server accesses the database and saves the new data.

[1798] Specific operation: The server accesses the database, reads the current data file, appends the new data to the existing data, and rewrites the updated data to the database file.

[1799] Input: Parsed data and emotion information (e.g., {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00", "emotion": "stress"}).

[1800] Output: The updated database file.

[1801] Step 4:

[1802] The server generates a message indicating that the save was successful and sends it to the terminal.

[1803] Specific operation: The server generates a message to inform the user that the save process was successful. This message is generated in a tone that takes into account the user's stress.

[1804] Input: Successful data storage process and emotional information (e.g., "stress").

[1805] Output: A response message for successful save based on emotion information (e.g., "Your data has been saved successfully. Thank you.").

[1806] Step 5:

[1807] The device will display a successful save message to the user.

[1808] Specific operation: The device displays the message received from the server to the user, allowing the user to confirm that the data has been successfully saved.

[1809] Input: Response message from the server (e.g. "Data saved successfully. Thank you.").

[1810] Output: A successful save message displayed on the terminal.

[1811] Step 6:

[1812] The user requests data acquisition through the terminal.

[1813] Specific operation: The user accesses the data acquisition screen on the device and requests data acquisition. At this time, emotion information is also sent.

[1814] Input: User request (e.g. {"action": "retrieve", "emotion": "relax"}).

[1815] Output: A request sent from the device to the server (e.g., {"action": "retrieve", "emotion": "relax"}).

[1816] Step 7:

[1817] The server processes the data retrieval request and reads the data from the database.

[1818] What happens: The server receives the request and reads all the data from the database file.

[1819] Input: A request from the device (e.g., {"action": "retrieve", "emotion": "relax"}).

[1820] Output: The data read (e.g. the entire contents of the database).

[1821] Step 8:

[1822] The server generates a response message based on the acquired data and emotion information and sends it to the terminal.

[1823] Specific operation: The server takes into account the user's emotional information when generating a response message. For a relaxed user, it generates a standard response message and sends it to the device along with the acquired data.

[1824] Input: Acquired data and emotional information (e.g., "Relaxed").

[1825] Output: A response message based on the acquired data and emotional information (e.g., "Here is the data you requested.").

[1826] Step 9:

[1827] The terminal displays the acquired data and a response message to the user.

[1828] Specific operation: The terminal displays the response message from the server and the acquired data to the user, so that the user can check the acquired data.

[1829] Input: Response message from the server and retrieved data (e.g., "This is the data you requested," database contents).

[1830] Output: Data and response messages displayed on the terminal.

[1831] The above is the specific processing flow of the program of this system.

[1832] (Application example 2)

[1833] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1834] Conventional food delivery systems have the problem of not improving the user experience because they process data and respond without considering the user's emotions. In particular, they are unable to respond appropriately to stressed or irritated users, which leads to a decrease in satisfaction.

[1835] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and selecting processing according to the action, means for saving or acquiring data based on the selected processing, means for transmitting the processing results to the terminal, means for adjusting response content and data processing priority based on the user's emotions using an emotion engine that recognizes the user's emotions, and means for suggesting personalized menus based on the user's emotions. This enables appropriate and flexible responses according to the user's emotional state, improving the user experience.

[1836] A "terminal" is an interface device used by a user, and is a device that transmits and receives data via communication with a server.

[1837] "Saving data" is the process of adding new data received to an existing database file and rewriting the database file.

[1838] "Data acquisition" is the process of reading all data from the database file and returning the requested data to the terminal.

[1839] The "processing result" is the result after the server has saved or retrieved the data, and includes information or messages to be sent to the terminal.

[1840] A "server" is a computer system that analyzes data received from a terminal, selects the appropriate processing, and returns the results.

[1841] An "emotion engine" is a technological element that analyzes user input and behavior to recognize emotions, and adjusts response content and data processing priority based on that information.

[1842] "Personalized menu suggestions" refers to a process of suggesting menu items and services that are optimal for a user based on the user's emotional data.

[1843] The recommender system for implementing the present invention can recognize the user's emotions and adjust data processing and response content accordingly. Specific embodiments are described below.

[1844] System configuration

[1845] The system mainly consists of two main components: a server and a terminal. The terminal receives user input, the server analyzes the input and takes appropriate action, and the emotion engine recognizes emotions and adjusts data processing accordingly.

[1846] Hardware and software used

[1847] The hardware required is a user device (smartphone or smart glasses) and a server. The software consists of the following main modules:

[1848] 1. Data receiving module: A communication module for receiving data sent by a terminal.

[1849] 2. Data analysis module: The processing logic for analyzing the received data and selecting the necessary actions. This includes the Python requests library.

[1850] 3. Data storage and retrieval module: A data management module for storing and retrieving data in a database. For database management, a database management system such as MySQL or PostgreSQL is used.

[1851] 4. Emotion Engine: An engine for recognizing and analyzing user emotions in real time. In this part, the generative AI model uses NLP techniques to recognize emotions from the user's input text.

[1852] 5. Personalization module: The logic for making personalized menu suggestions based on user sentiment.

[1853] Explanation of program processing

[1854] The server first receives data from the device through the data reception module. The data analysis module then analyzes the received data and uses the emotion engine to recognize the user's emotions. The emotion engine applies NLP technology, and if a user enters, for example, "I'm very busy at work and I'm frustrated," it will recognize this as "stress." Based on this information, the personalization module makes appropriate menu suggestions.

[1855] Next, if data storage or retrieval is required, the data storage and retrieval module interacts with the database on the server and performs the necessary operations. Finally, the server sends the processing results to the terminal and displays them to the user in an appropriate content according to their emotions.

[1856] Specific examples

[1857] For example, if a user inputs "I'm so busy at work and I'm frustrated," the emotion engine will recognize it as "stress," and the server will recommend "Sushi" as a personalized menu item. Also, when a data saving operation is performed, the operation result is sent to the device along with a user-friendly message.

[1858] Prompt Sentence Examples

[1859] Here is an example prompt:

[1860] Analyze the user's sentiment from the input sentence and recommend appropriate menu items based on that sentiment.

[1861] example:

[1862] Enter: "I'm so busy at work and it's frustrating."

[1863] Emotion: "Stress"

[1864] Recommended Menu: "Sushi"

[1865] In this way, the system aims to improve the user experience by responding appropriately and flexibly to the user's emotional state.

[1866] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1867] Step 1:

[1868] The terminal receives input data from the user (e.g., text such as "I'm so busy at work and I'm frustrated"), which is sent in a comma-separated format for further processing.

[1869] Step 2:

[1870] The terminal sends the received user input data to the server. The data includes text information and basic user information. The server receives the data using the requests module.

[1871] Step 3:

[1872] The server passes the received data to the data analysis module, which analyzes the text information and selects the necessary action, such as "save" or "get."

[1873] Step 4:

[1874] The data analysis module passes the analysis results to the emotion engine, which uses a generative AI model to recognize user emotions from the context of the text. This emotion recognition process utilizes natural language processing (NLP) techniques to classify the input data into various emotion labels.

[1875] Step 5:

[1876] Once the emotion engine recognizes the user's emotion, it returns the result to the main processing logic on the server. For example, it may recognize that the user is feeling "stressed." This result is used in the next processing step for personalized services and suggestions.

[1877] Step 6:

[1878] Based on the results of the emotion engine, the server calls the personalization module, which then suggests a menu item that matches the user's emotions. For example, if the user is feeling stressed, "Sushi" will be selected as the suggested menu item.

[1879] Step 7:

[1880] If necessary, the server saves or retrieves the data. In the case of saving data, it calls the data saving module to add the received data to the database file, or rewrites the existing database file.

[1881] Step 8:

[1882] In the case of data acquisition, the server calls the data acquisition module, reads the necessary data from the database, and returns it to the terminal. The returned data includes a response message according to the user's emotion.

[1883] Step 9:

[1884] The server then sends the appropriate response message or data to the device as the final processing result. The device then displays the received content to the user and performs the corresponding action, such as suggesting menu items to the user based on their emotions.

[1885] Step 10:

[1886] The terminal feeds back the data and response messages received from the server to the user, and the user can select the next action based on that.

[1887] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1888] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1889] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1890] [Fourth embodiment]

[1891] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1892] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1893] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1894] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1895] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1896] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1897] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1898] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1899] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1900] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1901] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1902] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1903] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1904] The present invention is a control system for improving the reliability and availability of data. The system in this specification is for efficiently exchanging data between servers, terminals, and users, and for storing and retrieving data.

[1905] System Overview

[1906] In this system, the server plays the main role, providing secure and reliable communication between the server and the terminal. The user sends data to the server through the terminal and retrieves the data as needed. The server analyzes the received data, performs appropriate processing, and returns the results to the terminal.

[1907] Data storage process

[1908] When a user inputs new data through a terminal and tries to save it, the terminal sends the data to the server. The server receives the data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the terminal notifying that the data was successfully saved.

[1909] Data Acquisition Process

[1910] When a user requests data acquisition through a terminal, the terminal sends the request to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The user can check the acquired data through the terminal and use it as needed.

[1911] Specific examples

[1912] Example of saving data

[1913] Suppose a user enters the following data at a terminal:

[1914] ID:1

[1915] Name: "Example Data"

[1916] Timestamp: "2023-10-14T12:00:00"

[1917] To save this, the device sends a request to the server like this:

[1918] Action:store

[1919] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[1920] The server receives this request, reads the database file, adds the new data, and rewrites it. After the process is completed, the server sends a response message to the terminal indicating that the data has been saved successfully, so the user can confirm that the data has been saved successfully.

[1921] Data retrieval operation example

[1922] If a user requests data retrieval through a device, the device sends the following request to the server:

[1923] Action: retrieve

[1924] When the server receives this request, it reads the data from the database file and returns the entire contents to the terminal, where the user can receive and check the acquired data on the terminal.

[1925] Error Handling

[1926] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it will return an error message and prompt the user to re-enter the appropriate information. In this way, the system achieves high reliability and fault tolerance.

[1927] The above is a specific embodiment of the control system of the present invention. By using this system, users can efficiently store and retrieve data, improving the reliability and availability of the system as a whole.

[1928] The processing flow will be explained below.

[1929] Data saving process flow

[1930] Step 1:

[1931] A user inputs new data on the terminal. For example, the data is "ID: 1, Name: 'Example Data', Timestamp: '2023-10-14T12:00:00'".

[1932] Step 2:

[1933] The terminal sends the entered data to the server in JSON format.

[1934] Step 3:

[1935] The server receives the data sent from the terminal and temporarily stores the data in a buffer using the recv function.

[1936] Step 4:

[1937] The server decodes the received data into JSON format and converts it into a dictionary object.

[1938] Step 5:

[1939] The server checks that the decoded data is a "store" action by looking at the "action" key in the data.

[1940] Step 6:

[1941] The server opens the database file (for example, 'data_store.json') in read mode. If the data already exists, it is read.

[1942] Step 7:

[1943] The server adds new data to the data it reads, specifically by appending the new data to the existing data list.

[1944] Step 8:

[1945] The server writes the updated data list to the database file, rewriting it from the beginning of the file.

[1946] Step 9:

[1947] The server creates a response message in JSON format indicating that the data saving process was successful and sends it to the terminal.

[1948] Step 10:

[1949] The terminal receives the response from the server and notifies the user that the data has been successfully saved.

[1950] Data acquisition process flow

[1951] Step 1:

[1952] The user operates the device and sends a data retrieval request to the server. The request format is "action: 'retrieve'".

[1953] Step 2:

[1954] The terminal sends a data acquisition request to the server.

[1955] Step 3:

[1956] The server receives the request sent from the terminal, retrieves the data using the recv function, and temporarily stores it in a buffer.

[1957] Step 4:

[1958] The server decodes the received request into JSON format and converts it into a dictionary object.

[1959] Step 5:

[1960] The server verifies that the decoded request is a "retrieve" action by looking at the "action" key in the data.

[1961] Step 6:

[1962] The server opens the database file in read mode, reading all data from the file.

[1963] Step 7:

[1964] The server creates a response message in JSON format from the data it reads.

[1965] Step 8:

[1966] The server sends the created response message to the terminal.

[1967] Step 9:

[1968] The terminal receives the response from the server and displays the acquired data to the user, who then checks the displayed data.

[1969] Error handling flow

[1970] Step 1:

[1971] If the server encounters an error receiving the data, it generates an error message.

[1972] Step 2:

[1973] The server converts the generated error message into JSON format and sends it to the terminal.

[1974] Step 3:

[1975] The terminal receives the error message from the server and notifies the user that an error has occurred.

[1976] These steps enable the system of the present invention to perform data storage and retrieval processes efficiently and reliably.

[1977] Example 1

[1978] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1979] Conventional data management systems did not ensure sufficient data reliability and availability, and responses to user operations were often delayed. Furthermore, the system's response to errors was insufficient, resulting in problems with system reliability.

[1980] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1981] In this invention, the server includes means for receiving data from a terminal, means for analyzing the received data and selecting processing according to the action, means for saving or retrieving data based on the selected processing, means for transmitting the processing results to the terminal, means for communicating with a database to read and write data, means for detecting and responding to errors, and means for displaying information through a user interface, thereby improving the reliability and availability of data and ensuring quick responses and high reliability.

[1982] A "terminal" is a device that is operated by a user to input and obtain data.

[1983] A "server" is a device or system for analyzing, storing, and retrieving data received from a terminal, and returning the processing results.

[1984] A "database" is a file system or data structure used by a server to store and retrieve data.

[1985] The "receiving means" is a function for acquiring data sent from the terminal to the server.

[1986] The "analysis means" is a function for analyzing the contents of received data and selecting an appropriate action.

[1987] The "means for selecting processing" is a function that determines the processing content to be performed based on the content of the data.

[1988] A "means for storing or retrieving data" is a function for storing new data in a database or retrieving existing data based on a selected operation.

[1989] The "means for transmitting processing results" is a function for returning the results of processing performed by the server to the terminal.

[1990] "Means for communicating with a database and reading and writing data" refers to the function of reading and writing data from and to a database.

[1991] "Means for error detection and response" refers to the function of detecting errors that occur during data analysis and processing, and generating and sending appropriate error messages.

[1992] The "means for displaying information through a user interface" is a function for displaying information such as processing results and error messages returned by the server to the user.

[1993] The present invention is a control system for efficiently exchanging data between servers, terminals, and users, and for storing and retrieving data. The purpose of this system is to improve the reliability and availability of data.

[1994] First, the main components of this system will be described. This system includes a server, a terminal, a database, and user operations.

[1995] The server plays a central role in data management and uses the following hardware and software:

[1996] Hardware: General-purpose computer or cloud service (e.g., Amazon Web Services EC2 instance)

[1997] Software: Python programs, web frameworks such as Flask, and database management systems such as MySQL

[1998] A terminal is a device used by a user to enter or obtain data, and uses the following hardware and software:

[1999] Hardware: PCs, tablets, smartphones, etc.

[2000] Software: Web browser or mobile application

[2001] A database is a file system or data structure that a server uses to store and retrieve data. Specifically, we will use a MySQL database.

[2002] Next, the operation of the system will be specifically described.

[2003] Data storage process

[2004] When a user inputs new data through the device and tries to save it, the device first sends the data in JSON format to the server. The server analyzes the received data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the device indicating that the data was successfully saved. The user can view the message through the device.

[2005] For example, if a user enters the following data:

[2006] ID:1

[2007] Name: "Example Data"

[2008] Timestamp: "2023-10-14T12:00:00"

[2009] The terminal sends a request including the action (store) and the data content to the server. After receiving this request, the server reads the database file, adds new data, and rewrites it. After the process is completed, the server sends a response message to the terminal indicating that the data has been successfully saved, allowing the user to confirm that the data has been saved successfully.

[2010] Data Acquisition Process

[2011] When a user requests data acquisition through a terminal, the terminal sends a data acquisition request to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The user can check the acquired data through the terminal and use it as needed.

[2012] For example, suppose a user requests to retrieve data. In this case, the device sends a request including an action (retrieve) to the server. When the server receives this request, it reads the data from the database file and returns the entire contents to the device in JSON format. The user can then receive and check the retrieved data on the device.

[2013] Error handling process

[2014] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it will return an error message and prompt the user to re-enter the appropriate information. In this way, the system achieves high reliability and fault tolerance.

[2015] Example prompts for generative AI models

[2016] Here are some example prompts to input to the generative AI model:

[2017] "Please give me a concrete example of how to save data. For example, if you want to save data in the form of ID, name, and timestamp, please explain the process in detail."

[2018] "Please give me a specific example of a request to perform a data retrieval operation. Please explain the format in which the request should be sent from the terminal to the server."

[2019] The above is a specific embodiment of the control system of the present invention. By using this system, users can efficiently store and retrieve data, improving the reliability and availability of the system as a whole.

[2020] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2021] Data storage process

[2022] Step 1:

[2023] The user inputs data on the device. Specifically, the user inputs data such as ID, name, timestamp, etc. into the input form on the device. The input data is in the following format:

[2024] ID:1

[2025] Name: "Example Data"

[2026] Timestamp: "2023-10-14T12:00:00"

[2027] input:

[2028] User-entered data

[2029] output:

[2030] Data displayed on the device's input form

[2031] Step 2:

[2032] The device sends data to the server. The device uses an HTTP POST request to send data to the server in JSON format. The data sent must be in the following format:

[2033] json

[2034] {

[2035] "action": "store",

[2036] "data": {

[2037] "id": 1,

[2038] "name": "Example Data",

[2039] "timestamp": "2023-10-14T12:00:00"

[2040] }

[2041] }

[2042] input:

[2043] Data entered by the user into the terminal

[2044] output:

[2045] JSON format data sent to the server

[2046] Step 3:

[2047] The server receives the data. The server uses a web framework such as Flask to receive the HTTP POST request and extracts the data sent. Specifically, the server extracts the JSON data from the body of the request.

[2048] input:

[2049] JSON format data sent from the device

[2050] output:

[2051] Data content extracted by the server

[2052] Step 4:

[2053] The server analyzes the data. The server determines that the received data should be stored. Specifically, it checks the validity of the data format and content (e.g., ID, name, timestamp).

[2054] input:

[2055] Data content extracted by the server

[2056] output:

[2057] That the data is valid

[2058] Step 5:

[2059] The server saves the data to the database. The server connects to the MySQL database and adds the new data. Specifically, it executes the following SQL statement:

[2060] sql

[2061] INSERT INTO datatable (id, name, timestamp) VALUES (1, 'Example Data', '2023-10-14T12:00:00');

[2062] input:

[2063] Validated data

[2064] output:

[2065] Data stored in a database

[2066] Step 6:

[2067] The server sends a response message to the device. If the save to the database is successful, the server returns a message in JSON format indicating that the save was successful to the device. Specifically, it sends the following message:

[2068] json

[2069] {

[2070] "status": "success",

[2071] "message": "Data stored successfully"

[2072] }

[2073] input:

[2074] Results of saving to database

[2075] output:

[2076] Response message sent to the terminal

[2077] Step 7:

[2078] The user confirms the save result. The device receives the response message from the server and displays a success message to the user. Specifically, the device displays the following message on the screen:

[2079] "Data stored successfully"

[2080] input:

[2081] Response message from the server

[2082] output:

[2083] A success message for the user to see

[2084] Data Acquisition Process

[2085] Step 1:

[2086] The user requests data acquisition on the terminal. Specifically, the user clicks a button on the terminal to instruct data acquisition.

[2087] input:

[2088] User's data request

[2089] output:

[2090] Device data acquisition request event

[2091] Step 2:

[2092] The device sends a request to the server. The device uses an HTTP GET request to send a data retrieval request to the server in JSON format. The data sent is in the following format:

[2093] json

[2094] {

[2095] "action": "retrieve"

[2096] }

[2097] input:

[2098] User's data request

[2099] output:

[2100] The request sent to the server

[2101] Step 3:

[2102] The server receives the request. The server receives the HTTP GET request and analyzes the request. Specifically, the server extracts the JSON data from the request body.

[2103] input:

[2104] Requests sent from the device

[2105] output:

[2106] The request content parsed by the server

[2107] Step 4:

[2108] The server retrieves data from the database. The server connects to the MySQL database and retrieves all records. Specifically, it executes the following SQL statement:

[2109] sql

[2110] SELECT FROM datatable;

[2111] input:

[2112] The requested data retrieval request

[2113] output:

[2114] All data retrieved from the database

[2115] Step 5:

[2116] The server returns the data to the device. The acquired data is converted to JSON format and returned to the device. Specifically, the following data is returned:

[2117] json

[2118] {

[2119] "status": "success",

[2120] "data": [

[2121] {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"},

[2122] {"id": 2, "name": "Another Data", "timestamp": "2023-10-15T12:00:00"}

[2123] ]

[2124] }

[2125] input:

[2126] All data retrieved from the database

[2127] output:

[2128] Data sent back to the device

[2129] Step 6:

[2130] The user checks the acquired data. The terminal receives the response data from the server and displays it to the user. Specifically, the user can check each piece of acquired data on the terminal screen.

[2131] input:

[2132] Data retrieved from the server

[2133] output:

[2134] Retrieved data displayed to the user

[2135] Error handling process

[2136] Step 1:

[2137] A user may enter data, but may enter incorrect data, for example, leaving the name field empty.

[2138] input:

[2139] Incorrect data

[2140] output:

[2141] Incorrect data displayed on the device

[2142] Step 2:

[2143] The device sends the data to the server. The device uses an HTTP POST request to send the erroneous data to the server in JSON format.

[2144] input:

[2145] Incorrect data entered by the user

[2146] output:

[2147] Incorrect data sent to the server

[2148] Step 3:

[2149] The server receives the data. The server receives the request and extracts the content of the data sent.

[2150] input:

[2151] Incorrect data sent from the device

[2152] output:

[2153] Data content extracted by the server

[2154] Step 4:

[2155] The server analyzes the data and detects errors. The server analyzes the format and content of the data to detect invalid data. Specifically, it checks that the name field is empty.

[2156] input:

[2157] Data content extracted by the server

[2158] output:

[2159] Presence or absence of errors

[2160] Step 5:

[2161] The server sends an error message to the terminal. If an error is detected, the server returns an error message in JSON format to the terminal. Specifically, it sends the following message:

[2162] json

[2163] {

[2164] "status": "error",

[2165] "message": "Name field is empty. Please re-enter."

[2166] }

[2167] input:

[2168] Error Information

[2169] output:

[2170] Error messages sent to the terminal

[2171] Step 6:

[2172] The user confirms the error and re-enters the data. The terminal receives the error message and displays it to the user. The user confirms the error message and re-enters the correct data.

[2173] input:

[2174] Error messages from the server

[2175] output:

[2176] Correct data to be re-entered

[2177] This concludes the explanation of the specific operations and inputs / outputs of each processing step in this system, which improves the reliability and availability of data and achieves fast response and high reliability.

[2178] (Application example 1)

[2179] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2180] Inventory management and shipping status tracking at logistics centers require the exchange of reliable data in real time to maximize efficiency. However, existing systems have issues with data reliability, availability, and operational efficiency, making management tasks cumbersome. In particular, updating inventory information and checking shipping status takes time, making errors and work delays more likely to occur. This reduces the operational efficiency of the entire logistics center, posing a challenge.

[2181] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2182] In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and selecting processing according to the action, means for saving or retrieving data based on the selected processing, means for transmitting the processing results to the terminal, means for tracking inventory management and shipping status at the logistics center, means for receiving and saving inventory information (identifier, name, quantity, date and time), and means for confirming inventory and retrieving shipping status and returning it to the terminal. This enables real-time monitoring of inventory management and shipping status at the logistics center, increases data reliability and availability, improves work efficiency, and reduces errors.

[2183] A "terminal" is a device for inputting and displaying data, and for transmitting data between a user and a system.

[2184] A "server" is a central device that receives data sent from a terminal, analyzes, saves, retrieves, and returns the processing results.

[2185] The "data receiving means" is a mechanism by which the server receives data sent from the terminal.

[2186] The "data analysis means" is a mechanism for analyzing received data and selecting an appropriate process based on the data's contents.

[2187] A "data storage means" is a mechanism for adding and storing data in an existing database file based on selected processing.

[2188] The "data acquisition means" is a mechanism for reading the necessary data from the database file and returning it to the terminal.

[2189] The "processing result transmission means" is a mechanism for transmitting the processing results performed by the server to the terminal.

[2190] A "distribution center" is a facility that stores and manages inventory and ships products.

[2191] "Inventory control" is the activity of recording and managing inventory of goods at a logistics center.

[2192] "Shipping status tracking" is the activity of tracking and managing the current status and location information of shipped goods.

[2193] "Inventory information" is data related to product identifiers, names, quantities, and the dates and times of stocking and shipping.

[2194] MODE FOR CARRYING OUT THE INVENTION

[2195] System Overview

[2196] As an embodiment of the present invention, the system of the present invention efficiently and reliably manages inventory at a logistics center and tracks shipping status. The system is configured as follows.

[2197] Hardware and Software

[2198] The main hardware components of this system are:

[2199] Terminal: A device used to enter and check inventory information and shipping status. For example, a smartphone.

[2200] Server: The main component that receives, analyzes, stores, retrieves data, and returns the processed results.

[2201] Database: A storage system for storing data. An example is SQLite.

[2202] The following software is used:

[2203] Flask: A Python framework that implements server-side processing.

[2204] SQLite: A lightweight database management system for managing inventory and shipping data.

[2205] Data processing and calculation

[2206] Receiving and storing data

[2207] 1. The user uses a terminal to enter new inventory information, including the identifier, name, quantity, and date and time.

[2208] 2. The device sends the entered data to the server, which analyzes the received data and selects the process for saving it.

[2209] 3. The server reads the existing data from the database and rewrites it with the new data.

[2210] Getting and returning data

[2211] 1. The user uses the terminal to request stock availability or shipping status.

[2212] 2. The device sends this request to the server, which retrieves the necessary information from the database based on the received request.

[2213] 3. The read data is sent back from the server to the device, where the user can view it.

[2214] Specific examples

[2215] Example of saving inventory information

[2216] For example, when a new item arrives at a distribution center, an associate enters the following information into their smartphone:

[2217] Identifier: 123

[2218] Name: "Product A"

[2219] Quantity:50

[2220] Date and time: "2023-10-22T09:00:00"

[2221] Once staff enter this information, the smartphone sends the data to a server, which stores it in a database.

[2222] Example of checking shipping status

[2223] When a user wants to check the status of a shipped item, the user sends a request to check the shipping status using the smartphone app. The server receives this request, retrieves the shipping status from the database, and sends it back to the smartphone. The user can then check the current status of the shipped item based on the returned data.

[2224] Prompt Sentence Examples

[2225] The following prompts can be used for the generative AI model:

[2226] "Write Python code to store data received by the server in a database and retrieve it as needed for an inventory management system used in a distribution center. Specifically, you will use Flask and SQLite."

[2227] In this way, the system of the present invention can efficiently and reliably realize inventory management and shipping status tracking in a logistics center.

[2228] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2229] Step 1:

[2230] The user uses a terminal to input new inventory information. The user inputs an identifier, name, quantity, and date and time. This input data is sent from the terminal to the server. The input data is expressed in JSON format.

[2231] Step 2:

[2232] The terminal sends the input data in JSON format to the server. The sent data includes the identifier, name, quantity, and date and time. The server receives this data.

[2233] Step 3:

[2234] The server analyzes the received data and determines whether it is information that should be saved. Specifically, it checks whether the data format and required fields (identifier, name, quantity, date and time) are complete. If the data is in the appropriate format, it prepares the data for saving.

[2235] Step 4:

[2236] The server reads existing data from the database by opening a database connection using SQLite and executing an SQL query to retrieve existing inventory data, where the input is the user data received by the server and the output is the result of the SQL query.

[2237] Step 5:

[2238] The server appends the new data to the existing data and rewrites it to the database. Using SQLite, it executes an SQL query to insert the new data. Once the data update is complete, it generates a message that the data was saved successfully.

[2239] Step 6:

[2240] The server sends a data saving success message to the terminal, and the terminal receives this message and notifies the user that the data has been saved successfully, completing the inventory information saving process.

[2241] Step 7:

[2242] The user uses the device to request stock availability or shipping status. The device sends a request to the server. This request is also in JSON format, and the action is "retrieve."

[2243] Step 8:

[2244] The server receives the request sent from the device and prepares to retrieve the necessary information from the database. Specifically, it uses SQLite to create SQL queries to retrieve inventory and shipping status.

[2245] Step 9:

[2246] The server executes SQL queries to retrieve inventory and shipping status data from the database. The input is the request data received by the server, and the output is the result of the SQL query. The retrieved data is then converted to JSON format and ready to be sent back.

[2247] Step 10:

[2248] The server returns the acquired data in JSON format to the device. The device receives this data and the user can check the stock status and shipping status on the device. This completes the data acquisition process.

[2249] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2250] The present invention combines a control system for improving data reliability and availability with an emotion engine that recognizes user emotions. The system in this specification not only efficiently exchanges data between servers, terminals, and users, and stores and retrieves data, but also responds by reflecting the user's emotions.

[2251] System Overview

[2252] The system is primarily based on a server, which provides secure and reliable communication between the server and the device. Users send data to the server via their device and retrieve data as needed. Furthermore, the system incorporates an emotion engine that recognizes the user's emotions, adjusting response content and data processing priority.

[2253] Emotion recognition processing

[2254] The emotion engine analyzes user input and behavior to recognize emotions. For example, it can determine whether a user is stressed based on the context of text input. This information is used by the server for data processing.

[2255] Data storage process

[2256] When a user inputs new data through the terminal and tries to save it, the terminal sends the data along with the user's emotional information to the server. The server receives the data and determines that the data should be saved. The server then reads the existing database file and adds the received new data to the existing data. The updated data is rewritten to the database file, and the server sends a message to the terminal notifying that the data was successfully saved.

[2257] Data Acquisition Process

[2258] When a user requests data through a terminal, the terminal sends the request along with the user's emotional information to the server. When the server receives the request, it reads all the data from the database file and returns the contents to the terminal. The returned data and response message are adjusted according to the user's emotional state. For example, if the user is feeling stressed, a more friendly response will be returned.

[2259] Specific examples

[2260] Example of saving data

[2261] Suppose a user enters the following data at a terminal:

[2262] ID:1

[2263] Name: "Example Data"

[2264] Timestamp: "2023-10-14T12:00:00"

[2265] Emotions: Stress

[2266] To save this, the device sends a request to the server like this:

[2267] Action:store

[2268] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[2269] Emotional information: Stress

[2270] The server receives this request, reads the database file, adds the new data, and rewrites it. After the process is complete, the server sends a response message to the terminal indicating that the data has been successfully saved, and notifies the user with a friendly tone.

[2271] Data retrieval operation example

[2272] If a user requests data retrieval through a device, the device sends the following request to the server:

[2273] Action: retrieve

[2274] Emotional information: Relaxation

[2275] When the server receives this request, it reads the data from the database file and returns the entire contents to the terminal. The server recognizes that the user is relaxed and sends a standard response message. The user can receive and check the retrieved data on the terminal.

[2276] Error Handling

[2277] The server also has the ability to respond when an abnormality occurs or the request content is invalid. For example, if the received data is incomplete, it returns an error message and prompts the user to re-enter the appropriate information. In this case, it utilizes an emotion engine to provide an error message in a way that reflects the user's emotions. For example, if the user is irritated, it will request the user to re-enter the information in a very polite tone.

[2278] These features enable the system of the present invention to improve the user experience and increase the reliability and efficiency of data management. By combining it with an emotion engine, flexible responses that are in tune with the user's emotions become possible.

[2279] The processing flow will be explained below.

[2280] Data storage process flow incorporating emotion recognition

[2281] Step 1:

[2282] A user inputs new data on the terminal. For example, the data is "ID: 1, Name: 'Example Data', Timestamp: '2023-10-14T12:00:00'".

[2283] Step 2:

[2284] The user is analyzed by the device's emotion engine, and the emotion is recognized as "stress."

[2285] Step 3:

[2286] The device sends the input data and emotion information to the server in JSON format.

[2287] Step 4:

[2288] The server receives the data sent from the terminal and temporarily stores the data in a buffer using the recv function.

[2289] Step 5:

[2290] The server decodes the received data into JSON format and converts it into a dictionary object.

[2291] Step 6:

[2292] The server checks that the decoded data is a "store" action by looking at the "action" key in the data.

[2293] Step 7:

[2294] The server checks the emotion information provided by the emotion engine and adjusts the data processing priority based on this emotion: if the user is feeling stressed, the processing priority is set high.

[2295] Step 8:

[2296] The server opens the database file (for example, 'data_store.json') in read mode. If the data already exists, it is read.

[2297] Step 9:

[2298] The server adds new data to the data it reads, specifically by appending the new data to the existing data list.

[2299] Step 10:

[2300] The server writes the updated data list to the database file, rewriting it from the beginning of the file.

[2301] Step 11:

[2302] The server creates a response message in JSON format indicating that the data saving process was successful, and sends it to the device along with a response based on the user's emotion. For example, if the user is "stressed," a message is sent in a more friendly tone.

[2303] Step 12:

[2304] The terminal receives the response from the server and notifies the user that the data has been successfully saved.

[2305] Data acquisition process flow incorporating emotion recognition

[2306] Step 1:

[2307] The user operates the device and sends a data retrieval request to the server. The request format is "action: 'retrieve'".

[2308] Step 2:

[2309] The user is analyzed by the device's emotion engine, and the emotion is recognized as "relaxed."

[2310] Step 3:

[2311] The device sends a data acquisition request and emotion information to the server.

[2312] Step 4:

[2313] The server receives the request sent from the terminal, retrieves the data using the recv function, and temporarily stores it in a buffer.

[2314] Step 5:

[2315] The server decodes the received request into JSON format and converts it into a dictionary object.

[2316] Step 6:

[2317] The server verifies that the decoded request is a "retrieve" action by looking at the "action" key in the data.

[2318] Step 7:

[2319] The server checks the emotion information provided by the emotion engine and adjusts the content of the response message based on this emotion: if the user is relaxed, it generates a standard response message;

[2320] Step 8:

[2321] The server opens the database file in read mode, reading all data from the file.

[2322] Step 9:

[2323] The server creates a response message in JSON format from the data it reads.

[2324] Step 10:

[2325] The server sends the created response message to the terminal.

[2326] Step 11:

[2327] The terminal receives the response from the server and displays the acquired data to the user, who then checks the displayed data.

[2328] Error handling flow

[2329] Step 1:

[2330] If an error occurs when the server receives data, an emotion engine is utilized to generate an error message based on the user's emotion.

[2331] Step 2:

[2332] The server generates an error message, converts it to JSON format, and sends it to the terminal, and if the user is annoyed, politely asks them to re-enter the information.

[2333] Step 3:

[2334] The terminal receives the error message from the server and notifies the user that an error has occurred.

[2335] These steps enable the system of the present invention to efficiently and reliably store and retrieve data, and by utilizing the emotion engine, it is possible to respond flexibly to the user's emotions.

[2336] Example 2

[2337] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2338] Conventional data management systems do not process data with consideration for user emotions, resulting in poor user experience. In particular, systems often lack appropriate responses for users who feel stressed or irritated when entering or retrieving data, which can impair system usability. In addition, data storage and retrieval processes must be efficient and reliable.

[2339] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2340] In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and extracting user emotion information, means for selecting a process corresponding to an action based on the emotion information, means for saving or retrieving data based on the selected process, and means for transmitting the processing result to the terminal together with a response message based on the emotion information. This enables data processing and response messages that take the user's emotion into consideration, improving system usability and the user experience. Furthermore, data saving and retrieval processes are performed efficiently and reliably.

[2341] A "terminal" is a computer or device through which a user inputs data and communicates with a server.

[2342] A "server" is a computer system that receives, analyzes, stores, retrieves data, extracts emotion information, and generates response messages.

[2343] The "means for receiving data" is a function for taking data sent from a terminal into the server.

[2344] "Means for analyzing data" refers to the function of understanding the content of received data, breaking it down into individual elements, and processing them.

[2345] The "means for extracting emotional information" is a function for identifying the emotional state of the user from the analyzed data.

[2346] The "means for selecting processing according to an action" is a function for determining an appropriate data processing method based on the user's emotional information and the data content.

[2347] "Means for saving data" is a function that adds new data to the database and rewrites existing data files.

[2348] "Means for obtaining data" is a function that reads the necessary data from the database and returns it to the terminal.

[2349] The "means for generating a response message" is a function for forming an appropriate message based on the results of data processing and the user's emotional information.

[2350] The "means for transmitting to the terminal" is a function for transmitting the generated response message and the data processing results from the server to the terminal.

[2351] The "measures to be taken when an abnormality occurs" is a function that detects that the received data is incomplete, formulates an error message corresponding to the user's feelings, and sends it to the terminal.

[2352] An "emotion engine" is a software component that analyzes user input data and behavior to recognize emotions.

[2353] MODE FOR CARRYING OUT THE INVENTION

[2354] This invention is a data management system that takes user emotions into consideration and aims to improve the reliability and availability of data. This system not only efficiently exchanges data between servers, terminals, and users, and stores and retrieves data, but also responds in a way that reflects the user's emotions.

[2355] System Configuration

[2356] The system consists of three main components:

[2357] 1. Server

[2358] 2. Terminal

[2359] 3. Users

[2360] 1. Server:

[2361] The server receives, analyzes, stores, and retrieves data, extracts emotion information, and generates response messages. The server includes an emotion engine and a database.

[2362] The emotion engine is a software component that analyzes user input data and behavior to recognize emotions, and can use, for example, text analysis algorithms.

[2363] 2. Terminal:

[2364] A terminal is a computer or device through which a user inputs data and communicates with a server. The user sends data through the terminal and retrieves the data as needed.

[2365] Examples of terminals include PCs, tablets, and smartphones.

[2366] 3. User:

[2367] Users input, save, and retrieve data through their terminals, and the user's emotional information is reflected in the overall processing of the system.

[2368] Examples of data storage

[2369] The user enters the following data at the terminal:

[2370] ID:1

[2371] Name: "Example Data"

[2372] Timestamp: "2023-10-14T12:00:00"

[2373] Emotions: Stress

[2374] To save this, the device sends the following request to the server:

[2375] Action:store

[2376] Data content: {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}

[2377] Emotional information: Stress

[2378] The server receives this request and does the following:

[2379] 1. Analyze the incoming data and use the emotion engine to identify the user's emotion as "stress."

[2380] 2. Access the database and read the existing data file.

[2381] 3. Append the new data to the existing data and rewrite the database file.

[2382] 4. Generate a message of successful saving and send a friendly tone message to the terminal, such as "The data has been saved successfully. Thank you," depending on the user's emotion.

[2383] 5. The terminal displays this message to the user, who confirms that the save process was successful.

[2384] Specific examples of data acquisition

[2385] When a user requests data retrieval through a device, the following request is sent:

[2386] Action: retrieve

[2387] Emotional information: Relaxation

[2388] The server receives this request and does the following:

[2389] 1. Read all the data from the database file.

[2390] 2. The read data is returned to the terminal as a response.

[2391] 3. Consider that the user is relaxed and send a standard response message.

[2392] 4. The terminal displays the data to the user, who then checks the data.

[2393] Example of error handling

[2394] The system also has the ability to react when an anomaly occurs. For example, if it detects that the received data is incomplete, it will:

[2395] 1. The server generates an error message and announces it in a tone that corresponds to the user's emotion. For example, for an annoyed user, it generates a message saying, "We apologize for the inconvenience, but please enter your data again. Confirmation is required."

[2396] 2. The terminal displays this error message to the user and prompts them to re-enter the appropriate information.

[2397] Prompt Sentence Examples

[2398] Here are some example prompts to input to a generative AI model:

[2399] > "The user wants to save new data. The data is as follows:

[2400] > - ID:1

[2401] - Name: "Example Data"

[2402] - Timestamp: "2023-10-14T12:00:00"

[2403] - Emotions: Stress

[2404] > Consider this data and sentiment information to generate an appropriate response message.

[2405] > "The user is requesting data retrieval. The user's emotional information is relaxed. Please generate an appropriate response message taking this emotional information into account."

[2406] As a result, it becomes possible to respond in a way that takes into account the user's emotions, improving the ease of use and reliability of the system.

[2407] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2408] Step 1:

[2409] The user inputs data through the terminal and sends it to the server.

[2410] What happens: A user accesses a data entry form and enters new data (e.g., ID, name, timestamp). Emotional information is also entered.

[2411] Input: User-entered data and emotion information (e.g., {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00", "emotion": "Stress"}).

[2412] Output: The device generates a request to send this to the server (e.g., {"action": "store", "data": {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}, "emotion": "stress"}).

[2413] Step 2:

[2414] The server receives the data and analyzes the user's emotional information using an emotion engine.

[2415] Specific operation: The server receives a request sent from the terminal, first analyzes the request content, and then identifies emotion information using the emotion engine.

[2416] Input: Request data received from the device (e.g., {"action": "store", "data": {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00"}, "emotion": "stress"}).

[2417] Output: As a result of the analysis, emotional information (e.g., "stress") is extracted.

[2418] Step 3:

[2419] The server accesses the database and saves the new data.

[2420] Specific operation: The server accesses the database, reads the current data file, appends the new data to the existing data, and rewrites the updated data to the database file.

[2421] Input: Parsed data and emotion information (e.g., {"id": 1, "name": "Example Data", "timestamp": "2023-10-14T12:00:00", "emotion": "stress"}).

[2422] Output: The updated database file.

[2423] Step 4:

[2424] The server generates a message indicating that the save was successful and sends it to the terminal.

[2425] Specific operation: The server generates a message to inform the user that the save process was successful. This message is generated in a tone that takes into account the user's stress.

[2426] Input: Successful data storage process and emotional information (e.g., "stress").

[2427] Output: A response message for successful save based on emotion information (e.g., "Your data has been saved successfully. Thank you.").

[2428] Step 5:

[2429] The device will display a successful save message to the user.

[2430] Specific operation: The device displays the message received from the server to the user, allowing the user to confirm that the data has been successfully saved.

[2431] Input: Response message from the server (e.g. "Data saved successfully. Thank you.").

[2432] Output: A successful save message displayed on the terminal.

[2433] Step 6:

[2434] The user requests data acquisition through the terminal.

[2435] Specific operation: The user accesses the data acquisition screen on the device and requests data acquisition. At this time, emotion information is also sent.

[2436] Input: User request (e.g. {"action": "retrieve", "emotion": "relax"}).

[2437] Output: A request sent from the device to the server (e.g., {"action": "retrieve", "emotion": "relax"}).

[2438] Step 7:

[2439] The server processes the data retrieval request and reads the data from the database.

[2440] What happens: The server receives the request and reads all the data from the database file.

[2441] Input: A request from the device (e.g., {"action": "retrieve", "emotion": "relax"}).

[2442] Output: The data read (e.g. the entire contents of the database).

[2443] Step 8:

[2444] The server generates a response message based on the acquired data and emotion information and sends it to the terminal.

[2445] Specific operation: The server takes into account the user's emotional information when generating a response message. For a relaxed user, it generates a standard response message and sends it to the device along with the acquired data.

[2446] Input: Acquired data and emotional information (e.g., "Relaxed").

[2447] Output: A response message based on the acquired data and emotional information (e.g., "Here is the data you requested.").

[2448] Step 9:

[2449] The terminal displays the acquired data and a response message to the user.

[2450] Specific operation: The terminal displays the response message from the server and the acquired data to the user, so that the user can check the acquired data.

[2451] Input: Response message from the server and retrieved data (e.g., "This is the data you requested," database contents).

[2452] Output: Data and response messages displayed on the terminal.

[2453] The above is the specific processing flow of the program of this system.

[2454] (Application example 2)

[2455] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2456] Conventional food delivery systems have the problem of not improving the user experience because they process data and respond without considering the user's emotions. In particular, they are unable to respond appropriately to stressed or irritated users, which leads to a decrease in satisfaction.

[2457] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving data from the terminal, means for analyzing the received data and selecting processing according to the action, means for saving or acquiring data based on the selected processing, means for transmitting the processing results to the terminal, means for adjusting response content and data processing priority based on the user's emotions using an emotion engine that recognizes the user's emotions, and means for suggesting personalized menus based on the user's emotions. This enables appropriate and flexible responses according to the user's emotional state, improving the user experience.

[2458] A "terminal" is an interface device used by a user, and is a device that transmits and receives data via communication with a server.

[2459] "Saving data" is the process of adding new data received to an existing database file and rewriting the database file.

[2460] "Data acquisition" is the process of reading all data from the database file and returning the requested data to the terminal.

[2461] The "processing result" is the result after the server has saved or retrieved the data, and includes information or messages to be sent to the terminal.

[2462] A "server" is a computer system that analyzes data received from a terminal, selects the appropriate processing, and returns the results.

[2463] An "emotion engine" is a technological element that analyzes user input and behavior to recognize emotions, and adjusts response content and data processing priority based on that information.

[2464] "Personalized menu suggestions" refers to a process of suggesting menu items and services that are optimal for a user based on the user's emotional data.

[2465] The recommender system for implementing the present invention can recognize the user's emotions and adjust data processing and response content accordingly. Specific embodiments are described below.

[2466] System configuration

[2467] The system mainly consists of two main components: a server and a terminal. The terminal receives user input, the server analyzes the input and takes appropriate action, and the emotion engine recognizes emotions and adjusts data processing accordingly.

[2468] Hardware and software used

[2469] The hardware required is a user device (smartphone or smart glasses) and a server. The software consists of the following main modules:

[2470] 1. Data receiving module: A communication module for receiving data sent by a terminal.

[2471] 2. Data analysis module: The processing logic for analyzing the received data and selecting the necessary actions. This includes the Python requests library.

[2472] 3. Data storage and retrieval module: A data management module for storing and retrieving data in a database. For database management, a database management system such as MySQL or PostgreSQL is used.

[2473] 4. Emotion Engine: An engine for recognizing and analyzing user emotions in real time. In this part, the generative AI model uses NLP techniques to recognize emotions from the user's input text.

[2474] 5. Personalization module: The logic for making personalized menu suggestions based on user sentiment.

[2475] Explanation of program processing

[2476] The server first receives data from the device through the data reception module. The data analysis module then analyzes the received data and uses the emotion engine to recognize the user's emotions. The emotion engine applies NLP technology, and if a user enters, for example, "I'm very busy at work and I'm frustrated," it will recognize this as "stress." Based on this information, the personalization module makes appropriate menu suggestions.

[2477] Next, if data storage or retrieval is required, the data storage and retrieval module interacts with the database on the server and performs the necessary operations. Finally, the server sends the processing results to the terminal and displays them to the user in an appropriate content according to their emotions.

[2478] Specific examples

[2479] For example, if a user inputs "I'm so busy at work and I'm frustrated," the emotion engine will recognize it as "stress," and the server will recommend "Sushi" as a personalized menu item. Also, when a data saving operation is performed, the operation result is sent to the device along with a user-friendly message.

[2480] Prompt Sentence Examples

[2481] Here is an example prompt:

[2482] Analyze the user's sentiment from the input sentence and recommend appropriate menu items based on that sentiment.

[2483] example:

[2484] Enter: "I'm so busy at work and it's frustrating."

[2485] Emotion: "Stress"

[2486] Recommended Menu: "Sushi"

[2487] In this way, the system aims to improve the user experience by responding appropriately and flexibly to the user's emotional state.

[2488] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2489] Step 1:

[2490] The terminal receives input data from the user (e.g., text such as "I'm so busy at work and I'm frustrated"), which is sent in a comma-separated format for further processing.

[2491] Step 2:

[2492] The terminal sends the received user input data to the server. The data includes text information and basic user information. The server receives the data using the requests module.

[2493] Step 3:

[2494] The server passes the received data to the data analysis module, which analyzes the text information and selects the necessary action, such as "save" or "get."

[2495] Step 4:

[2496] The data analysis module passes the analysis results to the emotion engine, which uses a generative AI model to recognize user emotions from the context of the text. This emotion recognition process utilizes natural language processing (NLP) techniques to classify the input data into various emotion labels.

[2497] Step 5:

[2498] Once the emotion engine recognizes the user's emotion, it returns the result to the main processing logic on the server. For example, it may recognize that the user is feeling "stressed." This result is used in the next processing step for personalized services and suggestions.

[2499] Step 6:

[2500] Based on the results of the emotion engine, the server calls the personalization module, which then suggests a menu item that matches the user's emotions. For example, if the user is feeling stressed, "Sushi" will be selected as the suggested menu item.

[2501] Step 7:

[2502] If necessary, the server saves or retrieves the data. In the case of saving data, it calls the data saving module to add the received data to the database file, or rewrites the existing database file.

[2503] Step 8:

[2504] In the case of data acquisition, the server calls the data acquisition module, reads the necessary data from the database, and returns it to the terminal. The returned data includes a response message according to the user's emotion.

[2505] Step 9:

[2506] The server then sends the appropriate response message or data to the device as the final processing result. The device then displays the received content to the user and performs the corresponding action, such as suggesting menu items to the user based on their emotions.

[2507] Step 10:

[2508] The terminal feeds back the data and response messages received from the server to the user, and the user can select the next action based on that.

[2509] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2510] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2511] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2512] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2513] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2514] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2515] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2516] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2517] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2518] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2519] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2520] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2521] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2522] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2523] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2524] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2525] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2526] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2527] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2528] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2529] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2530] The following is further disclosed regarding the above embodiment.

[2531] (Claim 1)

[2532] means for receiving data from a terminal;

[2533] A means for analyzing the received data and selecting a process according to the action;

[2534] means for storing or retrieving data based on the selected processing;

[2535] The system includes means for transmitting the processing result to the terminal.

[2536] (Claim 2)

[2537] 10. The system of claim 1, further comprising means for reading an existing database file for data storage and rewriting it with new data appended.

[2538] (Claim 3)

[2539] 10. The system of claim 1, further comprising means for reading data from the database file for data acquisition and returning the acquired data to the terminal.

[2540] "Example 1"

[2541] (Claim 1)

[2542] means for receiving data from a terminal;

[2543] A means for analyzing the received data and selecting a process according to the action;

[2544] means for storing or retrieving data based on the selected processing;

[2545] means for transmitting the processing result to a terminal;

[2546] A means of communicating with the database to read and write data;

[2547] means for error detection and response;

[2548] A system including a means for displaying information through a user interface.

[2549] (Claim 2)

[2550] 10. The system of claim 1, further comprising means for reading an existing database file for data storage and rewriting it with new data appended.

[2551] (Claim 3)

[2552] 10. The system of claim 1, further comprising means for reading data from the database file for data acquisition and returning the acquired data to the terminal.

[2553] "Application Example 1"

[2554] (Claim 1)

[2555] means for receiving data from a terminal;

[2556] A means for analyzing the received data and selecting a process according to the action;

[2557] means for storing or retrieving data based on the selected processing;

[2558] means for transmitting the processing result to a terminal;

[2559] A means for managing inventory at logistics centers and tracking shipping status,

[2560] A means for receiving and storing inventory information (identifier, name, quantity, date and time);

[2561] A system that includes a means to check inventory and obtain shipping status and return it to the terminal.

[2562] (Claim 2)

[2563] means for reading an existing database file for data storage and rewriting it with new data appended;

[2564] 10. The system of claim 1.

[2565] (Claim 3)

[2566] means for reading data from the database file to acquire data and returning the acquired data to the terminal;

[2567] 10. The system of claim 1.

[2568] "Example 2: Combining Emotion Engines"

[2569] (Claim 1)

[2570] means for receiving data from a terminal;

[2571] means for analyzing the received data and extracting user emotion information;

[2572] A means for selecting a process according to an action based on emotion information;

[2573] means for storing or retrieving data based on the selected processing;

[2574] The system includes a means for transmitting a processing result to the terminal together with a response message based on the emotion information.

[2575] (Claim 2)

[2576] 10. The system of claim 1, further comprising means for reading an existing database file for data storage and rewriting it with new data appended.

[2577] (Claim 3)

[2578] 10. The system of claim 1, further comprising means for reading data from the database file for data acquisition and returning the acquired data to the terminal.

[2579] (Claim 4)

[2580] 2. The system according to claim 1, further comprising means for detecting that the received data is incomplete when an abnormality occurs, and generating an error message based on the user's emotional information and transmitting the message to the terminal.

[2581] "Application example 2 when combining emotion engines"

[2582] (Claim 1)

[2583] means for receiving data from a terminal;

[2584] A means for analyzing the received data and selecting a process according to the action;

[2585] means for storing or retrieving data based on the selected processing;

[2586] means for transmitting the processing result to a terminal;

[2587] a means for adjusting response content and data processing priority based on the user's emotions using an emotion engine that recognizes the user's emotions;

[2588] A system including a means for providing personalized menu suggestions based on user sentiment.

[2589] (Claim 2)

[2590] 10. The system of claim 1, further comprising means for reading an existing database file for data storage and rewriting it with new data appended.

[2591] (Claim 3)

[2592] 10. The system of claim 1, further comprising means for reading data from the database file for data acquisition and returning the acquired data to the terminal. [Explanation of symbols]

[2593] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for receiving data from a terminal; A means for analyzing the received data and selecting a process according to the action; means for storing or retrieving data based on the selected processing; The system includes means for transmitting the processing result to the terminal.

2. 2. The system of claim 1, further comprising means for reading an existing database file for data storage and rewriting it with new data appended.

3. 2. The system of claim 1, further comprising means for reading data from a database file for data acquisition and returning the acquired data to the terminal.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A