system

Abstract

We provide the system. [Solution] A means of analyzing instructions input in natural language, A means for selecting a function or setting to be used in the electronic spreadsheet system based on the aforementioned analysis results, Means for executing the selected function or setting on an electronic spreadsheet system, A system that includes this.

Description

【Technical Field】 【0001】 The technology of the present disclosure relates to a system. 【Background Art】 【0002】 Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance. 【Prior Art Documents】 【Patent Documents】 【0003】 【Patent Document 1】 Japanese Unexamined Patent Application Publication No. 2022-180282 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0004】 In a conventional electronic spreadsheet system, when a user uses complex functions or settings, it requires advanced expertise, and the accompanying operations are cumbersome and time-consuming. As a result, there is a problem that it is difficult for beginners and non-expert users in particular to perform necessary tasks efficiently. Also, in modern times where an improvement in business efficiency is demanded, there is a problem that the productivity of the entire business decreases due to cumbersome operations. 【Means for Solving the Problems】 【0005】 This invention provides a system that automatically executes instructions entered by a user in natural language within an electronic spreadsheet system. This system includes means for analyzing the instructions entered in natural language and means for selecting appropriate functions or settings based on the analysis results. Furthermore, it includes means for executing the selected functions or settings on the electronic spreadsheet system. This enables intuitive spreadsheet operation without specialized knowledge, significantly improving work efficiency. 【0006】 "Natural language" refers to the forms of language that humans use on a daily basis, and is a means of conveying instructions and information in a natural way through written or spoken language. 【0007】 "Means of analysis" refer to functions and technological devices that analyze input data to extract and understand the underlying intentions and meanings. 【0008】 An "electronic spreadsheet system" is a software system for managing, calculating, and analyzing numerical data in a tabular format, and is commonly known as a worksheet or spreadsheet. 【0009】 A "function" refers to a mathematical formula or algorithm that performs a predetermined operation or process on a specific input and outputs a result. 【0010】 "Settings" refer to options and specifications that allow users to adjust the operation and appearance of software or a system according to their requirements. 【0011】 "Means of execution" refers to devices or functions that actually carry out predetermined actions based on pre-specified procedures or commands. 【0012】 "Means for generating procedures" refers to methods or devices for defining and specifying the sequence or process necessary to achieve a particular objective. 【0013】 A "large-scale language model" is a machine learning model built to understand and generate natural language based on a large amount of language data. [Brief explanation of the drawing] 【0014】 [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined. 【Embodiments for Carrying Out the Invention】 【0015】 Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings. 【0016】 First, the terms used in the following description will be explained. 【0017】 In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc. 【0018】 In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor. 【0019】 In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc. 【0020】 In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark). 【0021】 In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or." 【0022】 [First Embodiment] 【0023】 Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment. 【0024】 As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server. 【0025】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0026】 The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52. 【0027】 The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input. 【0028】 The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor. 【0029】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54. 【0030】 Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14. 【0031】 As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30. 【0032】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0033】 In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0034】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal". 【0035】 This invention is a system that automatically converts user-inputted instructions in natural language into various operations on an electronic spreadsheet system. To implement this invention, a program with the following specific configuration is required. 【0036】 First, the user instructs the electronic spreadsheet system to perform a specific operation using natural language. For example, they might want to gray out rows where column A is marked "Completed." The user interface prompts the terminal to input this instruction in text format. 【0037】 Next, the terminal converts the input instructions into data and sends it to the server. The transmitted instructions are analyzed by a large-scale language model installed on the server to clarify the user's intended operation. Based on the analysis results, the server selects the specific functions and settings to be used in the electronic spreadsheet system. For example, if conditional formatting is used to gray out rows where column A is "Completed," the server detects the relevant words or expressions and adjusts the corresponding spreadsheet functions. 【0038】 Next, the server generates instructions on how the selected functions and settings should be executed in the electronic spreadsheet system. These instructions are written in API call or script format and sent from the server to the terminal. A concrete example is the instructions for setting conditional formatting. 【0039】 Finally, the terminal executes specific functions and settings on the electronic spreadsheet system based on the received instructions. This ensures that the data in the spreadsheet is processed and displayed as intended by the user. 【0040】 In this way, the present invention makes it possible to easily perform complex operations within an electronic spreadsheet system using natural language, even without specialized knowledge, thereby significantly improving the user's work efficiency. 【0041】 The following describes the processing flow. 【0042】 Step 1: 【0043】 Users input the desired actions in the electronic spreadsheet system using natural language. They enter specific instructions into the user interface, such as "Gray out rows where column A is marked 'Completed'." 【0044】 Step 2: 【0045】 The terminal receives natural language instructions from the user and sends them to the server as data. An appropriate protocol is used for reliable data transmission. 【0046】 Step 3: 【0047】 The server analyzes the received natural language instructions using a large-scale language model. This model understands the meaning of the instructions and performs keyword extraction and grammatical analysis to clarify the user's intent. 【0048】 Step 4: 【0049】 Based on the analysis results, the server selects the functions and settings to be applied in the electronic spreadsheet system. For example, it determines the specific steps to gray out the "Completed" row in column A using conditional formatting. 【0050】 Step 5: 【0051】 The server generates detailed instructions for applying the selected function or settings to the electronic spreadsheet system. These instructions, in the form of API calls or scripts, include specific steps for execution. 【0052】 Step 6: 【0053】 The server sends the generated procedure to the terminal. Stable data transmission is maintained throughout this process to prevent communication interruptions. 【0054】 Step 7: 【0055】 The terminal executes the appropriate functions and settings in the electronic spreadsheet system according to the instructions received from the server. It sets the specified conditional formatting to process and display the data as intended by the user. 【0056】 Step 8: 【0057】 The user can verify the applied spreadsheet settings and results on their device. This allows the user to confirm that the instructions were followed correctly and complete the task. 【0058】 (Example 1) 【0059】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0060】 Conventional electronic spreadsheet systems made it difficult for users to intuitively instruct complex operations using natural language. This resulted in a problem where users without specialized knowledge could not perform these operations efficiently. Furthermore, the lack of means to translate natural language input into specific operations within the electronic spreadsheet system led to decreased user efficiency. 【0061】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0062】 In this invention, the server includes information processing means for analyzing instructions input in natural language; information processing means for selecting functions or settings to be used in the computing system based on the analysis results; information processing means for executing the selected functions or settings on the computing system; information processing means for converting the analyzed instructions into a data format and transmitting them via a communication network; and information processing means for generating a procedure for executing functions or settings based on instructions received via the communication network. This enables users to efficiently perform operations within the electronic spreadsheet system using intuitive natural language, even without specialized knowledge. 【0063】 "Natural language" refers to the system of words that humans use in everyday life, and unlike formalized programming languages, it can include context and ambiguity. 【0064】 "Analysis" is the act of interpreting given data or instructions to clarify their meaning and purpose. 【0065】 "Information processing means" refers to systems or modules that receive, transform, analyze, and process data based on specific purposes. 【0066】 A "computational processing system" is an electronic platform for receiving information, performing calculations, analysis, and display. 【0067】 A "function" refers to the executable actions of individual operations or processes provided by a particular system or program. 【0068】 "Settings" refer to a set of conditions or parameters defined to control the operation of a system or program. 【0069】 A "communication network" is an infrastructure for sending and receiving data between multiple electronic devices. 【0070】 A "procedure" refers to a set of operations or steps established to achieve a specific objective. 【0071】 A "generative AI model" refers to an artificial intelligence model that uses machine learning techniques to learn patterns from large amounts of data and then performs inferences on new data. 【0072】 This invention provides a system that automates complex settings and function execution by allowing users to instruct operations in natural language within an electronic spreadsheet system. The following specific configuration is used for implementation. 【0073】 First, the user inputs instructions in natural language via the terminal. These natural language instructions are converted into data format on the terminal and sent to the server via the communication network. For example, the user can give instructions such as "gray out rows where column A is marked 'Completed'." 【0074】 Next, the server analyzes the received natural language instructions using a large-scale generative AI model. This could be a large-scale language model such as OpenAI®. As a result of this analysis, the user's intended operation is clarified, and the necessary functions and settings for the computing system are identified. 【0075】 The information processing components included in the server select specific functions and settings to be used in the electronic spreadsheet system based on these analysis results. This selection allows users to easily execute complex commands. 【0076】 For example, if a user instructs a school report card to "display the grades of students with scores below 70 in red," the server can automatically perform this setting through analysis. An example of a prompt to the generating AI model would be, "Explain how to gray out rows that meet specific conditions using conditional formatting." 【0077】 In this way, the system enables even users without specialized knowledge to intuitively perform advanced operations within the electronic spreadsheet system, significantly improving work efficiency. 【0078】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0079】 Step 1: 【0080】 The user enters instructions in natural language. 【0081】 The user uses a terminal to input instructions for the electronic spreadsheet system in natural language. These instructions are in text format and might include something like, "Gray out rows where column A is marked 'Completed'." The input instructions are converted into data format on the terminal for subsequent processing. 【0082】 Step 2: 【0083】 The terminal converts the instructions into data and sends it to the server. 【0084】 The terminal converts natural language instructions input by the user into a machine-readable data format. This process involves pre-processing for natural language analysis, and the data is transmitted to the server via a communication network. The output is text data that can be parsed on the server side. 【0085】 Step 3: 【0086】 The server analyzes the instructions and clarifies the operation details. 【0087】 The server analyzes the received data using a generative AI model. Specifically, a large-scale language model deciphers the intent of natural language and identifies the required operations. The analysis extracts specific functions and settings to be executed in the electronic spreadsheet system. The output is information about the identified operations. 【0088】 Step 4: 【0089】 The server generates the execution procedure and sends it to the terminal. 【0090】 The server generates a procedure to perform the necessary operations based on the analysis results. This procedure is written in the form of API calls or scripts. The generated procedure is then sent back to the terminal via the communication network. The output is an execution procedure directed towards a specific operation. 【0091】 Step 5: 【0092】 The terminal operates the electronic spreadsheet system based on the execution procedure. 【0093】 Based on the received instructions, the terminal automatically executes the necessary functions and settings in the electronic spreadsheet system. Specific actions include applying conditional formatting and modifying formulas. This ensures that the user's instructed actions are executed within the spreadsheet software, yielding the desired results. The output reflects the results of the executed operations within the spreadsheet system. 【0094】 (Application Example 1) 【0095】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0096】 Traditionally, for users without specialized knowledge, operating information processing systems and automated machinery has been difficult due to the complexity of the operations and settings, making it challenging to give efficient instructions. Furthermore, it has not been easy for machines to properly interpret voice commands and execute actions automatically. 【0097】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0098】 In this invention, the server includes means for analyzing instructions input in natural language, means for selecting functions or settings to be used in the information processing system based on the analysis results, means for executing the selected functions or settings on the information processing system, means for converting voice instructions into text, means for analyzing the converted instructions into text and generating an operating procedure for an automated machine, and means for causing the automated machine to execute the generated operating procedure. This makes it possible for users to easily and efficiently operate the information processing system and automated machines using natural language or voice instructions. 【0099】 "Means for analyzing instructions entered in natural language" refers to technologies that receive instructions from users in natural language, analyze their content, and understand the specific actions to be performed. 【0100】 "Means for selecting functions or settings used in an information processing system" refers to a mechanism that selects appropriate functions or settings for information processing based on the analyzed instructions. 【0101】 "Means of execution on an information processing system" refers to the technology of actually applying selected functions and settings on an information processing system and executing the operation. 【0102】 "Means for converting voice instructions into text" refers to a device or technology that converts a user's voice instructions into textual information. 【0103】 "Means for analyzing instructions converted into text and generating operating procedures for automated machines" refers to a technology that analyzes instructions converted from speech into text and constructs specific operating procedures that automated machines should perform. 【0104】 "Means for having an automated machine execute the generated operation procedure" refers to a mechanism for transmitting the constructed operation procedure to an automated machine, allowing the machine to perform the operation based on its contents. 【0105】 A "server" is a computer system that performs tasks such as processing and analyzing information and selecting functions. 【0106】 One embodiment of this invention is a system for transmitting natural language instructions to an information processing system or automated machine. When a user gives instructions by voice via a smart device, those instructions are converted into text data by speech recognition software. Specific hardware such as smart glasses or a smartphone may be used. 【0107】 The server analyzes the received text data using a generative AI model to understand the user's intent. For example, OpenAI's GPT model is used as the generative AI model. Based on the analyzed instructions, the server determines the functions and settings to be used in the information processing system, or the operating procedures for automated machines. 【0108】 The terminal transmits the generated settings and operating procedures to the information processing system or automated machine, and ensures they are properly implemented. In this process, the terminal performs direct operations using APIs or scripts. 【0109】 To give a concrete example, a worker in a factory gives a voice command through smart glasses, saying, "Move 10 parts to the next section." The server analyzes the command, generates the corresponding action procedure, and has a robot execute it. In this process, the following prompt sentences are used as example inputs to the generating AI model: 【0110】 "Instruct the robots in the factory to transport the next 10 products to the next section." 【0111】 Thus, the system implementing the invention efficiently analyzes natural language instructions from the user and converts them into operations for the information processing system and automated machines, thereby achieving simplification and automation of operations. 【0112】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0113】 Step 1: 【0114】 The user gives voice instructions via a smart device. The voice data is captured by the device's microphone and converted into text data by speech recognition software. In this process, the input is the user's voice instructions, and the output is text data. Texted instructions are generated. 【0115】 Step 2: 【0116】 The terminal sends text data to the server. The server uses a generative AI model specialized in text analysis (e.g., the GPT model) to perform analysis to understand the user's instructions. The input is text data, and the output is semantic information of the analyzed instructions. The model analyzes natural language into a machine-understandable format. 【0117】 Step 3: 【0118】 The server determines the appropriate functions or operating procedures to be executed by the information processing system or automated machine based on the analyzed instructions. The input is the analysis result, and the output is a specific operating procedure or API call. In this process, the necessary function settings and operating procedures are selected depending on the analysis result. 【0119】 Step 4: 【0120】 The terminal transmits the operating instructions received from the server to automated machines or information processing systems. The input is the operating instructions from the server, and the output is the specific command or API request to be executed. The terminal issues operating commands to the actual system or machine. 【0121】 Step 5: 【0122】 An information processing system or automated machine initiates actual operation based on communicated procedures. The output is the result of the system or machine's operation. Specifically, a robot in a factory automatically performs tasks such as moving products. 【0123】 This series of processing steps enables users to easily operate systems and machines using natural language. 【0124】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0125】 This invention provides a system that allows users to instruct operations on an electronic spreadsheet system using natural language, recognizes the user's emotions, and adjusts the interface and suggested content accordingly. This system is comprised of a combination of natural language processing, an emotion engine, a large-scale language model, and an electronic spreadsheet system. 【0126】 When a user inputs instructions in natural language to perform an operation on an electronic spreadsheet system, the user interface collects these instructions and inputs them into the terminal. Simultaneously, the terminal performs emotion recognition to infer the user's emotions from their input and speech. This process allows the terminal to process the user's emotions as data. 【0127】 Subsequently, the device sends the recognized emotion data to the server along with the user's natural language instructions. The server uses a large-scale language model to analyze the instructions and clarify their intent. Simultaneously, based on the recognized emotions, the selection of suggested functions and settings is adjusted; for example, simple and easy-to-understand suggestions are provided for positive emotions, and supportive suggestions for negative emotions. 【0128】 Based on the analysis results, the server selects the functions and settings to be used in the electronic spreadsheet system. It also adjusts the interface to improve the user experience based on emotions. For example, if it determines that the user is experiencing stress, it can provide supplementary information such as displaying a help message on the interface. 【0129】 Along with the generated procedures, this adjusted information is sent to the terminal. The terminal then configures the electronic spreadsheet system and executes functions based on the information sent from the server, while simultaneously providing the user with the adjusted interface. 【0130】 In this way, users can easily perform operations on the spreadsheet even without specialized knowledge, and furthermore, a dynamic interface that takes into account the user's emotional state allows them to continue working more comfortably. For example, if a user enters "I want to compare column B using the VLOOKUP function based on column C," and the emotion engine determines that the user is anxious, the terminal can support the user by displaying hints and examples on how to use the VLOOKUP function. 【0131】 The following describes the processing flow. 【0132】 Step 1: 【0133】 The user provides instructions for operating the electronic spreadsheet system using natural language. Specific instructions, such as "I want to gray out rows where column A is marked 'Completed'," are entered into the user interface. 【0134】 Step 2: 【0135】 The device receives natural language instructions from the user and simultaneously recognizes emotions through analysis of the user's facial expressions and input tone. The emotion engine then records the user's emotional state as data. 【0136】 Step 3: 【0137】 The device sends collected natural language instructions and recognized sentiment data to the server. This transmission process uses appropriate protocols to maintain data integrity. 【0138】 Step 4: 【0139】 The server uses a large-scale language model to analyze the received natural language instructions. It clarifies the content of the instructions and prepares them for specific operations in the electronic spreadsheet system. 【0140】 Step 5: 【0141】 The server selects the appropriate functions and settings based on the analysis results and the perceived emotions of the user. If the server determines that the user is stressed, it will select the simplest and most user-friendly option. 【0142】 Step 6: 【0143】 The server generates the steps to be executed based on the selected functions and settings. Furthermore, it creates help messages and support information to display on the interface according to the user's emotional state. 【0144】 Step 7: 【0145】 The server sends the generated instructions and supporting information to the terminal. A protocol is used to ensure the security of the communication during the transmission of this information. 【0146】 Step 8: 【0147】 The terminal performs configuration and function execution in the electronic spreadsheet system according to the received instructions. It also displays necessary support information on the interface based on the user's mood. 【0148】 Step 9: 【0149】 Users can easily verify the results of applied functions and settings via their device. Emotion-responsive support information allows them to proceed with confidence. 【0150】 (Example 2) 【0151】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0152】 In modern information processing systems, users make sophisticated and diverse requests using natural language, but it has been difficult for systems to accurately understand their intentions and respond appropriately. Furthermore, there has been a lack of mechanisms to adjust interfaces and provide support tailored to individual needs, taking into account the user's emotional state. As a result, a challenge has been the inability of users to receive appropriate support when they experience anxiety or stress. 【0153】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0154】 In this invention, the server includes means for analyzing instructions input in natural language, means for recognizing the user's emotions, and means for selecting functions or settings based on the analysis results and emotion data. This makes it possible to adjust the dynamic interface to take the user's emotions into consideration and to make appropriate suggestions. 【0155】 "Natural language" refers to the language that humans use on a daily basis, and is a linguistic form used by computer systems to understand and analyze it. 【0156】 "Emotional data" refers to data that quantifies or analyzes a user's emotional state and can be used by a system. 【0157】 An "information processing system" is a complete system that includes hardware and software for performing assigned tasks and various processing operations. 【0158】 "Function or setting" refers to a set of actions or the necessary environmental components for performing a specific task in an information processing system. 【0159】 "User interface" refers to the screen configuration and operating devices that enable the user and the system to communicate with each other, and includes display elements that improve the user experience. 【0160】 A "suggestion" is a recommendation or option presented by the system in response to the user's requests and circumstances, intended to support the user's actions. 【0161】 This invention provides an information processing system that allows users to give instructions in natural language and enables the system to recognize user emotions and adjust the interface and suggestions accordingly. This system is comprised of a combination of natural language processing, an emotion engine, a large-scale language model, and an information processing system. 【0162】 The terminal receives natural language instructions entered by the user. If the user enters "I want to compare column B using the VLOOKUP function based on column C," the terminal processes this instruction. In this process, the terminal uses an emotion engine to recognize the user's emotions and processes the resulting emotion data. Emotion recognition uses techniques that employ tone analysis of speech and text to quantify emotions. 【0163】 The terminal sends user instructions and sentiment data to the server. The server uses a generative AI model to analyze the instructions and clarify the user's intent. This analysis is specifically performed by interpreting the instructions and creating appropriate prompt statements. An example of a prompt statement here would be: "Analyze the following instructions and make appropriate suggestions based on the user's sentiment: 'I want to compare column B using the VLOOKUP function based on column C'." 【0164】 Based on the analysis results and sentiment data, the server selects functions and settings appropriate for the user and adjusts and provides appropriate suggestions. For example, if the analysis indicates that the user is feeling anxious, the system enhances support for the user by displaying hints on how to use the VLOOKUP function through the terminal. 【0165】 This process allows users to efficiently use information processing systems even without specialized knowledge, and to operate them with confidence through an emotionally sensitive interface. 【0166】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0167】 Step 1: 【0168】 The user provides instructions for the information processing system using natural language. This input is received through the terminal's user interface and collected as text on the terminal. An example of natural language input is, "I want to compare column B with column C using the VLOOKUP function." At this stage, the output is the user's natural language instruction data. 【0169】 Step 2: 【0170】 The device recognizes the user's emotions using an emotion engine. Specifically, the device performs voice tone analysis and text analysis to quantify the user's emotions. The emotion data is then stored digitally within the device. The input for this step is the user's text instructions and voice data, and the output is emotion data. 【0171】 Step 3: 【0172】 The terminal packages both the user-inputted instructions and recognized emotion data and sends them to the server. This data package, containing both the instructions and the emotional state, serves as the basis for the server's subsequent analysis steps. The input consists of natural language instructions and emotion data, while the output is the data package transferred to the server. 【0173】 Step 4: 【0174】 The server analyzes the received instructions using a large-scale language model. The server clarifies the intent of the instructions by inputting prompts into a generative AI model. Specifically, it generates prompts in the form of "Analyze the following instructions and make appropriate suggestions based on the user's sentiment: 'I want to compare column B using the VLOOKUP function based on column C'" and inputs them into the model. In this process, the input is instructions and sentiment data, and the output is the analyzed instruction data. 【0175】 Step 5: 【0176】 The server selects appropriate functions and settings and adjusts the suggestions based on the analyzed instructions and sentiment data. Depending on the sentiment data, for example, if the user is feeling anxious, it provides reassurance to the user by adding multi-level support. The input for this step is the analyzed instruction data, and the output is the adjusted suggestion information and settings. 【0177】 Step 6: 【0178】 The adjusted suggestion information and settings are sent from the server to the terminal. The terminal receives this information and executes the appropriate function on the user interface while simultaneously displaying suggestions. Specifically, it displays examples and hints for using the VLOOKUP function. The input is the adjusted data, and the output is the execution result and advice displayed for the user. 【0179】 (Application Example 2) 【0180】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal". 【0181】 In modern information systems, a challenge faced by diverse users is the limited means of instructing them to operate the system using natural language. Furthermore, the lack of emotionally responsive interface adjustments results in a uniform user experience, making it difficult to address individual needs. 【0182】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0183】 In this invention, the server includes means for analyzing instructions input in natural language, means for selecting an operating procedure or setting in the information system based on the analysis results and recognized emotion data, and means for executing the selected operating procedure or setting and adjusting the interface of the information system. This enables the user to operate intuitively while receiving optimal support tailored to their emotional state. 【0184】 "Instructions entered in natural language" refers to operations or requests made to an information system using the language that humans normally use in conversation. 【0185】 "Means of analysis" refers to the technology or process by which an information system understands natural language received as input and interprets its intent. 【0186】 "Emotional data" refers to information used to represent the emotional state inferred from a user's statements and actions. 【0187】 "Means for selecting operating procedures or settings" refers to technologies or mechanisms for determining the optimal operating method or system settings based on user instructions or emotions. 【0188】 "Means of adjusting the interface" refers to technologies that appropriately change the display and operating environment of an information system according to the user's emotions and intentions. 【0189】 A "large-scale language model" refers to an artificial intelligence model that learns from large amounts of text data and has the ability to understand and generate human language. 【0190】 An "emotion engine" refers to artificial intelligence technology that analyzes and recognizes emotions from user input and statements. 【0191】 To implement this invention, an interface is needed in the information system that enables natural language instructions and emotion recognition. The system receives natural language instructions from the user via a smart terminal. The terminal uses speech recognition software to convert the speech input into text and uses a large-scale language model to analyze the text data. 【0192】 To understand the user's emotional state, the device activates an emotion engine that generates emotional data based on the user's speech and actions. This data is then analyzed by the system to identify the user's current emotional state. 【0193】 The server determines the optimal operating procedure or settings based on analyzed natural language instructions and sentiment data. This process utilizes large-scale language models such as BERT and GPT-3®. The selected procedure or settings are then adjusted based on the user's emotions, affecting the interface display and the information provided. Specifically, if the user is experiencing stress, relevant help messages and reassuring information are displayed on the interface. 【0194】 In the final stage, the generated interface and work procedures are returned to the terminal, which then provides them to the user. As a result, the user can perform natural and intuitive operations, thereby efficiently achieving their goals in the specific application. 【0195】 For example, if a user enters "I want to reserve this park for the weekend" and feels anxious, the system will generate a message that explains the reservation procedure in detail and provides reassurance to the user. An example of a prompt that supports this process is: "If a citizen has concerns about using a facility, create a clear, step-by-step explanation of how to make a reservation and provide reassuring messages along the way." 【0196】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0197】 Step 1: 【0198】 The terminal receives voice input from the user and converts it into text data using speech recognition software. The input is voice data, and the output is text data. Here, speech is recognized and converted into a format that can be processed as a string. 【0199】 Step 2: 【0200】 The terminal passes the generated text data to a large-scale language model, which then analyzes the natural language instructions. This process involves data processing to analyze the text data and identify the user's intent. The input is text data, and the output is the analysis result. 【0201】 Step 3: 【0202】 The device analyzes the user's speech and actions and generates emotional data using an emotion engine. In this step, data calculations are performed to infer emotions from the input text and speech, and emotional data is output as a result. 【0203】 Step 4: 【0204】 The server receives the analysis results and sentiment data, and selects the optimal operating procedure or settings for the information system. Here, data processing is performed using the analysis results and sentiment data as input to determine the appropriate operating procedure. The output is the operating procedure or settings. 【0205】 Step 5: 【0206】 The server adjusts the interface based on the user's emotions. Specifically, it generates emotionally relevant help messages and reassuring information. The input is emotional data, and the output is an adjusted interface design. Here, data processing is performed to improve the user experience. 【0207】 Step 6: 【0208】 The server sends the generated operating instructions and the adjusted interface to the terminal. The terminal receives this and presents it to the user. Finally, the user receives the operating instructions in an executable format through the adjusted interface. The output is the interface information presented to the user. 【0209】 The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data. 【0210】 Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0211】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14. 【0212】 [Second Embodiment] 【0213】 Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment. 【0214】 As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server. 【0215】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0216】 The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52. 【0217】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0218】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0219】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0220】 Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0221】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0222】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0223】 In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0224】 Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal". 【0225】 This invention is a system that automatically converts user-inputted instructions in natural language into various operations on an electronic spreadsheet system. To implement this invention, a program with the following specific configuration is required. 【0226】 First, the user instructs the electronic spreadsheet system to perform a specific operation using natural language. For example, they might want to gray out rows where column A is marked "Completed." The user interface prompts the terminal to input this instruction in text format. 【0227】 Next, the terminal converts the input instructions into data and sends it to the server. The transmitted instructions are analyzed by a large-scale language model installed on the server to clarify the user's intended operation. Based on the analysis results, the server selects the specific functions and settings to be used in the electronic spreadsheet system. For example, if conditional formatting is used to gray out rows where column A is "Completed," the server detects the relevant words or expressions and adjusts the corresponding spreadsheet functions. 【0228】 Next, the server generates instructions on how the selected functions and settings should be executed in the electronic spreadsheet system. These instructions are written in API call or script format and sent from the server to the terminal. A concrete example is the instructions for setting conditional formatting. 【0229】 Finally, the terminal executes specific functions and settings on the electronic spreadsheet system based on the received instructions. This ensures that the data in the spreadsheet is processed and displayed as intended by the user. 【0230】 In this way, the present invention makes it possible to easily perform complex operations within an electronic spreadsheet system using natural language, even without specialized knowledge, thereby significantly improving the user's work efficiency. 【0231】 The following describes the processing flow. 【0232】 Step 1: 【0233】 Users input the desired actions in the electronic spreadsheet system using natural language. They enter specific instructions into the user interface, such as "Gray out rows where column A is marked 'Completed'." 【0234】 Step 2: 【0235】 The terminal receives natural language instructions from the user and sends them to the server as data. An appropriate protocol is used for reliable data transmission. 【0236】 Step 3: 【0237】 The server analyzes the received natural language instructions using a large-scale language model. This model understands the meaning of the instructions and performs keyword extraction and grammatical analysis to clarify the user's intent. 【0238】 Step 4: 【0239】 Based on the analysis results, the server selects the functions and settings to be applied in the electronic spreadsheet system. For example, it determines the specific steps to gray out the "Completed" row in column A using conditional formatting. 【0240】 Step 5: 【0241】 The server generates detailed instructions for applying the selected function or settings to the electronic spreadsheet system. These instructions, in the form of API calls or scripts, include specific steps for execution. 【0242】 Step 6: 【0243】 The server sends the generated procedure to the terminal. Stable data transmission is maintained throughout this process to prevent communication interruptions. 【0244】 Step 7: 【0245】 The terminal executes the appropriate functions and settings in the electronic spreadsheet system according to the instructions received from the server. It sets the specified conditional formatting to process and display the data as intended by the user. 【0246】 Step 8: 【0247】 The user can verify the applied spreadsheet settings and results on their device. This allows the user to confirm that the instructions were followed correctly and complete the task. 【0248】 (Example 1) 【0249】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0250】 Conventional electronic spreadsheet systems made it difficult for users to intuitively instruct complex operations using natural language. This resulted in a problem where users without specialized knowledge could not perform these operations efficiently. Furthermore, the lack of means to translate natural language input into specific operations within the electronic spreadsheet system led to decreased user efficiency. 【0251】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0252】 In this invention, the server includes information processing means for analyzing instructions input in natural language; information processing means for selecting functions or settings to be used in the computing system based on the analysis results; information processing means for executing the selected functions or settings on the computing system; information processing means for converting the analyzed instructions into a data format and transmitting them via a communication network; and information processing means for generating a procedure for executing functions or settings based on instructions received via the communication network. This enables users to efficiently perform operations within the electronic spreadsheet system using intuitive natural language, even without specialized knowledge. 【0253】 "Natural language" refers to the system of words that humans use in everyday life, and unlike formalized programming languages, it can include context and ambiguity. 【0254】 "Analysis" is the act of interpreting given data or instructions to clarify their meaning and purpose. 【0255】 "Information processing means" refers to systems or modules that receive, transform, analyze, and process data based on specific purposes. 【0256】 A "computational processing system" is an electronic platform for receiving information, performing calculations, analysis, and display. 【0257】 A "function" refers to the executable actions of individual operations or processes provided by a particular system or program. 【0258】 "Settings" refer to a set of conditions or parameters defined to control the operation of a system or program. 【0259】 A "communication network" is an infrastructure for sending and receiving data between multiple electronic devices. 【0260】 A "procedure" refers to a set of operations or steps established to achieve a specific objective. 【0261】 A "generative AI model" refers to an artificial intelligence model that uses machine learning techniques to learn patterns from large amounts of data and then performs inferences on new data. 【0262】 This invention provides a system that automates complex settings and function execution by allowing users to instruct operations in natural language within an electronic spreadsheet system. The following specific configuration is used for implementation. 【0263】 First, the user inputs instructions in natural language via the terminal. These natural language instructions are converted into data format on the terminal and sent to the server via the communication network. For example, the user can give instructions such as "gray out rows where column A is marked 'Completed'." 【0264】 Next, the server analyzes the received natural language instructions using a large-scale generative AI model. This could be a large-scale language model such as OpenAI. As a result of this analysis, the user's intended operation is clarified, and the necessary functions and settings for the computing system are identified. 【0265】 The information processing components included in the server select specific functions and settings to be used in the electronic spreadsheet system based on these analysis results. This selection allows users to easily execute complex commands. 【0266】 For example, if a user instructs a school report card to "display the grades of students with scores below 70 in red," the server can automatically perform this setting through analysis. An example of a prompt to the generating AI model would be, "Explain how to gray out rows that meet specific conditions using conditional formatting." 【0267】 In this way, the system enables even users without specialized knowledge to intuitively perform advanced operations within the electronic spreadsheet system, significantly improving work efficiency. 【0268】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0269】 Step 1: 【0270】 The user enters instructions in natural language. 【0271】 The user uses a terminal to input instructions for the electronic spreadsheet system in natural language. These instructions are in text format and might include something like, "Gray out rows where column A is marked 'Completed'." The input instructions are converted into data format on the terminal for subsequent processing. 【0272】 Step 2: 【0273】 The terminal converts the instructions into data and sends it to the server. 【0274】 The terminal converts natural language instructions input by the user into a machine-readable data format. This process involves pre-processing for natural language analysis, and the data is transmitted to the server via a communication network. The output is text data that can be parsed on the server side. 【0275】 Step 3: 【0276】 The server analyzes the instructions and clarifies the operation details. 【0277】 The server analyzes the received data using a generative AI model. Specifically, a large-scale language model deciphers the intent of natural language and identifies the required operations. The analysis extracts specific functions and settings to be executed in the electronic spreadsheet system. The output is information about the identified operations. 【0278】 Step 4: 【0279】 The server generates the execution procedure and sends it to the terminal. 【0280】 The server generates a procedure to perform the necessary operations based on the analysis results. This procedure is written in the form of API calls or scripts. The generated procedure is then sent back to the terminal via the communication network. The output is an execution procedure directed towards a specific operation. 【0281】 Step 5: 【0282】 The terminal operates the electronic spreadsheet system based on the execution procedure. 【0283】 Based on the received instructions, the terminal automatically executes the necessary functions and settings in the electronic spreadsheet system. Specific actions include applying conditional formatting and modifying formulas. This ensures that the user's instructed actions are executed within the spreadsheet software, yielding the desired results. The output reflects the results of the executed operations within the spreadsheet system. 【0284】 (Application Example 1) 【0285】 Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart glasses 214 are referred to as a "terminal". 【0286】 Conventionally, regarding the operation of information processing systems and automatic machines, for users without specialized knowledge, complex operations and settings have been difficult to understand, and it has been difficult to give instructions efficiently. Also, it has not been easy for machines to appropriately interpret voice instructions and automatically execute operations. 【0287】 The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0288】 In this invention, the server includes means for analyzing an instruction input in natural language, means for selecting a function or setting used in an information processing system based on the analysis result, means for executing the selected function or setting on the information processing system, means for converting a voice instruction into text, means for analyzing the instruction converted into text and generating an operation procedure for an automatic machine, and means for causing the automatic machine to execute the generated operation procedure. Thereby, the user can easily and efficiently operate an information processing system and an automatic machine using natural language and voice instructions. 【0289】 The "means for analyzing an instruction input in natural language" is a technology for receiving an instruction in natural language from a user, analyzing its content, and understanding the specific operation content. 【0290】 The "means for selecting a function or setting used in an information processing system" is a mechanism for selecting appropriate functions and settings for information processing based on the analyzed instruction content. 【0291】 The "means for executing on an information processing system" is a technology for actually applying the selected functions and settings on the information processing system and causing operations to be executed. 【0292】 "Means for converting voice instructions into text" refers to a device or technology that converts a user's voice instructions into textual information. 【0293】 "Means for analyzing instructions converted into text and generating operating procedures for automated machines" refers to a technology that analyzes instructions converted from speech into text and constructs specific operating procedures that automated machines should perform. 【0294】 "Means for having an automated machine execute the generated operation procedure" refers to a mechanism for transmitting the constructed operation procedure to an automated machine, allowing the machine to perform the operation based on its contents. 【0295】 A "server" is a computer system that performs tasks such as processing and analyzing information and selecting functions. 【0296】 One embodiment of this invention is a system for transmitting natural language instructions to an information processing system or automated machine. When a user gives instructions by voice via a smart device, those instructions are converted into text data by speech recognition software. Specific hardware such as smart glasses or a smartphone may be used. 【0297】 The server analyzes the received text data using a generative AI model to understand the user's intent. For example, OpenAI's GPT model is used as the generative AI model. Based on the analyzed instructions, the server determines the functions and settings to be used in the information processing system, or the operating procedures for automated machines. 【0298】 The terminal transmits the generated settings and operating procedures to the information processing system or automated machine, and ensures they are properly implemented. In this process, the terminal performs direct operations using APIs or scripts. 【0299】 For example, an operator in a factory gives a voice instruction through smart glasses saying "Move 10 parts to the next section." The server analyzes the instruction, generates the corresponding operation procedure, and causes the robot to execute it. In this process, the following prompt sentences are used as input examples to the generation AI model: 【0300】 "Please instruct the robot in the factory to carry the next 10 products to the next section." 【0301】 In this way, the system for implementing the invention efficiently analyzes natural language instructions from the user and converts them into operations of information processing systems and automatic machines, thereby achieving simplification and automation of operations. 【0302】 The flow of specific processing in Application Example 1 will be described using FIG. 12. 【0303】 Step 1: 【0304】 The user gives an instruction by voice through a smart device. The voice data is captured by the device's microphone and converted into text data by voice recognition software. In this process, the input is the user's voice instruction, and the output is the text data. A texturized instruction is generated. 【0305】 Step 2: 【0306】 The terminal sends the text data to the server. The server uses a generation AI model specialized in text analysis (for example, the GPT model) to perform analysis to understand the user's instruction. The input is the text data, and the output is the semantic information of the analyzed instruction. The model analyzes natural language into a form that can be understood by the machine. 【0307】 Step 3: 【0308】 The server determines the appropriate functions or operating procedures to be executed by the information processing system or automated machine based on the analyzed instructions. The input is the analysis result, and the output is a specific operating procedure or API call. In this process, the necessary function settings and operating procedures are selected depending on the analysis result. 【0309】 Step 4: 【0310】 The terminal transmits the operating instructions received from the server to automated machines or information processing systems. The input is the operating instructions from the server, and the output is the specific command or API request to be executed. The terminal issues operating commands to the actual system or machine. 【0311】 Step 5: 【0312】 An information processing system or automated machine initiates actual operation based on communicated procedures. The output is the result of the system or machine's operation. Specifically, a robot in a factory automatically performs tasks such as moving products. 【0313】 This series of processing steps enables users to easily operate systems and machines using natural language. 【0314】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0315】 This invention provides a system that allows users to instruct operations on an electronic spreadsheet system using natural language, recognizes the user's emotions, and adjusts the interface and suggested content accordingly. This system is comprised of a combination of natural language processing, an emotion engine, a large-scale language model, and an electronic spreadsheet system. 【0316】 When a user inputs instructions in natural language to perform an operation on an electronic spreadsheet system, the user interface collects these instructions and inputs them into the terminal. Simultaneously, the terminal performs emotion recognition to infer the user's emotions from their input and speech. This process allows the terminal to process the user's emotions as data. 【0317】 Subsequently, the device sends the recognized emotion data to the server along with the user's natural language instructions. The server uses a large-scale language model to analyze the instructions and clarify their intent. Simultaneously, based on the recognized emotions, the selection of suggested functions and settings is adjusted; for example, simple and easy-to-understand suggestions are provided for positive emotions, and supportive suggestions for negative emotions. 【0318】 Based on the analysis results, the server selects the functions and settings to be used in the electronic spreadsheet system. It also adjusts the interface to improve the user experience based on emotions. For example, if it determines that the user is experiencing stress, it can provide supplementary information such as displaying a help message on the interface. 【0319】 Along with the generated procedures, this adjusted information is sent to the terminal. The terminal then configures the electronic spreadsheet system and executes functions based on the information sent from the server, while simultaneously providing the user with the adjusted interface. 【0320】 In this way, users can easily perform operations on the spreadsheet even without specialized knowledge, and furthermore, a dynamic interface that takes into account the user's emotional state allows them to continue working more comfortably. For example, if a user enters "I want to compare column B using the VLOOKUP function based on column C," and the emotion engine determines that the user is anxious, the terminal can support the user by displaying hints and examples on how to use the VLOOKUP function. 【0321】 The following describes the processing flow. 【0322】 Step 1: 【0323】 The user provides instructions for operating the electronic spreadsheet system using natural language. Specific instructions, such as "I want to gray out rows where column A is marked 'Completed'," are entered into the user interface. 【0324】 Step 2: 【0325】 The device receives natural language instructions from the user and simultaneously recognizes emotions through analysis of the user's facial expressions and input tone. The emotion engine then records the user's emotional state as data. 【0326】 Step 3: 【0327】 The device sends collected natural language instructions and recognized sentiment data to the server. This transmission process uses appropriate protocols to maintain data integrity. 【0328】 Step 4: 【0329】 The server uses a large-scale language model to analyze the received natural language instructions. It clarifies the content of the instructions and prepares them for specific operations in the electronic spreadsheet system. 【0330】 Step 5: 【0331】 The server selects the appropriate functions and settings based on the analysis results and the perceived emotions of the user. If the server determines that the user is stressed, it will select the simplest and most user-friendly option. 【0332】 Step 6: 【0333】 The server generates the steps to be executed based on the selected functions and settings. Furthermore, it creates help messages and support information to display on the interface according to the user's emotional state. 【0334】 Step 7: 【0335】 The server sends the generated instructions and supporting information to the terminal. A protocol is used to ensure the security of the communication during the transmission of this information. 【0336】 Step 8: 【0337】 The terminal performs configuration and function execution in the electronic spreadsheet system according to the received instructions. It also displays necessary support information on the interface based on the user's mood. 【0338】 Step 9: 【0339】 Users can easily verify the results of applied functions and settings via their device. Emotion-responsive support information allows them to proceed with confidence. 【0340】 (Example 2) 【0341】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal". 【0342】 In modern information processing systems, users make sophisticated and diverse requests using natural language, but it has been difficult for systems to accurately understand their intentions and respond appropriately. Furthermore, there has been a lack of mechanisms to adjust interfaces and provide support tailored to individual needs, taking into account the user's emotional state. As a result, a challenge has been the inability of users to receive appropriate support when they experience anxiety or stress. 【0343】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0344】 In this invention, the server includes means for analyzing instructions input in natural language, means for recognizing the user's emotions, and means for selecting functions or settings based on the analysis results and emotion data. This makes it possible to adjust the dynamic interface to take the user's emotions into consideration and to make appropriate suggestions. 【0345】 "Natural language" refers to the language that humans use on a daily basis, and is a linguistic form used by computer systems to understand and analyze it. 【0346】 "Emotional data" refers to data that quantifies or analyzes a user's emotional state and can be used by a system. 【0347】 An "information processing system" is a complete system that includes hardware and software for performing assigned tasks and various processing operations. 【0348】 "Function or setting" refers to a set of actions or the necessary environmental components for performing a specific task in an information processing system. 【0349】 "User interface" refers to the screen configuration and operating devices that enable the user and the system to communicate with each other, and includes display elements that improve the user experience. 【0350】 A "suggestion" is a recommendation or option presented by the system in response to the user's requests and circumstances, intended to support the user's actions. 【0351】 This invention provides an information processing system that allows users to give instructions in natural language and enables the system to recognize user emotions and adjust the interface and suggestions accordingly. This system is comprised of a combination of natural language processing, an emotion engine, a large-scale language model, and an information processing system. 【0352】 The terminal receives natural language instructions entered by the user. If the user enters "I want to compare column B using the VLOOKUP function based on column C," the terminal processes this instruction. In this process, the terminal uses an emotion engine to recognize the user's emotions and processes the resulting emotion data. Emotion recognition uses techniques that employ tone analysis of speech and text to quantify emotions. 【0353】 The terminal sends user instructions and sentiment data to the server. The server uses a generative AI model to analyze the instructions and clarify the user's intent. This analysis is specifically performed by interpreting the instructions and creating appropriate prompt statements. An example of a prompt statement here would be: "Analyze the following instructions and make appropriate suggestions based on the user's sentiment: 'I want to compare column B using the VLOOKUP function based on column C'." 【0354】 Based on the analysis results and sentiment data, the server selects functions and settings appropriate for the user and adjusts and provides appropriate suggestions. For example, if the analysis indicates that the user is feeling anxious, the system enhances support for the user by displaying hints on how to use the VLOOKUP function through the terminal. 【0355】 This process allows users to efficiently use information processing systems even without specialized knowledge, and to operate them with confidence through an emotionally sensitive interface. 【0356】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0357】 Step 1: 【0358】 The user provides instructions for the information processing system using natural language. This input is received through the terminal's user interface and collected as text on the terminal. An example of natural language input is, "I want to compare column B with column C using the VLOOKUP function." At this stage, the output is the user's natural language instruction data. 【0359】 Step 2: 【0360】 The device recognizes the user's emotions using an emotion engine. Specifically, the device performs voice tone analysis and text analysis to quantify the user's emotions. The emotion data is then stored digitally within the device. The input for this step is the user's text instructions and voice data, and the output is emotion data. 【0361】 Step 3: 【0362】 The terminal packages both the user-inputted instructions and recognized emotion data and sends them to the server. This data package, containing both the instructions and the emotional state, serves as the basis for the server's subsequent analysis steps. The input consists of natural language instructions and emotion data, while the output is the data package transferred to the server. 【0363】 Step 4: 【0364】 The server analyzes the received instructions using a large-scale language model. The server clarifies the intent of the instructions by inputting prompts into a generative AI model. Specifically, it generates prompts in the form of "Analyze the following instructions and make appropriate suggestions based on the user's sentiment: 'I want to compare column B using the VLOOKUP function based on column C'" and inputs them into the model. In this process, the input is instructions and sentiment data, and the output is the analyzed instruction data. 【0365】 Step 5: 【0366】 The server selects appropriate functions and settings and adjusts the suggestions based on the analyzed instructions and sentiment data. Depending on the sentiment data, for example, if the user is feeling anxious, it provides reassurance to the user by adding multi-level support. The input for this step is the analyzed instruction data, and the output is the adjusted suggestion information and settings. 【0367】 Step 6: 【0368】 The adjusted suggestion information and settings are sent from the server to the terminal. The terminal receives this information and executes the appropriate function on the user interface while simultaneously displaying suggestions. Specifically, it displays examples and hints for using the VLOOKUP function. The input is the adjusted data, and the output is the execution result and advice displayed for the user. 【0369】 (Application Example 2) 【0370】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0371】 In modern information systems, a challenge faced by diverse users is the limited means of instructing them to operate the system using natural language. Furthermore, the lack of emotionally responsive interface adjustments results in a uniform user experience, making it difficult to address individual needs. 【0372】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0373】 In this invention, the server includes means for analyzing instructions input in natural language, means for selecting an operating procedure or setting in the information system based on the analysis results and recognized emotion data, and means for executing the selected operating procedure or setting and adjusting the interface of the information system. This enables the user to operate intuitively while receiving optimal support tailored to their emotional state. 【0374】 "Instructions entered in natural language" refers to operations or requests made to an information system using the language that humans normally use in conversation. 【0375】 "Means of analysis" refers to the technology or process by which an information system understands natural language received as input and interprets its intent. 【0376】 "Emotional data" refers to information used to represent the emotional state inferred from a user's statements and actions. 【0377】 "Means for selecting operating procedures or settings" refers to technologies or mechanisms for determining the optimal operating method or system settings based on user instructions or emotions. 【0378】 "Means of adjusting the interface" refers to technologies that appropriately change the display and operating environment of an information system according to the user's emotions and intentions. 【0379】 A "large-scale language model" refers to an artificial intelligence model that learns from large amounts of text data and has the ability to understand and generate human language. 【0380】 An "emotion engine" refers to artificial intelligence technology that analyzes and recognizes emotions from user input and statements. 【0381】 To implement this invention, an interface is needed in the information system that enables natural language instructions and emotion recognition. The system receives natural language instructions from the user via a smart terminal. The terminal uses speech recognition software to convert the speech input into text and uses a large-scale language model to analyze the text data. 【0382】 To understand the user's emotional state, the device activates an emotion engine that generates emotional data based on the user's speech and actions. This data is then analyzed by the system to identify the user's current emotional state. 【0383】 The server determines the optimal operating procedure or settings based on analyzed natural language instructions and sentiment data. Large-scale language models such as BERT and GPT-3 are used in this process. The selected procedure or settings are then adjusted based on the user's emotions, affecting the interface display and the information provided. Specifically, if the user is experiencing stress, relevant help messages and reassuring information are displayed on the interface. 【0384】 In the final stage, the generated interface and work procedures are returned to the terminal, which then provides them to the user. As a result, the user can perform natural and intuitive operations, thereby efficiently achieving their goals in the specific application. 【0385】 For example, if a user enters "I want to reserve this park for the weekend" and feels anxious, the system will generate a message that explains the reservation procedure in detail and provides reassurance to the user. An example of a prompt that supports this process is: "If a citizen has concerns about using a facility, create a clear, step-by-step explanation of how to make a reservation and provide reassuring messages along the way." 【0386】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0387】 Step 1: 【0388】 The terminal receives voice input from the user and converts it into text data using speech recognition software. The input is voice data, and the output is text data. Here, speech is recognized and converted into a format that can be processed as a string. 【0389】 Step 2: 【0390】 The terminal passes the generated text data to a large-scale language model, which then analyzes the natural language instructions. This process involves data processing to analyze the text data and identify the user's intent. The input is text data, and the output is the analysis result. 【0391】 Step 3: 【0392】 The device analyzes the user's speech and actions and generates emotional data using an emotion engine. In this step, data calculations are performed to infer emotions from the input text and speech, and emotional data is output as a result. 【0393】 Step 4: 【0394】 The server receives the analysis results and sentiment data, and selects the optimal operating procedure or settings for the information system. Here, data processing is performed using the analysis results and sentiment data as input to determine the appropriate operating procedure. The output is the operating procedure or settings. 【0395】 Step 5: 【0396】 The server adjusts the interface based on the user's emotions. Specifically, it generates emotionally relevant help messages and reassuring information. The input is emotional data, and the output is an adjusted interface design. Here, data processing is performed to improve the user experience. 【0397】 Step 6: 【0398】 The server sends the generated operating instructions and the adjusted interface to the terminal. The terminal receives this and presents it to the user. Finally, the user receives the operating instructions in an executable format through the adjusted interface. The output is the interface information presented to the user. 【0399】 The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0400】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0401】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214. 【0402】 [Third Embodiment] 【0403】 Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment. 【0404】 As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server. 【0405】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0406】 The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52. 【0407】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0408】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0409】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0410】 Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0411】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0412】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0413】 In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0414】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal". 【0415】 This invention is a system that automatically converts user-inputted instructions in natural language into various operations on an electronic spreadsheet system. To implement this invention, a program with the following specific configuration is required. 【0416】 First, the user instructs the electronic spreadsheet system to perform a specific operation using natural language. For example, they might want to gray out rows where column A is marked "Completed." The user interface prompts the terminal to input this instruction in text format. 【0417】 Next, the terminal converts the input instructions into data and sends it to the server. The transmitted instructions are analyzed by a large-scale language model installed on the server to clarify the user's intended operation. Based on the analysis results, the server selects the specific functions and settings to be used in the electronic spreadsheet system. For example, if conditional formatting is used to gray out rows where column A is "Completed," the server detects the relevant words or expressions and adjusts the corresponding spreadsheet functions. 【0418】 Next, the server generates instructions on how the selected functions and settings should be executed in the electronic spreadsheet system. These instructions are written in API call or script format and sent from the server to the terminal. A concrete example is the instructions for setting conditional formatting. 【0419】 Finally, the terminal executes specific functions and settings on the electronic spreadsheet system based on the received instructions. This ensures that the data in the spreadsheet is processed and displayed as intended by the user. 【0420】 In this way, the present invention makes it possible to easily perform complex operations within an electronic spreadsheet system using natural language, even without specialized knowledge, thereby significantly improving the user's work efficiency. 【0421】 The following describes the processing flow. 【0422】 Step 1: 【0423】 Users input the desired actions in the electronic spreadsheet system using natural language. They enter specific instructions into the user interface, such as "Gray out rows where column A is marked 'Completed'." 【0424】 Step 2: 【0425】 The terminal receives natural language instructions from the user and sends them to the server as data. An appropriate protocol is used for reliable data transmission. 【0426】 Step 3: 【0427】 The server analyzes the received natural language instructions using a large-scale language model. This model understands the meaning of the instructions and performs keyword extraction and grammatical analysis to clarify the user's intent. 【0428】 Step 4: 【0429】 Based on the analysis results, the server selects the functions and settings to be applied in the electronic spreadsheet system. For example, it determines the specific steps to gray out the "Completed" row in column A using conditional formatting. 【0430】 Step 5: 【0431】 The server generates detailed instructions for applying the selected function or settings to the electronic spreadsheet system. These instructions, in the form of API calls or scripts, include specific steps for execution. 【0432】 Step 6: 【0433】 The server sends the generated procedure to the terminal. Stable data transmission is maintained throughout this process to prevent communication interruptions. 【0434】 Step 7: 【0435】 The terminal executes the appropriate functions and settings in the electronic spreadsheet system according to the instructions received from the server. It sets the specified conditional formatting to process and display the data as intended by the user. 【0436】 Step 8: 【0437】 The user can verify the applied spreadsheet settings and results on their device. This allows the user to confirm that the instructions were followed correctly and complete the task. 【0438】 (Example 1) 【0439】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0440】 Conventional electronic spreadsheet systems made it difficult for users to intuitively instruct complex operations using natural language. This resulted in a problem where users without specialized knowledge could not perform these operations efficiently. Furthermore, the lack of means to translate natural language input into specific operations within the electronic spreadsheet system led to decreased user efficiency. 【0441】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0442】 In this invention, the server includes information processing means for analyzing instructions input in natural language; information processing means for selecting functions or settings to be used in the computing system based on the analysis results; information processing means for executing the selected functions or settings on the computing system; information processing means for converting the analyzed instructions into a data format and transmitting them via a communication network; and information processing means for generating a procedure for executing functions or settings based on instructions received via the communication network. This enables users to efficiently perform operations within the electronic spreadsheet system using intuitive natural language, even without specialized knowledge. 【0443】 "Natural language" refers to the system of words that humans use in everyday life, and unlike formalized programming languages, it can include context and ambiguity. 【0444】 "Analysis" is the act of interpreting given data or instructions to clarify their meaning and purpose. 【0445】 "Information processing means" refers to systems or modules that receive, transform, analyze, and process data based on specific purposes. 【0446】 A "computational processing system" is an electronic platform for receiving information, performing calculations, analysis, and display. 【0447】 A "function" refers to the executable actions of individual operations or processes provided by a particular system or program. 【0448】 "Settings" refer to a set of conditions or parameters defined to control the operation of a system or program. 【0449】 A "communication network" is an infrastructure for sending and receiving data between multiple electronic devices. 【0450】 A "procedure" refers to a set of operations or steps established to achieve a specific objective. 【0451】 A "generative AI model" refers to an artificial intelligence model that uses machine learning techniques to learn patterns from large amounts of data and then performs inferences on new data. 【0452】 This invention provides a system that automates complex settings and function execution by allowing users to instruct operations in natural language within an electronic spreadsheet system. The following specific configuration is used for implementation. 【0453】 First, the user inputs instructions in natural language via the terminal. These natural language instructions are converted into data format on the terminal and sent to the server via the communication network. For example, the user can give instructions such as "gray out rows where column A is marked 'Completed'." 【0454】 Next, the server analyzes the received natural language instructions using a large-scale generative AI model. This could be a large-scale language model such as OpenAI. As a result of this analysis, the user's intended operation is clarified, and the necessary functions and settings for the computing system are identified. 【0455】 The information processing components included in the server select specific functions and settings to be used in the electronic spreadsheet system based on these analysis results. This selection allows users to easily execute complex commands. 【0456】 For example, if a user instructs a school report card to "display the grades of students with scores below 70 in red," the server can automatically perform this setting through analysis. An example of a prompt to the generating AI model would be, "Explain how to gray out rows that meet specific conditions using conditional formatting." 【0457】 In this way, the system enables even users without specialized knowledge to intuitively perform advanced operations within the electronic spreadsheet system, significantly improving work efficiency. 【0458】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0459】 Step 1: 【0460】 The user enters instructions in natural language. 【0461】 The user uses a terminal to input instructions for the electronic spreadsheet system in natural language. These instructions are in text format and might include something like, "Gray out rows where column A is marked 'Completed'." The input instructions are converted into data format on the terminal for subsequent processing. 【0462】 Step 2: 【0463】 The terminal converts the instructions into data and sends it to the server. 【0464】 The terminal converts natural language instructions input by the user into a machine-readable data format. This process involves pre-processing for natural language analysis, and the data is transmitted to the server via a communication network. The output is text data that can be parsed on the server side. 【0465】 Step 3: 【0466】 The server analyzes the instructions and clarifies the operation details. 【0467】 The server analyzes the received data using a generative AI model. Specifically, a large-scale language model deciphers the intent of natural language and identifies the required operations. The analysis extracts specific functions and settings to be executed in the electronic spreadsheet system. The output is information about the identified operations. 【0468】 Step 4: 【0469】 The server generates the execution procedure and sends it to the terminal. 【0470】 The server generates a procedure to perform the necessary operations based on the analysis results. This procedure is written in the form of API calls or scripts. The generated procedure is then sent back to the terminal via the communication network. The output is an execution procedure directed towards a specific operation. 【0471】 Step 5: 【0472】 The terminal operates the electronic spreadsheet system based on the execution procedure. 【0473】 Based on the received instructions, the terminal automatically executes the necessary functions and settings in the electronic spreadsheet system. Specific actions include applying conditional formatting and modifying formulas. This ensures that the user's instructed actions are executed within the spreadsheet software, yielding the desired results. The output reflects the results of the executed operations within the spreadsheet system. 【0474】 (Application Example 1) 【0475】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0476】 Traditionally, for users without specialized knowledge, operating information processing systems and automated machinery has been difficult due to the complexity of the operations and settings, making it challenging to give efficient instructions. Furthermore, it has not been easy for machines to properly interpret voice commands and execute actions automatically. 【0477】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0478】 In this invention, the server includes means for analyzing instructions input in natural language, means for selecting functions or settings to be used in the information processing system based on the analysis results, means for executing the selected functions or settings on the information processing system, means for converting voice instructions into text, means for analyzing the converted instructions into text and generating an operating procedure for an automated machine, and means for causing the automated machine to execute the generated operating procedure. This makes it possible for users to easily and efficiently operate the information processing system and automated machines using natural language or voice instructions. 【0479】 "Means for analyzing instructions entered in natural language" refers to technologies that receive instructions from users in natural language, analyze their content, and understand the specific actions to be performed. 【0480】 "Means for selecting functions or settings used in an information processing system" refers to a mechanism that selects appropriate functions or settings for information processing based on the analyzed instructions. 【0481】 "Means of execution on an information processing system" refers to the technology of actually applying selected functions and settings on an information processing system and executing the operation. 【0482】 "Means for converting voice instructions into text" refers to a device or technology that converts a user's voice instructions into textual information. 【0483】 "Means for analyzing instructions converted into text and generating operating procedures for automated machines" refers to a technology that analyzes instructions converted from speech into text and constructs specific operating procedures that automated machines should perform. 【0484】 "Means for having an automated machine execute the generated operation procedure" refers to a mechanism for transmitting the constructed operation procedure to an automated machine, allowing the machine to perform the operation based on its contents. 【0485】 A "server" is a computer system that performs tasks such as processing and analyzing information and selecting functions. 【0486】 One embodiment of this invention is a system for transmitting natural language instructions to an information processing system or automated machine. When a user gives instructions by voice via a smart device, those instructions are converted into text data by speech recognition software. Specific hardware such as smart glasses or a smartphone may be used. 【0487】 The server analyzes the received text data using a generative AI model to understand the user's intent. For example, OpenAI's GPT model is used as the generative AI model. Based on the analyzed instructions, the server determines the functions and settings to be used in the information processing system, or the operating procedures for automated machines. 【0488】 The terminal transmits the generated settings and operating procedures to the information processing system or automated machine, and ensures they are properly implemented. In this process, the terminal performs direct operations using APIs or scripts. 【0489】 To give a concrete example, a worker in a factory gives a voice command through smart glasses, saying, "Move 10 parts to the next section." The server analyzes the command, generates the corresponding action procedure, and has a robot execute it. In this process, the following prompt sentences are used as example inputs to the generating AI model: 【0490】 "Instruct the robots in the factory to transport the next 10 products to the next section." 【0491】 Thus, the system implementing the invention efficiently analyzes natural language instructions from the user and converts them into operations for the information processing system and automated machines, thereby achieving simplification and automation of operations. 【0492】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0493】 Step 1: 【0494】 The user gives voice instructions via a smart device. The voice data is captured by the device's microphone and converted into text data by speech recognition software. In this process, the input is the user's voice instructions, and the output is text data. Texted instructions are generated. 【0495】 Step 2: 【0496】 The terminal sends text data to the server. The server uses a generative AI model specialized in text analysis (e.g., the GPT model) to perform analysis to understand the user's instructions. The input is text data, and the output is semantic information of the analyzed instructions. The model analyzes natural language into a machine-understandable format. 【0497】 Step 3: 【0498】 The server determines the appropriate functions or operating procedures to be executed by the information processing system or automated machine based on the analyzed instructions. The input is the analysis result, and the output is a specific operating procedure or API call. In this process, the necessary function settings and operating procedures are selected depending on the analysis result. 【0499】 Step 4: 【0500】 The terminal transmits the operating instructions received from the server to automated machines or information processing systems. The input is the operating instructions from the server, and the output is the specific command or API request to be executed. The terminal issues operating commands to the actual system or machine. 【0501】 Step 5: 【0502】 An information processing system or automated machine initiates actual operation based on communicated procedures. The output is the result of the system or machine's operation. Specifically, a robot in a factory automatically performs tasks such as moving products. 【0503】 This series of processing steps enables users to easily operate systems and machines using natural language. 【0504】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0505】 This invention provides a system that allows users to instruct operations on an electronic spreadsheet system using natural language, recognizes the user's emotions, and adjusts the interface and suggested content accordingly. This system is comprised of a combination of natural language processing, an emotion engine, a large-scale language model, and an electronic spreadsheet system. 【0506】 When a user inputs instructions in natural language to perform an operation on an electronic spreadsheet system, the user interface collects these instructions and inputs them into the terminal. Simultaneously, the terminal performs emotion recognition to infer the user's emotions from their input and speech. This process allows the terminal to process the user's emotions as data. 【0507】 Subsequently, the device sends the recognized emotion data to the server along with the user's natural language instructions. The server uses a large-scale language model to analyze the instructions and clarify their intent. Simultaneously, based on the recognized emotions, the selection of suggested functions and settings is adjusted; for example, simple and easy-to-understand suggestions are provided for positive emotions, and supportive suggestions for negative emotions. 【0508】 Based on the analysis results, the server selects the functions and settings to be used in the electronic spreadsheet system. It also adjusts the interface to improve the user experience based on emotions. For example, if it determines that the user is experiencing stress, it can provide supplementary information such as displaying a help message on the interface. 【0509】 Along with the generated procedures, this adjusted information is sent to the terminal. The terminal then configures the electronic spreadsheet system and executes functions based on the information sent from the server, while simultaneously providing the user with the adjusted interface. 【0510】 In this way, users can easily perform operations on the spreadsheet even without specialized knowledge, and furthermore, a dynamic interface that takes into account the user's emotional state allows them to continue working more comfortably. For example, if a user enters "I want to compare column B using the VLOOKUP function based on column C," and the emotion engine determines that the user is anxious, the terminal can support the user by displaying hints and examples on how to use the VLOOKUP function. 【0511】 The following describes the processing flow. 【0512】 Step 1: 【0513】 The user provides instructions for operating the electronic spreadsheet system using natural language. Specific instructions, such as "I want to gray out rows where column A is marked 'Completed'," are entered into the user interface. 【0514】 Step 2: 【0515】 The device receives natural language instructions from the user and simultaneously recognizes emotions through analysis of the user's facial expressions and input tone. The emotion engine then records the user's emotional state as data. 【0516】 Step 3: 【0517】 The device sends collected natural language instructions and recognized sentiment data to the server. This transmission process uses appropriate protocols to maintain data integrity. 【0518】 Step 4: 【0519】 The server uses a large-scale language model to analyze the received natural language instructions. It clarifies the content of the instructions and prepares them for specific operations in the electronic spreadsheet system. 【0520】 Step 5: 【0521】 The server selects the appropriate functions and settings based on the analysis results and the perceived emotions of the user. If the server determines that the user is stressed, it will select the simplest and most user-friendly option. 【0522】 Step 6: 【0523】 The server generates the steps to be executed based on the selected functions and settings. Furthermore, it creates help messages and support information to display on the interface according to the user's emotional state. 【0524】 Step 7: 【0525】 The server sends the generated instructions and supporting information to the terminal. A protocol is used to ensure the security of the communication during the transmission of this information. 【0526】 Step 8: 【0527】 The terminal performs configuration and function execution in the electronic spreadsheet system according to the received instructions. It also displays necessary support information on the interface based on the user's mood. 【0528】 Step 9: 【0529】 Users can easily verify the results of applied functions and settings via their device. Emotion-responsive support information allows them to proceed with confidence. 【0530】 (Example 2) 【0531】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0532】 In modern information processing systems, users make sophisticated and diverse requests using natural language, but it has been difficult for systems to accurately understand their intentions and respond appropriately. Furthermore, there has been a lack of mechanisms to adjust interfaces and provide support tailored to individual needs, taking into account the user's emotional state. As a result, a challenge has been the inability of users to receive appropriate support when they experience anxiety or stress. 【0533】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0534】 In this invention, the server includes means for analyzing instructions input in natural language, means for recognizing the user's emotions, and means for selecting functions or settings based on the analysis results and emotion data. This makes it possible to adjust the dynamic interface to take the user's emotions into consideration and to make appropriate suggestions. 【0535】 "Natural language" refers to the language that humans use on a daily basis, and is a linguistic form used by computer systems to understand and analyze it. 【0536】 "Emotional data" refers to data that quantifies or analyzes a user's emotional state and can be used by a system. 【0537】 An "information processing system" is a complete system that includes hardware and software for performing assigned tasks and various processing operations. 【0538】 "Function or setting" refers to a set of actions or the necessary environmental components for performing a specific task in an information processing system. 【0539】 "User interface" refers to the screen configuration and operating devices that enable the user and the system to communicate with each other, and includes display elements that improve the user experience. 【0540】 A "suggestion" is a recommendation or option presented by the system in response to the user's requests and circumstances, intended to support the user's actions. 【0541】 This invention provides an information processing system that allows users to give instructions in natural language and enables the system to recognize user emotions and adjust the interface and suggestions accordingly. This system is comprised of a combination of natural language processing, an emotion engine, a large-scale language model, and an information processing system. 【0542】 The terminal receives natural language instructions entered by the user. If the user enters "I want to compare column B using the VLOOKUP function based on column C," the terminal processes this instruction. In this process, the terminal uses an emotion engine to recognize the user's emotions and processes the resulting emotion data. Emotion recognition uses techniques that employ tone analysis of speech and text to quantify emotions. 【0543】 The terminal sends user instructions and sentiment data to the server. The server uses a generative AI model to analyze the instructions and clarify the user's intent. This analysis is specifically performed by interpreting the instructions and creating appropriate prompt statements. An example of a prompt statement here would be: "Analyze the following instructions and make appropriate suggestions based on the user's sentiment: 'I want to compare column B using the VLOOKUP function based on column C'." 【0544】 Based on the analysis results and sentiment data, the server selects functions and settings appropriate for the user and adjusts and provides appropriate suggestions. For example, if the analysis indicates that the user is feeling anxious, the system enhances support for the user by displaying hints on how to use the VLOOKUP function through the terminal. 【0545】 This process allows users to efficiently use information processing systems even without specialized knowledge, and to operate them with confidence through an emotionally sensitive interface. 【0546】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0547】 Step 1: 【0548】 The user provides instructions for the information processing system using natural language. This input is received through the terminal's user interface and collected as text on the terminal. An example of natural language input is, "I want to compare column B with column C using the VLOOKUP function." At this stage, the output is the user's natural language instruction data. 【0549】 Step 2: 【0550】 The device recognizes the user's emotions using an emotion engine. Specifically, the device performs voice tone analysis and text analysis to quantify the user's emotions. The emotion data is then stored digitally within the device. The input for this step is the user's text instructions and voice data, and the output is emotion data. 【0551】 Step 3: 【0552】 The terminal packages both the user-inputted instructions and recognized emotion data and sends them to the server. This data package, containing both the instructions and the emotional state, serves as the basis for the server's subsequent analysis steps. The input consists of natural language instructions and emotion data, while the output is the data package transferred to the server. 【0553】 Step 4: 【0554】 The server analyzes the received instructions using a large-scale language model. The server clarifies the intent of the instructions by inputting prompts into a generative AI model. Specifically, it generates prompts in the form of "Analyze the following instructions and make appropriate suggestions based on the user's sentiment: 'I want to compare column B using the VLOOKUP function based on column C'" and inputs them into the model. In this process, the input is instructions and sentiment data, and the output is the analyzed instruction data. 【0555】 Step 5: 【0556】 The server selects appropriate functions and settings and adjusts the suggestions based on the analyzed instructions and sentiment data. Depending on the sentiment data, for example, if the user is feeling anxious, it provides reassurance to the user by adding multi-level support. The input for this step is the analyzed instruction data, and the output is the adjusted suggestion information and settings. 【0557】 Step 6: 【0558】 The adjusted suggestion information and settings are sent from the server to the terminal. The terminal receives this information and executes the appropriate function on the user interface while simultaneously displaying suggestions. Specifically, it displays examples and hints for using the VLOOKUP function. The input is the adjusted data, and the output is the execution result and advice displayed for the user. 【0559】 (Application Example 2) 【0560】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0561】 In modern information systems, a challenge faced by diverse users is the limited means of instructing them to operate the system using natural language. Furthermore, the lack of emotionally responsive interface adjustments results in a uniform user experience, making it difficult to address individual needs. 【0562】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0563】 In this invention, the server includes means for analyzing instructions input in natural language, means for selecting an operating procedure or setting in the information system based on the analysis results and recognized emotion data, and means for executing the selected operating procedure or setting and adjusting the interface of the information system. This enables the user to operate intuitively while receiving optimal support tailored to their emotional state. 【0564】 "Instructions entered in natural language" refers to operations or requests made to an information system using the language that humans normally use in conversation. 【0565】 "Means of analysis" refers to the technology or process by which an information system understands natural language received as input and interprets its intent. 【0566】 "Emotional data" refers to information used to represent the emotional state inferred from a user's statements and actions. 【0567】 "Means for selecting operating procedures or settings" refers to technologies or mechanisms for determining the optimal operating method or system settings based on user instructions or emotions. 【0568】 "Means of adjusting the interface" refers to technologies that appropriately change the display and operating environment of an information system according to the user's emotions and intentions. 【0569】 A "large-scale language model" refers to an artificial intelligence model that learns from large amounts of text data and has the ability to understand and generate human language. 【0570】 An "emotion engine" refers to artificial intelligence technology that analyzes and recognizes emotions from user input and statements. 【0571】 To implement this invention, an interface is needed in the information system that enables natural language instructions and emotion recognition. The system receives natural language instructions from the user via a smart terminal. The terminal uses speech recognition software to convert the speech input into text and uses a large-scale language model to analyze the text data. 【0572】 To understand the user's emotional state, the device activates an emotion engine that generates emotional data based on the user's speech and actions. This data is then analyzed by the system to identify the user's current emotional state. 【0573】 The server determines the optimal operating procedure or settings based on analyzed natural language instructions and sentiment data. Large-scale language models such as BERT and GPT-3 are used in this process. The selected procedure or settings are then adjusted based on the user's emotions, affecting the interface display and the information provided. Specifically, if the user is experiencing stress, relevant help messages and reassuring information are displayed on the interface. 【0574】 In the final stage, the generated interface and work procedures are returned to the terminal, which then provides them to the user. As a result, the user can perform natural and intuitive operations, thereby efficiently achieving their goals in the specific application. 【0575】 For example, if a user enters "I want to reserve this park for the weekend" and feels anxious, the system will generate a message that explains the reservation procedure in detail and provides reassurance to the user. An example of a prompt that supports this process is: "If a citizen has concerns about using a facility, create a clear, step-by-step explanation of how to make a reservation and provide reassuring messages along the way." 【0576】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0577】 Step 1: 【0578】 The terminal receives voice input from the user and converts it into text data using speech recognition software. The input is voice data, and the output is text data. Here, speech is recognized and converted into a format that can be processed as a string. 【0579】 Step 2: 【0580】 The terminal passes the generated text data to a large-scale language model, which then analyzes the natural language instructions. This process involves data processing to analyze the text data and identify the user's intent. The input is text data, and the output is the analysis result. 【0581】 Step 3: 【0582】 The device analyzes the user's speech and actions and generates emotional data using an emotion engine. In this step, data calculations are performed to infer emotions from the input text and speech, and emotional data is output as a result. 【0583】 Step 4: 【0584】 The server receives the analysis results and sentiment data, and selects the optimal operating procedure or settings for the information system. Here, data processing is performed using the analysis results and sentiment data as input to determine the appropriate operating procedure. The output is the operating procedure or settings. 【0585】 Step 5: 【0586】 The server adjusts the interface based on the user's emotions. Specifically, it generates emotionally relevant help messages and reassuring information. The input is emotional data, and the output is an adjusted interface design. Here, data processing is performed to improve the user experience. 【0587】 Step 6: 【0588】 The server sends the generated operating instructions and the adjusted interface to the terminal. The terminal receives this and presents it to the user. Finally, the user receives the operating instructions in an executable format through the adjusted interface. The output is the interface information presented to the user. 【0589】 The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0590】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0591】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314. 【0592】 [Fourth Embodiment] 【0593】 Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment. 【0594】 As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server. 【0595】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0596】 The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52. 【0597】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0598】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0599】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0600】 The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes. 【0601】 Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0602】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0603】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0604】 In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0605】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0606】 This invention is a system that automatically converts user-inputted instructions in natural language into various operations on an electronic spreadsheet system. To implement this invention, a program with the following specific configuration is required. 【0607】 First, the user instructs the electronic spreadsheet system to perform a specific operation using natural language. For example, they might want to gray out rows where column A is marked "Completed." The user interface prompts the terminal to input this instruction in text format. 【0608】 Next, the terminal converts the input instructions into data and sends it to the server. The transmitted instructions are analyzed by a large-scale language model installed on the server to clarify the user's intended operation. Based on the analysis results, the server selects the specific functions and settings to be used in the electronic spreadsheet system. For example, if conditional formatting is used to gray out rows where column A is "Completed," the server detects the relevant words or expressions and adjusts the corresponding spreadsheet functions. 【0609】 Next, the server generates instructions on how the selected functions and settings should be executed in the electronic spreadsheet system. These instructions are written in API call or script format and sent from the server to the terminal. A concrete example is the instructions for setting conditional formatting. 【0610】 Finally, the terminal executes specific functions and settings on the electronic spreadsheet system based on the received instructions. This ensures that the data in the spreadsheet is processed and displayed as intended by the user. 【0611】 In this way, the present invention makes it possible to easily perform complex operations within an electronic spreadsheet system using natural language, even without specialized knowledge, thereby significantly improving the user's work efficiency. 【0612】 The following describes the processing flow. 【0613】 Step 1: 【0614】 Users input the desired actions in the electronic spreadsheet system using natural language. They enter specific instructions into the user interface, such as "Gray out rows where column A is marked 'Completed'." 【0615】 Step 2: 【0616】 The terminal receives natural language instructions from the user and sends them to the server as data. An appropriate protocol is used for reliable data transmission. 【0617】 Step 3: 【0618】 The server analyzes the received natural language instructions using a large-scale language model. This model understands the meaning of the instructions and performs keyword extraction and grammatical analysis to clarify the user's intent. 【0619】 Step 4: 【0620】 Based on the analysis results, the server selects the functions and settings to be applied in the electronic spreadsheet system. For example, it determines the specific steps to gray out the "Completed" row in column A using conditional formatting. 【0621】 Step 5: 【0622】 The server generates detailed instructions for applying the selected function or settings to the electronic spreadsheet system. These instructions, in the form of API calls or scripts, include specific steps for execution. 【0623】 Step 6: 【0624】 The server sends the generated procedure to the terminal. Stable data transmission is maintained throughout this process to prevent communication interruptions. 【0625】 Step 7: 【0626】 The terminal executes the appropriate functions and settings in the electronic spreadsheet system according to the instructions received from the server. It sets the specified conditional formatting to process and display the data as intended by the user. 【0627】 Step 8: 【0628】 The user can verify the applied spreadsheet settings and results on their device. This allows the user to confirm that the instructions were followed correctly and complete the task. 【0629】 (Example 1) 【0630】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0631】 Conventional electronic spreadsheet systems made it difficult for users to intuitively instruct complex operations using natural language. This resulted in a problem where users without specialized knowledge could not perform these operations efficiently. Furthermore, the lack of means to translate natural language input into specific operations within the electronic spreadsheet system led to decreased user efficiency. 【0632】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0633】 In this invention, the server includes information processing means for analyzing instructions input in natural language; information processing means for selecting functions or settings to be used in the computing system based on the analysis results; information processing means for executing the selected functions or settings on the computing system; information processing means for converting the analyzed instructions into a data format and transmitting them via a communication network; and information processing means for generating a procedure for executing functions or settings based on instructions received via the communication network. This enables users to efficiently perform operations within the electronic spreadsheet system using intuitive natural language, even without specialized knowledge. 【0634】 "Natural language" refers to the system of words that humans use in everyday life, and unlike formalized programming languages, it can include context and ambiguity. 【0635】 "Analysis" is the act of interpreting given data or instructions to clarify their meaning and purpose. 【0636】 "Information processing means" refers to systems or modules that receive, transform, analyze, and process data based on specific purposes. 【0637】 A "computational processing system" is an electronic platform for receiving information, performing calculations, analysis, and display. 【0638】 A "function" refers to the executable actions of individual operations or processes provided by a particular system or program. 【0639】 "Settings" refer to a set of conditions or parameters defined to control the operation of a system or program. 【0640】 A "communication network" is an infrastructure for sending and receiving data between multiple electronic devices. 【0641】 A "procedure" refers to a set of operations or steps established to achieve a specific objective. 【0642】 A "generative AI model" refers to an artificial intelligence model that uses machine learning techniques to learn patterns from large amounts of data and then performs inferences on new data. 【0643】 This invention provides a system that automates complex settings and function execution by allowing users to instruct operations in natural language within an electronic spreadsheet system. The following specific configuration is used for implementation. 【0644】 First, the user inputs instructions in natural language via the terminal. These natural language instructions are converted into data format on the terminal and sent to the server via the communication network. For example, the user can give instructions such as "gray out rows where column A is marked 'Completed'." 【0645】 Next, the server analyzes the received natural language instructions using a large-scale generative AI model. This could be a large-scale language model such as OpenAI. As a result of this analysis, the user's intended operation is clarified, and the necessary functions and settings for the computing system are identified. 【0646】 The information processing components included in the server select specific functions and settings to be used in the electronic spreadsheet system based on these analysis results. This selection allows users to easily execute complex commands. 【0647】 For example, if a user instructs a school report card to "display the grades of students with scores below 70 in red," the server can automatically perform this setting through analysis. An example of a prompt to the generating AI model would be, "Explain how to gray out rows that meet specific conditions using conditional formatting." 【0648】 In this way, the system enables even users without specialized knowledge to intuitively perform advanced operations within the electronic spreadsheet system, significantly improving work efficiency. 【0649】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0650】 Step 1: 【0651】 The user enters instructions in natural language. 【0652】 The user uses a terminal to input instructions for the electronic spreadsheet system in natural language. These instructions are in text format and might include something like, "Gray out rows where column A is marked 'Completed'." The input instructions are converted into data format on the terminal for subsequent processing. 【0653】 Step 2: 【0654】 The terminal converts the instructions into data and sends it to the server. 【0655】 The terminal converts natural language instructions input by the user into a machine-readable data format. This process involves pre-processing for natural language analysis, and the data is transmitted to the server via a communication network. The output is text data that can be parsed on the server side. 【0656】 Step 3: 【0657】 The server analyzes the instructions and clarifies the operation details. 【0658】 The server analyzes the received data using a generative AI model. Specifically, a large-scale language model deciphers the intent of natural language and identifies the required operations. The analysis extracts specific functions and settings to be executed in the electronic spreadsheet system. The output is information about the identified operations. 【0659】 Step 4: 【0660】 The server generates the execution procedure and sends it to the terminal. 【0661】 The server generates a procedure to perform the necessary operations based on the analysis results. This procedure is written in the form of API calls or scripts. The generated procedure is then sent back to the terminal via the communication network. The output is an execution procedure directed towards a specific operation. 【0662】 Step 5: 【0663】 The terminal operates the electronic spreadsheet system based on the execution procedure. 【0664】 Based on the received instructions, the terminal automatically executes the necessary functions and settings in the electronic spreadsheet system. Specific actions include applying conditional formatting and modifying formulas. This ensures that the user's instructed actions are executed within the spreadsheet software, yielding the desired results. The output reflects the results of the executed operations within the spreadsheet system. 【0665】 (Application Example 1) 【0666】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0667】 Traditionally, for users without specialized knowledge, operating information processing systems and automated machinery has been difficult due to the complexity of the operations and settings, making it challenging to give efficient instructions. Furthermore, it has not been easy for machines to properly interpret voice commands and execute actions automatically. 【0668】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0669】 In this invention, the server includes means for analyzing instructions input in natural language, means for selecting functions or settings to be used in the information processing system based on the analysis results, means for executing the selected functions or settings on the information processing system, means for converting voice instructions into text, means for analyzing the converted instructions into text and generating an operating procedure for an automated machine, and means for causing the automated machine to execute the generated operating procedure. This makes it possible for users to easily and efficiently operate the information processing system and automated machines using natural language or voice instructions. 【0670】 "Means for analyzing instructions entered in natural language" refers to technologies that receive instructions from users in natural language, analyze their content, and understand the specific actions to be performed. 【0671】 "Means for selecting functions or settings used in an information processing system" refers to a mechanism that selects appropriate functions or settings for information processing based on the analyzed instructions. 【0672】 "Means of execution on an information processing system" refers to the technology of actually applying selected functions and settings on an information processing system and executing the operation. 【0673】 "Means for converting voice instructions into text" refers to a device or technology that converts a user's voice instructions into textual information. 【0674】 "Means for analyzing instructions converted into text and generating operating procedures for automated machines" refers to a technology that analyzes instructions converted from speech into text and constructs specific operating procedures that automated machines should perform. 【0675】 "Means for having an automated machine execute the generated operation procedure" refers to a mechanism for transmitting the constructed operation procedure to an automated machine, allowing the machine to perform the operation based on its contents. 【0676】 A "server" is a computer system that performs tasks such as processing and analyzing information and selecting functions. 【0677】 One embodiment of this invention is a system for transmitting natural language instructions to an information processing system or automated machine. When a user gives instructions by voice via a smart device, those instructions are converted into text data by speech recognition software. Specific hardware such as smart glasses or a smartphone may be used. 【0678】 The server analyzes the received text data using a generative AI model to understand the user's intent. For example, OpenAI's GPT model is used as the generative AI model. Based on the analyzed instructions, the server determines the functions and settings to be used in the information processing system, or the operating procedures for automated machines. 【0679】 The terminal transmits the generated settings and operating procedures to the information processing system or automated machine, and ensures they are properly implemented. In this process, the terminal performs direct operations using APIs or scripts. 【0680】 To give a concrete example, a worker in a factory gives a voice command through smart glasses, saying, "Move 10 parts to the next section." The server analyzes the command, generates the corresponding action procedure, and has a robot execute it. In this process, the following prompt sentences are used as example inputs to the generating AI model: 【0681】 "Instruct the robots in the factory to transport the next 10 products to the next section." 【0682】 Thus, the system implementing the invention efficiently analyzes natural language instructions from the user and converts them into operations for the information processing system and automated machines, thereby achieving simplification and automation of operations. 【0683】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0684】 Step 1: 【0685】 The user gives voice instructions via a smart device. The voice data is captured by the device's microphone and converted into text data by speech recognition software. In this process, the input is the user's voice instructions, and the output is text data. Texted instructions are generated. 【0686】 Step 2: 【0687】 The terminal sends text data to the server. The server uses a generative AI model specialized in text analysis (e.g., the GPT model) to perform analysis to understand the user's instructions. The input is text data, and the output is semantic information of the analyzed instructions. The model analyzes natural language into a machine-understandable format. 【0688】 Step 3: 【0689】 The server determines the appropriate functions or operating procedures to be executed by the information processing system or automated machine based on the analyzed instructions. The input is the analysis result, and the output is a specific operating procedure or API call. In this process, the necessary function settings and operating procedures are selected depending on the analysis result. 【0690】 Step 4: 【0691】 The terminal transmits the operating instructions received from the server to automated machines or information processing systems. The input is the operating instructions from the server, and the output is the specific command or API request to be executed. The terminal issues operating commands to the actual system or machine. 【0692】 Step 5: 【0693】 An information processing system or automated machine initiates actual operation based on communicated procedures. The output is the result of the system or machine's operation. Specifically, a robot in a factory automatically performs tasks such as moving products. 【0694】 This series of processing steps enables users to easily operate systems and machines using natural language. 【0695】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0696】 This invention provides a system that allows users to instruct operations on an electronic spreadsheet system using natural language, recognizes the user's emotions, and adjusts the interface and suggested content accordingly. This system is comprised of a combination of natural language processing, an emotion engine, a large-scale language model, and an electronic spreadsheet system. 【0697】 When a user inputs instructions in natural language to perform an operation on an electronic spreadsheet system, the user interface collects these instructions and inputs them into the terminal. Simultaneously, the terminal performs emotion recognition to infer the user's emotions from their input and speech. This process allows the terminal to process the user's emotions as data. 【0698】 Subsequently, the device sends the recognized emotion data to the server along with the user's natural language instructions. The server uses a large-scale language model to analyze the instructions and clarify their intent. Simultaneously, based on the recognized emotions, the selection of suggested functions and settings is adjusted; for example, simple and easy-to-understand suggestions are provided for positive emotions, and supportive suggestions for negative emotions. 【0699】 Based on the analysis results, the server selects the functions and settings to be used in the electronic spreadsheet system. It also adjusts the interface to improve the user experience based on emotions. For example, if it determines that the user is experiencing stress, it can provide supplementary information such as displaying a help message on the interface. 【0700】 Along with the generated procedures, this adjusted information is sent to the terminal. The terminal then configures the electronic spreadsheet system and executes functions based on the information sent from the server, while simultaneously providing the user with the adjusted interface. 【0701】 In this way, users can easily perform operations on the spreadsheet even without specialized knowledge, and furthermore, a dynamic interface that takes into account the user's emotional state allows them to continue working more comfortably. For example, if a user enters "I want to compare column B using the VLOOKUP function based on column C," and the emotion engine determines that the user is anxious, the terminal can support the user by displaying hints and examples on how to use the VLOOKUP function. 【0702】 The following describes the processing flow. 【0703】 Step 1: 【0704】 The user provides instructions for operating the electronic spreadsheet system using natural language. Specific instructions, such as "I want to gray out rows where column A is marked 'Completed'," are entered into the user interface. 【0705】 Step 2: 【0706】 The device receives natural language instructions from the user and simultaneously recognizes emotions through analysis of the user's facial expressions and input tone. The emotion engine then records the user's emotional state as data. 【0707】 Step 3: 【0708】 The device sends collected natural language instructions and recognized sentiment data to the server. This transmission process uses appropriate protocols to maintain data integrity. 【0709】 Step 4: 【0710】 The server uses a large-scale language model to analyze the received natural language instructions. It clarifies the content of the instructions and prepares them for specific operations in the electronic spreadsheet system. 【0711】 Step 5: 【0712】 The server selects the appropriate functions and settings based on the analysis results and the perceived emotions of the user. If the server determines that the user is stressed, it will select the simplest and most user-friendly option. 【0713】 Step 6: 【0714】 The server generates the steps to be executed based on the selected functions and settings. Furthermore, it creates help messages and support information to display on the interface according to the user's emotional state. 【0715】 Step 7: 【0716】 The server sends the generated instructions and supporting information to the terminal. A protocol is used to ensure the security of the communication during the transmission of this information. 【0717】 Step 8: 【0718】 The terminal performs configuration and function execution in the electronic spreadsheet system according to the received instructions. It also displays necessary support information on the interface based on the user's mood. 【0719】 Step 9: 【0720】 Users can easily verify the results of applied functions and settings via their device. Emotion-responsive support information allows them to proceed with confidence. 【0721】 (Example 2) 【0722】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0723】 In modern information processing systems, users make sophisticated and diverse requests using natural language, but it has been difficult for systems to accurately understand their intentions and respond appropriately. Furthermore, there has been a lack of mechanisms to adjust interfaces and provide support tailored to individual needs, taking into account the user's emotional state. As a result, a challenge has been the inability of users to receive appropriate support when they experience anxiety or stress. 【0724】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0725】 In this invention, the server includes means for analyzing instructions input in natural language, means for recognizing the user's emotions, and means for selecting functions or settings based on the analysis results and emotion data. This makes it possible to adjust the dynamic interface to take the user's emotions into consideration and to make appropriate suggestions. 【0726】 "Natural language" refers to the language that humans use on a daily basis, and is a linguistic form used by computer systems to understand and analyze it. 【0727】 "Emotional data" refers to data that quantifies or analyzes a user's emotional state and can be used by a system. 【0728】 An "information processing system" is a complete system that includes hardware and software for performing assigned tasks and various processing operations. 【0729】 "Function or setting" refers to a set of actions or the necessary environmental components for performing a specific task in an information processing system. 【0730】 "User interface" refers to the screen configuration and operating devices that enable the user and the system to communicate with each other, and includes display elements that improve the user experience. 【0731】 A "suggestion" is a recommendation or option presented by the system in response to the user's requests and circumstances, intended to support the user's actions. 【0732】 This invention provides an information processing system that allows users to give instructions in natural language and enables the system to recognize user emotions and adjust the interface and suggestions accordingly. This system is comprised of a combination of natural language processing, an emotion engine, a large-scale language model, and an information processing system. 【0733】 The terminal receives natural language instructions entered by the user. If the user enters "I want to compare column B using the VLOOKUP function based on column C," the terminal processes this instruction. In this process, the terminal uses an emotion engine to recognize the user's emotions and processes the resulting emotion data. Emotion recognition uses techniques that employ tone analysis of speech and text to quantify emotions. 【0734】 The terminal sends user instructions and sentiment data to the server. The server uses a generative AI model to analyze the instructions and clarify the user's intent. This analysis is specifically performed by interpreting the instructions and creating appropriate prompt statements. An example of a prompt statement here would be: "Analyze the following instructions and make appropriate suggestions based on the user's sentiment: 'I want to compare column B using the VLOOKUP function based on column C'." 【0735】 Based on the analysis results and sentiment data, the server selects functions and settings appropriate for the user and adjusts and provides appropriate suggestions. For example, if the analysis indicates that the user is feeling anxious, the system enhances support for the user by displaying hints on how to use the VLOOKUP function through the terminal. 【0736】 This process allows users to efficiently use information processing systems even without specialized knowledge, and to operate them with confidence through an emotionally sensitive interface. 【0737】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0738】 Step 1: 【0739】 The user provides instructions for the information processing system using natural language. This input is received through the terminal's user interface and collected as text on the terminal. An example of natural language input is, "I want to compare column B with column C using the VLOOKUP function." At this stage, the output is the user's natural language instruction data. 【0740】 Step 2: 【0741】 The device recognizes the user's emotions using an emotion engine. Specifically, the device performs voice tone analysis and text analysis to quantify the user's emotions. The emotion data is then stored digitally within the device. The input for this step is the user's text instructions and voice data, and the output is emotion data. 【0742】 Step 3: 【0743】 The terminal packages both the user-inputted instructions and recognized emotion data and sends them to the server. This data package, containing both the instructions and the emotional state, serves as the basis for the server's subsequent analysis steps. The input consists of natural language instructions and emotion data, while the output is the data package transferred to the server. 【0744】 Step 4: 【0745】 The server analyzes the received instructions using a large-scale language model. The server clarifies the intent of the instructions by inputting prompts into a generative AI model. Specifically, it generates prompts in the form of "Analyze the following instructions and make appropriate suggestions based on the user's sentiment: 'I want to compare column B using the VLOOKUP function based on column C'" and inputs them into the model. In this process, the input is instructions and sentiment data, and the output is the analyzed instruction data. 【0746】 Step 5: 【0747】 The server selects appropriate functions and settings and adjusts the suggestions based on the analyzed instructions and sentiment data. Depending on the sentiment data, for example, if the user is feeling anxious, it provides reassurance to the user by adding multi-level support. The input for this step is the analyzed instruction data, and the output is the adjusted suggestion information and settings. 【0748】 Step 6: 【0749】 The adjusted suggestion information and settings are sent from the server to the terminal. The terminal receives this information and executes the appropriate function on the user interface while simultaneously displaying suggestions. Specifically, it displays examples and hints for using the VLOOKUP function. The input is the adjusted data, and the output is the execution result and advice displayed for the user. 【0750】 (Application Example 2) 【0751】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0752】 In modern information systems, a challenge faced by diverse users is the limited means of instructing them to operate the system using natural language. Furthermore, the lack of emotionally responsive interface adjustments results in a uniform user experience, making it difficult to address individual needs. 【0753】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0754】 In this invention, the server includes means for analyzing instructions input in natural language, means for selecting an operating procedure or setting in the information system based on the analysis results and recognized emotion data, and means for executing the selected operating procedure or setting and adjusting the interface of the information system. This enables the user to operate intuitively while receiving optimal support tailored to their emotional state. 【0755】 "Instructions entered in natural language" refers to operations or requests made to an information system using the language that humans normally use in conversation. 【0756】 "Means of analysis" refers to the technology or process by which an information system understands natural language received as input and interprets its intent. 【0757】 "Emotional data" refers to information used to represent the emotional state inferred from a user's statements and actions. 【0758】 "Means for selecting operating procedures or settings" refers to technologies or mechanisms for determining the optimal operating method or system settings based on user instructions or emotions. 【0759】 "Means of adjusting the interface" refers to technologies that appropriately change the display and operating environment of an information system according to the user's emotions and intentions. 【0760】 A "large-scale language model" refers to an artificial intelligence model that learns from large amounts of text data and has the ability to understand and generate human language. 【0761】 An "emotion engine" refers to artificial intelligence technology that analyzes and recognizes emotions from user input and statements. 【0762】 To implement this invention, an interface is needed in the information system that enables natural language instructions and emotion recognition. The system receives natural language instructions from the user via a smart terminal. The terminal uses speech recognition software to convert the speech input into text and uses a large-scale language model to analyze the text data. 【0763】 To understand the user's emotional state, the device activates an emotion engine that generates emotional data based on the user's speech and actions. This data is then analyzed by the system to identify the user's current emotional state. 【0764】 The server determines the optimal operating procedure or settings based on analyzed natural language instructions and sentiment data. Large-scale language models such as BERT and GPT-3 are used in this process. The selected procedure or settings are then adjusted based on the user's emotions, affecting the interface display and the information provided. Specifically, if the user is experiencing stress, relevant help messages and reassuring information are displayed on the interface. 【0765】 In the final stage, the generated interface and work procedures are returned to the terminal, which then provides them to the user. As a result, the user can perform natural and intuitive operations, thereby efficiently achieving their goals in the specific application. 【0766】 For example, if a user enters "I want to reserve this park for the weekend" and feels anxious, the system will generate a message that explains the reservation procedure in detail and provides reassurance to the user. An example of a prompt that supports this process is: "If a citizen has concerns about using a facility, create a clear, step-by-step explanation of how to make a reservation and provide reassuring messages along the way." 【0767】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0768】 Step 1: 【0769】 The terminal receives voice input from the user and converts it into text data using speech recognition software. The input is voice data, and the output is text data. Here, speech is recognized and converted into a format that can be processed as a string. 【0770】 Step 2: 【0771】 The terminal passes the generated text data to a large-scale language model, which then analyzes the natural language instructions. This process involves data processing to analyze the text data and identify the user's intent. The input is text data, and the output is the analysis result. 【0772】 Step 3: 【0773】 The device analyzes the user's speech and actions and generates emotional data using an emotion engine. In this step, data calculations are performed to infer emotions from the input text and speech, and emotional data is output as a result. 【0774】 Step 4: 【0775】 The server receives the analysis results and sentiment data, and selects the optimal operating procedure or settings for the information system. Here, data processing is performed using the analysis results and sentiment data as input to determine the appropriate operating procedure. The output is the operating procedure or settings. 【0776】 Step 5: 【0777】 The server adjusts the interface based on the user's emotions. Specifically, it generates emotionally relevant help messages and reassuring information. The input is emotional data, and the output is an adjusted interface design. Here, data processing is performed to improve the user experience. 【0778】 Step 6: 【0779】 The server sends the generated operating instructions and the adjusted interface to the terminal. The terminal receives this and presents it to the user. Finally, the user receives the operating instructions in an executable format through the adjusted interface. The output is the interface information presented to the user. 【0780】 The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0781】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0782】 In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414. 【0783】 Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion. 【0784】 Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together. 【0785】 These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression. 【0786】 The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become. 【0787】 Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant. 【0788】 The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more." 【0789】 The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values. 【0790】 The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format. 【0791】 In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data. 【0792】 In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56. 【0793】 Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12. 【0794】 Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56. 【0795】 The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory. 【0796】 The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor. 【0797】 Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources. 【0798】 Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose. 【0799】 The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above. 【0800】 All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference. 【0801】 The following is further disclosed regarding the embodiments described above. 【0802】 (Claim 1) 【0803】 A means of analyzing instructions input in natural language, 【0804】 A means for selecting a function or setting to be used in the electronic spreadsheet system based on the aforementioned analysis results, 【0805】 Means for executing the selected function or setting on an electronic spreadsheet system, 【0806】 A system that includes this. 【0807】 (Claim 2) 【0808】 The system according to claim 1, comprising means for generating a procedure for performing the selected function or setting. 【0809】 (Claim 3) 【0810】 The system according to claim 1, characterized in that the analysis is performed using a large-scale language model. 【0811】 "Example 1" 【0812】 (Claim 1) 【0813】 An information processing means for analyzing instructions input in natural language, 【0814】 Information processing means for selecting functions or settings to be used in the calculation processing system based on the analysis results, 【0815】 Information processing means that executes the selected function or setting on the computing system, 【0816】 Information processing means that converts the analyzed instructions into a data format and transmits them via a communication network, 【0817】 Information processing means for generating a procedure to perform a function or setting based on instructions received via a communication network, 【0818】 A system that includes this. 【0819】 (Claim 2) 【0820】 The system according to claim 1, comprising information processing means for generating and transmitting procedures for performing the aforementioned functions or settings via a communication network. 【0821】 (Claim 3) 【0822】 The system according to claim 1, characterized in that the analysis is performed using a large-scale generative AI model. 【0823】 "Application Example 1" 【0824】 (Claim 1) 【0825】 A means of analyzing instructions input in natural language, 【0826】 A means for selecting functions or settings to be used in the information processing system based on the aforementioned analysis results, 【0827】 Means for executing the selected function or setting on the information processing system, 【0828】 A means of converting voice instructions into text, 【0829】 Means for analyzing the instructions converted into the aforementioned characters and generating the operation procedure of an automated machine, 【0830】 A means of having an automated machine execute the generated procedure, 【0831】 A system that includes this. 【0832】 (Claim 2) 【0833】 The system according to claim 1, comprising means for generating a procedure for performing the selected function or setting or operating procedure. 【0834】 (Claim 3) 【0835】 The system according to claim 1, characterized in that the analysis is performed using a generative AI model. 【0836】 "Example 2 of combining an emotion engine" 【0837】 (Claim 1) 【0838】 A means of analyzing instructions input in natural language, 【0839】 A means for recognizing the user's emotions when the aforementioned instructions are input, 【0840】 A means for selecting a function or setting to be used in the information processing system based on the analysis results and the emotion data, 【0841】 A means for adjusting the user interface and making suggestions based on the aforementioned sentiment data, 【0842】 Means for executing the selected function or setting on the information processing system, 【0843】 A system that includes this. 【0844】 (Claim 2) 【0845】 The system according to claim 1, comprising means for generating a procedure for performing the selected function or setting, and means for providing additional information to the user based on the sentiment data. 【0846】 (Claim 3) 【0847】 The system according to claim 1, characterized in that the analysis is performed using a large-scale language model, and further includes adjustment of the proposal based on the emotion recognition. 【0848】 "Application example 2 when combining with an emotional engine" 【0849】 (Claim 1) 【0850】 A means of analyzing instructions input in natural language, 【0851】 A means for selecting an operating procedure or setting in an information system based on the aforementioned analysis results and recognized emotion data, 【0852】 A means for executing selected operating procedures or settings, and for adjusting the interface of the information system, 【0853】 A system that includes this. 【0854】 (Claim 2) 【0855】 The system according to claim 1, comprising means for generating the selected operating procedure and the adjusted interface. 【0856】 (Claim 3) 【0857】 The system according to claim 1, characterized in that the analysis and emotion recognition are performed using a large-scale language model and an emotion engine. [Explanation of symbols] 【0858】 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

[Claim 1] A means of analyzing instructions input in natural language, A means for selecting a function or setting to be used in the electronic spreadsheet system based on the aforementioned analysis results, Means for executing the selected function or setting on an electronic spreadsheet system, A system that includes this. [Claim 2] The system according to claim 1, comprising means for generating a procedure for executing the selected function or setting. [Claim 3] The system according to claim 1, characterized in that the analysis is performed using a large-scale language model.

Images