system

Abstract

We provide the system. [Solution] Means of collecting information about users' interests and objectives, A means of extracting information from digital content based on collected information, Means for summarizing and organizing the extracted information, A means of providing organized information to users, A system that includes this.

Description

Technical Field

[0005] ,

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including receiving a user utterance; adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character; encoding the prompt; and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Due to the busyness of individuals in modern society, it has become difficult to allocate sufficient time for self-improvement and education. Therefore, it is required to efficiently obtain information based on individual interests and improve one's own knowledge and skills. Furthermore, it is also important to return the obtained information to the family and society as educational resources. However, there is a problem that the work of extracting and organizing useful information from a vast amount of digital content requires time and it is not realistic for an individual to do so.

Means for Solving the Problems

[0005] This invention provides a system that collects information according to the user's interests and objectives, and automatically extracts and summarizes useful information from relevant digital content based on that information. Furthermore, it supports users in developing concrete action plans based on the information provided by this system, and makes the results available as educational resources. This enables users to efficiently engage in self-improvement while contributing to their families and communities.

[0006] A "user" is an individual or group that uses this system to obtain information based on their interests and purposes.

[0007] "Interests and goals" refer to a user's specific interest in or objectives regarding a particular theme, skill, or knowledge they wish to acquire.

[0008] "Means of collecting information" refers to a process or device that receives and records data entered by a user or options selected by a user.

[0009] "Digital content" is a general term for informational materials that are stored and distributed electronically, such as ebooks, articles, and blogs.

[0010] "Means of extracting information" refers to the process or device of selecting and extracting information from digital content that is relevant to the user's interests and purposes.

[0011] "Means of summarizing and organizing" refers to a process or device that compiles and structures extracted information into a form that is easy for users to understand.

[0012] "Means of providing information" refers to a process or device that displays or delivers summarized information in a format accessible to users.

[0013] "Support for creating action plans" refers to the process of assisting users in creating specific action steps and schedules based on the information provided.

[0014] "Means of making it usable as an educational resource" refers to the process or apparatus of developing the information obtained through this system into a form that can be used for educational and awareness-raising activities in homes and communities. [Brief explanation of the drawing]

[0015] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Embodiments for Carrying Out the Invention

[0016] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0019] In the following embodiments, a labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0020] In the following embodiments, a labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0023] [First Embodiment]

[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0036] This invention is a system that collects information based on the user's interests and objectives, and extracts relevant information from digital content based on that information. For this system to operate, the user first inputs their interests, objectives, and areas of knowledge they wish to improve using a terminal. The terminal then transmits this information to a server.

[0037] The server analyzes the received user information and generates highly relevant keywords. Based on these keywords, the server searches digital content and lists potential information to be extracted. Next, the server uses natural language processing techniques to extract important information from the digital content included in the list.

[0038] The extracted information is summarized and structured, and organized in a way that is easily understandable to the user. The server then sends the organized information to the terminal, which displays it to the user. The terminal also provides tools for the user to create a concrete action plan based on the information obtained.

[0039] For example, if a user enters information into their device with the goal of improving their "leadership skills," the server analyzes digital content, including the latest theories and practical examples related to "leadership," and extracts relevant information. It then provides the user with specific practical methods and training plans, supporting the creation of an action plan.

[0040] Furthermore, this system includes features that allow the acquired information to be used as an educational resource, and provides options for devices to be shared within families and communities. As a result, users can not only achieve self-improvement but also utilize the acquired knowledge and skills for education and social contribution.

[0041] The following describes the processing flow.

[0042] Step 1:

[0043] The terminal displays an interface for users to input topics and goals of interest. Users enter their interests and areas of study into a dedicated input form.

[0044] Step 2:

[0045] The terminal sends the data entered by the user to the server.

[0046] Step 3:

[0047] The server analyzes the received information and generates appropriate keywords. These keywords form the basis for information extraction.

[0048] Step 4:

[0049] The server uses the generated keywords to search a database of digital content and lists the most relevant content.

[0050] Step 5:

[0051] The server applies natural language processing to the listed digital content and extracts the information best suited to the user's purpose.

[0052] Step 6:

[0053] The server summarizes the extracted information and organizes it into a user-friendly format. This information is then prepared to be provided to the user later.

[0054] Step 7:

[0055] The server sends the formatted information to the terminal.

[0056] Step 8:

[0057] The terminal displays the received information to the user and provides the necessary support tools to enable the user to develop an action plan based on that information.

[0058] Step 9:

[0059] Users will use the provided information and tools to create a concrete action plan.

[0060] Step 10:

[0061] The devices are designed with their use as educational resources in mind, and also offer options for easily sharing the information obtained.

[0062] (Example 1)

[0063] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0064] In modern society, users are required to efficiently acquire information that matches their interests and objectives from a vast amount of data, and to use that information to develop concrete action plans. However, existing information gathering systems struggle to effectively extract and organize highly relevant information that meets user needs, and they lack sufficient support for translating that information into concrete actions that align with those objectives. As a result, users are often overwhelmed by excessive information or overlook useful information. Therefore, there is a strong need for a new system that can provide information that meets user needs quickly and accurately, and further support the development of action plans based on that information.

[0065] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0066] In this invention, the server includes a device for collecting information related to the user's interests and objectives, a device for analyzing the collected information and generating highly relevant keywords, and a device for searching digital information sources and extracting information based on the generated keywords. This makes it possible to efficiently extract information that meets the user's needs and provide it in a way that is useful for specific actions.

[0067] A "user" refers to an individual or group that acquires and utilizes information.

[0068] "Interests" refer to specific themes or fields that a user is particularly interested in, and their depth and scope vary depending on the user's objectives.

[0069] "Purpose" refers to the specific outcome or result that the user wants to achieve, and serves as a standard for information gathering and action planning.

[0070] "Information" refers to facts, concepts, or content that facilitates understanding, provided in digital or other forms.

[0071] "Device" refers to a mechanical or electronic component designed to perform a specific function or task.

[0072] "Analysis" refers to the process of examining information in detail, understanding its structure, and gaining new insights.

[0073] "Keywords" are important words or phrases related to a specific theme or concept, and they serve as a starting point for information retrieval and organization.

[0074] "Digital information sources" refer to various types of data or content that are stored and provided electronically.

[0075] "Extraction" refers to the process of extracting specific information from a broad dataset.

[0076] "Support" refers to providing assistance and guidance to users in developing and implementing action plans based on the information they receive.

[0077] This invention is a system that helps users efficiently and accurately acquire information based on their interests and objectives, and to develop action plans based on that information. This system is primarily implemented using a server and terminals.

[0078] Users use the terminal to input information related to their interests and goals. This input can take various forms, including text and voice. The terminal receives the user's input and sends it to the server. In doing so, the terminal manages the data securely and efficiently by utilizing data configuration and security protocols.

[0079] The server analyzes the received information and generates highly relevant keywords using natural language processing technology. Specifically, it uses an analysis model that applies machine learning to extract important elements that align with the user's purpose. In this step, high-precision analysis is performed by utilizing common cloud services and AI models.

[0080] Next, the server searches digital information sources based on the generated keywords and extracts relevant information from the database. This information is then summarized and structured using natural language processing techniques and converted into a format that is easily understandable to the user. Specific examples include data analysis by Amazon Web Services (AWS®) and general-purpose search engines.

[0081] The organized information is sent back from the server to the terminal and presented to the user on the terminal. Based on the information provided, the user uses an action planning tool to set specific actions. For example, this would be the case with an application that integrates with task management tools such as Trello.

[0082] For example, if a user enters information with the goal of "improving leadership skills," the server will collect the latest leadership-related information and propose a summarized, practical skills training method via the terminal. Through this process, the user can clarify actionable steps based on specific strategies.

[0083] Examples of prompt statements include: "What are the latest leadership theories?" and "How can I improve my skills as a team leader?" Such prompts enable the generative AI model to provide information tailored to the user's needs.

[0084] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0085] Step 1:

[0086] The user uses a device to input their interests and goals in text or voice format. This input includes topics the user is interested in and skills they want to improve. Specifically, the user types a prompt such as "I want to learn about improving my leadership skills" using the keyboard. The device temporarily stores this information and prepares to send it to the server.

[0087] Step 2:

[0088] The terminal sends the entered user information to the server. This process uses an internet connection and employs encryption protocols to ensure security. The input data is structured and sent to the server via an HTTP request.

[0089] Step 3:

[0090] The server analyzes the received user information. First, it understands the text data using natural language processing (NLP) techniques and automatically generates relevant keywords. This calculation utilizes an AI model that takes into account the frequency of words and context in the text. The output is a list of keywords such as "leadership," "skills," and "training."

[0091] Step 4:

[0092] The server searches the internet for relevant digital information sources based on the generated keywords. Specifically, it uses a cloud-based search service to quickly search for relevant literature and articles in the database and create a list of candidates. This list is then output.

[0093] Step 5:

[0094] The server further processes the digital data obtained from the search results to extract important information. This process utilizes summarization algorithms to concisely summarize the main points and gist of the document. The output of this process is a concise and structured information description.

[0095] Step 6:

[0096] The server sends summarized and structured information to the terminal. This data is formatted in a user-friendly manner, re-encrypted, and then transmitted. The terminal receives this information and displays it to the user when ready.

[0097] Step 7:

[0098] The device visually presents information to the user and provides support tools for developing action plans based on the information obtained. For example, it can connect to applications (e.g., Trello or spreadsheets) for setting specific tasks based on the information, supporting the user in putting their plan into action.

[0099] (Application Example 1)

[0100] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0101] In modern society, when individual users aim to achieve specific learning goals or improve their skills, they are required to access relevant information, efficiently understand it, and put it into action. However, there is a challenge in selecting useful information from a vast amount of data and then optimizing and providing it to each individual user.

[0102] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0103] In this invention, the server includes means for collecting information about the user's interests and objectives, means for extracting information from information resources based on the collected information, and means for summarizing and organizing the extracted information. This makes it possible for the user to set specific learning goals or skill improvement objectives, efficiently collect and analyze information resources related to those fields, display summaries, and further assist in creating action plans.

[0104] "Information about user interests and objectives" refers to information about a user's interests and goals regarding a particular field or issue.

[0105] "Information resources" refer to various digital content and datasets that exist on the internet or in databases.

[0106] "Extraction" refers to the act of selecting highly relevant and important parts from a large amount of information.

[0107] "Summarization" is the act of making extracted information concise and clearly presenting the important points.

[0108] "Skill improvement" refers to the process of aiming to acquire knowledge and improve abilities in a specific field.

[0109] An "action plan" is a plan that outlines the steps and action guidelines for achieving a specific goal.

[0110] The system that realizes this invention begins with the user inputting a specific topic of interest or a skill improvement goal into a terminal such as a smartphone or head-mounted display. The terminal sends this information to a server. When the server analyzes the received information, it uses natural language processing technology to search the internet for highly relevant information resources based on the input content. This process utilizes the Python programming language and its library, requests, to ensure efficient communication.

[0111] The server extracts important information from the information resources obtained through the search, and then summarizes and organizes it appropriately. This information processing uses a natural language processing library to simplify the information and highlight key points. The organized information is then sent back from the server to the terminal.

[0112] The device supports the user's learning goals and skill improvement process by displaying organized information. Users can then develop concrete action plans based on the information they receive, and the device includes a guide function to assist in this planning process.

[0113] For example, if a user is interested in the topic of "environmental issues," the system will collect and summarize the latest environmental news and research data and provide it to the user. It will then offer concrete action suggestions to help with environmental protection activities, enabling the user to proactively develop their own action plans.

[0114] An example of a prompt message that supports this system is: "Collect, summarize, and display the latest information related to the user's area of ​​interest (environmental issues). Also, provide specific suggestions that will be useful for action planning." Based on this prompt message, the server performs optimal information collection and analysis.

[0115] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0116] Step 1:

[0117] The terminal receives information related to the user's interests and goals as input and sends it to the server. Here, the user sets a specific theme (e.g., environmental issues) or a goal for skill improvement and inputs that information as digital data. The input data is sent to the server via an HTTP request.

[0118] Step 2:

[0119] The server analyzes the received user information. It generates keywords related to the theme sent as input using a natural language processing library. Keyword generation involves analyzing the user's input theme and selecting appropriate related keywords based on its context. As a result, the server obtains a set of related keywords as output.

[0120] Step 3:

[0121] The server searches for information resources based on generated keywords. It accesses repositories and databases on the internet and collects relevant digital content. The input here is a set of pre-generated keywords, and the output is a list of relevant information resources. This includes information retrieval using external APIs and database queries.

[0122] Step 4:

[0123] The server extracts and summarizes information from collected information resources. Using the collected information as input, it extracts and summarizes important information using natural language processing techniques and outputs concise structured data. This process includes data processing such as evaluating the importance of information and extracting key points.

[0124] Step 5:

[0125] The server sends summarized information to the terminal. The output structured data is then sent back to the terminal via the HTTP protocol. As a result, the terminal presents the information in a format that is easy for the user to understand. The user can then use the presented information to aid in learning and skill improvement.

[0126] Step 6:

[0127] The terminal displays the received information and assists the user in developing a concrete action plan. The input here is structured data sent from the server, and the output is the action plan created by the user. Based on this information, the terminal utilizes a guide function to assist the user in creating their plan.

[0128] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0129] This invention relates to a system that recognizes a user's emotions using an emotion engine and extracts and provides information that takes these emotions into account. To implement this system, the user first inputs their interests and topics they wish to learn about into a terminal. The terminal then transmits this information, along with the emotion engine, to a server.

[0130] The server uses an emotion engine to analyze the user information it receives and generate appropriate keywords. The emotion engine recognizes the user's current emotional state based on what the user has entered and their feedback during use. This emotional information serves as one of the factors the server uses to determine what information to extract from the digital content.

[0131] The server considers the user's emotional state, selects the most appropriate content, and summarizes and organizes the extracted information with a tone and difficulty level appropriate to that emotion. It then sends the organized information to the device, providing it to the user in a viewable format. The device, in turn, utilizes an emotion engine to analyze how the user is receiving the information in real time and makes adjustments as needed.

[0132] For example, if a user is seeking information on "stress management," the emotion engine analyzes the user's current stress level. If, for instance, the system detects that the user is experiencing high stress, the server extracts calm and practical content on relaxation techniques and provides it to the device. This makes it easier for the user to receive information that is relevant to their emotions, enabling them to learn and improve themselves effectively.

[0133] Furthermore, the emotion engine records the user's emotional changes and uses this data to support the development of action plans. Based on this data, the device proposes the most user-friendly action plan and provides feedback to enhance learning outcomes. This process leads to increased user motivation and further refinement of action plans.

[0134] The following describes the processing flow.

[0135] Step 1:

[0136] The device displays an input screen for information about topics and objectives the user is interested in. The user enters the content they want to learn about or the fields they are interested in into the device.

[0137] Step 2:

[0138] The terminal sends the information entered by the user to the server. At the same time, the terminal also sends emotional data collected from the user in real time (such as typing speed and selection speed).

[0139] Step 3:

[0140] The server analyzes the received data and generates a list of keywords that match the user's interests. It also uses an emotion engine to evaluate the user's current emotional state based on the transmitted emotion data.

[0141] Step 4:

[0142] The server searches a database of digital content based on the generated keywords and extracts information tailored to the user's emotional state. For example, if the user is feeling stressed, it prioritizes information on relaxation methods.

[0143] Step 5:

[0144] The server summarizes the extracted information in a way that is optimal for the user's emotions. Depending on the emotional state, it adjusts the tone and presentation method of the information (video, simplified text, etc.) to make it easy for the user to understand.

[0145] Step 6:

[0146] The server sends the formatted information to the terminal.

[0147] Step 7:

[0148] The device displays the information provided to the user. The device tracks the user's subsequent emotional changes in real time using an emotion engine and adjusts the information presented as needed.

[0149] Step 8:

[0150] Users learn from the information presented and create specific action plans using the action planning tool provided on their device. During this process, they receive notifications from their device with advice and suggestions based on emotional data.

[0151] Step 9:

[0152] The device sends the action plan created by the user to the server, which then provides feedback that takes into account emotional shifts and the progress of the plan. The server accumulates long-term data and uses it to suggest future improvements.

[0153] (Example 2)

[0154] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0155] Conventional information delivery systems do not take into account the user's emotional state, making it difficult to provide information that is appropriate to the user's situation and emotions. As a result, users may not be interested in the information provided, and effective learning and self-improvement may be difficult. This invention aims to solve these problems by recognizing the user's emotions and providing information that is appropriate to those emotions.

[0156] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0157] In this invention, the server includes means for collecting information about the user's interests and objectives along with emotional information, means for recognizing the user's emotional state using an emotion engine, and means for extracting, summarizing, and organizing information from digital content based on the user's emotions. This enables the provision of information appropriate to the user's emotional state, facilitating effective learning and self-improvement.

[0158] A "user" is an individual or group that uses an information system to collect information related to their interests and purposes.

[0159] "Emotional information" refers to data that expresses the emotional state of a user when they receive information, and is an element that indicates the user's feelings and reactions.

[0160] An "emotion engine" is software or an algorithm that analyzes user input and feedback to identify the user's current emotional state.

[0161] "Digital content" refers to a collection of information that is stored and accessed in electronic format for the purpose of providing it to users, and includes text, images, videos, and other digital media.

[0162] "Keyword generation" is the process of selecting appropriate words or phrases to efficiently extract relevant information based on the user's interests and emotional state.

[0163] "Information summarization and organization" is the process of shortening extracted digital content in a way that is easy for users to understand and rearranging it logically.

[0164] "Feedback" refers to the reactions and responses that users show to the information provided, and is data collected to improve the system and enhance the user experience.

[0165] An "action plan" refers to a set of specific action steps that a user sets to achieve their goals, and serves as a practical guideline for daily life and learning.

[0166] This invention is a system that provides information while taking user emotions into consideration. In implementation, the user, terminal, and server cooperate to analyze and provide information using an emotion engine and a generative AI model.

[0167] The user inputs topics of interest or subjects they wish to learn into the device. The device receives this information from the user via a graphical user interface and sends it to the server along with sentiment information. Possible input formats include text fields and voice input.

[0168] The terminal is responsible for transmitting user input data to the server along with the emotion engine. The emotion engine used here analyzes user emotions in real time based on their input and generates emotion labels. This data is transmitted to the server using a digital communication protocol.

[0169] The server uses a high-performance data processing unit to analyze the received information. In particular, by incorporating an emotion engine and utilizing a generative AI model, it can recognize the user's emotional state with high accuracy. The analyzed emotional information is a crucial element when extracting information from relevant digital content. The server appropriately searches for this information from data storage, summarizes and organizes the content, and sends it to the terminal.

[0170] As a concrete example, consider a case where a user is seeking information on "stress management." If the emotion engine recognizes the user's stress level as "high," the server extracts content related to relaxation techniques. This content is summarized in a way that is easiest for the user to understand and delivered via the device.

[0171] Example of a prompt:

[0172] "When users need calm and practical information about stress management, provide content that is appropriate for their emotional state."

[0173] In this way, the system can optimize information according to the user's emotions, supporting effective learning and self-improvement.

[0174] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0175] Step 1:

[0176] The user inputs topics of interest or subjects they wish to learn into the device. Specifically, the user enters keywords such as "stress management" into input fields through the device's interface. This information becomes input data for the next processing step.

[0177] Step 2:

[0178] The terminal sends user input data to the server along with the emotion engine. The input data, converted into a digital format, is transmitted as packets via network communication. The emotion engine uses this data to perform an initial analysis of the user's emotional state.

[0179] Step 3:

[0180] The server analyzes the data received from the terminal and uses an emotion engine to recognize the user's emotional state in detail. A generative AI model is then used to generate detailed emotion labels based on the user's input. The input consists of the user's theme information and initial emotion data, while the output is the detailed emotion label.

[0181] Step 4:

[0182] The server extracts information from digital content based on the recognized emotional state. Specifically, it queries a database and filters information to match the user's emotions. The input consists of emotion labels and associated themes, while the output is the filtered content.

[0183] Step 5:

[0184] The server summarizes and organizes the extracted information. Using a generative AI model, it edits the content to the appropriate tone and difficulty level, transforming it into a format that is easiest for the user to understand. The input is the extracted content, and the output is the target-specific summarized content.

[0185] Step 6:

[0186] The server sends the organized information to the terminal. The terminal displays this information to the user, visualizing it so that the user can understand it. Specifically, it formats and displays the summarized information on the terminal's display.

[0187] Step 7:

[0188] The device collects user feedback in real time and analyzes it using an emotion engine. User reactions and comments are converted back into emotion data, contributing to improved system performance. The input is user feedback, and the output is analyzed emotion data.

[0189] Step 8:

[0190] The device proposes action plans based on collected emotional data. Considering past data and the user's current emotional state, it presents action plans in a list format that are easily accepted by the user. This enables effective learning and self-improvement.

[0191] (Application Example 2)

[0192] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0193] The current information delivery system has the challenge of not being able to fully provide information that matches users' interests and emotional states, as it is difficult to select and deliver appropriate content based on the user's emotional state. Furthermore, it lacks the functionality to dynamically adjust content delivery based on user feedback, making it difficult to improve the user experience.

[0194] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0195] In this invention, the server includes means for identifying the user's emotional state and adjusting content accordingly, means for analyzing user responses and dynamically adjusting content delivery, and means for acquiring information about the user's interests and objectives. This enables the delivery of content suited to the user's emotional state, resulting in more personalized information delivery and a superior user experience.

[0196] "Means of obtaining information about user interests and objectives" refers to a system for collecting data from users about areas of interest and goals they wish to achieve.

[0197] "Methods for selecting information from digital data" refer to systems that extract specific information from a group of digital content based on collected information.

[0198] "Means for summarizing and organizing information" refers to a system for concisely summarizing selected information and organizing it systematically.

[0199] "Means of providing organized information" refers to a system that presents organized information in a format that users can utilize.

[0200] "Means for identifying a user's emotional state and adjusting content accordingly" refers to a mechanism that recognizes a user's current emotional state and appropriately changes the content based on that information.

[0201] "Means of analyzing user responses and dynamically adjusting content delivery" refers to a system that analyzes user feedback and real-time responses and immediately adapts the content provided accordingly.

[0202] The system for implementing this invention employs a complex configuration including a user terminal, a server, and a digital network. The terminal is equipped with an interface for inputting information about the user's interests and purposes, which is achieved through an application installed on a mobile device such as a smartphone or smart glasses.

[0203] Upon receiving this information, the server first uses the OpenAI® API to activate its emotion engine and identify the user's emotional state. Using natural language processing with the Google® Cloud Natural Language API, it searches for digital content based on the user's interests from a database or external API. During this process, it appropriately adjusts the tone and difficulty level of the content, taking the emotional information into consideration.

[0204] The adjusted content is then sent back to the user's device via the network and provided to the user on the device. The device sends real-time responses and feedback from the user back to the server, which dynamically adjusts the accuracy of the content. This enables the provision of higher quality information to the user.

[0205] For example, if a user requests content related to "stress management," the emotion engine will analyze the user's stress level and suggest relaxation techniques as needed. Based on user feedback, further adjustments will be made, and content that better matches the user's current state will be continuously provided.

[0206] An example of a prompt message would be: "Based on the theme entered by the user, generate content that is best suited to his emotional state. If he is under high stress, recommend calming music content." This instruction would be provided to the AI ​​model.

[0207] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0208] Step 1:

[0209] Users input their interests and goals via a terminal. The information entered by the user is sent to the server by the terminal's application. This input data includes the user's interest categories and desired tone. The terminal transfers this input to the server in digital format.

[0210] Step 2:

[0211] The server analyzes the received user information in conjunction with the emotion engine. Specifically, it uses the OpenAI API to analyze the user's emotional state based on their input. As a result, the user's emotional state is output in text format. This output is used in the subsequent content selection process.

[0212] Step 3:

[0213] The server uses Google Cloud Natural Language to search for appropriate digital content based on the output of the emotional state. The input consists of the results of the emotional analysis and the user's interest information, which are then used to filter content data from a database or external API. The output is a refined content list.

[0214] Step 4:

[0215] The server adjusts the tone and difficulty level of the selected content according to the user's emotions. The text of the content is modified based on the user's emotional state. For example, a user experiencing high stress will be provided with text that promotes relaxation. As a result, content data in a format suitable for the user is generated.

[0216] Step 5:

[0217] The server transmits the processed content to the terminal over the network. The terminal receives this content and displays it to the user visually or audibly. The user can then view and verify the content on their own terminal.

[0218] Step 6:

[0219] User reactions and feedback are sent from the device to the server. The server analyzes the feedback using tools such as Google Cloud Natural Language and adjusts content delivery as needed. This input includes changes in the user's emotions and feedback during the session, and the output generates instructions for adjusting content delivery.

[0220] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0221] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0222] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0223] [Second Embodiment]

[0224] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0225] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0226] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0227] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0228] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0229] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0230] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0231] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0232] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0233] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0234] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0235] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0236] This invention is a system that collects information based on the user's interests and objectives, and extracts relevant information from digital content based on that information. For this system to operate, the user first inputs their interests, objectives, and areas of knowledge they wish to improve using a terminal. The terminal then transmits this information to a server.

[0237] The server analyzes the received user information and generates highly relevant keywords. Based on these keywords, the server searches digital content and lists potential information to be extracted. Next, the server uses natural language processing techniques to extract important information from the digital content included in the list.

[0238] The extracted information is summarized and structured, and organized in a way that is easily understandable to the user. The server then sends the organized information to the terminal, which displays it to the user. The terminal also provides tools for the user to create a concrete action plan based on the information obtained.

[0239] For example, if a user enters information into their device with the goal of improving their "leadership skills," the server analyzes digital content, including the latest theories and practical examples related to "leadership," and extracts relevant information. It then provides the user with specific practical methods and training plans, supporting the creation of an action plan.

[0240] Furthermore, this system includes features that allow the acquired information to be used as an educational resource, and provides options for devices to be shared within families and communities. As a result, users can not only achieve self-improvement but also utilize the acquired knowledge and skills for education and social contribution.

[0241] The following describes the processing flow.

[0242] Step 1:

[0243] The terminal displays an interface for users to input topics and goals of interest. Users enter their interests and areas of study into a dedicated input form.

[0244] Step 2:

[0245] The terminal sends the data entered by the user to the server.

[0246] Step 3:

[0247] The server analyzes the received information and generates appropriate keywords. These keywords form the basis for information extraction.

[0248] Step 4:

[0249] The server uses the generated keywords to search a database of digital content and lists the most relevant content.

[0250] Step 5:

[0251] The server applies natural language processing to the listed digital content and extracts the information best suited to the user's purpose.

[0252] Step 6:

[0253] The server summarizes the extracted information and organizes it into a user-friendly format. This information is then prepared to be provided to the user later.

[0254] Step 7:

[0255] The server sends the formatted information to the terminal.

[0256] Step 8:

[0257] The terminal displays the received information to the user and provides the necessary support tools to enable the user to develop an action plan based on that information.

[0258] Step 9:

[0259] Users will use the provided information and tools to create a concrete action plan.

[0260] Step 10:

[0261] The devices are designed with their use as educational resources in mind, and also offer options for easily sharing the information obtained.

[0262] (Example 1)

[0263] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0264] In modern society, users are required to efficiently acquire information that matches their interests and objectives from a vast amount of data, and to use that information to develop concrete action plans. However, existing information gathering systems struggle to effectively extract and organize highly relevant information that meets user needs, and they lack sufficient support for translating that information into concrete actions that align with those objectives. As a result, users are often overwhelmed by excessive information or overlook useful information. Therefore, there is a strong need for a new system that can provide information that meets user needs quickly and accurately, and further support the development of action plans based on that information.

[0265] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0266] In this invention, the server includes a device for collecting information related to the user's interests and objectives, a device for analyzing the collected information and generating highly relevant keywords, and a device for searching digital information sources and extracting information based on the generated keywords. This makes it possible to efficiently extract information that meets the user's needs and provide it in a way that is useful for specific actions.

[0267] A "user" refers to an individual or group that acquires and utilizes information.

[0268] "Interests" refer to specific themes or fields that a user is particularly interested in, and their depth and scope vary depending on the user's objectives.

[0269] "Purpose" refers to the specific outcome or result that the user wants to achieve, and serves as a standard for information gathering and action planning.

[0270] "Information" refers to facts, concepts, or content that facilitates understanding, provided in digital or other forms.

[0271] "Device" refers to a mechanical or electronic component designed to perform a specific function or task.

[0272] "Analysis" refers to the process of examining information in detail, understanding its structure, and gaining new insights.

[0273] "Keywords" are important words or phrases related to a specific theme or concept, and they serve as a starting point for information retrieval and organization.

[0274] "Digital information sources" refer to various types of data or content that are stored and provided electronically.

[0275] "Extraction" refers to the process of extracting specific information from a broad dataset.

[0276] "Support" refers to providing assistance and guidance to users in developing and implementing action plans based on the information they receive.

[0277] This invention is a system that helps users efficiently and accurately acquire information based on their interests and objectives, and to develop action plans based on that information. This system is primarily implemented using a server and terminals.

[0278] Users use the terminal to input information related to their interests and goals. This input can take various forms, including text and voice. The terminal receives the user's input and sends it to the server. In doing so, the terminal manages the data securely and efficiently by utilizing data configuration and security protocols.

[0279] The server analyzes the received information and generates highly relevant keywords using natural language processing technology. Specifically, an analysis model applying machine learning is used to extract important elements that meet the user's purpose. In this step, high-precision analysis is performed by leveraging general cloud services and AI models.

[0280] Next, the server searches digital information sources based on the generated keywords and extracts relevant information from the database. This information is then summarized and structured by natural language processing technology and converted into a format that is easily understandable by the user. Specific examples include data analysis by Amazon Web Services (AWS) and general search engines.

[0281] The organized information is sent from the server to the terminal again and presented to the user on the terminal. Based on the provided information, the user sets specific actions using a tool for making an action plan. For example, an application linked with a task management tool such as Trello falls into this category.

[0282] As a specific example, when the user inputs information with the purpose of "improving leadership skills", the server collects the latest information related to leadership and proposes practical skill training methods summarized through the terminal. Through this process, the user can clarify the action steps based on specific measures.

[0283] Specific examples of prompt sentences include the following. Contents such as "What is the latest leadership theory?" and "Teach me the skill improvement method as a team leader". With such prompts, the generative AI model can provide information according to the user's needs.

[0284] The flow of the specific process in Example 1 will be described using FIG. 11.

[0285] Step 1:

[0286] The user uses the terminal to input their interests and purposes in text or voice form. This input content includes themes the user is interested in and skills to be improved. As a specific operation, the user inputs a prompt sentence such as "want to learn about improving leadership skills" using the keyboard. The terminal temporarily stores this information and prepares it for transmission to the server.

[0287] Step 2:

[0288] The terminal transmits the input user information to the server. This process uses an Internet connection, and an encryption protocol is applied to ensure security. The input data is structured and transmitted to the server through an HTTP request.

[0289] Step 3:

[0290] The server analyzes the received user information. First, it uses natural language processing (NLP) technology to understand the text data and automatically generates relevant keywords. This operation utilizes an AI model that takes into account frequently occurring words and context in the text. The output is a list of keywords such as "leadership", "skills", "training", etc.

[0291] Step 4:

[0292] Based on the generated keywords, the server searches for relevant digital information sources on the Internet. As a specific operation, it uses a cloud-based search service to quickly search for relevant documents and articles in the database and lists the candidates. This list is output.

[0293] Step 5:

[0294] The server further processes the digital data obtained from the search results to extract important information. This process utilizes summarization algorithms to concisely summarize the main points and gist of the document. The output of this process is a concise and structured information description.

[0295] Step 6:

[0296] The server sends summarized and structured information to the terminal. This data is formatted in a user-friendly manner, re-encrypted, and then transmitted. The terminal receives this information and displays it to the user when ready.

[0297] Step 7:

[0298] The device visually presents information to the user and provides support tools for developing action plans based on the information obtained. For example, it can connect to applications (e.g., Trello or spreadsheets) for setting specific tasks based on the information, supporting the user in putting their plan into action.

[0299] (Application Example 1)

[0300] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0301] In modern society, when individual users aim to achieve specific learning goals or improve their skills, they are required to access relevant information, efficiently understand it, and put it into action. However, there is a challenge in selecting useful information from a vast amount of data and then optimizing and providing it to each individual user.

[0302] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0303] In this invention, the server includes means for collecting information regarding the user's interests and purposes, means for extracting information from information resources based on the collected information, and means for summarizing and organizing the extracted information. As a result, by setting a specific learning goal or skill improvement by the user, it becomes possible to efficiently collect, analyze information resources related to that field, display a summary version, and further support the creation of an action plan.

[0304] "Information regarding the user's interests and purposes" refers to information regarding the user's interests and goals to be achieved with respect to a specific field or issue.

[0305] "Information resources" refers to various digital contents and datasets existing on the Internet or in databases.

[0306] "Extraction" refers to the act of extracting highly relevant and important parts from a large amount of information.

[0307] "Summary" refers to the act of simplifying the extracted information and clearly presenting the important points.

[0308] "Skill improvement" refers to the process aiming at acquisition and improvement of abilities in a specific field.

[0309] "Action plan" refers to a plan summarizing the steps and action guidelines for achieving a specific goal.

[0310] The system for realizing this invention starts when the user inputs a specific theme or skill improvement goal that the user is interested in into a terminal such as a smartphone or a head-mounted display. The terminal transmits that information to the server. When analyzing the received information, the server uses natural language processing technology to search for highly relevant information resources from the Internet based on the input content. In this process, the Python programming language and its library requests are utilized to achieve efficient communication.

[0311] The server extracts important information from the information resources obtained through the search, and then summarizes and organizes it appropriately. This information processing uses a natural language processing library to simplify the information and highlight key points. The organized information is then sent back from the server to the terminal.

[0312] The device supports the user's learning goals and skill improvement process by displaying organized information. Users can then develop concrete action plans based on the information they receive, and the device includes a guide function to assist in this planning process.

[0313] For example, if a user is interested in the topic of "environmental issues," the system will collect and summarize the latest environmental news and research data and provide it to the user. It will then offer concrete action suggestions to help with environmental protection activities, enabling the user to proactively develop their own action plans.

[0314] An example of a prompt message that supports this system is: "Collect, summarize, and display the latest information related to the user's area of ​​interest (environmental issues). Also, provide specific suggestions that will be useful for action planning." Based on this prompt message, the server performs optimal information collection and analysis.

[0315] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0316] Step 1:

[0317] The terminal receives information related to the user's interests and goals as input and sends it to the server. Here, the user sets a specific theme (e.g., environmental issues) or a goal for skill improvement and inputs that information as digital data. The input data is sent to the server via an HTTP request.

[0318] Step 2:

[0319] The server analyzes the received user information. It generates keywords related to the theme sent as input using a natural language processing library. Keyword generation involves analyzing the user's input theme and selecting appropriate related keywords based on its context. As a result, the server obtains a set of related keywords as output.

[0320] Step 3:

[0321] The server searches for information resources based on generated keywords. It accesses repositories and databases on the internet and collects relevant digital content. The input here is a set of pre-generated keywords, and the output is a list of relevant information resources. This includes information retrieval using external APIs and database queries.

[0322] Step 4:

[0323] The server extracts and summarizes information from collected information resources. Using the collected information as input, it extracts and summarizes important information using natural language processing techniques and outputs concise structured data. This process includes data processing such as evaluating the importance of information and extracting key points.

[0324] Step 5:

[0325] The server sends summarized information to the terminal. The output structured data is then sent back to the terminal via the HTTP protocol. As a result, the terminal presents the information in a format that is easy for the user to understand. The user can then use the presented information to aid in learning and skill improvement.

[0326] Step 6:

[0327] The terminal displays the received information and assists the user in developing a concrete action plan. The input here is structured data sent from the server, and the output is the action plan created by the user. Based on this information, the terminal utilizes a guide function to assist the user in creating their plan.

[0328] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0329] This invention relates to a system that recognizes a user's emotions using an emotion engine and extracts and provides information that takes these emotions into account. To implement this system, the user first inputs their interests and topics they wish to learn about into a terminal. The terminal then transmits this information, along with the emotion engine, to a server.

[0330] The server uses an emotion engine to analyze the user information it receives and generate appropriate keywords. The emotion engine recognizes the user's current emotional state based on what the user has entered and their feedback during use. This emotional information serves as one of the factors the server uses to determine what information to extract from the digital content.

[0331] The server considers the user's emotional state, selects the most appropriate content, and summarizes and organizes the extracted information with a tone and difficulty level appropriate to that emotion. It then sends the organized information to the device, providing it to the user in a viewable format. The device, in turn, utilizes an emotion engine to analyze how the user is receiving the information in real time and makes adjustments as needed.

[0332] For example, if a user is seeking information on "stress management," the emotion engine analyzes the user's current stress level. If, for instance, the system detects that the user is experiencing high stress, the server extracts calm and practical content on relaxation techniques and provides it to the device. This makes it easier for the user to receive information that is relevant to their emotions, enabling them to learn and improve themselves effectively.

[0333] Furthermore, the emotion engine records the user's emotional changes and uses this data to support the development of action plans. Based on this data, the device proposes the most user-friendly action plan and provides feedback to enhance learning outcomes. This process leads to increased user motivation and further refinement of action plans.

[0334] The following describes the processing flow.

[0335] Step 1:

[0336] The device displays an input screen for information about topics and objectives the user is interested in. The user enters the content they want to learn about or the fields they are interested in into the device.

[0337] Step 2:

[0338] The terminal sends the information entered by the user to the server. At the same time, the terminal also sends emotional data collected from the user in real time (such as typing speed and selection speed).

[0339] Step 3:

[0340] The server analyzes the received data and generates a list of keywords that match the user's interests. It also uses an emotion engine to evaluate the user's current emotional state based on the transmitted emotion data.

[0341] Step 4:

[0342] The server searches a database of digital content based on the generated keywords and extracts information tailored to the user's emotional state. For example, if the user is feeling stressed, it prioritizes information on relaxation methods.

[0343] Step 5:

[0344] The server summarizes the extracted information in a way that is optimal for the user's emotions. Depending on the emotional state, it adjusts the tone and presentation method of the information (video, simplified text, etc.) to make it easy for the user to understand.

[0345] Step 6:

[0346] The server sends the formatted information to the terminal.

[0347] Step 7:

[0348] The device displays the information provided to the user. The device tracks the user's subsequent emotional changes in real time using an emotion engine and adjusts the information presented as needed.

[0349] Step 8:

[0350] Users learn from the information presented and create specific action plans using the action planning tool provided on their device. During this process, they receive notifications from their device with advice and suggestions based on emotional data.

[0351] Step 9:

[0352] The device sends the action plan created by the user to the server, which then provides feedback that takes into account emotional shifts and the progress of the plan. The server accumulates long-term data and uses it to suggest future improvements.

[0353] (Example 2)

[0354] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0355] Conventional information delivery systems do not take into account the user's emotional state, making it difficult to provide information that is appropriate to the user's situation and emotions. As a result, users may not be interested in the information provided, and effective learning and self-improvement may be difficult. This invention aims to solve these problems by recognizing the user's emotions and providing information that is appropriate to those emotions.

[0356] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0357] In this invention, the server includes means for collecting information about the user's interests and objectives along with emotional information, means for recognizing the user's emotional state using an emotion engine, and means for extracting, summarizing, and organizing information from digital content based on the user's emotions. This enables the provision of information appropriate to the user's emotional state, facilitating effective learning and self-improvement.

[0358] A "user" is an individual or group that uses an information system to collect information related to their interests and purposes.

[0359] "Emotional information" refers to data that expresses the emotional state of a user when they receive information, and is an element that indicates the user's feelings and reactions.

[0360] An "emotion engine" is software or an algorithm that analyzes user input and feedback to identify the user's current emotional state.

[0361] "Digital content" refers to a collection of information that is stored and accessed in electronic format for the purpose of providing it to users, and includes text, images, videos, and other digital media.

[0362] "Keyword generation" is the process of selecting appropriate words or phrases to efficiently extract relevant information based on the user's interests and emotional state.

[0363] "Information summarization and organization" is the process of shortening extracted digital content in a way that is easy for users to understand and rearranging it logically.

[0364] "Feedback" refers to the reactions and responses that users show to the information provided, and is data collected to improve the system and enhance the user experience.

[0365] An "action plan" refers to a set of specific action steps that a user sets to achieve their goals, and serves as a practical guideline for daily life and learning.

[0366] This invention is a system that provides information while taking user emotions into consideration. In implementation, the user, terminal, and server cooperate to analyze and provide information using an emotion engine and a generative AI model.

[0367] The user inputs topics of interest or subjects they wish to learn into the device. The device receives this information from the user via a graphical user interface and sends it to the server along with sentiment information. Possible input formats include text fields and voice input.

[0368] The terminal is responsible for transmitting user input data to the server along with the emotion engine. The emotion engine used here analyzes user emotions in real time based on their input and generates emotion labels. This data is transmitted to the server using a digital communication protocol.

[0369] The server uses a high-performance data processing unit to analyze the received information. In particular, by incorporating an emotion engine and utilizing a generative AI model, it can recognize the user's emotional state with high accuracy. The analyzed emotional information is a crucial element when extracting information from relevant digital content. The server appropriately searches for this information from data storage, summarizes and organizes the content, and sends it to the terminal.

[0370] As a concrete example, consider a case where a user is seeking information on "stress management." If the emotion engine recognizes the user's stress level as "high," the server extracts content related to relaxation techniques. This content is summarized in a way that is easiest for the user to understand and delivered via the device.

[0371] Example of a prompt:

[0372] "When users need calm and practical information about stress management, provide content that is appropriate for their emotional state."

[0373] In this way, the system can optimize information according to the user's emotions, supporting effective learning and self-improvement.

[0374] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0375] Step 1:

[0376] The user inputs topics of interest or subjects they wish to learn into the device. Specifically, the user enters keywords such as "stress management" into input fields through the device's interface. This information becomes input data for the next processing step.

[0377] Step 2:

[0378] The terminal sends user input data to the server along with the emotion engine. The input data, converted into a digital format, is transmitted as packets via network communication. The emotion engine uses this data to perform an initial analysis of the user's emotional state.

[0379] Step 3:

[0380] The server analyzes the data received from the terminal and uses an emotion engine to recognize the user's emotional state in detail. A generative AI model is then used to generate detailed emotion labels based on the user's input. The input consists of the user's theme information and initial emotion data, while the output is the detailed emotion label.

[0381] Step 4:

[0382] The server extracts information from digital content based on the recognized emotional state. Specifically, it queries a database and filters information to match the user's emotions. The input consists of emotion labels and associated themes, while the output is the filtered content.

[0383] Step 5:

[0384] The server summarizes and organizes the extracted information. Using a generative AI model, it edits the content to the appropriate tone and difficulty level, transforming it into a format that is easiest for the user to understand. The input is the extracted content, and the output is the target-specific summarized content.

[0385] Step 6:

[0386] The server sends the organized information to the terminal. The terminal displays this information to the user, visualizing it so that the user can understand it. Specifically, it formats and displays the summarized information on the terminal's display.

[0387] Step 7:

[0388] The device collects user feedback in real time and analyzes it using an emotion engine. User reactions and comments are converted back into emotion data, contributing to improved system performance. The input is user feedback, and the output is analyzed emotion data.

[0389] Step 8:

[0390] The device proposes action plans based on collected emotional data. Considering past data and the user's current emotional state, it presents action plans in a list format that are easily accepted by the user. This enables effective learning and self-improvement.

[0391] (Application Example 2)

[0392] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart glasses 214 as the "terminal".

[0393] The current information delivery system has the challenge of not being able to fully provide information that matches users' interests and emotional states, as it is difficult to select and deliver appropriate content based on the user's emotional state. Furthermore, it lacks the functionality to dynamically adjust content delivery based on user feedback, making it difficult to improve the user experience.

[0394] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0395] In this invention, the server includes means for identifying the user's emotional state and adjusting content accordingly, means for analyzing user responses and dynamically adjusting content delivery, and means for acquiring information about the user's interests and objectives. This enables the delivery of content suited to the user's emotional state, resulting in more personalized information delivery and a superior user experience.

[0396] "Means of obtaining information about user interests and objectives" refers to a system for collecting data from users about areas of interest and goals they wish to achieve.

[0397] "Methods for selecting information from digital data" refer to systems that extract specific information from a group of digital content based on collected information.

[0398] "Means for summarizing and organizing information" refers to a system for concisely summarizing selected information and organizing it systematically.

[0399] "Means of providing organized information" refers to a system that presents organized information in a format that users can utilize.

[0400] "Means for identifying a user's emotional state and adjusting content accordingly" refers to a mechanism that recognizes a user's current emotional state and appropriately changes the content based on that information.

[0401] "Means of analyzing user responses and dynamically adjusting content delivery" refers to a system that analyzes user feedback and real-time responses and immediately adapts the content provided accordingly.

[0402] The system for implementing this invention employs a complex configuration including a user terminal, a server, and a digital network. The terminal is equipped with an interface for inputting information about the user's interests and purposes, which is achieved through an application installed on a mobile device such as a smartphone or smart glasses.

[0403] Upon receiving this information, the server first uses the OpenAI API to activate its emotion engine and identify the user's emotional state. Using natural language processing with the Google Cloud Natural Language API, it searches for digital content based on the user's interests from a database or external API. During this process, it appropriately adjusts the tone and difficulty level of the content, taking the emotional information into consideration.

[0404] The adjusted content is then sent back to the user's device via the network and provided to the user on the device. The device sends real-time responses and feedback from the user back to the server, which dynamically adjusts the accuracy of the content. This enables the provision of higher quality information to the user.

[0405] For example, if a user requests content related to "stress management," the emotion engine will analyze the user's stress level and suggest relaxation techniques as needed. Based on user feedback, further adjustments will be made, and content that better matches the user's current state will be continuously provided.

[0406] An example of a prompt message would be: "Based on the theme entered by the user, generate content that is best suited to his emotional state. If he is under high stress, recommend calming music content." This instruction would be provided to the AI ​​model.

[0407] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0408] Step 1:

[0409] Users input their interests and goals via a terminal. The information entered by the user is sent to the server by the terminal's application. This input data includes the user's interest categories and desired tone. The terminal transfers this input to the server in digital format.

[0410] Step 2:

[0411] The server analyzes the received user information in conjunction with the emotion engine. Specifically, it uses the OpenAI API to analyze the user's emotional state based on their input. As a result, the user's emotional state is output in text format. This output is used in the subsequent content selection process.

[0412] Step 3:

[0413] The server uses Google Cloud Natural Language to search for appropriate digital content based on the output of the emotional state. The input consists of the results of the emotional analysis and the user's interest information, which are then used to filter content data from a database or external API. The output is a refined content list.

[0414] Step 4:

[0415] The server adjusts the tone and difficulty level of the selected content according to the user's emotions. The text of the content is modified based on the user's emotional state. For example, a user experiencing high stress will be provided with text that promotes relaxation. As a result, content data in a format suitable for the user is generated.

[0416] Step 5:

[0417] The server transmits the processed content to the terminal over the network. The terminal receives this content and displays it to the user visually or audibly. The user can then view and verify the content on their own terminal.

[0418] Step 6:

[0419] User reactions and feedback are sent from the device to the server. The server analyzes the feedback using tools such as Google Cloud Natural Language and adjusts content delivery as needed. This input includes changes in the user's emotions and feedback during the session, and the output generates instructions for adjusting content delivery.

[0420] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0421] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0422] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0423] [Third Embodiment]

[0424] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0425] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0426] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0427] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0428] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0429] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0430] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0431] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0432] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0433] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0434] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0435] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0436] This invention is a system that collects information based on the user's interests and objectives, and extracts relevant information from digital content based on that information. For this system to operate, the user first inputs their interests, objectives, and areas of knowledge they wish to improve using a terminal. The terminal then transmits this information to a server.

[0437] The server analyzes the received user information and generates highly relevant keywords. Based on these keywords, the server searches digital content and lists potential information to be extracted. Next, the server uses natural language processing techniques to extract important information from the digital content included in the list.

[0438] The extracted information is summarized and structured, and organized in a way that is easily understandable to the user. The server then sends the organized information to the terminal, which displays it to the user. The terminal also provides tools for the user to create a concrete action plan based on the information obtained.

[0439] For example, if a user enters information into their device with the goal of improving their "leadership skills," the server analyzes digital content, including the latest theories and practical examples related to "leadership," and extracts relevant information. It then provides the user with specific practical methods and training plans, supporting the creation of an action plan.

[0440] Furthermore, this system includes features that allow the acquired information to be used as an educational resource, and provides options for devices to be shared within families and communities. As a result, users can not only achieve self-improvement but also utilize the acquired knowledge and skills for education and social contribution.

[0441] The following describes the processing flow.

[0442] Step 1:

[0443] The terminal displays an interface for users to input topics and goals of interest. Users enter their interests and areas of study into a dedicated input form.

[0444] Step 2:

[0445] The terminal sends the data entered by the user to the server.

[0446] Step 3:

[0447] The server analyzes the received information and generates appropriate keywords. These keywords form the basis for information extraction.

[0448] Step 4:

[0449] The server uses the generated keywords to search a database of digital content and lists the most relevant content.

[0450] Step 5:

[0451] The server applies natural language processing to the listed digital content and extracts the information best suited to the user's purpose.

[0452] Step 6:

[0453] The server summarizes the extracted information and organizes it into a user-friendly format. This information is then prepared to be provided to the user later.

[0454] Step 7:

[0455] The server sends the formatted information to the terminal.

[0456] Step 8:

[0457] The terminal displays the received information to the user and provides the necessary support tools to enable the user to develop an action plan based on that information.

[0458] Step 9:

[0459] Users will use the provided information and tools to create a concrete action plan.

[0460] Step 10:

[0461] The devices are designed with their use as educational resources in mind, and also offer options for easily sharing the information obtained.

[0462] (Example 1)

[0463] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0464] In modern society, users are required to efficiently acquire information that matches their interests and objectives from a vast amount of data, and to use that information to develop concrete action plans. However, existing information gathering systems struggle to effectively extract and organize highly relevant information that meets user needs, and they lack sufficient support for translating that information into concrete actions that align with those objectives. As a result, users are often overwhelmed by excessive information or overlook useful information. Therefore, there is a strong need for a new system that can provide information that meets user needs quickly and accurately, and further support the development of action plans based on that information.

[0465] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0466] In this invention, the server includes a device for collecting information related to the user's interests and objectives, a device for analyzing the collected information and generating highly relevant keywords, and a device for searching digital information sources and extracting information based on the generated keywords. This makes it possible to efficiently extract information that meets the user's needs and provide it in a way that is useful for specific actions.

[0467] A "user" refers to an individual or group that acquires and utilizes information.

[0468] "Interests" refer to specific themes or fields that a user is particularly interested in, and their depth and scope vary depending on the user's objectives.

[0469] "Purpose" refers to the specific outcome or result that the user wants to achieve, and serves as a standard for information gathering and action planning.

[0470] "Information" refers to facts, concepts, or content that facilitates understanding, provided in digital or other forms.

[0471] "Device" refers to a mechanical or electronic component designed to perform a specific function or task.

[0472] "Analysis" refers to the process of examining information in detail, understanding its structure, and gaining new insights.

[0473] "Keywords" are important words or phrases related to a specific theme or concept, and they serve as a starting point for information retrieval and organization.

[0474] "Digital information sources" refer to various types of data or content that are stored and provided electronically.

[0475] "Extraction" refers to the process of extracting specific information from a broad dataset.

[0476] "Support" refers to providing assistance and guidance to users in developing and implementing action plans based on the information they receive.

[0477] This invention is a system that helps users efficiently and accurately acquire information based on their interests and objectives, and to develop action plans based on that information. This system is primarily implemented using a server and terminals.

[0478] Users use the terminal to input information related to their interests and goals. This input can take various forms, including text and voice. The terminal receives the user's input and sends it to the server. In doing so, the terminal manages the data securely and efficiently by utilizing data configuration and security protocols.

[0479] The server analyzes the received information and generates highly relevant keywords using natural language processing technology. Specifically, it uses an analysis model that applies machine learning to extract important elements that align with the user's purpose. In this step, high-precision analysis is performed by utilizing common cloud services and AI models.

[0480] Next, the server searches digital information sources based on the generated keywords and extracts relevant information from the database. This information is then summarized and structured using natural language processing techniques and converted into a format that is easily understandable to the user. Specific examples include data analysis using Amazon Web Services (AWS) and general-purpose search engines.

[0481] The organized information is sent back from the server to the terminal and presented to the user on the terminal. Based on the information provided, the user uses an action planning tool to set specific actions. For example, this would be the case with an application that integrates with task management tools such as Trello.

[0482] For example, if a user enters information with the goal of "improving leadership skills," the server will collect the latest leadership-related information and propose a summarized, practical skills training method via the terminal. Through this process, the user can clarify actionable steps based on specific strategies.

[0483] Examples of prompt statements include: "What are the latest leadership theories?" and "How can I improve my skills as a team leader?" Such prompts enable the generative AI model to provide information tailored to the user's needs.

[0484] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0485] Step 1:

[0486] The user uses a device to input their interests and goals in text or voice format. This input includes topics the user is interested in and skills they want to improve. Specifically, the user types a prompt such as "I want to learn about improving my leadership skills" using the keyboard. The device temporarily stores this information and prepares to send it to the server.

[0487] Step 2:

[0488] The terminal sends the entered user information to the server. This process uses an internet connection and employs encryption protocols to ensure security. The input data is structured and sent to the server via an HTTP request.

[0489] Step 3:

[0490] The server analyzes the received user information. First, it understands the text data using natural language processing (NLP) techniques and automatically generates relevant keywords. This calculation utilizes an AI model that takes into account the frequency of words and context in the text. The output is a list of keywords such as "leadership," "skills," and "training."

[0491] Step 4:

[0492] The server searches the internet for relevant digital information sources based on the generated keywords. Specifically, it uses a cloud-based search service to quickly search for relevant literature and articles in the database and create a list of candidates. This list is then output.

[0493] Step 5:

[0494] The server further processes the digital data obtained from the search results to extract important information. This process utilizes summarization algorithms to concisely summarize the main points and gist of the document. The output of this process is a concise and structured information description.

[0495] Step 6:

[0496] The server sends summarized and structured information to the terminal. This data is formatted in a user-friendly manner, re-encrypted, and then transmitted. The terminal receives this information and displays it to the user when ready.

[0497] Step 7:

[0498] The device visually presents information to the user and provides support tools for developing action plans based on the information obtained. For example, it can connect to applications (e.g., Trello or spreadsheets) for setting specific tasks based on the information, supporting the user in putting their plan into action.

[0499] (Application Example 1)

[0500] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0501] In modern society, when individual users aim to achieve specific learning goals or improve their skills, they are required to access relevant information, efficiently understand it, and put it into action. However, there is a challenge in selecting useful information from a vast amount of data and then optimizing and providing it to each individual user.

[0502] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0503] In this invention, the server includes means for collecting information about the user's interests and objectives, means for extracting information from information resources based on the collected information, and means for summarizing and organizing the extracted information. This makes it possible for the user to set specific learning goals or skill improvement objectives, efficiently collect and analyze information resources related to those fields, display summaries, and further assist in creating action plans.

[0504] "Information about user interests and objectives" refers to information about a user's interests and goals regarding a particular field or issue.

[0505] "Information resources" refer to various digital content and datasets that exist on the internet or in databases.

[0506] "Extraction" refers to the act of selecting highly relevant and important parts from a large amount of information.

[0507] "Summarization" is the act of making extracted information concise and clearly presenting the important points.

[0508] "Skill improvement" refers to the process of aiming to acquire knowledge and improve abilities in a specific field.

[0509] An "action plan" is a plan that outlines the steps and action guidelines for achieving a specific goal.

[0510] The system that realizes this invention begins with the user inputting a specific topic of interest or a skill improvement goal into a terminal such as a smartphone or head-mounted display. The terminal sends this information to a server. When the server analyzes the received information, it uses natural language processing technology to search the internet for highly relevant information resources based on the input content. This process utilizes the Python programming language and its library, requests, to ensure efficient communication.

[0511] The server extracts important information from the information resources obtained through the search, and then summarizes and organizes it appropriately. This information processing uses a natural language processing library to simplify the information and highlight key points. The organized information is then sent back from the server to the terminal.

[0512] The device supports the user's learning goals and skill improvement process by displaying organized information. Users can then develop concrete action plans based on the information they receive, and the device includes a guide function to assist in this planning process.

[0513] For example, if a user is interested in the topic of "environmental issues," the system will collect and summarize the latest environmental news and research data and provide it to the user. It will then offer concrete action suggestions to help with environmental protection activities, enabling the user to proactively develop their own action plans.

[0514] An example of a prompt message that supports this system is: "Collect, summarize, and display the latest information related to the user's area of ​​interest (environmental issues). Also, provide specific suggestions that will be useful for action planning." Based on this prompt message, the server performs optimal information collection and analysis.

[0515] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0516] Step 1:

[0517] The terminal receives information related to the user's interests and goals as input and sends it to the server. Here, the user sets a specific theme (e.g., environmental issues) or a goal for skill improvement and inputs that information as digital data. The input data is sent to the server via an HTTP request.

[0518] Step 2:

[0519] The server analyzes the received user information. It generates keywords related to the theme sent as input using a natural language processing library. Keyword generation involves analyzing the user's input theme and selecting appropriate related keywords based on its context. As a result, the server obtains a set of related keywords as output.

[0520] Step 3:

[0521] The server searches for information resources based on generated keywords. It accesses repositories and databases on the internet and collects relevant digital content. The input here is a set of pre-generated keywords, and the output is a list of relevant information resources. This includes information retrieval using external APIs and database queries.

[0522] Step 4:

[0523] The server extracts and summarizes information from collected information resources. Using the collected information as input, it extracts and summarizes important information using natural language processing techniques and outputs concise structured data. This process includes data processing such as evaluating the importance of information and extracting key points.

[0524] Step 5:

[0525] The server sends summarized information to the terminal. The output structured data is then sent back to the terminal via the HTTP protocol. As a result, the terminal presents the information in a format that is easy for the user to understand. The user can then use the presented information to aid in learning and skill improvement.

[0526] Step 6:

[0527] The terminal displays the received information and assists the user in developing a concrete action plan. The input here is structured data sent from the server, and the output is the action plan created by the user. Based on this information, the terminal utilizes a guide function to assist the user in creating their plan.

[0528] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0529] This invention relates to a system that recognizes a user's emotions using an emotion engine and extracts and provides information that takes these emotions into account. To implement this system, the user first inputs their interests and topics they wish to learn about into a terminal. The terminal then transmits this information, along with the emotion engine, to a server.

[0530] The server uses an emotion engine to analyze the user information it receives and generate appropriate keywords. The emotion engine recognizes the user's current emotional state based on what the user has entered and their feedback during use. This emotional information serves as one of the factors the server uses to determine what information to extract from the digital content.

[0531] The server considers the user's emotional state, selects the most appropriate content, and summarizes and organizes the extracted information with a tone and difficulty level appropriate to that emotion. It then sends the organized information to the device, providing it to the user in a viewable format. The device, in turn, utilizes an emotion engine to analyze how the user is receiving the information in real time and makes adjustments as needed.

[0532] For example, if a user is seeking information on "stress management," the emotion engine analyzes the user's current stress level. If, for instance, the system detects that the user is experiencing high stress, the server extracts calm and practical content on relaxation techniques and provides it to the device. This makes it easier for the user to receive information that is relevant to their emotions, enabling them to learn and improve themselves effectively.

[0533] Furthermore, the emotion engine records the user's emotional changes and uses this data to support the development of action plans. Based on this data, the device proposes the most user-friendly action plan and provides feedback to enhance learning outcomes. This process leads to increased user motivation and further refinement of action plans.

[0534] The following describes the processing flow.

[0535] Step 1:

[0536] The device displays an input screen for information about topics and objectives the user is interested in. The user enters the content they want to learn about or the fields they are interested in into the device.

[0537] Step 2:

[0538] The terminal sends the information entered by the user to the server. At the same time, the terminal also sends emotional data collected from the user in real time (such as typing speed and selection speed).

[0539] Step 3:

[0540] The server analyzes the received data and generates a list of keywords that match the user's interests. It also uses an emotion engine to evaluate the user's current emotional state based on the transmitted emotion data.

[0541] Step 4:

[0542] The server searches a database of digital content based on the generated keywords and extracts information tailored to the user's emotional state. For example, if the user is feeling stressed, it prioritizes information on relaxation methods.

[0543] Step 5:

[0544] The server summarizes the extracted information in a way that is optimal for the user's emotions. Depending on the emotional state, it adjusts the tone and presentation method of the information (video, simplified text, etc.) to make it easy for the user to understand.

[0545] Step 6:

[0546] The server sends the formatted information to the terminal.

[0547] Step 7:

[0548] The device displays the information provided to the user. The device tracks the user's subsequent emotional changes in real time using an emotion engine and adjusts the information presented as needed.

[0549] Step 8:

[0550] Users learn from the information presented and create specific action plans using the action planning tool provided on their device. During this process, they receive notifications from their device with advice and suggestions based on emotional data.

[0551] Step 9:

[0552] The device sends the action plan created by the user to the server, which then provides feedback that takes into account emotional shifts and the progress of the plan. The server accumulates long-term data and uses it to suggest future improvements.

[0553] (Example 2)

[0554] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0555] Conventional information delivery systems do not take into account the user's emotional state, making it difficult to provide information that is appropriate to the user's situation and emotions. As a result, users may not be interested in the information provided, and effective learning and self-improvement may be difficult. This invention aims to solve these problems by recognizing the user's emotions and providing information that is appropriate to those emotions.

[0556] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0557] In this invention, the server includes means for collecting information about the user's interests and objectives along with emotional information, means for recognizing the user's emotional state using an emotion engine, and means for extracting, summarizing, and organizing information from digital content based on the user's emotions. This enables the provision of information appropriate to the user's emotional state, facilitating effective learning and self-improvement.

[0558] A "user" is an individual or group that uses an information system to collect information related to their interests and purposes.

[0559] "Emotional information" refers to data that expresses the emotional state of a user when they receive information, and is an element that indicates the user's feelings and reactions.

[0560] An "emotion engine" is software or an algorithm that analyzes user input and feedback to identify the user's current emotional state.

[0561] "Digital content" refers to a collection of information that is stored and accessed in electronic format for the purpose of providing it to users, and includes text, images, videos, and other digital media.

[0562] "Keyword generation" is the process of selecting appropriate words or phrases to efficiently extract relevant information based on the user's interests and emotional state.

[0563] "Information summarization and organization" is the process of shortening extracted digital content in a way that is easy for users to understand and rearranging it logically.

[0564] "Feedback" refers to the reactions and responses that users show to the information provided, and is data collected to improve the system and enhance the user experience.

[0565] An "action plan" refers to a set of specific action steps that a user sets to achieve their goals, and serves as a practical guideline for daily life and learning.

[0566] This invention is a system that provides information while taking user emotions into consideration. In implementation, the user, terminal, and server cooperate to analyze and provide information using an emotion engine and a generative AI model.

[0567] The user inputs topics of interest or subjects they wish to learn into the device. The device receives this information from the user via a graphical user interface and sends it to the server along with sentiment information. Possible input formats include text fields and voice input.

[0568] The terminal is responsible for transmitting user input data to the server along with the emotion engine. The emotion engine used here analyzes user emotions in real time based on their input and generates emotion labels. This data is transmitted to the server using a digital communication protocol.

[0569] The server uses a high-performance data processing unit to analyze the received information. In particular, by incorporating an emotion engine and utilizing a generative AI model, it can recognize the user's emotional state with high accuracy. The analyzed emotional information is a crucial element when extracting information from relevant digital content. The server appropriately searches for this information from data storage, summarizes and organizes the content, and sends it to the terminal.

[0570] As a concrete example, consider a case where a user is seeking information on "stress management." If the emotion engine recognizes the user's stress level as "high," the server extracts content related to relaxation techniques. This content is summarized in a way that is easiest for the user to understand and delivered via the device.

[0571] Example of a prompt:

[0572] "When users need calm and practical information about stress management, provide content that is appropriate for their emotional state."

[0573] In this way, the system can optimize information according to the user's emotions, supporting effective learning and self-improvement.

[0574] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0575] Step 1:

[0576] The user inputs topics of interest or subjects they wish to learn into the device. Specifically, the user enters keywords such as "stress management" into input fields through the device's interface. This information becomes input data for the next processing step.

[0577] Step 2:

[0578] The terminal sends user input data to the server along with the emotion engine. The input data, converted into a digital format, is transmitted as packets via network communication. The emotion engine uses this data to perform an initial analysis of the user's emotional state.

[0579] Step 3:

[0580] The server analyzes the data received from the terminal and uses an emotion engine to recognize the user's emotional state in detail. A generative AI model is then used to generate detailed emotion labels based on the user's input. The input consists of the user's theme information and initial emotion data, while the output is the detailed emotion label.

[0581] Step 4:

[0582] The server extracts information from digital content based on the recognized emotional state. Specifically, it queries a database and filters information to match the user's emotions. The input consists of emotion labels and associated themes, while the output is the filtered content.

[0583] Step 5:

[0584] The server summarizes and organizes the extracted information. Using a generative AI model, it edits the content to the appropriate tone and difficulty level, transforming it into a format that is easiest for the user to understand. The input is the extracted content, and the output is the target-specific summarized content.

[0585] Step 6:

[0586] The server sends the organized information to the terminal. The terminal displays this information to the user, visualizing it so that the user can understand it. Specifically, it formats and displays the summarized information on the terminal's display.

[0587] Step 7:

[0588] The device collects user feedback in real time and analyzes it using an emotion engine. User reactions and comments are converted back into emotion data, contributing to improved system performance. The input is user feedback, and the output is analyzed emotion data.

[0589] Step 8:

[0590] The device proposes action plans based on collected emotional data. Considering past data and the user's current emotional state, it presents action plans in a list format that are easily accepted by the user. This enables effective learning and self-improvement.

[0591] (Application Example 2)

[0592] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0593] The current information delivery system has the challenge of not being able to fully provide information that matches users' interests and emotional states, as it is difficult to select and deliver appropriate content based on the user's emotional state. Furthermore, it lacks the functionality to dynamically adjust content delivery based on user feedback, making it difficult to improve the user experience.

[0594] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0595] In this invention, the server includes means for identifying the user's emotional state and adjusting content accordingly, means for analyzing user responses and dynamically adjusting content delivery, and means for acquiring information about the user's interests and objectives. This enables the delivery of content suited to the user's emotional state, resulting in more personalized information delivery and a superior user experience.

[0596] "Means of obtaining information about user interests and objectives" refers to a system for collecting data from users about areas of interest and goals they wish to achieve.

[0597] "Methods for selecting information from digital data" refer to systems that extract specific information from a group of digital content based on collected information.

[0598] "Means for summarizing and organizing information" refers to a system for concisely summarizing selected information and organizing it systematically.

[0599] "Means of providing organized information" refers to a system that presents organized information in a format that users can utilize.

[0600] "Means for identifying a user's emotional state and adjusting content accordingly" refers to a mechanism that recognizes a user's current emotional state and appropriately changes the content based on that information.

[0601] "Means of analyzing user responses and dynamically adjusting content delivery" refers to a system that analyzes user feedback and real-time responses and immediately adapts the content provided accordingly.

[0602] The system for implementing this invention employs a complex configuration including a user terminal, a server, and a digital network. The terminal is equipped with an interface for inputting information about the user's interests and purposes, which is achieved through an application installed on a mobile device such as a smartphone or smart glasses.

[0603] Upon receiving this information, the server first uses the OpenAI API to activate its emotion engine and identify the user's emotional state. Using natural language processing with the Google Cloud Natural Language API, it searches for digital content based on the user's interests from a database or external API. During this process, it appropriately adjusts the tone and difficulty level of the content, taking the emotional information into consideration.

[0604] The adjusted content is then sent back to the user's device via the network and provided to the user on the device. The device sends real-time responses and feedback from the user back to the server, which dynamically adjusts the accuracy of the content. This enables the provision of higher quality information to the user.

[0605] For example, if a user requests content related to "stress management," the emotion engine will analyze the user's stress level and suggest relaxation techniques as needed. Based on user feedback, further adjustments will be made, and content that better matches the user's current state will be continuously provided.

[0606] An example of a prompt message would be: "Based on the theme entered by the user, generate content that is best suited to his emotional state. If he is under high stress, recommend calming music content." This instruction would be provided to the AI ​​model.

[0607] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0608] Step 1:

[0609] Users input their interests and goals via a terminal. The information entered by the user is sent to the server by the terminal's application. This input data includes the user's interest categories and desired tone. The terminal transfers this input to the server in digital format.

[0610] Step 2:

[0611] The server analyzes the received user information in conjunction with the emotion engine. Specifically, it uses the OpenAI API to analyze the user's emotional state based on their input. As a result, the user's emotional state is output in text format. This output is used in the subsequent content selection process.

[0612] Step 3:

[0613] The server uses Google Cloud Natural Language to search for appropriate digital content based on the output of the emotional state. The input consists of the results of the emotional analysis and the user's interest information, which are then used to filter content data from a database or external API. The output is a refined content list.

[0614] Step 4:

[0615] The server adjusts the tone and difficulty level of the selected content according to the user's emotions. The text of the content is modified based on the user's emotional state. For example, a user experiencing high stress will be provided with text that promotes relaxation. As a result, content data in a format suitable for the user is generated.

[0616] Step 5:

[0617] The server transmits the processed content to the terminal over the network. The terminal receives this content and displays it to the user visually or audibly. The user can then view and verify the content on their own terminal.

[0618] Step 6:

[0619] User reactions and feedback are sent from the device to the server. The server analyzes the feedback using tools such as Google Cloud Natural Language and adjusts content delivery as needed. This input includes changes in the user's emotions and feedback during the session, and the output generates instructions for adjusting content delivery.

[0620] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0621] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0622] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0623] [Fourth Embodiment]

[0624] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0625] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0626] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0627] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0628] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0629] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0630] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0631] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0632] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0633] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0634] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0635] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0636] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0637] This invention is a system that collects information based on the user's interests and objectives, and extracts relevant information from digital content based on that information. For this system to operate, the user first inputs their interests, objectives, and areas of knowledge they wish to improve using a terminal. The terminal then transmits this information to a server.

[0638] The server analyzes the received user information and generates highly relevant keywords. Based on these keywords, the server searches digital content and lists potential information to be extracted. Next, the server uses natural language processing techniques to extract important information from the digital content included in the list.

[0639] The extracted information is summarized and structured, and organized in a way that is easily understandable to the user. The server then sends the organized information to the terminal, which displays it to the user. The terminal also provides tools for the user to create a concrete action plan based on the information obtained.

[0640] For example, if a user enters information into their device with the goal of improving their "leadership skills," the server analyzes digital content, including the latest theories and practical examples related to "leadership," and extracts relevant information. It then provides the user with specific practical methods and training plans, supporting the creation of an action plan.

[0641] Furthermore, this system includes features that allow the acquired information to be used as an educational resource, and provides options for devices to be shared within families and communities. As a result, users can not only achieve self-improvement but also utilize the acquired knowledge and skills for education and social contribution.

[0642] The following describes the processing flow.

[0643] Step 1:

[0644] The terminal displays an interface for users to input topics and goals of interest. Users enter their interests and areas of study into a dedicated input form.

[0645] Step 2:

[0646] The terminal sends the data entered by the user to the server.

[0647] Step 3:

[0648] The server analyzes the received information and generates appropriate keywords. These keywords form the basis for information extraction.

[0649] Step 4:

[0650] The server uses the generated keywords to search a database of digital content and lists the most relevant content.

[0651] Step 5:

[0652] The server applies natural language processing to the listed digital content and extracts the information best suited to the user's purpose.

[0653] Step 6:

[0654] The server summarizes the extracted information and organizes it into a user-friendly format. This information is then prepared to be provided to the user later.

[0655] Step 7:

[0656] The server sends the formatted information to the terminal.

[0657] Step 8:

[0658] The terminal displays the received information to the user and provides the necessary support tools to enable the user to develop an action plan based on that information.

[0659] Step 9:

[0660] Users will use the provided information and tools to create a concrete action plan.

[0661] Step 10:

[0662] The devices are designed with their use as educational resources in mind, and also offer options for easily sharing the information obtained.

[0663] (Example 1)

[0664] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0665] In modern society, users are required to efficiently acquire information that matches their interests and objectives from a vast amount of data, and to use that information to develop concrete action plans. However, existing information gathering systems struggle to effectively extract and organize highly relevant information that meets user needs, and they lack sufficient support for translating that information into concrete actions that align with those objectives. As a result, users are often overwhelmed by excessive information or overlook useful information. Therefore, there is a strong need for a new system that can provide information that meets user needs quickly and accurately, and further support the development of action plans based on that information.

[0666] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0667] In this invention, the server includes a device for collecting information related to the user's interests and objectives, a device for analyzing the collected information and generating highly relevant keywords, and a device for searching digital information sources and extracting information based on the generated keywords. This makes it possible to efficiently extract information that meets the user's needs and provide it in a way that is useful for specific actions.

[0668] A "user" refers to an individual or group that acquires and utilizes information.

[0669] "Interests" refer to specific themes or fields that a user is particularly interested in, and their depth and scope vary depending on the user's objectives.

[0670] "Purpose" refers to the specific outcome or result that the user wants to achieve, and serves as a standard for information gathering and action planning.

[0671] "Information" refers to facts, concepts, or content that facilitates understanding, provided in digital or other forms.

[0672] "Device" refers to a mechanical or electronic component designed to perform a specific function or task.

[0673] "Analysis" refers to the process of examining information in detail, understanding its structure, and gaining new insights.

[0674] "Keywords" are important words or phrases related to a specific theme or concept, and they serve as a starting point for information retrieval and organization.

[0675] "Digital information sources" refer to various types of data or content that are stored and provided electronically.

[0676] "Extraction" refers to the process of extracting specific information from a broad dataset.

[0677] "Support" refers to providing assistance and guidance to users in developing and implementing action plans based on the information they receive.

[0678] This invention is a system that helps users efficiently and accurately acquire information based on their interests and objectives, and to develop action plans based on that information. This system is primarily implemented using a server and terminals.

[0679] Users use the terminal to input information related to their interests and goals. This input can take various forms, including text and voice. The terminal receives the user's input and sends it to the server. In doing so, the terminal manages the data securely and efficiently by utilizing data configuration and security protocols.

[0680] The server analyzes the received information and generates highly relevant keywords using natural language processing technology. Specifically, it uses an analysis model that applies machine learning to extract important elements that align with the user's purpose. In this step, high-precision analysis is performed by utilizing common cloud services and AI models.

[0681] Next, the server searches digital information sources based on the generated keywords and extracts relevant information from the database. This information is then summarized and structured using natural language processing techniques and converted into a format that is easily understandable to the user. Specific examples include data analysis using Amazon Web Services (AWS) and general-purpose search engines.

[0682] The organized information is sent back from the server to the terminal and presented to the user on the terminal. Based on the information provided, the user uses an action planning tool to set specific actions. For example, this would be the case with an application that integrates with task management tools such as Trello.

[0683] For example, if a user enters information with the goal of "improving leadership skills," the server will collect the latest leadership-related information and propose a summarized, practical skills training method via the terminal. Through this process, the user can clarify actionable steps based on specific strategies.

[0684] Examples of prompt statements include: "What are the latest leadership theories?" and "How can I improve my skills as a team leader?" Such prompts enable the generative AI model to provide information tailored to the user's needs.

[0685] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0686] Step 1:

[0687] The user uses a device to input their interests and goals in text or voice format. This input includes topics the user is interested in and skills they want to improve. Specifically, the user types a prompt such as "I want to learn about improving my leadership skills" using the keyboard. The device temporarily stores this information and prepares to send it to the server.

[0688] Step 2:

[0689] The terminal sends the entered user information to the server. This process uses an internet connection and employs encryption protocols to ensure security. The input data is structured and sent to the server via an HTTP request.

[0690] Step 3:

[0691] The server analyzes the received user information. First, it understands the text data using natural language processing (NLP) techniques and automatically generates relevant keywords. This calculation utilizes an AI model that takes into account the frequency of words and context in the text. The output is a list of keywords such as "leadership," "skills," and "training."

[0692] Step 4:

[0693] The server searches the internet for relevant digital information sources based on the generated keywords. Specifically, it uses a cloud-based search service to quickly search for relevant literature and articles in the database and create a list of candidates. This list is then output.

[0694] Step 5:

[0695] The server further processes the digital data obtained from the search results to extract important information. This process utilizes summarization algorithms to concisely summarize the main points and gist of the document. The output of this process is a concise and structured information description.

[0696] Step 6:

[0697] The server sends summarized and structured information to the terminal. This data is formatted in a user-friendly manner, re-encrypted, and then transmitted. The terminal receives this information and displays it to the user when ready.

[0698] Step 7:

[0699] The device visually presents information to the user and provides support tools for developing action plans based on the information obtained. For example, it can connect to applications (e.g., Trello or spreadsheets) for setting specific tasks based on the information, supporting the user in putting their plan into action.

[0700] (Application Example 1)

[0701] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0702] In modern society, when individual users aim to achieve specific learning goals or improve their skills, they are required to access relevant information, efficiently understand it, and put it into action. However, there is a challenge in selecting useful information from a vast amount of data and then optimizing and providing it to each individual user.

[0703] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0704] In this invention, the server includes means for collecting information about the user's interests and objectives, means for extracting information from information resources based on the collected information, and means for summarizing and organizing the extracted information. This makes it possible for the user to set specific learning goals or skill improvement objectives, efficiently collect and analyze information resources related to those fields, display summaries, and further assist in creating action plans.

[0705] "Information about user interests and objectives" refers to information about a user's interests and goals regarding a particular field or issue.

[0706] "Information resources" refer to various digital content and datasets that exist on the internet or in databases.

[0707] "Extraction" refers to the act of selecting highly relevant and important parts from a large amount of information.

[0708] "Summarization" is the act of making extracted information concise and clearly presenting the important points.

[0709] "Skill improvement" refers to the process of aiming to acquire knowledge and improve abilities in a specific field.

[0710] An "action plan" is a plan that outlines the steps and action guidelines for achieving a specific goal.

[0711] The system that realizes this invention begins with the user inputting a specific topic of interest or a skill improvement goal into a terminal such as a smartphone or head-mounted display. The terminal sends this information to a server. When the server analyzes the received information, it uses natural language processing technology to search the internet for highly relevant information resources based on the input content. This process utilizes the Python programming language and its library, requests, to ensure efficient communication.

[0712] The server extracts important information from the information resources obtained through the search, and then summarizes and organizes it appropriately. This information processing uses a natural language processing library to simplify the information and highlight key points. The organized information is then sent back from the server to the terminal.

[0713] The device supports the user's learning goals and skill improvement process by displaying organized information. Users can then develop concrete action plans based on the information they receive, and the device includes a guide function to assist in this planning process.

[0714] For example, if a user is interested in the topic of "environmental issues," the system will collect and summarize the latest environmental news and research data and provide it to the user. It will then offer concrete action suggestions to help with environmental protection activities, enabling the user to proactively develop their own action plans.

[0715] An example of a prompt message that supports this system is: "Collect, summarize, and display the latest information related to the user's area of ​​interest (environmental issues). Also, provide specific suggestions that will be useful for action planning." Based on this prompt message, the server performs optimal information collection and analysis.

[0716] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0717] Step 1:

[0718] The terminal receives information related to the user's interests and goals as input and sends it to the server. Here, the user sets a specific theme (e.g., environmental issues) or a goal for skill improvement and inputs that information as digital data. The input data is sent to the server via an HTTP request.

[0719] Step 2:

[0720] The server analyzes the received user information. It generates keywords related to the theme sent as input using a natural language processing library. Keyword generation involves analyzing the user's input theme and selecting appropriate related keywords based on its context. As a result, the server obtains a set of related keywords as output.

[0721] Step 3:

[0722] The server searches for information resources based on generated keywords. It accesses repositories and databases on the internet and collects relevant digital content. The input here is a set of pre-generated keywords, and the output is a list of relevant information resources. This includes information retrieval using external APIs and database queries.

[0723] Step 4:

[0724] The server extracts and summarizes information from collected information resources. Using the collected information as input, it extracts and summarizes important information using natural language processing techniques and outputs concise structured data. This process includes data processing such as evaluating the importance of information and extracting key points.

[0725] Step 5:

[0726] The server sends summarized information to the terminal. The output structured data is then sent back to the terminal via the HTTP protocol. As a result, the terminal presents the information in a format that is easy for the user to understand. The user can then use the presented information to aid in learning and skill improvement.

[0727] Step 6:

[0728] The terminal displays the received information and assists the user in developing a concrete action plan. The input here is structured data sent from the server, and the output is the action plan created by the user. Based on this information, the terminal utilizes a guide function to assist the user in creating their plan.

[0729] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0730] This invention relates to a system that recognizes a user's emotions using an emotion engine and extracts and provides information that takes these emotions into account. To implement this system, the user first inputs their interests and topics they wish to learn about into a terminal. The terminal then transmits this information, along with the emotion engine, to a server.

[0731] The server uses an emotion engine to analyze the user information it receives and generate appropriate keywords. The emotion engine recognizes the user's current emotional state based on what the user has entered and their feedback during use. This emotional information serves as one of the factors the server uses to determine what information to extract from the digital content.

[0732] The server considers the user's emotional state, selects the most appropriate content, and summarizes and organizes the extracted information with a tone and difficulty level appropriate to that emotion. It then sends the organized information to the device, providing it to the user in a viewable format. The device, in turn, utilizes an emotion engine to analyze how the user is receiving the information in real time and makes adjustments as needed.

[0733] For example, if a user is seeking information on "stress management," the emotion engine analyzes the user's current stress level. If, for instance, the system detects that the user is experiencing high stress, the server extracts calm and practical content on relaxation techniques and provides it to the device. This makes it easier for the user to receive information that is relevant to their emotions, enabling them to learn and improve themselves effectively.

[0734] Furthermore, the emotion engine records the user's emotional changes and uses this data to support the development of action plans. Based on this data, the device proposes the most user-friendly action plan and provides feedback to enhance learning outcomes. This process leads to increased user motivation and further refinement of action plans.

[0735] The following describes the processing flow.

[0736] Step 1:

[0737] The device displays an input screen for information about topics and objectives the user is interested in. The user enters the content they want to learn about or the fields they are interested in into the device.

[0738] Step 2:

[0739] The terminal sends the information entered by the user to the server. At the same time, the terminal also sends emotional data collected from the user in real time (such as typing speed and selection speed).

[0740] Step 3:

[0741] The server analyzes the received data and generates a list of keywords that match the user's interests. It also uses an emotion engine to evaluate the user's current emotional state based on the transmitted emotion data.

[0742] Step 4:

[0743] The server searches a database of digital content based on the generated keywords and extracts information tailored to the user's emotional state. For example, if the user is feeling stressed, it prioritizes information on relaxation methods.

[0744] Step 5:

[0745] The server summarizes the extracted information in a way that is optimal for the user's emotions. Depending on the emotional state, it adjusts the tone and presentation method of the information (video, simplified text, etc.) to make it easy for the user to understand.

[0746] Step 6:

[0747] The server sends the formatted information to the terminal.

[0748] Step 7:

[0749] The device displays the information provided to the user. The device tracks the user's subsequent emotional changes in real time using an emotion engine and adjusts the information presented as needed.

[0750] Step 8:

[0751] Users learn from the information presented and create specific action plans using the action planning tool provided on their device. During this process, they receive notifications from their device with advice and suggestions based on emotional data.

[0752] Step 9:

[0753] The device sends the action plan created by the user to the server, which then provides feedback that takes into account emotional shifts and the progress of the plan. The server accumulates long-term data and uses it to suggest future improvements.

[0754] (Example 2)

[0755] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0756] Conventional information delivery systems do not take into account the user's emotional state, making it difficult to provide information that is appropriate to the user's situation and emotions. As a result, users may not be interested in the information provided, and effective learning and self-improvement may be difficult. This invention aims to solve these problems by recognizing the user's emotions and providing information that is appropriate to those emotions.

[0757] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0758] In this invention, the server includes means for collecting information about the user's interests and objectives along with emotional information, means for recognizing the user's emotional state using an emotion engine, and means for extracting, summarizing, and organizing information from digital content based on the user's emotions. This enables the provision of information appropriate to the user's emotional state, facilitating effective learning and self-improvement.

[0759] A "user" is an individual or group that uses an information system to collect information related to their interests and purposes.

[0760] "Emotional information" refers to data that expresses the emotional state of a user when they receive information, and is an element that indicates the user's feelings and reactions.

[0761] An "emotion engine" is software or an algorithm that analyzes user input and feedback to identify the user's current emotional state.

[0762] "Digital content" refers to a collection of information that is stored and accessed in electronic format for the purpose of providing it to users, and includes text, images, videos, and other digital media.

[0763] "Keyword generation" is the process of selecting appropriate words or phrases to efficiently extract relevant information based on the user's interests and emotional state.

[0764] "Information summarization and organization" is the process of shortening extracted digital content in a way that is easy for users to understand and rearranging it logically.

[0765] "Feedback" refers to the reactions and responses that users show to the information provided, and is data collected to improve the system and enhance the user experience.

[0766] An "action plan" refers to a set of specific action steps that a user sets to achieve their goals, and serves as a practical guideline for daily life and learning.

[0767] This invention is a system that provides information while taking user emotions into consideration. In implementation, the user, terminal, and server cooperate to analyze and provide information using an emotion engine and a generative AI model.

[0768] The user inputs topics of interest or subjects they wish to learn into the device. The device receives this information from the user via a graphical user interface and sends it to the server along with sentiment information. Possible input formats include text fields and voice input.

[0769] The terminal is responsible for transmitting user input data to the server along with the emotion engine. The emotion engine used here analyzes user emotions in real time based on their input and generates emotion labels. This data is transmitted to the server using a digital communication protocol.

[0770] The server uses a high-performance data processing unit to analyze the received information. In particular, by incorporating an emotion engine and utilizing a generative AI model, it can recognize the user's emotional state with high accuracy. The analyzed emotional information is a crucial element when extracting information from relevant digital content. The server appropriately searches for this information from data storage, summarizes and organizes the content, and sends it to the terminal.

[0771] As a concrete example, consider a case where a user is seeking information on "stress management." If the emotion engine recognizes the user's stress level as "high," the server extracts content related to relaxation techniques. This content is summarized in a way that is easiest for the user to understand and delivered via the device.

[0772] Example of a prompt:

[0773] "When users need calm and practical information about stress management, provide content that is appropriate for their emotional state."

[0774] In this way, the system can optimize information according to the user's emotions, supporting effective learning and self-improvement.

[0775] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0776] Step 1:

[0777] The user inputs topics of interest or subjects they wish to learn into the device. Specifically, the user enters keywords such as "stress management" into input fields through the device's interface. This information becomes input data for the next processing step.

[0778] Step 2:

[0779] The terminal sends user input data to the server along with the emotion engine. The input data, converted into a digital format, is transmitted as packets via network communication. The emotion engine uses this data to perform an initial analysis of the user's emotional state.

[0780] Step 3:

[0781] The server analyzes the data received from the terminal and uses an emotion engine to recognize the user's emotional state in detail. A generative AI model is then used to generate detailed emotion labels based on the user's input. The input consists of the user's theme information and initial emotion data, while the output is the detailed emotion label.

[0782] Step 4:

[0783] The server extracts information from digital content based on the recognized emotional state. Specifically, it queries a database and filters information to match the user's emotions. The input consists of emotion labels and associated themes, while the output is the filtered content.

[0784] Step 5:

[0785] The server summarizes and organizes the extracted information. Using a generative AI model, it edits the content to the appropriate tone and difficulty level, transforming it into a format that is easiest for the user to understand. The input is the extracted content, and the output is the target-specific summarized content.

[0786] Step 6:

[0787] The server sends the organized information to the terminal. The terminal displays this information to the user, visualizing it so that the user can understand it. Specifically, it formats and displays the summarized information on the terminal's display.

[0788] Step 7:

[0789] The device collects user feedback in real time and analyzes it using an emotion engine. User reactions and comments are converted back into emotion data, contributing to improved system performance. The input is user feedback, and the output is analyzed emotion data.

[0790] Step 8:

[0791] The device proposes action plans based on collected emotional data. Considering past data and the user's current emotional state, it presents action plans in a list format that are easily accepted by the user. This enables effective learning and self-improvement.

[0792] (Application Example 2)

[0793] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0794] The current information delivery system has the challenge of not being able to fully provide information that matches users' interests and emotional states, as it is difficult to select and deliver appropriate content based on the user's emotional state. Furthermore, it lacks the functionality to dynamically adjust content delivery based on user feedback, making it difficult to improve the user experience.

[0795] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0796] In this invention, the server includes means for identifying the user's emotional state and adjusting content accordingly, means for analyzing user responses and dynamically adjusting content delivery, and means for acquiring information about the user's interests and objectives. This enables the delivery of content suited to the user's emotional state, resulting in more personalized information delivery and a superior user experience.

[0797] "Means of obtaining information about user interests and objectives" refers to a system for collecting data from users about areas of interest and goals they wish to achieve.

[0798] "Methods for selecting information from digital data" refer to systems that extract specific information from a group of digital content based on collected information.

[0799] "Means for summarizing and organizing information" refers to a system for concisely summarizing selected information and organizing it systematically.

[0800] "Means of providing organized information" refers to a system that presents organized information in a format that users can utilize.

[0801] "Means for identifying a user's emotional state and adjusting content accordingly" refers to a mechanism that recognizes a user's current emotional state and appropriately changes the content based on that information.

[0802] "Means of analyzing user responses and dynamically adjusting content delivery" refers to a system that analyzes user feedback and real-time responses and immediately adapts the content provided accordingly.

[0803] The system for implementing this invention employs a complex configuration including a user terminal, a server, and a digital network. The terminal is equipped with an interface for inputting information about the user's interests and purposes, which is achieved through an application installed on a mobile device such as a smartphone or smart glasses.

[0804] Upon receiving this information, the server first uses the OpenAI API to activate its emotion engine and identify the user's emotional state. Using natural language processing with the Google Cloud Natural Language API, it searches for digital content based on the user's interests from a database or external API. During this process, it appropriately adjusts the tone and difficulty level of the content, taking the emotional information into consideration.

[0805] The adjusted content is then sent back to the user's device via the network and provided to the user on the device. The device sends real-time responses and feedback from the user back to the server, which dynamically adjusts the accuracy of the content. This enables the provision of higher quality information to the user.

[0806] For example, if a user requests content related to "stress management," the emotion engine will analyze the user's stress level and suggest relaxation techniques as needed. Based on user feedback, further adjustments will be made, and content that better matches the user's current state will be continuously provided.

[0807] An example of a prompt message would be: "Based on the theme entered by the user, generate content that is best suited to his emotional state. If he is under high stress, recommend calming music content." This instruction would be provided to the AI ​​model.

[0808] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0809] Step 1:

[0810] Users input their interests and goals via a terminal. The information entered by the user is sent to the server by the terminal's application. This input data includes the user's interest categories and desired tone. The terminal transfers this input to the server in digital format.

[0811] Step 2:

[0812] The server analyzes the received user information in conjunction with the emotion engine. Specifically, it uses the OpenAI API to analyze the user's emotional state based on their input. As a result, the user's emotional state is output in text format. This output is used in the subsequent content selection process.

[0813] Step 3:

[0814] The server uses Google Cloud Natural Language to search for appropriate digital content based on the output of the emotional state. The input consists of the results of the emotional analysis and the user's interest information, which are then used to filter content data from a database or external API. The output is a refined content list.

[0815] Step 4:

[0816] The server adjusts the tone and difficulty level of the selected content according to the user's emotions. The text of the content is modified based on the user's emotional state. For example, a user experiencing high stress will be provided with text that promotes relaxation. As a result, content data in a format suitable for the user is generated.

[0817] Step 5:

[0818] The server transmits the processed content to the terminal over the network. The terminal receives this content and displays it to the user visually or audibly. The user can then view and verify the content on their own terminal.

[0819] Step 6:

[0820] User reactions and feedback are sent from the device to the server. The server analyzes the feedback using tools such as Google Cloud Natural Language and adjusts content delivery as needed. This input includes changes in the user's emotions and feedback during the session, and the output generates instructions for adjusting content delivery.

[0821] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0822] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0823] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0824] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0825] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0826] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0827] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0828] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0829] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0830] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0831] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0832] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0833] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0834] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0835] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0836] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0837] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0838] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0839] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0840] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0841] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0842] The following is further disclosed regarding the embodiments described above.

[0843] (Claim 1)

[0844] Means of collecting information about users' interests and objectives,

[0845] A means of extracting information from digital content based on collected information,

[0846] Means for summarizing and organizing the extracted information,

[0847] A means of providing organized information to users,

[0848] A system that includes this.

[0849] (Claim 2)

[0850] The system according to claim 1, further comprising means for assisting a user in creating an action plan.

[0851] (Claim 3)

[0852] The system according to claim 1, further comprising means for making the provided information available as an educational resource.

[0853] "Example 1"

[0854] (Claim 1)

[0855] A device for collecting information related to the user's interests and objectives,

[0856] A device for analyzing collected information and generating highly relevant keywords,

[0857] A device for searching digital information sources and extracting information based on generated keywords,

[0858] A device for processing, summarizing, and structuring extracted information,

[0859] A device for providing processed information to the user,

[0860] A device for presenting information to the user through an interface,

[0861] A system that includes this.

[0862] (Claim 2)

[0863] The system according to claim 1, further comprising a device for providing assistance to a user in creating an action plan based on the information obtained.

[0864] (Claim 3)

[0865] The system according to claim 1, further comprising a device for making the provided information available as an educational resource.

[0866] "Application Example 1"

[0867] (Claim 1)

[0868] Means of collecting information about users' interests and objectives,

[0869] A means of extracting information from information resources based on collected information,

[0870] Means for summarizing and organizing the extracted information,

[0871] A means of providing organized information to users,

[0872] A means of collecting, analyzing, and displaying summarized information resources related to a field, based on the user setting specific learning goals or skill improvement objectives.

[0873] A system that includes this.

[0874] (Claim 2)

[0875] The system according to claim 1, further comprising means for assisting a user in creating an action plan.

[0876] (Claim 3)

[0877] The system according to claim 1, further comprising means for making the provided information available as an educational resource.

[0878] "Example 2 of combining an emotion engine"

[0879] (Claim 1)

[0880] A means of collecting information about users' interests and objectives, along with emotional information,

[0881] A means of analyzing the collected information and recognizing the user's emotional state using an emotion engine,

[0882] A means for extracting information from digital content and generating appropriate keywords based on the user's emotional state,

[0883] A means of summarizing and organizing extracted information in a tone and difficulty level that matches the user's emotions,

[0884] A means of providing users with organized information and collecting feedback in real time,

[0885] A system that includes this.

[0886] (Claim 2)

[0887] The system according to claim 1, further comprising means for suggesting an optimal action plan by recording and analyzing changes in emotional information in order for the user to create an action plan.

[0888] (Claim 3)

[0889] The system according to claim 1, further comprising means for enabling the provided information to be used as an educational resource to improve the user's learning outcomes.

[0890] "Application example 2 of combining emotional engines"

[0891] (Claim 1)

[0892] Means of obtaining information about the user's interests and objectives,

[0893] A means of selecting information from digital data based on acquired information,

[0894] Means for summarizing and organizing selected information,

[0895] Means for providing organized information to users,

[0896] A means of identifying the user's emotional state and adjusting content based on it,

[0897] A means of analyzing user feedback and dynamically adjusting content delivery,

[0898] A system that includes this.

[0899] (Claim 2)

[0900] The system according to claim 1, further comprising means for assisting a user in creating an action plan.

[0901] (Claim 3)

[0902] The system according to claim 1, further comprising means for making the provided information available as an educational resource. [Explanation of Symbols]

[0903] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. Means of collecting information about users' interests and objectives, A means of extracting information from digital content based on collected information, Means for summarizing and organizing the extracted information, A means of providing organized information to users, A system that includes this.

2. The system according to claim 1, further comprising means for assisting a user in creating an action plan.

3. The system according to claim 1, further comprising means for making the provided information available for use as an educational resource.

Images