System
The system addresses the challenge of mimicking a particular person's thought process in search systems by allowing users to input information, perform searches, and present results in a manner that reflects the selected person's thought process, resulting in improved information quality and relevance.
Patent Information
- Application Number
- JP2024165136
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-25
- Filing Date
- 2024-09-24
- Publication Date
- 2025-04-07
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Current search systems make it difficult for users to obtain information that mimics a particular person's thought process, and performing a search based on such information is also challenging.
The system allows users to provide information to mimic a particular person's thought process, perform a search based on that information, and present the search results in a way that reflects the thought process of the selected person.
This approach enables users to accurately and flexibly mimic the thinking process of a particular person, improving the quality and relevance of the information provided.
Smart Images

Figure 2025054272000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Current search systems make it difficult for users to obtain information that allows them to emulate a specific person's thought process, and also makes it difficult for them to conduct searches based on such information. [Means for solving the problem]
[0005] The present invention provides a means for providing information that allows a user to imitate the thought process of a specific person, a means for the user to perform a search based on that information, and a means for presenting the search results to the user, thereby enabling the user to imitate the thought process of a specific person and perform a search based on that thought process. [Brief explanation of the drawings]
[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0008] First, the terms used in the following description will be explained.
[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).
[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0014] [First embodiment]
[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[0027] "Example 1"
[0028] In one embodiment of the present invention, a database is provided as a means for providing information for imitating the thought process of a specific person. This database stores information representing the thought process inferred from the past actions and statements of the specific person. A user can select information from this database for imitating the thought process of a specific person.
[0029] "Example 2"
[0030] Next, a search engine is provided as a means for searching based on the information selected by the user. This search engine searches for related information based on the keywords entered by the user and the information selected to mimic the thought process.
[0031] "Example 3"
[0032] Finally, a user interface is provided as a means for presenting search results to the user. This user interface visually presents the search results obtained from the search engine to the user, specifically by displaying the search results in a list format and providing a description for each result that indicates how the information is relevant to a particular person's thought process.
[0033] The processing flow of each embodiment will be described below.
[0034] "Example 1"
[0035] Step 1: The user selects a specific person. This is the person whose thought process the user wants to emulate.
[0036] Step 2: The system retrieves information from the database that represents the selected person's thought process, inferred from their past actions and statements.
[0037] Step 3: The acquired information is presented to the user, who can then use it to mimic the thought process of a specific person.
[0038] "Example 2"
[0039] Step 1: User enters search keywords.
[0040] Step 2: The system performs a search based on the keywords entered and information intended to mimic the thought process described above.
[0041] Step 3: Present the search results to the user.
[0042] "Example 3"
[0043] Step 1: The system displays the search results in a list format.
[0044] Step 2: For each result, provide an explanation that shows how the information relates to a particular person's thought process.
[0045] Step 3: Present the search results with this description to the user.
[0046] Example 1
[0047] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0048] In conventional systems, the means of providing information to imitate the thought process of a specific person were limited, making it difficult for users to provide sufficient accuracy and flexibility when searching based on that information.In addition, inferences about the thought process based on a specific person's past actions and statements were insufficient, resulting in a problem of reduced quality of information provided to users.
[0049] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0050] In this invention, the server includes: means for providing information for a user to imitate the thought process of a specific person; means for the user to perform a search based on the information; means for presenting the search results to the user; means for acquiring data on the specific person's past actions and statements from a database; means for analyzing the acquired data and inferring the specific person's thought process; and means for inputting the analysis results into a generative AI model and providing the generated information to the user. This makes it possible to imitate the thought process of a specific person with high accuracy and flexibility, improving the quality of information provided to the user.
[0051] A "user" is an entity that uses the system to obtain and search for information that mimics the thought process of a particular person.
[0052] A "specific person" is someone whose thought process is inferred based on their past actions and statements.
[0053] A "thought process" is a flow or pattern of thought that can be inferred from a particular person's past actions or statements.
[0054] An "information provision means" is a means for a user to provide information that allows the user to imitate the thought process of a particular person.
[0055] "Search means" refers to the means by which a user conducts a search based on the information provided.
[0056] "Presentation means" refers to the means for presenting search results to the user.
[0057] A "database" is a system for storing data about a specific person's past actions and statements.
[0058] "Data acquisition means" refers to a means for acquiring data on the past actions and statements of a specific person from a database.
[0059] "Analysis means" refers to a means for analyzing acquired data and inferring the thought process of a particular person.
[0060] A "generative AI model" is an artificial intelligence model that generates new information based on analysis results.
[0061] A "prompt sentence" is an instruction sentence input to a generative AI model.
[0062] The present invention relates to a system for providing information for imitating the thought process of a specific person. A specific embodiment of this system will be described below.
[0063] System configuration
[0064] This system consists of three main elements: a server, a terminal, and a user. The server retrieves data from a database, analyzes it, and generates information using a generative AI model. The terminal provides an interface for users to access the system and retrieve information. Users access the system through their terminal and retrieve information to mimic the thought process of a specific person.
[0065] Hardware and software used
[0066] Server: A server with a powerful processor and large memory capacity is required, specifically, a server with an Intel Xeon processor or AMD EPYC processor is suitable.
[0067] Database: A relational database management system (RDBMS) such as MySQL (registered trademark) or PostgreSQL is used.
[0068] Analysis software: Python's NLTK library and machine learning models (e.g., GPT-4 (registered trademark)) are used.
[0069] Device: The device used by users to access the site is a PC, tablet, smartphone, etc. Google Chrome (registered trademark) or Mozilla Firefox are suitable web browsers.
[0070] Data processing and calculation
[0071] The server first accesses a database to retrieve data about a specific person's past actions and statements. The retrieved data is preprocessed using Python's NLTK library, which includes tokenizing the text and removing stop words. The data is then analyzed using a GPT-4 model to infer the specific person's thought process.
[0072] Specific examples
[0073] For example, if a user wants to imitate the thought process of a historical figure, "Scientist A," they would follow the steps below.
[0074] 1. The user opens Google Chrome and enters the system URL to access it. The system login screen is displayed, and the user logs in by entering their ID and password.
[0075] 2. The user enters "Scientist A" in the search bar on the system's main screen and clicks the search button. The search results are displayed and the user selects Scientist A.
[0076] 3. The server executes the SQL query "SELECT FROM actions WHERE person='Scientist A'" to retrieve data about Scientist A's actions and statements from the database.
[0077] 4. The server preprocesses the acquired data using Python's NLTK library, for example by tokenizing the text and removing stop words, and then uses the GPT-4 model to analyze the data and infer Scientist A's thought process.
[0078] 5. Based on the analysis results, the server inputs the prompt statement, "Please imitate the thought process of scientist A and propose a new scientific theory." into the generative AI model.
[0079] 6. The server provides the user with new ideas obtained from the generative AI model. The user can check the generated ideas on the system's results display screen. For example, specific ideas such as "a new law of conservation of energy" are displayed.
[0080] In this way, users can imitate the thought process of a particular person and gain new ideas and knowledge.
[0081] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0082] Step 1:
[0083] A user accesses the system.
[0084] The user opens a web browser such as Google Chrome and enters the system's URL to access it. The system's login screen is displayed, and the user logs in by entering their ID and password.
[0085] Input: User ID and password
[0086] Output: System main screen
[0087] Step 2:
[0088] The user selects a specific person.
[0089] The user enters the name of a specific person in the search bar on the system's main screen and clicks the search button. The search results are displayed and the user can select a specific person.
[0090] Input: Name of a specific person
[0091] Output: Search results for a specific person
[0092] Step 3:
[0093] The server retrieves the data from the database.
[0094] The server retrieves data about the specific person selected by the user from the database. Specifically, it executes the SQL query "SELECT FROM actions WHERE person='specific person'" to retrieve data about actions and comments from the database.
[0095] Input: Name of a specific person
[0096] Output: Data about the actions and statements of a specific person
[0097] Step 4:
[0098] The server analyzes the data.
[0099] The server uses Python's NLTK library to analyze the acquired data, first performing preprocessing such as tokenizing the text and removing stop words, then using the GPT-4 model to analyze the data and infer the thought process of a particular person.
[0100] Input: Data about what a specific person did or said
[0101] Output: Analysis of a specific person's thought process
[0102] Step 5:
[0103] The server inputs the analysis results into a generative AI model.
[0104] The server generates a prompt based on the analysis results and inputs it into the generative AI model. For example, it generates a prompt such as, "Please mimic the thought process of a specific person and propose a new idea."
[0105] Input: Analysis of a specific person's thought process
[0106] Output: The prompt sentence that is fed into the generative AI model
[0107] Step 6:
[0108] The server provides the generated information to the user.
[0109] The server provides the user with new ideas obtained from the generative AI model. The user can check the generated ideas on the system's results display screen. For example, specific ideas such as "a new law of conservation of energy" are displayed.
[0110] Input: Output from a generative AI model
[0111] Output: New ideas provided to users
[0112] (Application example 1)
[0113] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0114] Conventional ad generation systems have difficulty reflecting the thought process of specific celebrities or influencers when creating ad copy. As a result, they are unable to provide effective ads to target users, limiting the effectiveness of the ads. In addition, creating ad copy takes a great deal of time and effort, so there is a need for efficient ad generation.
[0115] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0116] In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, means for generating advertising copy by imitating the thought process of a specific person, and means for presenting the generated advertising copy to the user. This makes it possible to generate effective advertising copy that reflects the thought process of a specific celebrity or influencer, thereby improving the efficiency and effectiveness of advertising creation.
[0117] A "user" is an entity that uses the system to imitate the thought process of a specific person and generate advertising copy.
[0118] "Specific individuals" are individuals such as celebrities or influencers whose thought processes can be inferred from their past actions and statements.
[0119] A "thought process" is a flow or pattern of thought that can be inferred from a particular person's past actions or statements.
[0120] "Information" is the data or knowledge required to mimic a particular person's thought process.
[0121] A "means for providing" is a method or device for providing a user with information about a particular person's thought process.
[0122] A "means for performing a search" is a method or device that allows a user to search for a specific person's thought process based on the information provided.
[0123] "Presenting means" refers to a method or device for displaying search results and generated advertising copy to users.
[0124] "Ad copy" is promotional text that is generated by imitating the thought process of a particular person.
[0125] The "means for generating" is a method or device for automatically generating advertising copy based on the thought process of a specific person.
[0126] The system for implementing this invention allows a user to generate advertising copy by imitating the thought process of a specific person. The system is composed of a server and a user terminal.
[0127] The server provides a means for users to provide information that allows them to imitate the thought process of a specific person. This information is data that represents the thought process inferred from the specific person's past actions and statements. The server manages this information using a database and makes it accessible to users.
[0128] The user terminal is equipped with a means for performing a search based on the information provided by the server. The user can select information about a specific person's thought process and perform a search. The search results are displayed on the user terminal.
[0129] The server further includes a means for generating ad copy by imitating the thought process of a specific person, the means using a generative AI model (e.g., GPT-3 (registered trademark)) to generate ad copy based on a prompt provided by the user, and the generated ad copy is presented to the user terminal.
[0130] As a specific example, the following prompt sentence can be input to the generative AI model:
[0131] Example prompt sentence:
[0132] Use a positive, energetic tone and generate copy based on the following product information: Latest smartphone, long battery life, great camera.
[0133] This system makes it possible to generate effective ad copy that reflects the thought process of specific celebrities and influencers, improving the efficiency and effectiveness of ad creation.
[0134] The server uses the OpenAI (registered trademark) API to access the generative AI model and generate ad copy based on the prompt text provided by the user. The user's device displays the generated ad copy for the user to review. This allows users to easily create ad copy that mimics the thought process of a specific person.
[0135] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0136] Step 1:
[0137] The user selects information to mimic the thought process of a particular person.
[0138] Input: An interface for the user to select a specific person.
[0139] Output: The ID of the specific person selected.
[0140] Specific operation: The user terminal displays a list of specific people provided by the server, and the user selects a specific person from the list.
[0141] Step 2:
[0142] The server retrieves information about the thought process of the particular selected person from a database.
[0143] Input: The ID of a specific person.
[0144] Output: Information about a particular person's thought process.
[0145] Specific operation: The server accesses the database and retrieves thought process data corresponding to a specific person's ID.
[0146] Step 3:
[0147] The user enters a prompt to generate the ad copy.
[0148] Input: The prompt text that the user enters.
[0149] Output: The prompt statement entered.
[0150] Specific operation: The user terminal displays a text box for inputting a prompt sentence, and the user inputs the prompt sentence.
[0151] Step 4:
[0152] The server uses the generative AI model to generate ad copy based on the prompt text.
[0153] Input: Information about a particular person's thought process, prompt statements entered by the user.
[0154] Output: The generated ad copy.
[0155] How it works: The server uses OpenAI's API to input a specific person's thought process and prompt into a generative AI model to generate advertising copy.
[0156] Step 5:
[0157] The generated ad copy is presented to the user.
[0158] Input: The generated ad text.
[0159] Output: The ad copy that is presented to the user.
[0160] Specific operation: The user's device displays the generated ad copy for the user to review.
[0161] Step 6:
[0162] The user can review the generated ad copy and modify it if necessary.
[0163] Input: The generated ad text.
[0164] Output: Revised ad copy (if necessary).
[0165] Specific operations: The user device provides an interface for editing the ad copy, allowing the user to modify the ad copy.
[0166] Step 7:
[0167] Save the final ad copy and use it in your ad campaign.
[0168] Input: The revised (or generated) ad copy.
[0169] Output: Saved ad copy.
[0170] What happens: The server stores the final ad copy in a database so it can be used in ad campaigns.
[0171] Example 2
[0172] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0173] Conventional search systems make it difficult for users to search for information by imitating the thought processes of a specific person. Furthermore, they lack a means to efficiently search for relevant information based on the keywords and thought processes entered by the user and provide filtered results. This makes it difficult for users to quickly and accurately obtain the information they need.
[0174] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0175] In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, means for generating a search query based on keywords entered by the user and the thought process selected by the user, means for searching for related information using the generated search query, and means for filtering the search results and returning them to the user. This enables the user to efficiently search for related information and quickly obtain filtered results while imitating the thought process of a specific person.
[0176] "User" means any person or entity that uses the System to search for information.
[0177] A "thought process" is a series of steps or methods by which a particular person gathers, analyzes, and makes decisions about information.
[0178] "Means for providing information" refers to a function or device that provides a user with information to imitate the thought process of a particular person.
[0179] "Search means" refers to a function or device for searching for related information based on keywords entered by the user and the information provided.
[0180] "Means for presenting search results" refers to functions or devices for displaying information obtained through a search to the user.
[0181] A "means for generating a search query" is a function or device for creating a search query based on keywords entered by the user and the thought process selected by the user.
[0182] The "means for searching related information" refers to a function or device for searching information in a database or on the Internet using the generated search query.
[0183] A "means for filtering search results" is a function or device that narrows down the information obtained by a search based on a thought process selected by the user.
[0184] "Means for returning to user" refers to the functionality or device for sending filtered search results to the user.
[0185] This invention is a system that allows users to search for information by imitating the thought process of a specific person. The system generates a search query based on keywords entered by the user and the thought process selected by the user, searches for related information, and provides the user with filtered results.
[0186] The server receives the keywords entered by the user and the selected thought process and generates a search query. To do this, the server uses search engine software such as Google Search API or ElasticSearch (registered trademark). Based on the generated search query, the server searches for related information and retrieves search results.
[0187] The server then filters the search results to extract the information most relevant to the user's selected thought process. The filtered search results are sent back to the user. The device displays the search results received from the server to the user.
[0188] As a concrete example, consider the case where a user inputs the keywords "generative AI model" and the thought process "data preprocessing." In this case, the server generates a search query "generative AI model data preprocessing" and searches for related information using the Google Search API. The search results are filtered to information about data preprocessing and provided to the user.
[0189] Examples of prompts to input to a generative AI model might include:
[0190] If a user types in the keyword "generative AI model" and selects "data preprocessing" as the thought process, they should search for related information.
[0191] By inputting this prompt into a generative AI model, the model can provide search results that meet the user's requirements.
[0192] The system allows users to efficiently search for relevant information and quickly obtain filtered results, while mimicking a specific person's thought process.
[0193] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0194] Step 1:
[0195] The user inputs keywords and thought processes.
[0196] Users input keywords they want to search for (e.g., "generative AI model") and related thought processes (e.g., "data preprocessing") through the system's interface. The input information is then sent to the terminal.
[0197] Step 2:
[0198] The terminal transmits the input information to the server.
[0199] The terminal sends the user's input keywords and selected thought processes to the server using an HTTP request. The input data is passed to the server as pairs of keywords and thought processes.
[0200] Step 3:
[0201] The server generates a search query based on the received information.
[0202] The server generates a search query based on the received keywords ("generative AI model") and thought process ("data preprocessing"). Specifically, it combines this information to create a search query called "generative AI model data preprocessing." The generated search query is used in the next step.
[0203] Step 4:
[0204] The server uses a search engine to search for relevant information.
[0205] The server uses the generated search query to send a query to a search engine such as the Google Search API or Elasticsearch, which retrieves relevant information from its indexed database and sends it back to the server, which returns the search results to the server as a list of relevant web pages or documents.
[0206] Step 5:
[0207] The server filters the search results and returns them to the user.
[0208] The server filters the search results obtained from the search engine. The filtering criteria are based on the thought process selected by the user, for example, extracting only information related to "data preprocessing." The filtered search results are then returned to the user.
[0209] Step 6:
[0210] The terminal displays the search results to the user.
[0211] The terminal displays the filtered search results received from the server to the user, who can then obtain the information they need based on the displayed search results. Specifically, a list of search results is displayed on the interface, and the user can click on it to view detailed information.
[0212] (Application example 2)
[0213] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0214] Conventional search systems only provide simple search results based on keywords entered by the user, making it difficult to provide search results that reflect the user's thought process. Furthermore, there was a lack of a way for users to conduct searches based on information that would allow them to mimic a specific thought process, making it difficult to efficiently obtain information that meets the user's intent. Furthermore, there was no way to utilize generative AI models to generate prompt sentences and optimize search queries, resulting in low search accuracy.
[0215] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0216] In this invention, the server includes a means for providing information for a user to imitate the thought process of a specific person, a means for the user to perform a search based on the information, a means for generating a prompt sentence using a generative AI model, a means for searching for related information based on the prompt sentence, and a means for presenting the search results to the user, thereby making it possible to provide search results that reflect the user's thought process.
[0217] "User" means any person or entity that uses the System to search for information.
[0218] A "specific person" is an individual whose thought process the user wishes to emulate.
[0219] A "thought process" is a set of cognitive steps or ways in which a particular person processes information and makes decisions.
[0220] A "means for providing information" is a method or device for providing a user with information about a particular person's thought process.
[0221] A "search means" is a method or device for searching for related information based on keywords entered by a user or information provided by the user.
[0222] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate prompts based on user input.
[0223] A "prompt sentence" is a sentence generated by a generative AI model to optimize a search query.
[0224] The "means for searching related information" refers to a method or device for searching the Internet or a database for the information the user is looking for based on the generated prompt sentence.
[0225] "Means for presenting search results to the user" refers to a method or device for displaying the information obtained by the search to the user.
[0226] This invention is a system that provides users with information to imitate the thought process of a specific person, performs searches based on that information, generates prompt sentences using a generative AI model, and searches for related information and presents it to the user.
[0227] System configuration
[0228] The system consists of the following main components:
[0229] 1. User device: The device (e.g., smartphone, tablet, PC) through which the user enters search keywords and specific thought processes.
[0230] 2. Server: A central processing unit for receiving input from the user, generating prompt sentences using generative AI models, and retrieving relevant information.
[0231] 3. Generative AI model: An artificial intelligence algorithm (e.g., GPT-3) for generating prompt sentences based on user input.
[0232] 4. Search engine: A system for searching relevant information from the Internet or databases based on the generated prompt (e.g., Google Custom Search API).
[0233] Processing flow
[0234] 1. User device: The user uses the device to input search keywords and a specific thought process, for example, "latest movies" and "focus on reviews."
[0235] 2. Server: The server receives input from the user and sends it to the generative AI model.
[0236] 3. Generative AI model: The generative AI model generates prompts based on user input, such as "Generate prompts for users to search for information related to the latest movies, with an emphasis on reviews."
[0237] 4. Server: Based on the generated prompt sentence, a search engine is used to search for relevant information.
[0238] 5. Search Engines: Search engines retrieve relevant information from the internet and databases based on the prompt text.
[0239] 6. Server: Sends the search results to the user's device.
[0240] 7. User device: The user views the search results through their device.
[0241] Hardware and software used
[0242] Hardware: Smartphones, tablets, PCs, servers
[0243] Software: Python, OpenAI API, Google Custom Search API
[0244] Specific examples
[0245] For example, if a user types in "latest movies" and selects "important reviews" as their thought process, the generative AI model will generate a prompt like this:
[0246] "Generate prompts to help users search for information related to the latest movies, with an emphasis on reviews."
[0247] Based on this prompt, the search engine can retrieve and provide information about the latest movies, including reviews and ratings, allowing users to efficiently find results that fit their own thought process.
[0248] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0249] Step 1:
[0250] User device: The user uses the device to input search keywords and a specific thought process, for example, "latest movies" and "focus on reviews." The input data is then sent to the server.
[0251] Step 2:
[0252] Server: The server receives input from the user and sends it to the generative AI model. Specifically, it converts the user's input data (search keywords and thought processes) into a format suitable for the generative AI model and creates an API request.
[0253] Step 3:
[0254] Generative AI model: The generative AI model generates prompt sentences based on input data received from the server. For example, it generates a prompt sentence such as, "Generate a prompt sentence for a user to search for information related to the latest movies, with an emphasis on reviews." The generated prompt sentence is returned to the server.
[0255] Step 4:
[0256] Server: The server receives the prompt sentence returned by the generative AI model and sends it to the search engine. Specifically, the server uses the prompt sentence as a search query and sends a request to the search engine API.
[0257] Step 5:
[0258] Search engine: A search engine searches the Internet and databases for relevant information based on the prompt received from the server, and returns the search results to the server.
[0259] Step 6:
[0260] Server: The server receives the search results returned by the search engine and sends them to the user's device. Specifically, it formats the search results in a format that is easy for the user to view and sends them to the user's device.
[0261] Step 7:
[0262] User device: The user views search results on their device, including information about the latest movies, including reviews and ratings.
[0263] Example 3
[0264] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0265] Conventional search systems lacked the means to provide users with information that would allow them to mimic the thought process of a specific person, making it difficult for users to effectively use search results. Furthermore, they lacked the means to generate prompts to properly input search queries into generative AI models, and to properly display the generated search results in the user interface. This made it difficult for users to quickly and accurately obtain the information they were looking for.
[0266] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[0267] In this invention, the server includes means for receiving a search query from a user, means for converting the received search query into a prompt sentence for input to a generative AI model, means for processing the prompt sentence using the generative AI model to generate relevant search results, and means for converting the generated search results into a format appropriate for display on a user interface, thereby providing information for the user to imitate the thought process of a specific person, enabling the search query to be appropriately processed and the generated search results to be effectively displayed.
[0268] "User" means any person or entity that uses the System to search for information and receive results.
[0269] "Search Query" means a search request or question entered into a system by a user.
[0270] A "generative AI model" refers to an algorithm or program that uses artificial intelligence technology to generate relevant information based on input prompts.
[0271] A "prompt sentence" refers to a sentence that is converted from a user's search query to appropriately input it into a generative AI model.
[0272] "Search results" refers to the information and data generated by a generative AI model based on a prompt.
[0273] "User interface" refers to the screen or display means through which a user interacts with the system and visually confirms search results.
[0274] "Server" refers to the central computer system that receives search queries from users, generates search results using the generative AI model, and displays them in the user interface.
[0275] A "means" refers to a method or apparatus designed to perform a particular function or role.
[0276] This invention is a system that provides information for users to imitate the thought process of a specific person, converts search queries into prompt sentences for appropriate input into a generative AI model, and appropriately displays the generated search results in a user interface.
[0277] Server Roles
[0278] The server receives a search query from a user. For example, if the user types, "I want to know about the latest technology trends," the server receives the query. The server then converts the received search query into a prompt sentence to input into the generative AI model. This prompt sentence reflects the user's intention and request. For example, the server converts the query, "I want to know about the latest technology trends," into a prompt sentence, "Please provide information about the latest technology trends."
[0279] The server processes the prompt using a generative AI model (e.g., OpenAI's GPT-4) to generate relevant search results. The generated search results include explanations related to a specific person's thought process. For example, in response to the prompt, "Please provide information about the latest technology trends," the generative AI model generates a search result such as, "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a specific person (e.g., a technology analyst)."
[0280] Device Role
[0281] The terminal receives the search results sent from the server. The terminal converts these search results into an appropriate format for display on the user interface. Specifically, the terminal displays the search results in a list format, and for each result, it provides a description that indicates how the information is related to the thought process of a specific person. For example, the terminal displays the search result "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a specific person (e.g., a technology analyst)" in a list format.
[0282] User Roles
[0283] The user visually checks the search results displayed on the device. The user reads the description attached to each search result and understands how the information relates to a specific person's thought process. For example, if a user enters the query "Please provide information on the latest technology trends," the user will check and understand the search result: "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a specific person (e.g., a technology analyst)."
[0284] Specific examples
[0285] Prompt Sentence Examples
[0286] "I want to know about the latest technology trends"
[0287] Example of search results
[0288] "The latest technology trends include the evolution of AI, the widespread adoption of 5G, and the application of blockchain technology. These technologies play a key role in the thought process of certain individuals (e.g., technology analysts)."
[0289] In this way, the user can visually check the search results and understand information related to the thought process of a particular person. The flow of the identification process in the third embodiment will be described with reference to FIG.
[0290] Step 1:
[0291] The server receives a search query from a user.
[0292] What happens: When a user types "I want to know about the latest technology trends," the server receives the query.
[0293] Input: User's search query: "I want to know about the latest technology trends"
[0294] Output: Received search query
[0295] Step 2:
[0296] The server converts the received search query into a prompt sentence to be input into the generative AI model.
[0297] Specific behavior: The server converts the query "I want to know about the latest technology trends" into the prompt "Please provide information about the latest technology trends."
[0298] Input: Incoming search query
[0299] Output: Generated prompt: "Please provide information about the latest technology trends."
[0300] Step 3:
[0301] The server inputs the generated prompt sentence into the generative AI model.
[0302] Specific operation: The server sends a prompt to the generative AI model: "Please provide information on the latest technology trends."
[0303] Input: Generated prompt text
[0304] Output: The prompt sent to the generative AI model
[0305] Step 4:
[0306] The generative AI model generates relevant search results based on the prompt sentence.
[0307] Specific behavior: The generative AI model generates the search result, "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a particular person (e.g., a technology analyst)."
[0308] Input: The prompt sent to the generative AI model
[0309] Output: Generated search results
[0310] Step 5:
[0311] The server transmits the generated search results to the terminal.
[0312] Specific operation: The server sends the search results received from the generative AI model to the terminal.
[0313] Input: Generated search results
[0314] Output: Search results sent to your device
[0315] Step 6:
[0316] The terminal receives the search results sent from the server.
[0317] Specific operation: The device receives the search result sent from the server: "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a particular person (e.g., a technology analyst)."
[0318] Input: Search results sent from the server
[0319] Output: Search results received
[0320] Step 7:
[0321] The terminal converts the received search results into an appropriate format for display on the user interface.
[0322] What it does: The device converts search results into a list, with each result provided with a description of how the information relates to a particular person's thought process.
[0323] Input: Search results received
[0324] Output: Search results converted into a list
[0325] Step 8:
[0326] The terminal displays the converted search results on a user interface.
[0327] What it does: The device displays a list of search results for the phrase "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a particular person (e.g., a technology analyst)."
[0328] Input: Search results converted to list format
[0329] Output: Search results displayed in the user interface
[0330] Step 9:
[0331] The user visually checks the search results displayed on the terminal.
[0332] Specific Action: The user reads the list of search results displayed on the device and understands how the information relates to a particular person's thought process.
[0333] Input: Search results displayed in the user interface
[0334] Output: User understanding and confirmation
[0335] (Application example 3)
[0336] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0337] Conventional search systems lack the information necessary for users to efficiently utilize search results, and have particular challenges in providing highly relevant information based on users' past behavior and interests. Furthermore, the lack of explanations showing how search results relate to the user's thought process makes it difficult for users to properly evaluate and select search results.
[0338] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[0339] In this invention, the server includes a means for providing information for a user to imitate the thought process of a specific person, a means for the user to perform a search based on the information, a means for presenting the search results to the user, and a means for providing an explanation for each search result that indicates how the information relates to the user's past behavior and interests, thereby enabling the user to efficiently use the search results and obtain highly relevant information based on their past behavior and interests.
[0340] "User" means any person or entity that uses the System to conduct a search.
[0341] A "specific person" is an individual whose thought process the user is trying to emulate.
[0342] A "thought process" is the set of cognitive steps a particular person takes to process information and make decisions.
[0343] A "means for providing information" is a device or software that has the function of providing a user with information to mimic the thought process of a particular person.
[0344] A "means for performing a search" is a device or software that has the function of allowing a user to input a search query based on information provided and retrieve information using a search engine.
[0345] A "means for presenting search results" is a device or software capable of visually displaying to a user search results obtained from a search engine.
[0346] "Means for providing explanations" means a device or software capable of generating and providing an explanation for each search result that shows how the information relates to the user's past behavior and interests.
[0347] "Past behavior" refers to the user's previous behavioral history, such as searches and browsing history.
[0348] "Interests" are topics or themes that a user is particularly interested in.
[0349] The system for implementing this invention provides users with information to emulate the thought process of a specific person, performs searches based on that information, and presents search results to the user. It also has the ability to provide an explanation for each search result, showing how the information relates to the user's past behavior and interests.
[0350] System configuration
[0351] The system consists of the following main components:
[0352] 1. User device: A device operated by a user, such as a smartphone or computer.
[0353] 2. Server: Manages the search engine API and database, and retrieves and annotates search results.
[0354] 3. Software: A program to retrieve and annotate search results using Python, the requests library, BeautifulSoup library, etc.
[0355] Processing flow
[0356] 1. Loading user profile: The user device loads a profile containing the user's interests from the server.
[0357] 2. Sending a search query: The user terminal sends the search query entered by the user to the server.
[0358] 3. Obtaining search results: The server obtains the search results using the search engine API.
[0359] 4. Annotating search results: The server generates and annotates each search result based on the user's profile.
[0360] 5. Displaying results: The user device visually presents the annotated search results to the user.
[0361] Hardware and software used
[0362] Hardware: Smartphones, PCs
[0363] Software: Python, requests library, BeautifulSoup library
[0364] Specific examples
[0365] For example, if a user searches for the query "latest AI technology," the server retrieves search results using a search engine API. Then, for each search result, the server generates and annotates it based on the user's profile, such as "Relevant to your interests" or "New information." Finally, the user's device displays these annotated search results to the user.
[0366] Prompt Sentence Examples
[0367] Build an application that annotates search results based on user interests. Users' profiles contain topics they are interested in. Display search results in a list format, with a description for each result that explains how the information is relevant to the user's interests.
[0368] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[0369] Step 1:
[0370] Loading the user profile
[0371] The user device reads a profile containing the user's interests from the server. Specifically, the user device sends a request to the server, and the server retrieves the corresponding user profile from the user profile database and returns it to the user device.
[0372] Input: User ID
[0373] Output: User profile (interest data)
[0374] Data processing: Search and retrieve profile information from database based on user ID.
[0375] Step 2:
[0376] Submitting a search query
[0377] The user terminal transmits the search query entered by the user to the server. Specifically, when the user enters a query in the search box and presses the search button, the query is transmitted to the server.
[0378] Input: search query
[0379] Output: Send search query to server
[0380] Data processing: Taking user input, converting it into an appropriate format and sending it to the server.
[0381] Step 3:
[0382] Getting search results
[0383] The server obtains search results using a search engine API, specifically, the server sends a search query to the search engine API and receives search results returned from the API.
[0384] Input: search query
[0385] Output: Search results (list format)
[0386] Data processing: Converting search queries into API requests and parsing responses from the API to obtain search results.
[0387] Step 4:
[0388] Annotating search results
[0389] The server generates and adds annotations based on the user's profile to each search result. Specifically, it compares the title and content of the search result with the user's interests, and adds annotations such as "Related to your interests" to highly relevant results.
[0390] Input: search results, user profile
[0391] Output: Annotated search results
[0392] Data processing: Compare search results with user profiles and generate annotations based on relevance.
[0393] Step 5:
[0394] Displaying the results
[0395] The user terminal visually presents the annotated search results to the user, specifically, by displaying the annotated search results in a list format and displaying annotations for each result.
[0396] Input: Annotated search results
[0397] Output: what is displayed on the user interface
[0398] Data processing: Convert the annotated search results into a format suitable for the user interface and display them.
[0399] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0400] "Example 1"
[0401] As one embodiment of the present invention, a system is provided that combines an emotion engine that recognizes a user's emotions. This system includes a means for providing information for a user to imitate the thought process of a specific person, a means for the user to perform a search based on the information, and a means for presenting the search results to the user. The emotion engine recognizes emotions from the user's facial expressions, tone of voice, choice of words, etc. For example, when a user is happy, the emotion engine recognizes the user's joy and selects information to imitate the user's thought process based on the user's joy. Also, when a user is sad, the emotion engine recognizes the user's sadness and performs a search based on the user's sadness.
[0402] "Example 2"
[0403] As a specific example, when a user is happy, the emotion engine recognizes the joy and selects information to imitate the thought process of a particular person based on the joy. For example, when a user is happy, the emotion engine recognizes the joy and selects information to imitate the thought process of a comedian based on the joy. Also, when a user is sad, the emotion engine recognizes the sadness and selects information to imitate the thought process of a poet based on the sadness.
[0404] "Example 3"
[0405] The emotion engine also recognizes the user's emotion and performs a search based on that emotion. For example, when the user is happy, the emotion engine recognizes that joy and performs a search based on that joy. This search searches for information related to joy or information that the user is likely to feel happy about. When the user is sad, the emotion engine recognizes that sadness and performs a search based on sadness. This search searches for information related to sadness or information that the user is likely to feel sad about.
[0406] The processing flow of each embodiment will be described below.
[0407] "Example 1"
[0408] Step 1: The emotion engine recognizes the user's emotions from their facial expressions, tone of voice, choice of words, etc.
[0409] Step 2: Based on the emotions recognized by the emotion engine, select information to mimic the thought process of a specific person.
[0410] Step 3: The user performs a search based on the selected information.
[0411] Step 4: Present the search results to the user.
[0412] "Example 2"
[0413] Step 1: When a user is happy, the emotion engine recognizes that joy.
[0414] Step 2: Select information based on pleasure to mimic the comedian's thought process.
[0415] Step 3: The user performs a search based on the selected information.
[0416] Step 4: Present the search results to the user.
[0417] "Example 3"
[0418] Step 1: When a user is sad, the emotion engine recognizes that sadness.
[0419] Step 2: Based on the sadness, information is selected to mimic the poet's thought process. Step 3: The user conducts a search based on the selected information.
[0420] Step 4: Present the search results to the user.
[0421] Example 1
[0422] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0423] Conventional systems were unable to take the user's emotions into account when obtaining information to imitate the thought process of a specific person, which made it difficult to provide appropriate information according to the user's emotional state, limiting the user's experience.
[0424] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0425] In this invention, the server includes: means for providing information that allows a user to imitate the thought process of a specific person; means for the user to perform a search based on the information; means for presenting the search results to the user; means including an emotion engine that recognizes the user's emotions; and means for selecting information based on the emotions recognized by the emotion engine. This makes it possible to provide appropriate information according to the user's emotional state.
[0426] A "user" refers to an individual who uses the system to attempt to mimic the thought process of a particular person.
[0427] "Specific person" refers to a person, past or present, that the user wishes to emulate.
[0428] A "thought process" refers to the flow or pattern of thought that a particular person follows based on their past actions and statements.
[0429] "Means for providing information" refers to a function that provides the user with information about a particular person's thought process.
[0430] "Means for searching" refers to the functionality that allows users to search for more detailed information based on the information provided.
[0431] "Means for presenting search results" refers to the functionality for displaying results for a search conducted by a user.
[0432] An "emotion engine" refers to software or hardware that recognizes emotions from a user's facial expressions, tone of voice, choice of words, etc.
[0433] "Means for selecting information based on emotions" refers to a function for selecting appropriate information from a database based on the user's emotions recognized by the emotion engine.
[0434] The present invention provides a system that provides information for a user to imitate the thought process of a specific person and selects appropriate information based on the user's emotions. Specific embodiments of this system will be described below.
[0435] System configuration
[0436] Hardware
[0437] 1. Device: A device used by a user that has a camera and microphone, which can capture the user's facial expressions and tone of voice.
[0438] 2. Server: A central processing unit that includes a database and emotion engine. The server processes data sent by users and provides appropriate information.
[0439] software
[0440] 1. Emotion Engine: Software that recognizes emotions from the user's facial expressions, tone of voice, choice of words, etc. The emotion engine analyzes the user's emotional state in real time.
[0441] 2. Database: This database contains information that represents a specific person's thought process, which can be inferred from their past actions and statements. The server selects the appropriate information from this database.
[0442] System Operation
[0443] Obtaining user sentiment data
[0444] Users access the system and provide emotional data via a camera and microphone, and the device captures the user's facial expressions and tone of voice in real time.
[0445] Emotional Data Analysis
[0446] The device sends the acquired emotional data to the emotion engine, which analyzes the user's facial expressions and tone of voice to identify the user's emotions.
[0447] Selecting information from a database
[0448] Based on the emotional information received from the emotion engine, the server selects appropriate information from a database that stores information to mimic the thought process of a specific person.
[0449] Providing information
[0450] The server provides the user with selected information that allows the user to understand the thought process of a particular person.
[0451] Processing a user's search query
[0452] The user can then perform further searches based on the information provided. When the user enters a search query, the device sends the query to the server.
[0453] Presenting search results
[0454] The server generates appropriate search results for the user's search query and presents them to the user, allowing the user to gain a deeper understanding of a particular person's thought process.
[0455] Specific examples
[0456] Suppose a user accesses the system and wants to imitate the thought process of a particular person (for example, a famous philosopher in history). When the user says to the system, "I am very happy right now," the emotion engine recognizes the user's joy. The server selects information from the database based on the actions and statements made by the philosopher when he or she felt joy, and provides it to the user. The user can then use that information to conduct further searches and gain a deeper understanding of the philosopher's thought process.
[0457] Prompt Sentence Examples
[0458] "I'm very happy right now. Give me information to mimic the thought process of a particular person."
[0459] The system provides appropriate information based on the user's emotions and helps mimic the thought process of a specific person.
[0460] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0461] Step 1:
[0462] Users access the system and provide emotional data via a camera and microphone, and the device captures the user's facial expressions and tone of voice in real time.
[0463] Input: User's facial expression data, tone of voice
[0464] Output: Captured emotion data
[0465] Specific operation: The user speaks into the camera. The device captures the user's facial expressions with the camera and records the tone of voice with the microphone.
[0466] Step 2:
[0467] The device transmits the acquired emotion data to the emotion engine, which analyzes the user's facial expressions and tone of voice to identify the user's emotion.
[0468] Input: Captured emotion data
[0469] Output: Analyzed emotion information (e.g., joy, sadness)
[0470] Specific operation: The device sends the captured data to the emotion engine, which identifies the user's emotion, such as "happy" or "sad."
[0471] Step 3:
[0472] Based on the emotional information received from the emotion engine, the server selects appropriate information from a database that stores information to mimic the thought process of a specific person.
[0473] Input: Parsed emotion information
[0474] Output: Selected information (e.g., information about a particular person's thought process)
[0475] Specific operation: The server receives information from the emotion engine that "the user is happy." The server selects information from the database to mimic the thought process of a specific person related to "joy."
[0476] Step 4:
[0477] The server provides the user with selected information that allows the user to understand the thought process of a particular person.
[0478] Input: Selected information
[0479] Output: Information provided to the user
[0480] Specific operation: The server sends the selected information to the user's terminal, which then displays the information to the user.
[0481] Step 5:
[0482] The user can then perform further searches based on the provided information. When the user enters a search query, the device sends the query to the server.
[0483] Input: User's search query
[0484] Output: The search query sent to the server
[0485] Specific Action: The user inputs, "What specific action did this philosopher take when he was happy?" The device sends the search query to the server.
[0486] Step 6:
[0487] The server generates appropriate search results for the user's search query and presents them to the user, who can then use the results to gain a deeper understanding of the thought process of a particular person.
[0488] Input: User's search query
[0489] Output: Search results
[0490] Specific operations: The server searches the database based on the search query. The server sends the search results to the user's terminal. The terminal displays the search results to the user.
[0491] (Application example 1)
[0492] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0493] In conventional systems, the means by which users can imitate the thought processes of specific individuals are limited, making it difficult to provide appropriate information based on the user's emotions. In addition, the range of information that users can independently select is limited, making it difficult to increase user satisfaction.
[0494] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, an emotion engine that recognizes the user's emotions, and means for selecting information for imitating the thought process of a specific person based on the emotion engine. This makes it possible to provide appropriate information based on the user's emotions and expands the range of information that the user can independently select, thereby increasing user satisfaction.
[0495] "User" means any individual or entity that uses the System.
[0496] A "specific person" is an individual whose thought process can be inferred from their past actions and statements.
[0497] A "thought process" is a flow or pattern of thought that can be inferred based on a particular person's past actions and statements.
[0498] "Information" is the data or knowledge required to mimic a particular person's thought process.
[0499] "Means for providing" refers to a method or device for providing information to a user.
[0500] A "means for conducting a search" is a method or device that allows a user to conduct a search based on information provided by the user.
[0501] A "presentation means" is a method or device for displaying search results to a user.
[0502] An "emotion engine" is software or hardware that recognizes a user's emotions and selects appropriate information based on those emotions.
[0503] The "means for selecting" is a method or device for selecting information to imitate the thought process of a particular person based on an emotion engine.
[0504] A system for implementing this invention provides information that allows a user to imitate the thought process of a specific person, and selects and presents appropriate information based on the user's emotions. Specific embodiments of this system are described below.
[0505] System Configuration
[0506] The system consists of the following main components:
[0507] 1. User device: A device such as a smartphone or tablet that has a camera and microphone.
[0508] 2. Server: Includes information provision means, search means, presentation means, emotion engine, and selection means.
[0509] 3. Database: Stores the thought processes inferred from a particular person's past actions and statements.
[0510] Program processing
[0511] emotion recognition
[0512] The camera and microphone on the user's device are used to capture the user's facial expressions and tone of voice. This data is then sent to the emotion engine on the server, which then uses the Emotion Recognition API to recognize the user's emotions.
[0513] Providing information
[0514] The server retrieves information about a specific person's thought process from a database, based on the past actions and statements of the specific person the user wants to emulate.
[0515] Search and Select
[0516] The server uses the search engine to search for relevant content based on the recognized emotion and the acquired thought process. Based on the emotion engine, the server selects information that matches the user's emotion.
[0517] presentation
[0518] The search results are sent to the user's device and displayed to the user, who can then browse the information presented and conduct further detailed searches.
[0519] Specific examples
[0520] For example, if a user wants to search for content that mimics the thought process of a specific author, they can input the following prompt into the generative AI model:
[0521] User Emotion: Delight
[0522] Specific Authors: Specific Authors
[0523] Search results for: Content that mimics the thought process of a particular author
[0524] Based on this prompt, the server searches for content that mimics the thought process of a particular author and provides it to the user, allowing the user to understand the thought process of a particular author and gain inspiration based on it.
[0525] Hardware and software used
[0526] Hardware: Smartphone camera and microphone
[0527] Software: Emotion Recognition API, Content Database, Search Engine
[0528] In this way, it becomes possible to provide appropriate information based on the user's emotions, and the range of information that the user can independently select is expanded, thereby increasing user satisfaction.
[0529] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0530] Step 1:
[0531] The camera and microphone on the user's device are used to capture the user's facial expressions and tone of voice. This data is used as input data for recognizing the user's emotions. Specifically, it includes image data captured by the camera and audio data recorded by the microphone.
[0532] Step 2:
[0533] The user device sends the captured facial expression and tone of voice data to the server. The server then analyzes this data using the Emotion Recognition API to recognize the user's emotions. The input data is image data and voice data, and the output data is the recognized emotion (e.g., joy, sadness, anger, etc.).
[0534] Step 3:
[0535] The server retrieves information about the specific person's thought process from a database based on the recognized emotion. The input data is the recognized emotion and the specific person's identification information, and the output data is information about the specific person's thought process. Specifically, it includes data based on the specific person's past actions and statements.
[0536] Step 4:
[0537] The server uses a search engine to search for related content based on the acquired information about thought processes and the recognized emotions. The input data is the information about thought processes and the recognized emotions, and the output data is a content list as search results. Specifically, it includes related articles, videos, images, etc.
[0538] Step 5:
[0539] The server sends the search results to the user terminal. The user terminal displays the received search results to the user. The input data is a content list as the search results, and the output data is the content that is displayed to the user. Specifically, the content is displayed in a format that the user can view.
[0540] Step 6:
[0541] The user can browse the presented content and perform a more detailed search. Depending on the user's operation, the process is repeated from step 1. The input data is the user's operation information, and the output data is new search results. Specifically, a new search is performed based on the content that the user is interested in.
[0542] Example 2
[0543] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0544] Conventional search systems provide information without considering the user's emotional state, making it difficult to provide information appropriate to the user's current emotions. Furthermore, there was a lack of a way to search based on information that mimics a specific person's thought process, and information provided was not adequately tailored to the user's needs. This made it difficult to provide the information users were looking for quickly and accurately.
[0545] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0546] In this invention, the server includes means for a user to input an emotional state, means for recognizing the emotional state, means for selecting information for imitating the thought process of a specific person based on the recognized emotional state, means for a user to input search keywords, means for searching for related information based on the search keywords and the selected information, and means for presenting the search results to the user. This makes it possible to provide information according to the user's emotional state, and realizes a search based on information that imitates the thought process of a specific person.
[0547] "User" means any person or entity that uses the System to search for information.
[0548] "Emotional state" indicates the type of emotion the user is currently feeling, and includes, for example, joy, sadness, anger, etc.
[0549] "Emotion engine" refers to a software or hardware component that recognizes the emotional state input by a user and selects appropriate information based on that emotion.
[0550] A "thought process" refers to the set of cognitive steps or methods by which a particular person processes information and makes decisions.
[0551] "Search keywords" are words or phrases that a user types into a search engine to identify the information they are searching for.
[0552] "Search engine" refers to a software or hardware component that searches for and provides results related to search keywords and selected information entered by a user.
[0553] "Search results" refers to the list or content of relevant information that a search engine provides based on a user's search keywords.
[0554] "Presentation mechanism" refers to a method or device for visually or audibly displaying search results to a user.
[0555] This invention is a system that recognizes the emotional state of a user, selects information that mimics the thought process of a specific person based on that emotion, and searches for and presents related information. Specific embodiments of this system are described below.
[0556] Hardware and software used
[0557] Hardware: Servers, user devices (PCs, smartphones, etc.)
[0558] Software: Emotion engine, search engine, generative AI model
[0559] System configuration
[0560] 1. Input of the user's emotional state
[0561] The user accesses the system through a terminal and inputs their emotional state. For example, the user can select emotions such as "happy" or "sad."
[0562] 2. Emotion Recognition by Emotion Engine
[0563] The server activates the emotion engine and recognizes the emotional state input by the user. Specifically, the emotion engine recognizes that "the user is happy."
[0564] 3. Selection of information to mimic thought processes
[0565] The server selects information to imitate the thought process of a specific person based on the recognition results of the emotion engine. For example, the emotion engine selects "the thought process of a comedian" based on "joy."
[0566] 4. User input of keywords
[0567] The user inputs the keyword they want to search for through the device. For example, the user inputs "interesting movies."
[0568] 5. Information Search Using Search Engines
[0569] The server launches a search engine to search for relevant information based on the keywords entered by the user and the thought process information selected by the emotion engine. Specifically, the search engine searches for information about comedy movies based on "funny movies" and "comedians' thought processes."
[0570] 6. Display of search results
[0571] The server generates search results and sends them to the user's device. The device displays the search results for the user to view. Specifically, the device displays a list of "recommended comedy movies."
[0572] Specific examples
[0573] User's emotional state: joy
[0574] Input keyword: "interesting movie"
[0575] Choosing an Emotional Engine: A Comedian's Thought Process
[0576] Search results for: information about comedy movies
[0577] Prompt Sentence Examples
[0578] Examples of prompts to be input to a generative AI model include:
[0579] What movie recommendations do you recommend when a user is happy? A user searches for "funny movies." Imitate a comedian's thought process and suggest related movies.
[0580] In this way, the system recognizes the user's emotional state, selects information that mimics a specific person's thought process based on that emotion, and searches for and displays related information, thereby providing appropriate information according to the user's emotions.
[0581] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0582] Step 1:
[0583] The user inputs an emotional state.
[0584] The user accesses the system through a terminal and selects an emotion such as "happy" or "sad" from the emotional state selection screen. The input emotional state is sent from the terminal to the server.
[0585] Step 2:
[0586] The server activates an emotion engine to recognize the emotional state input by the user.
[0587] The server receives the emotional state sent from the device and recognizes the emotion using the emotion engine. For example, the emotion engine recognizes that the user is happy. The recognition result is stored in the server.
[0588] Step 3:
[0589] The server selects information to mimic the thought process of a particular person based on the perceived emotional state.
[0590] The server selects information to imitate the thought process of a specific person based on the recognition results of the emotion engine. For example, the emotion engine selects "the thought process of a comedian" based on "joy." The selected information is stored in the server.
[0591] Step 4:
[0592] The user enters search keywords.
[0593] The user enters the keyword they want to search for in the search bar through their device. For example, the user enters "interesting movies." The entered keyword is sent from the device to the server.
[0594] Step 5:
[0595] The server launches a search engine to search for relevant information based on the keywords entered by the user and the thought process information selected by the emotion engine.
[0596] The server receives the search keywords sent from the device and the thought process information selected by the emotion engine, and searches for related information using a search engine. For example, the search engine searches for information about comedy movies based on "funny movies" and "comedians' thought processes." Search results are generated within the server.
[0597] Step 6:
[0598] The server generates search results and sends them to the user's terminal.
[0599] The server sends the search results generated by the search engine to the user's device, which then displays the received search results for the user to view. For example, the device displays a list of "recommended comedy movies."
[0600] (Application example 2)
[0601] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0602] Conventional search systems provide information without considering the user's emotional state, making it difficult to provide information appropriate to the user's current emotions. Furthermore, when a user selects information to imitate a specific person's thought process, it is not possible to select appropriate information based on the user's emotional state. Therefore, to increase user satisfaction, a system that recognizes the user's emotional state and provides optimal information based on that state is needed.
[0603] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0604] In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, means for recognizing the emotional state of the user, means for selecting information for imitating the thought process of the specific person based on the recognized emotional state, and means for recommending optimal content to the user based on the selected information, thereby making it possible to provide optimal information according to the emotional state of the user.
[0605] "User" means any individual or entity that uses the System.
[0606] A "specific person" is an individual whose thought process the user wishes to emulate.
[0607] A "thought process" is a set of cognitive steps or ways in which a particular person processes information and makes decisions.
[0608] A "means for providing information" is a method or device for providing a user with information that allows them to imitate the thought process of a particular person.
[0609] A "means for performing a search" is a method or device that allows a user to search for related information based on the information provided.
[0610] A "means for presenting search results" is a method or device for displaying or providing search results to a user.
[0611] An "emotional state" is a state that indicates the user's current feelings or mood.
[0612] A "means for recognizing an emotional state" is a method or device for detecting and recognizing a user's emotional state.
[0613] The "means for selecting information" is a method or apparatus for selecting appropriate information to mimic the thought process of a particular person based on a recognized emotional state.
[0614] The "means for recommending content" refers to a method or device for recommending optimal content to a user based on selected information.
[0615] The system for implementing this invention recognizes the emotional state of a user, selects information that mimics the thought process of a specific person based on that emotion, and recommends optimal content. Specific embodiments of this system are described below.
[0616] System Configuration
[0617] The system consists of the following main components:
[0618] 1. User device: A device such as a smartphone or tablet that has a camera and microphone.
[0619] 2. Emotion Recognition Engine: Software that recognizes emotions from the user's facial expressions and tone of voice. Specifically, it uses OpenCV to capture camera footage and EmotionRecognizer to recognize emotions.
[0620] 3. Thought Process Imitation Engine: Software that selects information that mimics a particular person's thought process based on perceived emotions.
[0621] 4. Content Recommendation Engine: Software that recommends the most suitable content to users based on selected information. Use ContentRecommender.
[0622] Processing flow
[0623] 1. Emotion Recognition: The camera and microphone on the user's device are used to capture the user's facial expressions and tone of voice. The video is processed using OpenCV, and emotions are recognized using EmotionRecognizer.
[0624] 2. Thought process selection: Based on the recognized emotion, the thought process imitation engine selects information to imitate the thought process of a specific person. For example, if the user is happy, it will select information to imitate the thought process of a comedian.
[0625] 3. Content recommendation: Based on the selected information, the content recommendation engine will recommend the most suitable content to the user, such as comedy videos or inspirational poems.
[0626] Hardware and software used
[0627] Hardware: smartphone, tablet, camera, microphone
[0628] Software: OpenCV (image processing), EmotionRecognizer (emotion recognition), ContentRecommender (content recommendation)
[0629] Specific examples
[0630] For example, when a user is smiling, the system mimics the thought process of a comedian and recommends related comedy videos, while when a user is sad, the system mimics the thought process of a poet and recommends inspiring poetry and music.
[0631] Prompt Sentence Examples
[0632] When a user is smiling, mimic the comedian's thought process and recommend related comedy videos.
[0633] When a user is sad, mimic the thought process of a poet and recommend inspiring poetry or music.
[0634] In this way, it is possible to provide optimal information according to the user's emotional state.
[0635] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0636] Step 1:
[0637] The user device uses a camera and microphone to capture the user's facial expressions and tone of voice. The input is camera video and audio data, and the output is a real-time multimedia stream containing these data.
[0638] Step 2:
[0639] The user device processes the captured video using OpenCV and recognizes the user's emotions using EmotionRecognizer. The input is the multimedia stream obtained in step 1, and the output is the recognized emotion (e.g., joy, sadness, etc.). Specifically, the operation involves extracting facial feature points and applying a facial expression analysis algorithm.
[0640] Step 3:
[0641] Based on the recognized emotions, the server uses a thought process imitation engine to select information to imitate the thought process of a specific person. The input is the emotion data obtained in step 2, and the output is the selected thought process information. Specifically, the server searches for the profile of an appropriate person based on the emotion data and extracts information to imitate that person's thought process.
[0642] Step 4:
[0643] The server uses ContentRecommender to recommend the most suitable content to the user based on the selected thought process information. The input is the thought process information obtained in step 3, and the output is the recommended content (e.g., video, music, article, etc.). Specifically, the server searches the content database based on the thought process information and selects the most suitable content.
[0644] Step 5:
[0645] The user terminal presents the recommended content received from the server to the user. The input is the recommended content obtained in step 4, and the output is the content displayed to the user. Specifically, the content is displayed on the user interface so that the user can view or use it.
[0646] In this way, it is possible to provide optimal information according to the user's emotional state.
[0647] Example 3
[0648] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0649] Conventional search systems have had difficulty providing search results that take into account the user's emotions or the thought processes of specific individuals. As a result, users are unable to obtain appropriate search results for the information they are looking for, resulting in a decrease in user satisfaction. In particular, there is a need to provide search results that are based on the user's emotions, thereby providing information that is more suited to the user's needs.
[0650] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[0651] In this invention, the server includes means for recognizing a user's emotion, means for generating a search query based on the emotion, and means for performing a search based on the search query, thereby making it possible to provide appropriate search results according to the user's emotion.
[0652] "User" means any person or entity that uses the System to search for information and receive results.
[0653] "A particular person's thought process" refers to the flow of thought and criteria for judgment that can be inferred from a particular person's past actions and statements.
[0654] "Means for providing information" refers to a method or device for presenting information about a particular person's thought process to a user.
[0655] "Means for performing a search" refers to a method or apparatus for searching for relevant data based on user-entered information or a system-generated query.
[0656] "Means for presenting search results to a user" refers to a method or device for visually displaying search results obtained from a search engine to a user.
[0657] "Means for recognizing user emotions" refers to a method or device for analyzing and identifying emotions from user input data and behavior.
[0658] "Means for generating search queries" refers to a method or apparatus for creating appropriate search queries based on recognized user sentiment.
[0659] "Means for conducting a search" refers to a method or apparatus for querying a search engine for relevant information using a generated search query.
[0660] "Means for organizing search results" refers to a method or device for organizing and identifying the obtained search results as information related to the user's emotions.
[0661] MODE FOR CARRYING OUT THE INVENTION
[0662] The present invention relates to a system that recognizes a user's emotions and provides appropriate search results based on the emotions. A specific embodiment of this system will be described below.
[0663] Hardware and software used
[0664] Hardware: Servers, devices (PCs, smartphones, etc.)
[0665] Software: Search engines (e.g., popular search APIs), sentiment engines (e.g., popular sentiment analysis APIs), user interfaces (e.g., popular front-end frameworks)
[0666] System processing overview
[0667] 1. Obtaining user input data
[0668] Users access the system through a terminal and input data using text or voice.
[0669] The terminal transmits this input data to the server.
[0670] 2. Emotion recognition
[0671] The server sends the received input data to the emotion engine.
[0672] The emotion engine analyzes the input data and identifies the user's emotion.
[0673] 3. Search Query Generation
[0674] The server generates appropriate search queries based on the recognized sentiment.
[0675] 4. Execute search
[0676] The server uses the generated search query to perform a search on a search engine.
[0677] The search engine returns relevant search results based on the query.
[0678] 5. Organizing search results
[0679] The server organizes the retrieved search results and identifies information related to the user's emotions.
[0680] 6. Presentation of search results
[0681] The search results are displayed in list format through the device's user interface.
[0682] Each search result is accompanied by a description that shows how the information is relevant to a particular person's thought process.
[0683] Specific examples
[0684] User input: User types, "I've been feeling stressed at work lately."
[0685] Emotion recognition: The emotion engine recognizes the emotion "stress."
[0686] Search query generation: The server generates search queries such as "stress relief" or "relaxation techniques."
[0687] Get search results: A search engine returns results such as "articles on stress relief" or "relaxation music playlists."
[0688] Presentation of results: The user interface presents search results in a list format, with a description for each result, such as "This information may help you relieve stress."
[0689] Prompt Sentence Examples
[0690] "What search results should we present to users when they are stressed?"
[0691] "How can we help users find relevant information when they're happy?"
[0692] In this way, the system can provide appropriate search results based on the user's emotions and visually present information that meets the user's needs. The flow of the identification process in the third embodiment will be described with reference to FIG.
[0693] Step 1:
[0694] Obtaining user input data
[0695] Users access the system through a terminal and input data using text or voice.
[0696] Input: User types the text "I've been feeling stressed at work lately."
[0697] The terminal receives this input data and sends it to the server.
[0698] Output: User input data sent to the server.
[0699] Step 2:
[0700] emotion recognition
[0701] The server sends the received input data to the emotion engine.
[0702] Input: User input data.
[0703] The emotion engine analyzes the input data and identifies the user's emotion.
[0704] Specific behavior: The emotion engine recognizes the emotion "stress."
[0705] Output: Recognized emotion data (e.g., stress).
[0706] Step 3:
[0707] Search Query Generation
[0708] The server generates appropriate search queries based on the recognized sentiment.
[0709] Input: Recognized emotion data.
[0710] What it does: The server generates search queries such as "stress relief" or "relaxation techniques."
[0711] Output: The generated search query.
[0712] Step 4:
[0713] Search execution
[0714] The server uses the generated search query to perform a search on a search engine.
[0715] Input: The generated search query.
[0716] The search engine returns relevant search results based on the query.
[0717] What it does: A search engine returns results like "articles on stress relief" and "relaxation music playlists."
[0718] Output: Search result data.
[0719] Step 5:
[0720] Organizing search results
[0721] The server organizes the retrieved search results and identifies information related to the user's emotions.
[0722] Input: Search result data.
[0723] What it does: The server formats the search results into a list and provides a description for each result.
[0724] Output: Organized search results data.
[0725] Step 6:
[0726] Presenting search results
[0727] The search results are displayed in list format through the device's user interface.
[0728] Input: Organized search results data.
[0729] What it does: The user interface displays search results with a description such as "This information may help you relieve stress."
[0730] Output: Search results presented to the user.
[0731] (Application example 3)
[0732] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0733] Conventional search systems provide search results without considering the user's emotional state, making it difficult to provide information appropriate to the user's current emotions. Additionally, they lack explanations of how search results relate to the user's thought process, making it difficult for users to effectively use search results.
[0734] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, means for recognizing the user's emotions, means for performing a search based on the emotions, and means for visually presenting the search results. This makes it possible to provide search results that are appropriate for the user's emotional state and to provide an explanation showing how the search results are related to the user's thought process.
[0735] "User" means any individual or entity that uses the System.
[0736] A "specific person" is an individual whose thought process the user is trying to emulate.
[0737] A "thought process" is the process by which a particular person processes information and makes decisions.
[0738] A "means of providing information" is a method of providing information to a user to mimic the thought process of a particular person.
[0739] A "means of conducting a search" is the method by which a user performs a search based on the information provided.
[0740] A "means of presenting search results" is the method by which search results are visually displayed to the user.
[0741] An "emotion recognition means" is a method for detecting and identifying a user's emotional state.
[0742] A "means for performing search based on emotions" is a method for performing appropriate searches according to the recognized emotions of a user.
[0743] A "visual presentation" is a method by which search results are visually displayed to a user.
[0744] The system for implementing the present invention recognizes the user's emotions and provides optimal search results based on the emotions. A specific embodiment of this system will be described below.
[0745] Hardware and Software Configuration
[0746] This system uses the following hardware and software:
[0747] Hardware: Smartphone camera
[0748] Software: OpenCV, Keras, Scikit-learn, Requests
[0749] Processing flow
[0750] 1. Emotion Recognition: Capture the user's face using the smartphone camera, detect the face using OpenCV, and input it into the Keras emotion recognition model to recognize the user's emotions.
[0751] 2. Search execution: Based on the recognized sentiment, generate an appropriate search query and send a request to an external content recommendation API.
[0752] 3. Results display: Visually displaying the recommended content to the user.
[0753] Specific examples
[0754] For example, if a user is happy, it will recommend the latest comedy videos or fun music playlists, and if a user is sad, it will recommend relaxing music or videos with encouraging messages.
[0755] Prompt Sentence Examples
[0756] Develop an application that recognizes the user's emotions and recommends the best content based on those emotions: when the user is happy, recommend entertaining videos or music, when the user is sad, recommend comforting content.
[0757] In this way, it is possible to provide search results that are appropriate to the user's emotional state and provide explanations that show how the search results relate to the user's thought process.
[0758] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[0759] Step 1:
[0760] The device captures the user's face using the smartphone's camera. The input is real-time video from the camera, and the output is the captured face image. Specifically, the camera detects the user's face and acquires its image data.
[0761] Step 2:
[0762] The device uses OpenCV to detect the face region from the captured face image. The input is the face image obtained in step 1, and the output is the coordinate information of the face region. Specifically, a face detection algorithm is applied to identify the position of the face.
[0763] Step 3:
[0764] The device inputs the image data of the face region into the Keras emotion recognition model to recognize the user's emotions. The input is the image data of the face region obtained in step 2, and the output is the recognized emotion label. Specifically, the face image is preprocessed and input into the emotion recognition model to classify the emotion.
[0765] Step 4:
[0766] The server generates an appropriate search query based on the recognized emotion. The input is the emotion label obtained in step 3, and the output is the search query. Specifically, it selects keywords corresponding to the emotion label and constructs the search query.
[0767] Step 5:
[0768] The server sends a request to an external content recommendation API using the generated search query. The input is the search query obtained in step 4, and the output is a list of recommended content. Specifically, an HTTP request is sent to the API endpoint to obtain the recommendation results.
[0769] Step 6:
[0770] The terminal visually displays the recommended content received from the server to the user. The input is the list of recommended content obtained in step 5, and the output is the content displayed to the user. Specifically, the recommended content is displayed in list form on the screen, allowing the user to select it.
[0771] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0772] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0773] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.
[0774] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0775] [Second embodiment]
[0776] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0777] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0778] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0779] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0780] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0781] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0782] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0783] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0784] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0785] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0786] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0787] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[0788] "Example 1"
[0789] In one embodiment of the present invention, a database is provided as a means for providing information for imitating the thought process of a specific person. This database stores information representing the thought process inferred from the past actions and statements of the specific person. A user can select information from this database for imitating the thought process of a specific person.
[0790] "Example 2"
[0791] Next, a search engine is provided as a means for searching based on the information selected by the user. This search engine searches for related information based on the keywords entered by the user and the information selected to mimic the thought process.
[0792] "Example 3"
[0793] Finally, a user interface is provided as a means for presenting search results to the user. This user interface visually presents the search results obtained from the search engine to the user, specifically by displaying the search results in a list format and providing a description for each result that indicates how the information is relevant to a particular person's thought process.
[0794] The processing flow of each embodiment will be described below.
[0795] "Example 1"
[0796] Step 1: The user selects a specific person. This is the person whose thought process the user wants to emulate.
[0797] Step 2: The system retrieves information from the database that represents the selected person's thought process, inferred from their past actions and statements.
[0798] Step 3: The acquired information is presented to the user, who can then use it to mimic the thought process of a specific person.
[0799] "Example 2"
[0800] Step 1: User enters search keywords.
[0801] Step 2: The system performs a search based on the keywords entered and information intended to mimic the thought process described above.
[0802] Step 3: Present the search results to the user.
[0803] "Example 3"
[0804] Step 1: The system displays the search results in a list format.
[0805] Step 2: For each result, provide an explanation that shows how the information relates to a particular person's thought process.
[0806] Step 3: Present the search results with this description to the user.
[0807] Example 1
[0808] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0809] In conventional systems, the means of providing information to imitate the thought process of a specific person were limited, making it difficult for users to provide sufficient accuracy and flexibility when searching based on that information.In addition, inferences about the thought process based on a specific person's past actions and statements were insufficient, resulting in a problem of reduced quality of information provided to users.
[0810] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0811] In this invention, the server includes: means for providing information for a user to imitate the thought process of a specific person; means for the user to perform a search based on the information; means for presenting the search results to the user; means for acquiring data on the specific person's past actions and statements from a database; means for analyzing the acquired data and inferring the specific person's thought process; and means for inputting the analysis results into a generative AI model and providing the generated information to the user. This makes it possible to imitate the thought process of a specific person with high accuracy and flexibility, improving the quality of information provided to the user.
[0812] A "user" is an entity that uses the system to obtain and search for information that mimics the thought process of a particular person.
[0813] A "specific person" is someone whose thought process is inferred based on their past actions and statements.
[0814] A "thought process" is a flow or pattern of thought that can be inferred from a particular person's past actions or statements.
[0815] An "information provision means" is a means for a user to provide information that allows the user to imitate the thought process of a particular person.
[0816] "Search means" refers to the means by which a user conducts a search based on the information provided.
[0817] "Presentation means" refers to the means for presenting search results to the user.
[0818] A "database" is a system for storing data about a specific person's past actions and statements.
[0819] "Data acquisition means" refers to a means for acquiring data on the past actions and statements of a specific person from a database.
[0820] "Analysis means" refers to a means for analyzing acquired data and inferring the thought process of a particular person.
[0821] A "generative AI model" is an artificial intelligence model that generates new information based on analysis results.
[0822] A "prompt sentence" is an instruction sentence input to a generative AI model.
[0823] The present invention relates to a system for providing information for imitating the thought process of a specific person. A specific embodiment of this system will be described below.
[0824] System configuration
[0825] This system consists of three main elements: a server, a terminal, and a user. The server retrieves data from a database, analyzes it, and generates information using a generative AI model. The terminal provides an interface for users to access the system and retrieve information. Users access the system through their terminal and retrieve information to mimic the thought process of a specific person.
[0826] Hardware and software used
[0827] Server: A server with a powerful processor and large memory capacity is required, specifically, a server with an Intel Xeon processor or AMD EPYC processor is suitable.
[0828] Database: A relational database management system (RDBMS) such as MySQL or PostgreSQL is used.
[0829] Analysis software: Python's NLTK library and machine learning models (e.g., GPT-4) are used.
[0830] Devices: Users can access the site using devices such as PCs, tablets, and smartphones. Suitable web browsers include Google Chrome and Mozilla Firefox.
[0831] Data processing and calculation
[0832] The server first accesses a database to retrieve data about a specific person's past actions and statements. The retrieved data is preprocessed using Python's NLTK library, which includes tokenizing the text and removing stop words. The data is then analyzed using a GPT-4 model to infer the specific person's thought process.
[0833] Specific examples
[0834] For example, if a user wants to imitate the thought process of a historical figure, "Scientist A," they would follow the steps below.
[0835] 1. The user opens Google Chrome and enters the system URL to access the system. The system login screen is displayed, and the user logs in by entering their ID and password.
[0836] 2. The user enters "Scientist A" in the search bar on the system's main screen and clicks the search button. The search results are displayed and the user selects Scientist A.
[0837] 3. The server executes the SQL query "SELECT FROM actions WHERE person='Scientist A'" to retrieve data about Scientist A's actions and statements from the database.
[0838] 4. The server preprocesses the acquired data using Python's NLTK library, for example by tokenizing the text and removing stop words, and then uses the GPT-4 model to analyze the data and infer Scientist A's thought process.
[0839] 5. Based on the analysis results, the server inputs the prompt statement, "Please imitate the thought process of scientist A and propose a new scientific theory." into the generative AI model.
[0840] 6. The server provides the user with new ideas obtained from the generative AI model. The user can check the generated ideas on the system's results display screen. For example, specific ideas such as "a new law of conservation of energy" are displayed.
[0841] In this way, users can imitate the thought process of a particular person and gain new ideas and knowledge.
[0842] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0843] Step 1:
[0844] A user accesses the system.
[0845] The user opens a web browser such as Google Chrome and enters the system's URL to access it. The system's login screen is displayed, and the user logs in by entering their ID and password.
[0846] Input: User ID and password
[0847] Output: System main screen
[0848] Step 2:
[0849] The user selects a specific person.
[0850] The user enters the name of a specific person in the search bar on the system's main screen and clicks the search button. The search results are displayed and the user can select a specific person.
[0851] Input: Name of a specific person
[0852] Output: Search results for a specific person
[0853] Step 3:
[0854] The server retrieves the data from the database.
[0855] The server retrieves data about the specific person selected by the user from the database. Specifically, it executes the SQL query "SELECT FROM actions WHERE person='specific person'" to retrieve data about actions and comments from the database.
[0856] Input: Name of a specific person
[0857] Output: Data about the actions and statements of a specific person
[0858] Step 4:
[0859] The server analyzes the data.
[0860] The server uses Python's NLTK library to analyze the acquired data, first performing preprocessing such as tokenizing the text and removing stop words, then using the GPT-4 model to analyze the data and infer the thought process of a particular person.
[0861] Input: Data about what a specific person did or said
[0862] Output: Analysis of a specific person's thought process
[0863] Step 5:
[0864] The server inputs the analysis results into a generative AI model.
[0865] The server generates a prompt based on the analysis results and inputs it into the generative AI model. For example, it generates a prompt such as, "Please mimic the thought process of a specific person and propose a new idea."
[0866] Input: Analysis of a specific person's thought process
[0867] Output: The prompt sentence that is fed into the generative AI model
[0868] Step 6:
[0869] The server provides the generated information to the user.
[0870] The server provides the user with new ideas obtained from the generative AI model. The user can check the generated ideas on the system's results display screen. For example, specific ideas such as "a new law of conservation of energy" are displayed.
[0871] Input: Output from a generative AI model
[0872] Output: New ideas provided to users
[0873] (Application example 1)
[0874] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0875] Conventional ad generation systems have difficulty reflecting the thought process of specific celebrities or influencers when creating ad copy. As a result, they are unable to provide effective ads to target users, limiting the effectiveness of the ads. In addition, creating ad copy takes a great deal of time and effort, so there is a need for efficient ad generation.
[0876] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0877] In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, means for generating advertising copy by imitating the thought process of a specific person, and means for presenting the generated advertising copy to the user. This makes it possible to generate effective advertising copy that reflects the thought process of a specific celebrity or influencer, thereby improving the efficiency and effectiveness of advertising creation.
[0878] A "user" is an entity that uses the system to imitate the thought process of a specific person and generate advertising copy.
[0879] "Specific individuals" are individuals such as celebrities or influencers whose thought processes can be inferred from their past actions and statements.
[0880] A "thought process" is a flow or pattern of thought that can be inferred from a particular person's past actions or statements.
[0881] "Information" is the data or knowledge required to mimic a particular person's thought process.
[0882] A "means for providing" is a method or device for providing a user with information about a particular person's thought process.
[0883] A "means for performing a search" is a method or device that allows a user to search for a specific person's thought process based on the information provided.
[0884] "Presenting means" refers to a method or device for displaying search results and generated advertising copy to users.
[0885] "Ad copy" is promotional text that is generated by imitating the thought process of a particular person.
[0886] The "means for generating" is a method or device for automatically generating advertising copy based on the thought process of a specific person.
[0887] The system for implementing this invention allows a user to generate advertising copy by imitating the thought process of a specific person. The system is composed of a server and a user terminal.
[0888] The server provides a means for users to provide information that allows them to imitate the thought process of a specific person. This information is data that represents the thought process inferred from the specific person's past actions and statements. The server manages this information using a database and makes it accessible to users.
[0889] The user terminal is equipped with a means for performing a search based on the information provided by the server. The user can select information about a specific person's thought process and perform a search. The search results are displayed on the user terminal.
[0890] The server further includes a means for generating ad copy by imitating the thought process of a particular person, the means using a generative AI model (e.g., GPT-3) to generate ad copy based on a prompt provided by the user, and the generated ad copy is presented on the user's device.
[0891] As a specific example, the following prompt sentence can be input to the generative AI model:
[0892] Example prompt sentence:
[0893] Use a positive, energetic tone and generate copy based on the following product information: Latest smartphone, long battery life, great camera.
[0894] This system makes it possible to generate effective ad copy that reflects the thought process of specific celebrities and influencers, improving the efficiency and effectiveness of ad creation.
[0895] The server uses OpenAI's API to access the generative AI model and generate ad copy based on the prompt provided by the user. The generated ad copy is then displayed on the user's device for the user to review. This allows users to easily create ad copy that mimics a specific person's thought process.
[0896] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0897] Step 1:
[0898] The user selects information to mimic the thought process of a particular person.
[0899] Input: An interface for the user to select a specific person.
[0900] Output: The ID of the specific person selected.
[0901] Specific operation: The user terminal displays a list of specific people provided by the server, and the user selects a specific person from the list.
[0902] Step 2:
[0903] The server retrieves information about the thought process of the particular selected person from a database.
[0904] Input: The ID of a specific person.
[0905] Output: Information about a particular person's thought process.
[0906] Specific operation: The server accesses the database and retrieves thought process data corresponding to a specific person's ID.
[0907] Step 3:
[0908] The user enters a prompt to generate the ad copy.
[0909] Input: The prompt text that the user enters.
[0910] Output: The prompt statement entered.
[0911] Specific operation: The user terminal displays a text box for inputting a prompt sentence, and the user inputs the prompt sentence.
[0912] Step 4:
[0913] The server uses the generative AI model to generate ad copy based on the prompt text.
[0914] Input: Information about a particular person's thought process, prompt statements entered by the user.
[0915] Output: The generated ad copy.
[0916] How it works: The server uses OpenAI's API to input a specific person's thought process and prompt into a generative AI model to generate advertising copy.
[0917] Step 5:
[0918] The generated ad copy is presented to the user.
[0919] Input: The generated ad text.
[0920] Output: The ad copy that is presented to the user.
[0921] Specific operation: The user's device displays the generated ad copy for the user to review.
[0922] Step 6:
[0923] The user can review the generated ad copy and modify it if necessary.
[0924] Input: The generated ad text.
[0925] Output: Revised ad copy (if necessary).
[0926] Specific operations: The user device provides an interface for editing the ad copy, allowing the user to modify the ad copy.
[0927] Step 7:
[0928] Save the final ad copy and use it in your ad campaign.
[0929] Input: The revised (or generated) ad copy.
[0930] Output: Saved ad copy.
[0931] What happens: The server stores the final ad copy in a database so it can be used in ad campaigns.
[0932] Example 2
[0933] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0934] Conventional search systems make it difficult for users to search for information by imitating the thought processes of a specific person. Furthermore, they lack a means to efficiently search for relevant information based on the keywords and thought processes entered by the user and provide filtered results. This makes it difficult for users to quickly and accurately obtain the information they need.
[0935] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0936] In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, means for generating a search query based on keywords entered by the user and the thought process selected by the user, means for searching for related information using the generated search query, and means for filtering the search results and returning them to the user. This enables the user to efficiently search for related information and quickly obtain filtered results while imitating the thought process of a specific person.
[0937] "User" means any person or entity that uses the System to search for information.
[0938] A "thought process" is a series of steps or methods by which a particular person gathers, analyzes, and makes decisions about information.
[0939] "Means for providing information" refers to a function or device that provides a user with information to imitate the thought process of a particular person.
[0940] "Search means" refers to a function or device for searching for related information based on keywords entered by the user and the information provided.
[0941] "Means for presenting search results" refers to functions or devices for displaying information obtained through a search to the user.
[0942] A "means for generating a search query" is a function or device for creating a search query based on keywords entered by the user and the thought process selected by the user.
[0943] The "means for searching related information" refers to a function or device for searching information in a database or on the Internet using the generated search query.
[0944] A "means for filtering search results" is a function or device that narrows down the information obtained by a search based on a thought process selected by the user.
[0945] "Means for returning to user" refers to the functionality or device for sending filtered search results to the user.
[0946] This invention is a system that allows users to search for information by imitating the thought process of a specific person. The system generates a search query based on keywords entered by the user and the thought process selected by the user, searches for related information, and provides the user with filtered results.
[0947] The server receives the keywords entered by the user and the selected thought process and generates a search query using search engine software such as the Google Search API or Elasticsearch. Based on the generated search query, the server searches for related information and retrieves the search results.
[0948] The server then filters the search results to extract the information most relevant to the user's selected thought process. The filtered search results are sent back to the user. The device displays the search results received from the server to the user.
[0949] As a concrete example, consider the case where a user inputs the keywords "generative AI model" and the thought process "data preprocessing." In this case, the server generates a search query "generative AI model data preprocessing" and searches for related information using the Google Search API. The search results are filtered to information about data preprocessing and provided to the user.
[0950] Examples of prompts to input to a generative AI model might include:
[0951] If a user types in the keyword "generative AI model" and selects "data preprocessing" as the thought process, they should search for related information.
[0952] By inputting this prompt into a generative AI model, the model can provide search results that meet the user's requirements.
[0953] The system allows users to efficiently search for relevant information and quickly obtain filtered results, while mimicking a specific person's thought process.
[0954] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0955] Step 1:
[0956] The user inputs keywords and thought processes.
[0957] Users input keywords they want to search for (e.g., "generative AI model") and related thought processes (e.g., "data preprocessing") through the system's interface. The input information is then sent to the terminal.
[0958] Step 2:
[0959] The terminal transmits the input information to the server.
[0960] The terminal sends the user's input keywords and selected thought processes to the server using an HTTP request. The input data is passed to the server as pairs of keywords and thought processes.
[0961] Step 3:
[0962] The server generates a search query based on the received information.
[0963] The server generates a search query based on the received keywords ("generative AI model") and thought process ("data preprocessing"). Specifically, it combines this information to create a search query called "generative AI model data preprocessing." The generated search query is used in the next step.
[0964] Step 4:
[0965] The server uses a search engine to search for relevant information.
[0966] The server uses the generated search query to send a query to a search engine such as the Google Search API or Elasticsearch, which retrieves relevant information from its indexed database and sends it back to the server, which returns the search results to the server as a list of relevant web pages or documents.
[0967] Step 5:
[0968] The server filters the search results and returns them to the user.
[0969] The server filters the search results obtained from the search engine. The filtering criteria are based on the thought process selected by the user, for example, extracting only information related to "data preprocessing." The filtered search results are then returned to the user.
[0970] Step 6:
[0971] The terminal displays the search results to the user.
[0972] The terminal displays the filtered search results received from the server to the user, who can then obtain the information they need based on the displayed search results. Specifically, a list of search results is displayed on the interface, and the user can click on it to view detailed information.
[0973] (Application example 2)
[0974] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0975] Conventional search systems only provide simple search results based on keywords entered by the user, making it difficult to provide search results that reflect the user's thought process. Furthermore, there was a lack of a way for users to conduct searches based on information that would allow them to mimic a specific thought process, making it difficult to efficiently obtain information that meets the user's intent. Furthermore, there was no way to utilize generative AI models to generate prompt sentences and optimize search queries, resulting in low search accuracy.
[0976] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0977] In this invention, the server includes a means for providing information for a user to imitate the thought process of a specific person, a means for the user to perform a search based on the information, a means for generating a prompt sentence using a generative AI model, a means for searching for related information based on the prompt sentence, and a means for presenting the search results to the user, thereby making it possible to provide search results that reflect the user's thought process.
[0978] "User" means any person or entity that uses the System to search for information.
[0979] A "specific person" is an individual whose thought process the user wishes to emulate.
[0980] A "thought process" is a set of cognitive steps or ways in which a particular person processes information and makes decisions.
[0981] A "means for providing information" is a method or device for providing a user with information about a particular person's thought process.
[0982] A "search means" is a method or device for searching for related information based on keywords entered by a user or information provided by the user.
[0983] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate prompts based on user input.
[0984] A "prompt sentence" is a sentence generated by a generative AI model to optimize a search query.
[0985] The "means for searching related information" refers to a method or device for searching the Internet or a database for the information the user is looking for based on the generated prompt sentence.
[0986] "Means for presenting search results to the user" refers to a method or device for displaying the information obtained by the search to the user.
[0987] This invention is a system that provides users with information to imitate the thought process of a specific person, performs searches based on that information, generates prompt sentences using a generative AI model, and searches for related information and presents it to the user.
[0988] System configuration
[0989] The system consists of the following main components:
[0990] 1. User device: The device (e.g., smartphone, tablet, PC) through which the user enters search keywords and specific thought processes.
[0991] 2. Server: A central processing unit for receiving input from the user, generating prompt sentences using generative AI models, and retrieving relevant information.
[0992] 3. Generative AI model: An artificial intelligence algorithm (e.g., GPT-3) for generating prompt sentences based on user input.
[0993] 4. Search engine: A system for searching relevant information from the Internet or databases based on the generated prompt (e.g., Google Custom Search API).
[0994] Processing flow
[0995] 1. User device: The user uses the device to input search keywords and a specific thought process, for example, "latest movies" and "focus on reviews."
[0996] 2. Server: The server receives input from the user and sends it to the generative AI model.
[0997] 3. Generative AI model: The generative AI model generates prompts based on user input, such as "Generate prompts for users to search for information related to the latest movies, with an emphasis on reviews."
[0998] 4. Server: Based on the generated prompt sentence, a search engine is used to search for relevant information.
[0999] 5. Search Engines: Search engines retrieve relevant information from the internet and databases based on the prompt text.
[1000] 6. Server: Sends the search results to the user's device.
[1001] 7. User device: The user views the search results through their device.
[1002] Hardware and software used
[1003] Hardware: Smartphones, tablets, PCs, servers
[1004] Software: Python, OpenAI API, Google Custom Search API
[1005] Specific examples
[1006] For example, if a user types in "latest movies" and selects "important reviews" as their thought process, the generative AI model will generate a prompt like this:
[1007] "Generate prompts to help users search for information related to the latest movies, with an emphasis on reviews."
[1008] Based on this prompt, the search engine can retrieve and provide information about the latest movies, including reviews and ratings, allowing users to efficiently find results that fit their own thought process.
[1009] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1010] Step 1:
[1011] User device: The user uses the device to input search keywords and a specific thought process, for example, "latest movies" and "focus on reviews." The input data is then sent to the server.
[1012] Step 2:
[1013] Server: The server receives input from the user and sends it to the generative AI model. Specifically, it converts the user's input data (search keywords and thought processes) into a format suitable for the generative AI model and creates an API request.
[1014] Step 3:
[1015] Generative AI model: The generative AI model generates prompt sentences based on input data received from the server. For example, it generates a prompt sentence such as, "Generate a prompt sentence for a user to search for information related to the latest movies, with an emphasis on reviews." The generated prompt sentence is returned to the server.
[1016] Step 4:
[1017] Server: The server receives the prompt sentence returned by the generative AI model and sends it to the search engine. Specifically, the server uses the prompt sentence as a search query and sends a request to the search engine API.
[1018] Step 5:
[1019] Search engine: A search engine searches the Internet and databases for relevant information based on the prompt received from the server, and returns the search results to the server.
[1020] Step 6:
[1021] Server: The server receives the search results returned by the search engine and sends them to the user's device. Specifically, it formats the search results in a format that is easy for the user to view and sends them to the user's device.
[1022] Step 7:
[1023] User device: The user views search results on their device, including information about the latest movies, including reviews and ratings.
[1024] Example 3
[1025] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1026] Conventional search systems lacked the means to provide users with information that would allow them to mimic the thought process of a specific person, making it difficult for users to effectively use search results. Furthermore, they lacked the means to generate prompts to properly input search queries into generative AI models, and to properly display the generated search results in the user interface. This made it difficult for users to quickly and accurately obtain the information they were looking for.
[1027] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[1028] In this invention, the server includes means for receiving a search query from a user, means for converting the received search query into a prompt sentence for input to a generative AI model, means for processing the prompt sentence using the generative AI model to generate relevant search results, and means for converting the generated search results into a format appropriate for display on a user interface, thereby providing information for the user to imitate the thought process of a specific person, enabling the search query to be appropriately processed and the generated search results to be effectively displayed.
[1029] "User" means any person or entity that uses the System to search for information and receive results.
[1030] "Search Query" means a search request or question entered into a system by a user.
[1031] A "generative AI model" refers to an algorithm or program that uses artificial intelligence technology to generate relevant information based on input prompts.
[1032] A "prompt sentence" refers to a sentence that is converted from a user's search query to appropriately input it into a generative AI model.
[1033] "Search results" refers to the information and data generated by a generative AI model based on a prompt.
[1034] "User interface" refers to the screen or display means through which a user interacts with the system and visually confirms search results.
[1035] "Server" refers to the central computer system that receives search queries from users, generates search results using the generative AI model, and displays them in the user interface.
[1036] A "means" refers to a method or apparatus designed to perform a particular function or role.
[1037] This invention is a system that provides information for users to imitate the thought process of a specific person, converts search queries into prompt sentences for appropriate input into a generative AI model, and appropriately displays the generated search results in a user interface.
[1038] Server Roles
[1039] The server receives a search query from a user. For example, if the user types, "I want to know about the latest technology trends," the server receives the query. The server then converts the received search query into a prompt sentence to input into the generative AI model. This prompt sentence reflects the user's intention and request. For example, the server converts the query, "I want to know about the latest technology trends," into a prompt sentence, "Please provide information about the latest technology trends."
[1040] The server processes the prompt using a generative AI model (e.g., OpenAI's GPT-4) to generate relevant search results. The generated search results include explanations related to a specific person's thought process. For example, in response to the prompt, "Please provide information about the latest technology trends," the generative AI model generates a search result such as, "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a specific person (e.g., a technology analyst)."
[1041] Device Role
[1042] The terminal receives the search results sent from the server. The terminal converts these search results into an appropriate format for display on the user interface. Specifically, the terminal displays the search results in a list format, and for each result, it provides a description that indicates how the information is related to the thought process of a specific person. For example, the terminal displays the search result "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a specific person (e.g., a technology analyst)" in a list format.
[1043] User Roles
[1044] The user visually checks the search results displayed on the device. The user reads the description attached to each search result and understands how the information relates to a specific person's thought process. For example, if a user enters the query "Please provide information on the latest technology trends," the user will check and understand the search result: "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a specific person (e.g., a technology analyst)."
[1045] Specific examples
[1046] Prompt Sentence Examples
[1047] "I want to know about the latest technology trends"
[1048] Example of search results
[1049] "The latest technology trends include the evolution of AI, the widespread adoption of 5G, and the application of blockchain technology. These technologies play a key role in the thought process of certain individuals (e.g., technology analysts)."
[1050] In this way, the user can visually check the search results and understand information related to the thought process of a particular person. The flow of the identification process in the third embodiment will be described with reference to FIG.
[1051] Step 1:
[1052] The server receives a search query from a user.
[1053] What happens: When a user types "I want to know about the latest technology trends," the server receives the query.
[1054] Input: User's search query: "I want to know about the latest technology trends"
[1055] Output: Received search query
[1056] Step 2:
[1057] The server converts the received search query into a prompt sentence to be input into the generative AI model.
[1058] Specific behavior: The server converts the query "I want to know about the latest technology trends" into the prompt "Please provide information about the latest technology trends."
[1059] Input: Incoming search query
[1060] Output: Generated prompt: "Please provide information about the latest technology trends."
[1061] Step 3:
[1062] The server inputs the generated prompt sentence into the generative AI model.
[1063] Specific operation: The server sends a prompt to the generative AI model: "Please provide information on the latest technology trends."
[1064] Input: Generated prompt text
[1065] Output: The prompt sent to the generative AI model
[1066] Step 4:
[1067] The generative AI model generates relevant search results based on the prompt sentence.
[1068] Specific behavior: The generative AI model generates the search result, "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a particular person (e.g., a technology analyst)."
[1069] Input: The prompt sent to the generative AI model
[1070] Output: Generated search results
[1071] Step 5:
[1072] The server transmits the generated search results to the terminal.
[1073] Specific operation: The server sends the search results received from the generative AI model to the terminal.
[1074] Input: Generated search results
[1075] Output: Search results sent to your device
[1076] Step 6:
[1077] The terminal receives the search results sent from the server.
[1078] Specific operation: The device receives the search result sent from the server: "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a particular person (e.g., a technology analyst)."
[1079] Input: Search results sent from the server
[1080] Output: Search results received
[1081] Step 7:
[1082] The terminal converts the received search results into an appropriate format for display on the user interface.
[1083] What it does: The device converts search results into a list, with each result provided with a description of how the information relates to a particular person's thought process.
[1084] Input: Search results received
[1085] Output: Search results converted into a list
[1086] Step 8:
[1087] The terminal displays the converted search results on a user interface.
[1088] What it does: The device displays a list of search results for the phrase "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a particular person (e.g., a technology analyst)."
[1089] Input: Search results converted to list format
[1090] Output: Search results displayed in the user interface
[1091] Step 9:
[1092] The user visually checks the search results displayed on the terminal.
[1093] Specific Action: The user reads the list of search results displayed on the device and understands how the information relates to a particular person's thought process.
[1094] Input: Search results displayed in the user interface
[1095] Output: User understanding and confirmation
[1096] (Application example 3)
[1097] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1098] Conventional search systems lack the information necessary for users to efficiently utilize search results, and have particular challenges in providing highly relevant information based on users' past behavior and interests. Furthermore, the lack of explanations showing how search results relate to the user's thought process makes it difficult for users to properly evaluate and select search results.
[1099] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[1100] In this invention, the server includes a means for providing information for a user to imitate the thought process of a specific person, a means for the user to perform a search based on the information, a means for presenting the search results to the user, and a means for providing an explanation for each search result that indicates how the information relates to the user's past behavior and interests, thereby enabling the user to efficiently use the search results and obtain highly relevant information based on their past behavior and interests.
[1101] "User" means any person or entity that uses the System to conduct a search.
[1102] A "specific person" is an individual whose thought process the user is trying to emulate.
[1103] A "thought process" is the set of cognitive steps a particular person takes to process information and make decisions.
[1104] A "means for providing information" is a device or software that has the function of providing a user with information to mimic the thought process of a particular person.
[1105] A "means for performing a search" is a device or software that has the function of allowing a user to input a search query based on information provided and retrieve information using a search engine.
[1106] A "means for presenting search results" is a device or software capable of visually displaying to a user search results obtained from a search engine.
[1107] "Means for providing explanations" means a device or software capable of generating and providing an explanation for each search result that shows how the information relates to the user's past behavior and interests.
[1108] "Past behavior" refers to the user's previous behavioral history, such as searches and browsing history.
[1109] "Interests" are topics or themes that a user is particularly interested in.
[1110] The system for implementing this invention provides users with information to emulate the thought process of a specific person, performs searches based on that information, and presents search results to the user. It also has the ability to provide an explanation for each search result, showing how the information relates to the user's past behavior and interests.
[1111] System configuration
[1112] The system consists of the following main components:
[1113] 1. User device: A device operated by a user, such as a smartphone or computer.
[1114] 2. Server: Manages the search engine API and database, and retrieves and annotates search results.
[1115] 3. Software: A program to retrieve and annotate search results using Python, the requests library, BeautifulSoup library, etc.
[1116] Processing flow
[1117] 1. Loading user profile: The user device loads a profile containing the user's interests from the server.
[1118] 2. Sending a search query: The user terminal sends the search query entered by the user to the server.
[1119] 3. Obtaining search results: The server obtains the search results using the search engine API.
[1120] 4. Annotating search results: The server generates and annotates each search result based on the user's profile.
[1121] 5. Displaying results: The user device visually presents the annotated search results to the user.
[1122] Hardware and software used
[1123] Hardware: Smartphones, PCs
[1124] Software: Python, requests library, BeautifulSoup library
[1125] Specific examples
[1126] For example, if a user searches for the query "latest AI technology," the server retrieves search results using a search engine API. Then, for each search result, the server generates and annotates it based on the user's profile, such as "Relevant to your interests" or "New information." Finally, the user's device displays these annotated search results to the user.
[1127] Prompt Sentence Examples
[1128] Build an application that annotates search results based on user interests. Users' profiles contain topics they are interested in. Display search results in a list format, with a description for each result that explains how the information is relevant to the user's interests.
[1129] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1130] Step 1:
[1131] Loading the user profile
[1132] The user device reads a profile containing the user's interests from the server. Specifically, the user device sends a request to the server, and the server retrieves the corresponding user profile from the user profile database and returns it to the user device.
[1133] Input: User ID
[1134] Output: User profile (interest data)
[1135] Data processing: Search and retrieve profile information from database based on user ID.
[1136] Step 2:
[1137] Submitting a search query
[1138] The user terminal transmits the search query entered by the user to the server. Specifically, when the user enters a query in the search box and presses the search button, the query is transmitted to the server.
[1139] Input: search query
[1140] Output: Send search query to server
[1141] Data processing: Taking user input, converting it into an appropriate format and sending it to the server.
[1142] Step 3:
[1143] Getting search results
[1144] The server obtains search results using a search engine API, specifically, the server sends a search query to the search engine API and receives search results returned from the API.
[1145] Input: search query
[1146] Output: Search results (list format)
[1147] Data processing: Converting search queries into API requests and parsing responses from the API to obtain search results.
[1148] Step 4:
[1149] Annotating search results
[1150] The server generates and adds annotations based on the user's profile to each search result. Specifically, it compares the title and content of the search result with the user's interests, and adds annotations such as "Related to your interests" to highly relevant results.
[1151] Input: search results, user profile
[1152] Output: Annotated search results
[1153] Data processing: Compare search results with user profiles and generate annotations based on relevance.
[1154] Step 5:
[1155] Displaying the results
[1156] The user terminal visually presents the annotated search results to the user, specifically, by displaying the annotated search results in a list format and displaying annotations for each result.
[1157] Input: Annotated search results
[1158] Output: what is displayed on the user interface
[1159] Data processing: Convert the annotated search results into a format suitable for the user interface and display them.
[1160] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1161] "Example 1"
[1162] As one embodiment of the present invention, a system is provided that combines an emotion engine that recognizes a user's emotions. This system includes a means for providing information for a user to imitate the thought process of a specific person, a means for the user to perform a search based on the information, and a means for presenting the search results to the user. The emotion engine recognizes emotions from the user's facial expressions, tone of voice, choice of words, etc. For example, when a user is happy, the emotion engine recognizes the user's joy and selects information to imitate the user's thought process based on the user's joy. Also, when a user is sad, the emotion engine recognizes the user's sadness and performs a search based on the user's sadness.
[1163] "Example 2"
[1164] As a specific example, when a user is happy, the emotion engine recognizes the joy and selects information to imitate the thought process of a particular person based on the joy. For example, when a user is happy, the emotion engine recognizes the joy and selects information to imitate the thought process of a comedian based on the joy. Also, when a user is sad, the emotion engine recognizes the sadness and selects information to imitate the thought process of a poet based on the sadness.
[1165] "Example 3"
[1166] The emotion engine also recognizes the user's emotion and performs a search based on that emotion. For example, when the user is happy, the emotion engine recognizes that joy and performs a search based on that joy. This search searches for information related to joy or information that the user is likely to feel happy about. When the user is sad, the emotion engine recognizes that sadness and performs a search based on sadness. This search searches for information related to sadness or information that the user is likely to feel sad about.
[1167] The processing flow of each embodiment will be described below.
[1168] "Example 1"
[1169] Step 1: The emotion engine recognizes the user's emotions from their facial expressions, tone of voice, choice of words, etc.
[1170] Step 2: Based on the emotions recognized by the emotion engine, select information to mimic the thought process of a specific person.
[1171] Step 3: The user performs a search based on the selected information.
[1172] Step 4: Present the search results to the user.
[1173] "Example 2"
[1174] Step 1: When a user is happy, the emotion engine recognizes that joy.
[1175] Step 2: Select information based on pleasure to mimic the comedian's thought process.
[1176] Step 3: The user performs a search based on the selected information.
[1177] Step 4: Present the search results to the user.
[1178] "Example 3"
[1179] Step 1: When a user is sad, the emotion engine recognizes that sadness.
[1180] Step 2: Based on the sadness, information is selected to mimic the poet's thought process. Step 3: The user conducts a search based on the selected information.
[1181] Step 4: Present the search results to the user.
[1182] Example 1
[1183] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1184] Conventional systems were unable to take the user's emotions into account when obtaining information to imitate the thought process of a specific person, which made it difficult to provide appropriate information according to the user's emotional state, limiting the user's experience.
[1185] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1186] In this invention, the server includes: means for providing information that allows a user to imitate the thought process of a specific person; means for the user to perform a search based on the information; means for presenting the search results to the user; means including an emotion engine that recognizes the user's emotions; and means for selecting information based on the emotions recognized by the emotion engine. This makes it possible to provide appropriate information according to the user's emotional state.
[1187] A "user" refers to an individual who uses the system to attempt to mimic the thought process of a particular person.
[1188] "Specific person" refers to a person, past or present, that the user wishes to emulate.
[1189] A "thought process" refers to the flow or pattern of thought that a particular person follows based on their past actions and statements.
[1190] "Means for providing information" refers to a function that provides the user with information about a particular person's thought process.
[1191] "Means for searching" refers to the functionality that allows users to search for more detailed information based on the information provided.
[1192] "Means for presenting search results" refers to the functionality for displaying results for a search conducted by a user.
[1193] An "emotion engine" refers to software or hardware that recognizes emotions from a user's facial expressions, tone of voice, choice of words, etc.
[1194] "Means for selecting information based on emotions" refers to a function for selecting appropriate information from a database based on the user's emotions recognized by the emotion engine.
[1195] The present invention provides a system that provides information for a user to imitate the thought process of a specific person and selects appropriate information based on the user's emotions. Specific embodiments of this system will be described below.
[1196] System configuration
[1197] Hardware
[1198] 1. Device: A device used by a user that has a camera and microphone, which can capture the user's facial expressions and tone of voice.
[1199] 2. Server: A central processing unit that includes a database and emotion engine. The server processes data sent by users and provides appropriate information.
[1200] software
[1201] 1. Emotion Engine: Software that recognizes emotions from the user's facial expressions, tone of voice, choice of words, etc. The emotion engine analyzes the user's emotional state in real time.
[1202] 2. Database: This database contains information that represents a specific person's thought process, which can be inferred from their past actions and statements. The server selects the appropriate information from this database.
[1203] System Operation
[1204] Obtaining user sentiment data
[1205] Users access the system and provide emotional data via a camera and microphone, and the device captures the user's facial expressions and tone of voice in real time.
[1206] Emotional Data Analysis
[1207] The device sends the acquired emotional data to the emotion engine, which analyzes the user's facial expressions and tone of voice to identify the user's emotions.
[1208] Selecting information from a database
[1209] Based on the emotional information received from the emotion engine, the server selects appropriate information from a database that stores information to mimic the thought process of a specific person.
[1210] Providing information
[1211] The server provides the user with selected information that allows the user to understand the thought process of a particular person.
[1212] Processing a user's search query
[1213] The user can then perform further searches based on the information provided. When the user enters a search query, the device sends the query to the server.
[1214] Presenting search results
[1215] The server generates appropriate search results for the user's search query and presents them to the user, allowing the user to gain a deeper understanding of a particular person's thought process.
[1216] Specific examples
[1217] Suppose a user accesses the system and wants to imitate the thought process of a particular person (for example, a famous philosopher in history). When the user says to the system, "I am very happy right now," the emotion engine recognizes the user's joy. The server selects information from the database based on the actions and statements made by the philosopher when he or she felt joy, and provides it to the user. The user can then use that information to conduct further searches and gain a deeper understanding of the philosopher's thought process.
[1218] Prompt Sentence Examples
[1219] "I'm very happy right now. Give me information to mimic the thought process of a particular person."
[1220] The system provides appropriate information based on the user's emotions and helps mimic the thought process of a specific person.
[1221] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1222] Step 1:
[1223] Users access the system and provide emotional data via a camera and microphone, and the device captures the user's facial expressions and tone of voice in real time.
[1224] Input: User's facial expression data, tone of voice
[1225] Output: Captured emotion data
[1226] Specific operation: The user speaks into the camera. The device captures the user's facial expressions with the camera and records the tone of voice with the microphone.
[1227] Step 2:
[1228] The device transmits the acquired emotion data to the emotion engine, which analyzes the user's facial expressions and tone of voice to identify the user's emotion.
[1229] Input: Captured emotion data
[1230] Output: Analyzed emotion information (e.g., joy, sadness)
[1231] Specific operation: The device sends the captured data to the emotion engine, which identifies the user's emotion, such as "happy" or "sad."
[1232] Step 3:
[1233] Based on the emotional information received from the emotion engine, the server selects appropriate information from a database that stores information to mimic the thought process of a specific person.
[1234] Input: Parsed emotion information
[1235] Output: Selected information (e.g., information about a particular person's thought process)
[1236] Specific operation: The server receives information from the emotion engine that "the user is happy." The server selects information from the database to mimic the thought process of a specific person related to "joy."
[1237] Step 4:
[1238] The server provides the user with selected information that allows the user to understand the thought process of a particular person.
[1239] Input: Selected information
[1240] Output: Information provided to the user
[1241] Specific operation: The server sends the selected information to the user's terminal, which then displays the information to the user.
[1242] Step 5:
[1243] The user can then perform further searches based on the provided information. When the user enters a search query, the device sends the query to the server.
[1244] Input: User's search query
[1245] Output: The search query sent to the server
[1246] Specific Action: The user inputs, "What specific action did this philosopher take when he was happy?" The device sends the search query to the server.
[1247] Step 6:
[1248] The server generates appropriate search results for the user's search query and presents them to the user, who can then use the results to gain a deeper understanding of the thought process of a particular person.
[1249] Input: User's search query
[1250] Output: Search results
[1251] Specific operations: The server searches the database based on the search query. The server sends the search results to the user's terminal. The terminal displays the search results to the user.
[1252] (Application example 1)
[1253] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1254] In conventional systems, the means by which users can imitate the thought processes of specific individuals are limited, making it difficult to provide appropriate information based on the user's emotions. In addition, the range of information that users can independently select is limited, making it difficult to increase user satisfaction.
[1255] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, an emotion engine that recognizes the user's emotions, and means for selecting information for imitating the thought process of a specific person based on the emotion engine. This makes it possible to provide appropriate information based on the user's emotions and expands the range of information that the user can independently select, thereby increasing user satisfaction.
[1256] "User" means any individual or entity that uses the System.
[1257] A "specific person" is an individual whose thought process can be inferred from their past actions and statements.
[1258] A "thought process" is a flow or pattern of thought that can be inferred based on a particular person's past actions and statements.
[1259] "Information" is the data or knowledge required to mimic a particular person's thought process.
[1260] "Means for providing" refers to a method or device for providing information to a user.
[1261] A "means for conducting a search" is a method or device that allows a user to conduct a search based on information provided by the user.
[1262] A "presentation means" is a method or device for displaying search results to a user.
[1263] An "emotion engine" is software or hardware that recognizes a user's emotions and selects appropriate information based on those emotions.
[1264] The "means for selecting" is a method or device for selecting information to imitate the thought process of a particular person based on an emotion engine.
[1265] A system for implementing this invention provides information that allows a user to imitate the thought process of a specific person, and selects and presents appropriate information based on the user's emotions. Specific embodiments of this system are described below.
[1266] System Configuration
[1267] The system consists of the following main components:
[1268] 1. User device: A device such as a smartphone or tablet that has a camera and microphone.
[1269] 2. Server: Includes information provision means, search means, presentation means, emotion engine, and selection means.
[1270] 3. Database: Stores the thought processes inferred from a particular person's past actions and statements.
[1271] Program processing
[1272] emotion recognition
[1273] The camera and microphone on the user's device are used to capture the user's facial expressions and tone of voice. This data is then sent to the emotion engine on the server, which then uses the Emotion Recognition API to recognize the user's emotions.
[1274] Providing information
[1275] The server retrieves information about a specific person's thought process from a database, based on the past actions and statements of the specific person the user wants to emulate.
[1276] Search and Select
[1277] The server uses the search engine to search for relevant content based on the recognized emotion and the acquired thought process. Based on the emotion engine, the server selects information that matches the user's emotion.
[1278] presentation
[1279] The search results are sent to the user's device and displayed to the user, who can then browse the information presented and conduct further detailed searches.
[1280] Specific examples
[1281] For example, if a user wants to search for content that mimics the thought process of a specific author, they can input the following prompt into the generative AI model:
[1282] User Emotion: Delight
[1283] Specific Authors: Specific Authors
[1284] Search results for: Content that mimics the thought process of a particular author
[1285] Based on this prompt, the server searches for content that mimics the thought process of a particular author and provides it to the user, allowing the user to understand the thought process of a particular author and gain inspiration based on it.
[1286] Hardware and software used
[1287] Hardware: Smartphone camera and microphone
[1288] Software: Emotion Recognition API, Content Database, Search Engine
[1289] In this way, it becomes possible to provide appropriate information based on the user's emotions, and the range of information that the user can independently select is expanded, thereby increasing user satisfaction.
[1290] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1291] Step 1:
[1292] The camera and microphone on the user's device are used to capture the user's facial expressions and tone of voice. This data is used as input data for recognizing the user's emotions. Specifically, it includes image data captured by the camera and audio data recorded by the microphone.
[1293] Step 2:
[1294] The user device sends the captured facial expression and tone of voice data to the server. The server then analyzes this data using the Emotion Recognition API to recognize the user's emotions. The input data is image data and voice data, and the output data is the recognized emotion (e.g., joy, sadness, anger, etc.).
[1295] Step 3:
[1296] The server retrieves information about the specific person's thought process from a database based on the recognized emotion. The input data is the recognized emotion and the specific person's identification information, and the output data is information about the specific person's thought process. Specifically, it includes data based on the specific person's past actions and statements.
[1297] Step 4:
[1298] The server uses a search engine to search for related content based on the acquired information about thought processes and the recognized emotions. The input data is the information about thought processes and the recognized emotions, and the output data is a content list as search results. Specifically, it includes related articles, videos, images, etc.
[1299] Step 5:
[1300] The server sends the search results to the user terminal. The user terminal displays the received search results to the user. The input data is a content list as the search results, and the output data is the content that is displayed to the user. Specifically, the content is displayed in a format that the user can view.
[1301] Step 6:
[1302] The user can browse the presented content and perform a more detailed search. Depending on the user's operation, the process is repeated from step 1. The input data is the user's operation information, and the output data is new search results. Specifically, a new search is performed based on the content that the user is interested in.
[1303] Example 2
[1304] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1305] Conventional search systems provide information without considering the user's emotional state, making it difficult to provide information appropriate to the user's current emotions. Furthermore, there was a lack of a way to search based on information that mimics a specific person's thought process, and information provided was not adequately tailored to the user's needs. This made it difficult to provide the information users were looking for quickly and accurately.
[1306] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1307] In this invention, the server includes means for a user to input an emotional state, means for recognizing the emotional state, means for selecting information for imitating the thought process of a specific person based on the recognized emotional state, means for a user to input search keywords, means for searching for related information based on the search keywords and the selected information, and means for presenting the search results to the user. This makes it possible to provide information according to the user's emotional state, and realizes a search based on information that imitates the thought process of a specific person.
[1308] "User" means any person or entity that uses the System to search for information.
[1309] "Emotional state" indicates the type of emotion the user is currently feeling, and includes, for example, joy, sadness, anger, etc.
[1310] "Emotion engine" refers to a software or hardware component that recognizes the emotional state input by a user and selects appropriate information based on that emotion.
[1311] A "thought process" refers to the set of cognitive steps or methods by which a particular person processes information and makes decisions.
[1312] "Search keywords" are words or phrases that a user types into a search engine to identify the information they are searching for.
[1313] "Search engine" refers to a software or hardware component that searches for and provides results related to search keywords and selected information entered by a user.
[1314] "Search results" refers to the list or content of relevant information that a search engine provides based on a user's search keywords.
[1315] "Presentation mechanism" refers to a method or device for visually or audibly displaying search results to a user.
[1316] This invention is a system that recognizes the emotional state of a user, selects information that mimics the thought process of a specific person based on that emotion, and searches for and presents related information. Specific embodiments of this system are described below.
[1317] Hardware and software used
[1318] Hardware: Servers, user devices (PCs, smartphones, etc.)
[1319] Software: Emotion engine, search engine, generative AI model
[1320] System configuration
[1321] 1. Input of the user's emotional state
[1322] The user accesses the system through a terminal and inputs their emotional state. For example, the user can select emotions such as "happy" or "sad."
[1323] 2. Emotion Recognition by Emotion Engine
[1324] The server activates the emotion engine and recognizes the emotional state input by the user. Specifically, the emotion engine recognizes that "the user is happy."
[1325] 3. Selection of information to mimic thought processes
[1326] The server selects information to imitate the thought process of a specific person based on the recognition results of the emotion engine. For example, the emotion engine selects "the thought process of a comedian" based on "joy."
[1327] 4. User input of keywords
[1328] The user inputs the keyword they want to search for through the device. For example, the user inputs "interesting movies."
[1329] 5. Information Search Using Search Engines
[1330] The server launches a search engine to search for relevant information based on the keywords entered by the user and the thought process information selected by the emotion engine. Specifically, the search engine searches for information about comedy movies based on "funny movies" and "comedians' thought processes."
[1331] 6. Display of search results
[1332] The server generates search results and sends them to the user's device. The device displays the search results for the user to view. Specifically, the device displays a list of "recommended comedy movies."
[1333] Specific examples
[1334] User's emotional state: joy
[1335] Input keyword: "interesting movie"
[1336] Choosing an Emotional Engine: A Comedian's Thought Process
[1337] Search results for: information about comedy movies
[1338] Prompt Sentence Examples
[1339] Examples of prompts to be input to a generative AI model include:
[1340] What movie recommendations do you recommend when a user is happy? A user searches for "funny movies." Imitate a comedian's thought process and suggest related movies.
[1341] In this way, the system recognizes the user's emotional state, selects information that mimics a specific person's thought process based on that emotion, and searches for and displays related information, thereby providing appropriate information according to the user's emotions.
[1342] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1343] Step 1:
[1344] The user inputs an emotional state.
[1345] The user accesses the system through a terminal and selects an emotion such as "happy" or "sad" from the emotional state selection screen. The input emotional state is sent from the terminal to the server.
[1346] Step 2:
[1347] The server activates an emotion engine to recognize the emotional state input by the user.
[1348] The server receives the emotional state sent from the device and recognizes the emotion using the emotion engine. For example, the emotion engine recognizes that the user is happy. The recognition result is stored in the server.
[1349] Step 3:
[1350] The server selects information to mimic the thought process of a particular person based on the perceived emotional state.
[1351] The server selects information to imitate the thought process of a specific person based on the recognition results of the emotion engine. For example, the emotion engine selects "the thought process of a comedian" based on "joy." The selected information is stored in the server.
[1352] Step 4:
[1353] The user enters search keywords.
[1354] The user enters the keyword they want to search for in the search bar through their device. For example, the user enters "interesting movies." The entered keyword is sent from the device to the server.
[1355] Step 5:
[1356] The server launches a search engine to search for relevant information based on the keywords entered by the user and the thought process information selected by the emotion engine.
[1357] The server receives the search keywords sent from the device and the thought process information selected by the emotion engine, and searches for related information using a search engine. For example, the search engine searches for information about comedy movies based on "funny movies" and "comedians' thought processes." Search results are generated within the server.
[1358] Step 6:
[1359] The server generates search results and sends them to the user's terminal.
[1360] The server sends the search results generated by the search engine to the user's device, which then displays the received search results for the user to view. For example, the device displays a list of "recommended comedy movies."
[1361] (Application example 2)
[1362] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1363] Conventional search systems provide information without considering the user's emotional state, making it difficult to provide information appropriate to the user's current emotions. Furthermore, when a user selects information to imitate a specific person's thought process, it is not possible to select appropriate information based on the user's emotional state. Therefore, to increase user satisfaction, a system that recognizes the user's emotional state and provides optimal information based on that state is needed.
[1364] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1365] In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, means for recognizing the emotional state of the user, means for selecting information for imitating the thought process of the specific person based on the recognized emotional state, and means for recommending optimal content to the user based on the selected information, thereby making it possible to provide optimal information according to the emotional state of the user.
[1366] "User" means any individual or entity that uses the System.
[1367] A "specific person" is an individual whose thought process the user wishes to emulate.
[1368] A "thought process" is a set of cognitive steps or ways in which a particular person processes information and makes decisions.
[1369] A "means for providing information" is a method or device for providing a user with information that allows them to imitate the thought process of a particular person.
[1370] A "means for performing a search" is a method or device that allows a user to search for related information based on the information provided.
[1371] A "means for presenting search results" is a method or device for displaying or providing search results to a user.
[1372] An "emotional state" is a state that indicates the user's current feelings or mood.
[1373] A "means for recognizing an emotional state" is a method or device for detecting and recognizing a user's emotional state.
[1374] The "means for selecting information" is a method or apparatus for selecting appropriate information to mimic the thought process of a particular person based on a recognized emotional state.
[1375] The "means for recommending content" refers to a method or device for recommending optimal content to a user based on selected information.
[1376] The system for implementing this invention recognizes the emotional state of a user, selects information that mimics the thought process of a specific person based on that emotion, and recommends optimal content. Specific embodiments of this system are described below.
[1377] System Configuration
[1378] The system consists of the following main components:
[1379] 1. User device: A device such as a smartphone or tablet that has a camera and microphone.
[1380] 2. Emotion Recognition Engine: Software that recognizes emotions from the user's facial expressions and tone of voice. Specifically, it uses OpenCV to capture camera footage and EmotionRecognizer to recognize emotions.
[1381] 3. Thought Process Imitation Engine: Software that selects information that mimics a particular person's thought process based on perceived emotions.
[1382] 4. Content Recommendation Engine: Software that recommends the most suitable content to users based on selected information. Use ContentRecommender.
[1383] Processing flow
[1384] 1. Emotion Recognition: The camera and microphone on the user's device are used to capture the user's facial expressions and tone of voice. The video is processed using OpenCV, and emotions are recognized using EmotionRecognizer.
[1385] 2. Thought process selection: Based on the recognized emotion, the thought process imitation engine selects information to imitate the thought process of a specific person. For example, if the user is happy, it will select information to imitate the thought process of a comedian.
[1386] 3. Content recommendation: Based on the selected information, the content recommendation engine will recommend the most suitable content to the user, such as comedy videos or inspirational poems.
[1387] Hardware and software used
[1388] Hardware: smartphone, tablet, camera, microphone
[1389] Software: OpenCV (image processing), EmotionRecognizer (emotion recognition), ContentRecommender (content recommendation)
[1390] Specific examples
[1391] For example, when a user is smiling, the system mimics the thought process of a comedian and recommends related comedy videos, while when a user is sad, the system mimics the thought process of a poet and recommends inspiring poetry and music.
[1392] Prompt Sentence Examples
[1393] When a user is smiling, mimic the comedian's thought process and recommend related comedy videos.
[1394] When a user is sad, mimic the thought process of a poet and recommend inspiring poetry or music.
[1395] In this way, it is possible to provide optimal information according to the user's emotional state.
[1396] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1397] Step 1:
[1398] The user device uses a camera and microphone to capture the user's facial expressions and tone of voice. The input is camera video and audio data, and the output is a real-time multimedia stream containing these data.
[1399] Step 2:
[1400] The user device processes the captured video using OpenCV and recognizes the user's emotions using EmotionRecognizer. The input is the multimedia stream obtained in step 1, and the output is the recognized emotion (e.g., joy, sadness, etc.). Specifically, the operation involves extracting facial feature points and applying a facial expression analysis algorithm.
[1401] Step 3:
[1402] Based on the recognized emotions, the server uses a thought process imitation engine to select information to imitate the thought process of a specific person. The input is the emotion data obtained in step 2, and the output is the selected thought process information. Specifically, the server searches for the profile of an appropriate person based on the emotion data and extracts information to imitate that person's thought process.
[1403] Step 4:
[1404] The server uses ContentRecommender to recommend the most suitable content to the user based on the selected thought process information. The input is the thought process information obtained in step 3, and the output is the recommended content (e.g., video, music, article, etc.). Specifically, the server searches the content database based on the thought process information and selects the most suitable content.
[1405] Step 5:
[1406] The user terminal presents the recommended content received from the server to the user. The input is the recommended content obtained in step 4, and the output is the content displayed to the user. Specifically, the content is displayed on the user interface so that the user can view or use it.
[1407] In this way, it is possible to provide optimal information according to the user's emotional state.
[1408] Example 3
[1409] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1410] Conventional search systems have had difficulty providing search results that take into account the user's emotions or the thought processes of specific individuals. As a result, users are unable to obtain appropriate search results for the information they are looking for, resulting in a decrease in user satisfaction. In particular, there is a need to provide search results that are based on the user's emotions, thereby providing information that is more suited to the user's needs.
[1411] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[1412] In this invention, the server includes means for recognizing a user's emotion, means for generating a search query based on the emotion, and means for performing a search based on the search query, thereby making it possible to provide appropriate search results according to the user's emotion.
[1413] "User" means any person or entity that uses the System to search for information and receive results.
[1414] "A particular person's thought process" refers to the flow of thought and criteria for judgment that can be inferred from a particular person's past actions and statements.
[1415] "Means for providing information" refers to a method or device for presenting information about a particular person's thought process to a user.
[1416] "Means for performing a search" refers to a method or apparatus for searching for relevant data based on user-entered information or a system-generated query.
[1417] "Means for presenting search results to a user" refers to a method or device for visually displaying search results obtained from a search engine to a user.
[1418] "Means for recognizing user emotions" refers to a method or device for analyzing and identifying emotions from user input data and behavior.
[1419] "Means for generating search queries" refers to a method or apparatus for creating appropriate search queries based on recognized user sentiment.
[1420] "Means for conducting a search" refers to a method or apparatus for querying a search engine for relevant information using a generated search query.
[1421] "Means for organizing search results" refers to a method or device for organizing and identifying the obtained search results as information related to the user's emotions.
[1422] MODE FOR CARRYING OUT THE INVENTION
[1423] The present invention relates to a system that recognizes a user's emotions and provides appropriate search results based on the emotions. A specific embodiment of this system will be described below.
[1424] Hardware and software used
[1425] Hardware: Servers, devices (PCs, smartphones, etc.)
[1426] Software: Search engines (e.g., popular search APIs), sentiment engines (e.g., popular sentiment analysis APIs), user interfaces (e.g., popular front-end frameworks)
[1427] System processing overview
[1428] 1. Obtaining user input data
[1429] Users access the system through a terminal and input data using text or voice.
[1430] The terminal transmits this input data to the server.
[1431] 2. Emotion recognition
[1432] The server sends the received input data to the emotion engine.
[1433] The emotion engine analyzes the input data and identifies the user's emotion.
[1434] 3. Search Query Generation
[1435] The server generates appropriate search queries based on the recognized sentiment.
[1436] 4. Execute search
[1437] The server uses the generated search query to perform a search on a search engine.
[1438] The search engine returns relevant search results based on the query.
[1439] 5. Organizing search results
[1440] The server organizes the retrieved search results and identifies information related to the user's emotions.
[1441] 6. Presentation of search results
[1442] The search results are displayed in list format through the device's user interface.
[1443] Each search result is accompanied by a description that shows how the information is relevant to a particular person's thought process.
[1444] Specific examples
[1445] User input: User types, "I've been feeling stressed at work lately."
[1446] Emotion recognition: The emotion engine recognizes the emotion "stress."
[1447] Search query generation: The server generates search queries such as "stress relief" or "relaxation techniques."
[1448] Get search results: A search engine returns results such as "articles on stress relief" or "relaxation music playlists."
[1449] Presentation of results: The user interface presents search results in a list format, with a description for each result, such as "This information may help you relieve stress."
[1450] Prompt Sentence Examples
[1451] "What search results should we present to users when they are stressed?"
[1452] "How can we help users find relevant information when they're happy?"
[1453] In this way, the system can provide appropriate search results based on the user's emotions and visually present information that meets the user's needs. The flow of the identification process in the third embodiment will be described with reference to FIG.
[1454] Step 1:
[1455] Obtaining user input data
[1456] Users access the system through a terminal and input data using text or voice.
[1457] Input: User types the text "I've been feeling stressed at work lately."
[1458] The terminal receives this input data and sends it to the server.
[1459] Output: User input data sent to the server.
[1460] Step 2:
[1461] emotion recognition
[1462] The server sends the received input data to the emotion engine.
[1463] Input: User input data.
[1464] The emotion engine analyzes the input data and identifies the user's emotion.
[1465] Specific behavior: The emotion engine recognizes the emotion "stress."
[1466] Output: Recognized emotion data (e.g., stress).
[1467] Step 3:
[1468] Search Query Generation
[1469] The server generates appropriate search queries based on the recognized sentiment.
[1470] Input: Recognized emotion data.
[1471] What it does: The server generates search queries such as "stress relief" or "relaxation techniques."
[1472] Output: The generated search query.
[1473] Step 4:
[1474] Search execution
[1475] The server uses the generated search query to perform a search on a search engine.
[1476] Input: The generated search query.
[1477] The search engine returns relevant search results based on the query.
[1478] What it does: A search engine returns results like "articles on stress relief" and "relaxation music playlists."
[1479] Output: Search result data.
[1480] Step 5:
[1481] Organizing search results
[1482] The server organizes the retrieved search results and identifies information related to the user's emotions.
[1483] Input: Search result data.
[1484] What it does: The server formats the search results into a list and provides a description for each result.
[1485] Output: Organized search results data.
[1486] Step 6:
[1487] Presenting search results
[1488] The search results are displayed in list format through the device's user interface.
[1489] Input: Organized search results data.
[1490] What it does: The user interface displays search results with a description such as "This information may help you relieve stress."
[1491] Output: Search results presented to the user.
[1492] (Application example 3)
[1493] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1494] Conventional search systems provide search results without considering the user's emotional state, making it difficult to provide information appropriate to the user's current emotions. Furthermore, they lack explanations of how search results relate to the user's thought process, making it difficult for users to effectively use search results.
[1495] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, means for recognizing the user's emotions, means for performing a search based on the emotions, and means for visually presenting the search results. This makes it possible to provide search results that are appropriate for the user's emotional state and to provide an explanation showing how the search results are related to the user's thought process.
[1496] "User" means any individual or entity that uses the System.
[1497] A "specific person" is an individual whose thought process the user is trying to emulate.
[1498] A "thought process" is the process by which a particular person processes information and makes decisions.
[1499] A "means of providing information" is a method of providing information to a user to mimic the thought process of a particular person.
[1500] A "means of conducting a search" is the method by which a user performs a search based on the information provided.
[1501] A "means of presenting search results" is the method by which search results are visually displayed to the user.
[1502] An "emotion recognition means" is a method for detecting and identifying a user's emotional state.
[1503] A "means for performing search based on emotions" is a method for performing appropriate searches according to the recognized emotions of a user.
[1504] A "visual presentation" is a method by which search results are visually displayed to a user.
[1505] The system for implementing the present invention recognizes the user's emotions and provides optimal search results based on the emotions. A specific embodiment of this system will be described below.
[1506] Hardware and Software Configuration
[1507] This system uses the following hardware and software:
[1508] Hardware: Smartphone camera
[1509] Software: OpenCV, Keras, Scikit-learn, Requests
[1510] Processing flow
[1511] 1. Emotion Recognition: Capture the user's face using the smartphone camera, detect the face using OpenCV, and input it into the Keras emotion recognition model to recognize the user's emotions.
[1512] 2. Search execution: Based on the recognized sentiment, generate an appropriate search query and send a request to an external content recommendation API.
[1513] 3. Results display: Visually displaying the recommended content to the user.
[1514] Specific examples
[1515] For example, if a user is happy, it will recommend the latest comedy videos or fun music playlists, and if a user is sad, it will recommend relaxing music or videos with encouraging messages.
[1516] Prompt Sentence Examples
[1517] Develop an application that recognizes the user's emotions and recommends the best content based on those emotions: when the user is happy, recommend entertaining videos or music, when the user is sad, recommend comforting content.
[1518] In this way, it is possible to provide search results that are appropriate to the user's emotional state and provide explanations that show how the search results relate to the user's thought process.
[1519] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1520] Step 1:
[1521] The device captures the user's face using the smartphone's camera. The input is real-time video from the camera, and the output is the captured face image. Specifically, the camera detects the user's face and acquires its image data.
[1522] Step 2:
[1523] The device uses OpenCV to detect the face region from the captured face image. The input is the face image obtained in step 1, and the output is the coordinate information of the face region. Specifically, a face detection algorithm is applied to identify the position of the face.
[1524] Step 3:
[1525] The device inputs the image data of the face region into the Keras emotion recognition model to recognize the user's emotions. The input is the image data of the face region obtained in step 2, and the output is the recognized emotion label. Specifically, the face image is preprocessed and input into the emotion recognition model to classify the emotion.
[1526] Step 4:
[1527] The server generates an appropriate search query based on the recognized emotion. The input is the emotion label obtained in step 3, and the output is the search query. Specifically, it selects keywords corresponding to the emotion label and constructs the search query.
[1528] Step 5:
[1529] The server sends a request to an external content recommendation API using the generated search query. The input is the search query obtained in step 4, and the output is a list of recommended content. Specifically, an HTTP request is sent to the API endpoint to obtain the recommendation results.
[1530] Step 6:
[1531] The terminal visually displays the recommended content received from the server to the user. The input is the list of recommended content obtained in step 5, and the output is the content displayed to the user. Specifically, the recommended content is displayed in list form on the screen, allowing the user to select it.
[1532] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1533] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1534] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.
[1535] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1536] [Third embodiment]
[1537] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1538] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1539] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1540] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1541] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1542] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1543] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1544] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1545] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1546] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1547] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1548] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[1549] "Example 1"
[1550] In one embodiment of the present invention, a database is provided as a means for providing information for imitating the thought process of a specific person. This database stores information representing the thought process inferred from the past actions and statements of the specific person. A user can select information from this database for imitating the thought process of a specific person.
[1551] "Example 2"
[1552] Next, a search engine is provided as a means for searching based on the information selected by the user. This search engine searches for related information based on the keywords entered by the user and the information selected to mimic the thought process.
[1553] "Example 3"
[1554] Finally, a user interface is provided as a means for presenting search results to the user. This user interface visually presents the search results obtained from the search engine to the user, specifically by displaying the search results in a list format and providing a description for each result that indicates how the information is relevant to a particular person's thought process.
[1555] The processing flow of each embodiment will be described below.
[1556] "Example 1"
[1557] Step 1: The user selects a specific person. This is the person whose thought process the user wants to emulate.
[1558] Step 2: The system retrieves information from the database that represents the selected person's thought process, inferred from their past actions and statements.
[1559] Step 3: The acquired information is presented to the user, who can then use it to mimic the thought process of a specific person.
[1560] "Example 2"
[1561] Step 1: User enters search keywords.
[1562] Step 2: The system performs a search based on the keywords entered and information intended to mimic the thought process described above.
[1563] Step 3: Present the search results to the user.
[1564] "Example 3"
[1565] Step 1: The system displays the search results in a list format.
[1566] Step 2: For each result, provide an explanation that shows how the information relates to a particular person's thought process.
[1567] Step 3: Present the search results with this description to the user.
[1568] Example 1
[1569] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1570] In conventional systems, the means of providing information to imitate the thought process of a specific person were limited, making it difficult for users to provide sufficient accuracy and flexibility when searching based on that information.In addition, inferences about the thought process based on a specific person's past actions and statements were insufficient, resulting in a problem of reduced quality of information provided to users.
[1571] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1572] In this invention, the server includes: means for providing information for a user to imitate the thought process of a specific person; means for the user to perform a search based on the information; means for presenting the search results to the user; means for acquiring data on the specific person's past actions and statements from a database; means for analyzing the acquired data and inferring the specific person's thought process; and means for inputting the analysis results into a generative AI model and providing the generated information to the user. This makes it possible to imitate the thought process of a specific person with high accuracy and flexibility, improving the quality of information provided to the user.
[1573] A "user" is an entity that uses the system to obtain and search for information that mimics the thought process of a particular person.
[1574] A "specific person" is someone whose thought process is inferred based on their past actions and statements.
[1575] A "thought process" is a flow or pattern of thought that can be inferred from a particular person's past actions or statements.
[1576] An "information provision means" is a means for a user to provide information that allows the user to imitate the thought process of a particular person.
[1577] "Search means" refers to the means by which a user conducts a search based on the information provided.
[1578] "Presentation means" refers to the means for presenting search results to the user.
[1579] A "database" is a system for storing data about a specific person's past actions and statements.
[1580] "Data acquisition means" refers to a means for acquiring data on the past actions and statements of a specific person from a database.
[1581] "Analysis means" refers to a means for analyzing acquired data and inferring the thought process of a particular person.
[1582] A "generative AI model" is an artificial intelligence model that generates new information based on analysis results.
[1583] A "prompt sentence" is an instruction sentence input to a generative AI model.
[1584] The present invention relates to a system for providing information for imitating the thought process of a specific person. A specific embodiment of this system will be described below.
[1585] System configuration
[1586] This system consists of three main elements: a server, a terminal, and a user. The server retrieves data from a database, analyzes it, and generates information using a generative AI model. The terminal provides an interface for users to access the system and retrieve information. Users access the system through their terminal and retrieve information to mimic the thought process of a specific person.
[1587] Hardware and software used
[1588] Server: A server with a powerful processor and large memory capacity is required, specifically, a server with an Intel Xeon processor or AMD EPYC processor is suitable.
[1589] Database: A relational database management system (RDBMS) such as MySQL or PostgreSQL is used.
[1590] Analysis software: Python's NLTK library and machine learning models (e.g., GPT-4) are used.
[1591] Devices: Users can access the site using devices such as PCs, tablets, and smartphones. Suitable web browsers include Google Chrome and Mozilla Firefox.
[1592] Data processing and calculation
[1593] The server first accesses a database to retrieve data about a specific person's past actions and statements. The retrieved data is preprocessed using Python's NLTK library, which includes tokenizing the text and removing stop words. The data is then analyzed using a GPT-4 model to infer the specific person's thought process.
[1594] Specific examples
[1595] For example, if a user wants to imitate the thought process of a historical figure, "Scientist A," they would follow the steps below.
[1596] 1. The user opens Google Chrome and enters the system URL to access the system. The system login screen is displayed, and the user logs in by entering their ID and password.
[1597] 2. The user enters "Scientist A" in the search bar on the system's main screen and clicks the search button. The search results are displayed and the user selects Scientist A.
[1598] 3. The server executes the SQL query "SELECT FROM actions WHERE person='Scientist A'" to retrieve data about Scientist A's actions and statements from the database.
[1599] 4. The server preprocesses the acquired data using Python's NLTK library, for example by tokenizing the text and removing stop words, and then uses the GPT-4 model to analyze the data and infer Scientist A's thought process.
[1600] 5. Based on the analysis results, the server inputs the prompt statement, "Please imitate the thought process of scientist A and propose a new scientific theory." into the generative AI model.
[1601] 6. The server provides the user with new ideas obtained from the generative AI model. The user can check the generated ideas on the system's results display screen. For example, specific ideas such as "a new law of conservation of energy" are displayed.
[1602] In this way, users can imitate the thought process of a particular person and gain new ideas and knowledge.
[1603] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1604] Step 1:
[1605] A user accesses the system.
[1606] The user opens a web browser such as Google Chrome and enters the system's URL to access it. The system's login screen is displayed, and the user logs in by entering their ID and password.
[1607] Input: User ID and password
[1608] Output: System main screen
[1609] Step 2:
[1610] The user selects a specific person.
[1611] The user enters the name of a specific person in the search bar on the system's main screen and clicks the search button. The search results are displayed and the user can select a specific person.
[1612] Input: Name of a specific person
[1613] Output: Search results for a specific person
[1614] Step 3:
[1615] The server retrieves the data from the database.
[1616] The server retrieves data about the specific person selected by the user from the database. Specifically, it executes the SQL query "SELECT FROM actions WHERE person='specific person'" to retrieve data about actions and comments from the database.
[1617] Input: Name of a specific person
[1618] Output: Data about the actions and statements of a specific person
[1619] Step 4:
[1620] The server analyzes the data.
[1621] The server uses Python's NLTK library to analyze the acquired data, first performing preprocessing such as tokenizing the text and removing stop words, then using the GPT-4 model to analyze the data and infer the thought process of a particular person.
[1622] Input: Data about what a specific person did or said
[1623] Output: Analysis of a specific person's thought process
[1624] Step 5:
[1625] The server inputs the analysis results into a generative AI model.
[1626] The server generates a prompt based on the analysis results and inputs it into the generative AI model. For example, it generates a prompt such as, "Please mimic the thought process of a specific person and propose a new idea."
[1627] Input: Analysis of a specific person's thought process
[1628] Output: The prompt sentence that is fed into the generative AI model
[1629] Step 6:
[1630] The server provides the generated information to the user.
[1631] The server provides the user with new ideas obtained from the generative AI model. The user can check the generated ideas on the system's results display screen. For example, specific ideas such as "a new law of conservation of energy" are displayed.
[1632] Input: Output from a generative AI model
[1633] Output: New ideas provided to users
[1634] (Application example 1)
[1635] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1636] Conventional ad generation systems have difficulty reflecting the thought process of specific celebrities or influencers when creating ad copy. As a result, they are unable to provide effective ads to target users, limiting the effectiveness of the ads. In addition, creating ad copy takes a great deal of time and effort, so there is a need for efficient ad generation.
[1637] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1638] In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, means for generating advertising copy by imitating the thought process of a specific person, and means for presenting the generated advertising copy to the user. This makes it possible to generate effective advertising copy that reflects the thought process of a specific celebrity or influencer, thereby improving the efficiency and effectiveness of advertising creation.
[1639] A "user" is an entity that uses the system to imitate the thought process of a specific person and generate advertising copy.
[1640] "Specific individuals" are individuals such as celebrities or influencers whose thought processes can be inferred from their past actions and statements.
[1641] A "thought process" is a flow or pattern of thought that can be inferred from a particular person's past actions or statements.
[1642] "Information" is the data or knowledge required to mimic a particular person's thought process.
[1643] A "means for providing" is a method or device for providing a user with information about a particular person's thought process.
[1644] A "means for performing a search" is a method or device that allows a user to search for a specific person's thought process based on the information provided.
[1645] "Presenting means" refers to a method or device for displaying search results and generated advertising copy to users.
[1646] "Ad copy" is promotional text that is generated by imitating the thought process of a particular person.
[1647] The "means for generating" is a method or device for automatically generating advertising copy based on the thought process of a specific person.
[1648] The system for implementing this invention allows a user to generate advertising copy by imitating the thought process of a specific person. The system is composed of a server and a user terminal.
[1649] The server provides a means for users to provide information that allows them to imitate the thought process of a specific person. This information is data that represents the thought process inferred from the specific person's past actions and statements. The server manages this information using a database and makes it accessible to users.
[1650] The user terminal is equipped with a means for performing a search based on the information provided by the server. The user can select information about a specific person's thought process and perform a search. The search results are displayed on the user terminal.
[1651] The server further includes a means for generating ad copy by imitating the thought process of a particular person, the means using a generative AI model (e.g., GPT-3) to generate ad copy based on a prompt provided by the user, and the generated ad copy is presented on the user's device.
[1652] As a specific example, the following prompt sentence can be input to the generative AI model:
[1653] Example prompt sentence:
[1654] Use a positive, energetic tone and generate copy based on the following product information: Latest smartphone, long battery life, great camera.
[1655] This system makes it possible to generate effective ad copy that reflects the thought process of specific celebrities and influencers, improving the efficiency and effectiveness of ad creation.
[1656] The server uses OpenAI's API to access the generative AI model and generate ad copy based on the prompt provided by the user. The generated ad copy is then displayed on the user's device for the user to review. This allows users to easily create ad copy that mimics a specific person's thought process.
[1657] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1658] Step 1:
[1659] The user selects information to mimic the thought process of a particular person.
[1660] Input: An interface for the user to select a specific person.
[1661] Output: The ID of the specific person selected.
[1662] Specific operation: The user terminal displays a list of specific people provided by the server, and the user selects a specific person from the list.
[1663] Step 2:
[1664] The server retrieves information about the thought process of the particular selected person from a database.
[1665] Input: The ID of a specific person.
[1666] Output: Information about a particular person's thought process.
[1667] Specific operation: The server accesses the database and retrieves thought process data corresponding to a specific person's ID.
[1668] Step 3:
[1669] The user enters a prompt to generate the ad copy.
[1670] Input: The prompt text that the user enters.
[1671] Output: The prompt statement entered.
[1672] Specific operation: The user terminal displays a text box for inputting a prompt sentence, and the user inputs the prompt sentence.
[1673] Step 4:
[1674] The server uses the generative AI model to generate ad copy based on the prompt text.
[1675] Input: Information about a particular person's thought process, prompt statements entered by the user.
[1676] Output: The generated ad copy.
[1677] How it works: The server uses OpenAI's API to input a specific person's thought process and prompt into a generative AI model to generate advertising copy.
[1678] Step 5:
[1679] The generated ad copy is presented to the user.
[1680] Input: The generated ad text.
[1681] Output: The ad copy that is presented to the user.
[1682] Specific operation: The user's device displays the generated ad copy for the user to review.
[1683] Step 6:
[1684] The user can review the generated ad copy and modify it if necessary.
[1685] Input: The generated ad text.
[1686] Output: Revised ad copy (if necessary).
[1687] Specific operations: The user device provides an interface for editing the ad copy, allowing the user to modify the ad copy.
[1688] Step 7:
[1689] Save the final ad copy and use it in your ad campaign.
[1690] Input: The revised (or generated) ad copy.
[1691] Output: Saved ad copy.
[1692] What happens: The server stores the final ad copy in a database so it can be used in ad campaigns.
[1693] Example 2
[1694] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1695] Conventional search systems make it difficult for users to search for information by imitating the thought processes of a specific person. Furthermore, they lack a means to efficiently search for relevant information based on the keywords and thought processes entered by the user and provide filtered results. This makes it difficult for users to quickly and accurately obtain the information they need.
[1696] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1697] In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, means for generating a search query based on keywords entered by the user and the thought process selected by the user, means for searching for related information using the generated search query, and means for filtering the search results and returning them to the user. This enables the user to efficiently search for related information and quickly obtain filtered results while imitating the thought process of a specific person.
[1698] "User" means any person or entity that uses the System to search for information.
[1699] A "thought process" is a series of steps or methods by which a particular person gathers, analyzes, and makes decisions about information.
[1700] "Means for providing information" refers to a function or device that provides a user with information to imitate the thought process of a particular person.
[1701] "Search means" refers to a function or device for searching for related information based on keywords entered by the user and the information provided.
[1702] "Means for presenting search results" refers to functions or devices for displaying information obtained through a search to the user.
[1703] A "means for generating a search query" is a function or device for creating a search query based on keywords entered by the user and the thought process selected by the user.
[1704] The "means for searching related information" refers to a function or device for searching information in a database or on the Internet using the generated search query.
[1705] A "means for filtering search results" is a function or device that narrows down the information obtained by a search based on a thought process selected by the user.
[1706] "Means for returning to user" refers to the functionality or device for sending filtered search results to the user.
[1707] This invention is a system that allows users to search for information by imitating the thought process of a specific person. The system generates a search query based on keywords entered by the user and the thought process selected by the user, searches for related information, and provides the user with filtered results.
[1708] The server receives the keywords entered by the user and the selected thought process and generates a search query using search engine software such as the Google Search API or Elasticsearch. Based on the generated search query, the server searches for related information and retrieves the search results.
[1709] The server then filters the search results to extract the information most relevant to the user's selected thought process. The filtered search results are sent back to the user. The device displays the search results received from the server to the user.
[1710] As a concrete example, consider the case where a user inputs the keywords "generative AI model" and the thought process "data preprocessing." In this case, the server generates a search query "generative AI model data preprocessing" and searches for related information using the Google Search API. The search results are filtered to information about data preprocessing and provided to the user.
[1711] Examples of prompts to input to a generative AI model might include:
[1712] If a user types in the keyword "generative AI model" and selects "data preprocessing" as the thought process, they should search for related information.
[1713] By inputting this prompt into a generative AI model, the model can provide search results that meet the user's requirements.
[1714] The system allows users to efficiently search for relevant information and quickly obtain filtered results, while mimicking a specific person's thought process.
[1715] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1716] Step 1:
[1717] The user inputs keywords and thought processes.
[1718] Users input keywords they want to search for (e.g., "generative AI model") and related thought processes (e.g., "data preprocessing") through the system's interface. The input information is then sent to the terminal.
[1719] Step 2:
[1720] The terminal transmits the input information to the server.
[1721] The terminal sends the user's input keywords and selected thought processes to the server using an HTTP request. The input data is passed to the server as pairs of keywords and thought processes.
[1722] Step 3:
[1723] The server generates a search query based on the received information.
[1724] The server generates a search query based on the received keywords ("generative AI model") and thought process ("data preprocessing"). Specifically, it combines this information to create a search query called "generative AI model data preprocessing." The generated search query is used in the next step.
[1725] Step 4:
[1726] The server uses a search engine to search for relevant information.
[1727] The server uses the generated search query to send a query to a search engine such as the Google Search API or Elasticsearch, which retrieves relevant information from its indexed database and sends it back to the server, which returns the search results to the server as a list of relevant web pages or documents.
[1728] Step 5:
[1729] The server filters the search results and returns them to the user.
[1730] The server filters the search results obtained from the search engine. The filtering criteria are based on the thought process selected by the user, for example, extracting only information related to "data preprocessing." The filtered search results are then returned to the user.
[1731] Step 6:
[1732] The terminal displays the search results to the user.
[1733] The terminal displays the filtered search results received from the server to the user, who can then obtain the information they need based on the displayed search results. Specifically, a list of search results is displayed on the interface, and the user can click on it to view detailed information.
[1734] (Application example 2)
[1735] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1736] Conventional search systems only provide simple search results based on keywords entered by the user, making it difficult to provide search results that reflect the user's thought process. Furthermore, there was a lack of a way for users to conduct searches based on information that would allow them to mimic a specific thought process, making it difficult to efficiently obtain information that meets the user's intent. Furthermore, there was no way to utilize generative AI models to generate prompt sentences and optimize search queries, resulting in low search accuracy.
[1737] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1738] In this invention, the server includes a means for providing information for a user to imitate the thought process of a specific person, a means for the user to perform a search based on the information, a means for generating a prompt sentence using a generative AI model, a means for searching for related information based on the prompt sentence, and a means for presenting the search results to the user, thereby making it possible to provide search results that reflect the user's thought process.
[1739] "User" means any person or entity that uses the System to search for information.
[1740] A "specific person" is an individual whose thought process the user wishes to emulate.
[1741] A "thought process" is a set of cognitive steps or ways in which a particular person processes information and makes decisions.
[1742] A "means for providing information" is a method or device for providing a user with information about a particular person's thought process.
[1743] A "search means" is a method or device for searching for related information based on keywords entered by a user or information provided by the user.
[1744] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate prompts based on user input.
[1745] A "prompt sentence" is a sentence generated by a generative AI model to optimize a search query.
[1746] The "means for searching related information" refers to a method or device for searching the Internet or a database for the information the user is looking for based on the generated prompt sentence.
[1747] "Means for presenting search results to the user" refers to a method or device for displaying the information obtained by the search to the user.
[1748] This invention is a system that provides users with information to imitate the thought process of a specific person, performs searches based on that information, generates prompt sentences using a generative AI model, and searches for related information and presents it to the user.
[1749] System configuration
[1750] The system consists of the following main components:
[1751] 1. User device: The device (e.g., smartphone, tablet, PC) through which the user enters search keywords and specific thought processes.
[1752] 2. Server: A central processing unit for receiving input from the user, generating prompt sentences using generative AI models, and retrieving relevant information.
[1753] 3. Generative AI model: An artificial intelligence algorithm (e.g., GPT-3) for generating prompt sentences based on user input.
[1754] 4. Search engine: A system for searching relevant information from the Internet or databases based on the generated prompt (e.g., Google Custom Search API).
[1755] Processing flow
[1756] 1. User device: The user uses the device to input search keywords and a specific thought process, for example, "latest movies" and "focus on reviews."
[1757] 2. Server: The server receives input from the user and sends it to the generative AI model.
[1758] 3. Generative AI model: The generative AI model generates prompts based on user input, such as "Generate prompts for users to search for information related to the latest movies, with an emphasis on reviews."
[1759] 4. Server: Based on the generated prompt sentence, a search engine is used to search for relevant information.
[1760] 5. Search Engines: Search engines retrieve relevant information from the internet and databases based on the prompt text.
[1761] 6. Server: Sends the search results to the user's device.
[1762] 7. User device: The user views the search results through their device.
[1763] Hardware and software used
[1764] Hardware: Smartphones, tablets, PCs, servers
[1765] Software: Python, OpenAI API, Google Custom Search API
[1766] Specific examples
[1767] For example, if a user types in "latest movies" and selects "important reviews" as their thought process, the generative AI model will generate a prompt like this:
[1768] "Generate prompts to help users search for information related to the latest movies, with an emphasis on reviews."
[1769] Based on this prompt, the search engine can retrieve and provide information about the latest movies, including reviews and ratings, allowing users to efficiently find results that fit their own thought process.
[1770] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1771] Step 1:
[1772] User device: The user uses the device to input search keywords and a specific thought process, for example, "latest movies" and "focus on reviews." The input data is then sent to the server.
[1773] Step 2:
[1774] Server: The server receives input from the user and sends it to the generative AI model. Specifically, it converts the user's input data (search keywords and thought processes) into a format suitable for the generative AI model and creates an API request.
[1775] Step 3:
[1776] Generative AI model: The generative AI model generates prompt sentences based on input data received from the server. For example, it generates a prompt sentence such as, "Generate a prompt sentence for a user to search for information related to the latest movies, with an emphasis on reviews." The generated prompt sentence is returned to the server.
[1777] Step 4:
[1778] Server: The server receives the prompt sentence returned by the generative AI model and sends it to the search engine. Specifically, the server uses the prompt sentence as a search query and sends a request to the search engine API.
[1779] Step 5:
[1780] Search engine: A search engine searches the Internet and databases for relevant information based on the prompt received from the server, and returns the search results to the server.
[1781] Step 6:
[1782] Server: The server receives the search results returned by the search engine and sends them to the user's device. Specifically, it formats the search results in a format that is easy for the user to view and sends them to the user's device.
[1783] Step 7:
[1784] User device: The user views search results on their device, including information about the latest movies, including reviews and ratings.
[1785] Example 3
[1786] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1787] Conventional search systems lacked the means to provide users with information that would allow them to mimic the thought process of a specific person, making it difficult for users to effectively use search results. Furthermore, they lacked the means to generate prompts to properly input search queries into the AI model, and to properly display the generated search results in the user interface. This made it difficult for users to quickly and accurately obtain the information they were looking for.
[1788] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[1789] In this invention, the server includes means for receiving a search query from a user, means for converting the received search query into a prompt sentence for input to a generative AI model, means for processing the prompt sentence using the generative AI model to generate relevant search results, and means for converting the generated search results into a format appropriate for display on a user interface, thereby providing information for the user to imitate the thought process of a specific person, enabling the search query to be appropriately processed and the generated search results to be effectively displayed.
[1790] "User" means any person or entity that uses the System to search for information and receive results.
[1791] "Search Query" means a search request or question entered into a system by a user.
[1792] A "generative AI model" refers to an algorithm or program that uses artificial intelligence technology to generate relevant information based on input prompts.
[1793] A "prompt sentence" refers to a sentence that is converted from a user's search query to appropriately input it into a generative AI model.
[1794] "Search results" refers to the information and data generated by a generative AI model based on a prompt.
[1795] "User interface" refers to the screen or display means through which a user interacts with the system and visually confirms search results.
[1796] "Server" refers to the central computer system that receives search queries from users, generates search results using the generative AI model, and displays them in the user interface.
[1797] A "means" refers to a method or apparatus designed to perform a particular function or role.
[1798] This invention is a system that provides information for users to imitate the thought process of a specific person, converts search queries into prompt sentences for appropriate input into a generative AI model, and appropriately displays the generated search results in a user interface.
[1799] Server Roles
[1800] The server receives a search query from a user. For example, if the user types, "I want to know about the latest technology trends," the server receives the query. The server then converts the received search query into a prompt sentence to input into the generative AI model. This prompt sentence reflects the user's intention and request. For example, the server converts the query, "I want to know about the latest technology trends," into a prompt sentence, "Please provide information about the latest technology trends."
[1801] The server processes the prompt using a generative AI model (e.g., OpenAI's GPT-4) to generate relevant search results. The generated search results include explanations related to a specific person's thought process. For example, in response to the prompt, "Please provide information about the latest technology trends," the generative AI model generates a search result such as, "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a specific person (e.g., a technology analyst)."
[1802] Device Role
[1803] The terminal receives the search results sent from the server. The terminal converts these search results into an appropriate format for display on the user interface. Specifically, the terminal displays the search results in a list format, and for each result, it provides a description that indicates how the information is related to the thought process of a specific person. For example, the terminal displays the search result "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a specific person (e.g., a technology analyst)" in a list format.
[1804] User Roles
[1805] The user visually checks the search results displayed on the device. The user reads the description attached to each search result and understands how the information relates to a specific person's thought process. For example, if a user enters the query "Please provide information on the latest technology trends," the user will check and understand the search result: "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a specific person (e.g., a technology analyst)."
[1806] Specific examples
[1807] Prompt Sentence Examples
[1808] "I want to know about the latest technology trends"
[1809] Example of search results
[1810] "The latest technology trends include the evolution of AI, the widespread adoption of 5G, and the application of blockchain technology. These technologies play a key role in the thought process of certain individuals (e.g., technology analysts)."
[1811] In this way, the user can visually check the search results and understand information related to the thought process of a particular person. The flow of the identification process in the third embodiment will be described with reference to FIG.
[1812] Step 1:
[1813] The server receives a search query from a user.
[1814] What happens: When a user types "I want to know about the latest technology trends," the server receives the query.
[1815] Input: User's search query: "I want to know about the latest technology trends"
[1816] Output: Received search query
[1817] Step 2:
[1818] The server converts the received search query into a prompt sentence to be input into the generative AI model.
[1819] Specific behavior: The server converts the query "I want to know about the latest technology trends" into the prompt "Please provide information about the latest technology trends."
[1820] Input: Incoming search query
[1821] Output: Generated prompt: "Please provide information about the latest technology trends."
[1822] Step 3:
[1823] The server inputs the generated prompt sentence into the generative AI model.
[1824] Specific operation: The server sends a prompt to the generative AI model: "Please provide information on the latest technology trends."
[1825] Input: Generated prompt text
[1826] Output: The prompt sent to the generative AI model
[1827] Step 4:
[1828] The generative AI model generates relevant search results based on the prompt sentence.
[1829] Specific behavior: The generative AI model generates the search result, "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a particular person (e.g., a technology analyst)."
[1830] Input: The prompt sent to the generative AI model
[1831] Output: Generated search results
[1832] Step 5:
[1833] The server transmits the generated search results to the terminal.
[1834] Specific operation: The server sends the search results received from the generative AI model to the terminal.
[1835] Input: Generated search results
[1836] Output: Search results sent to your device
[1837] Step 6:
[1838] The terminal receives the search results sent from the server.
[1839] Specific operation: The device receives the search result sent from the server: "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a particular person (e.g., a technology analyst)."
[1840] Input: Search results sent from the server
[1841] Output: Search results received
[1842] Step 7:
[1843] The terminal converts the received search results into an appropriate format for display on the user interface.
[1844] What it does: The device converts search results into a list, with each result provided with a description of how the information relates to a particular person's thought process.
[1845] Input: Search results received
[1846] Output: Search results converted into a list
[1847] Step 8:
[1848] The terminal displays the converted search results on a user interface.
[1849] What it does: The device displays a list of search results for the phrase "The latest technology trends include the evolution of AI, the spread of 5G, and the application of blockchain technology. These technologies play an important role in the thought process of a particular person (e.g., a technology analyst)."
[1850] Input: Search results converted to list format
[1851] Output: Search results displayed in the user interface
[1852] Step 9:
[1853] The user visually checks the search results displayed on the terminal.
[1854] Specific Action: The user reads the list of search results displayed on the device and understands how the information relates to a particular person's thought process.
[1855] Input: Search results displayed in the user interface
[1856] Output: User understanding and confirmation
[1857] (Application example 3)
[1858] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1859] Conventional search systems lack the information necessary for users to efficiently utilize search results, and have particular challenges in providing highly relevant information based on users' past behavior and interests. Furthermore, the lack of explanations showing how search results relate to the user's thought process makes it difficult for users to properly evaluate and select search results.
[1860] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[1861] In this invention, the server includes a means for providing information for a user to imitate the thought process of a specific person, a means for the user to perform a search based on the information, a means for presenting the search results to the user, and a means for providing an explanation for each search result that indicates how the information relates to the user's past behavior and interests, thereby enabling the user to efficiently use the search results and obtain highly relevant information based on their past behavior and interests.
[1862] "User" means any person or entity that uses the System to conduct a search.
[1863] A "specific person" is an individual whose thought process the user is trying to emulate.
[1864] A "thought process" is the set of cognitive steps a particular person takes to process information and make decisions.
[1865] A "means for providing information" is a device or software that has the function of providing a user with information to mimic the thought process of a particular person.
[1866] A "means for performing a search" is a device or software that has the function of allowing a user to input a search query based on information provided and retrieve information using a search engine.
[1867] A "means for presenting search results" is a device or software capable of visually displaying to a user search results obtained from a search engine.
[1868] "Means for providing explanations" means a device or software capable of generating and providing an explanation for each search result that shows how the information relates to the user's past behavior and interests.
[1869] "Past behavior" refers to the user's previous behavioral history, such as searches and browsing history.
[1870] "Interests" are topics or themes that a user is particularly interested in.
[1871] The system for implementing this invention provides users with information to emulate the thought process of a specific person, performs searches based on that information, and presents search results to the user. It also has the ability to provide an explanation for each search result, showing how the information relates to the user's past behavior and interests.
[1872] System configuration
[1873] The system consists of the following main components:
[1874] 1. User device: A device operated by a user, such as a smartphone or computer.
[1875] 2. Server: Manages the search engine API and database, and retrieves and annotates search results.
[1876] 3. Software: A program to retrieve and annotate search results using Python, the requests library, BeautifulSoup library, etc.
[1877] Processing flow
[1878] 1. Loading user profile: The user device loads a profile containing the user's interests from the server.
[1879] 2. Sending a search query: The user terminal sends the search query entered by the user to the server.
[1880] 3. Obtaining search results: The server obtains the search results using the search engine API.
[1881] 4. Annotating search results: The server generates and annotates each search result based on the user's profile.
[1882] 5. Displaying results: The user device visually presents the annotated search results to the user.
[1883] Hardware and software used
[1884] Hardware: Smartphones, PCs
[1885] Software: Python, requests library, BeautifulSoup library
[1886] Specific examples
[1887] For example, if a user searches for the query "latest AI technology," the server retrieves search results using a search engine API. Then, for each search result, the server generates and annotates it based on the user's profile, such as "Relevant to your interests" or "New information." Finally, the user's device displays these annotated search results to the user.
[1888] Prompt Sentence Examples
[1889] Build an application that annotates search results based on user interests. Users' profiles contain topics they are interested in. Display search results in a list format, with a description for each result that explains how the information is relevant to the user's interests.
[1890] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1891] Step 1:
[1892] Loading the user profile
[1893] The user device reads a profile containing the user's interests from the server. Specifically, the user device sends a request to the server, and the server retrieves the corresponding user profile from the user profile database and returns it to the user device.
[1894] Input: User ID
[1895] Output: User profile (interest data)
[1896] Data processing: Search and retrieve profile information from database based on user ID.
[1897] Step 2:
[1898] Submitting a search query
[1899] The user terminal transmits the search query entered by the user to the server. Specifically, when the user enters a query in the search box and presses the search button, the query is transmitted to the server.
[1900] Input: search query
[1901] Output: Send search query to server
[1902] Data processing: Taking user input, converting it into an appropriate format and sending it to the server.
[1903] Step 3:
[1904] Getting search results
[1905] The server obtains search results using a search engine API, specifically, the server sends a search query to the search engine API and receives search results returned from the API.
[1906] Input: search query
[1907] Output: Search results (list format)
[1908] Data processing: Converting search queries into API requests and parsing responses from the API to obtain search results.
[1909] Step 4:
[1910] Annotating search results
[1911] The server generates and adds annotations based on the user's profile to each search result. Specifically, it compares the title and content of the search result with the user's interests, and adds annotations such as "Related to your interests" to highly relevant results.
[1912] Input: search results, user profile
[1913] Output: Annotated search results
[1914] Data processing: Compare search results with user profiles and generate annotations based on relevance.
[1915] Step 5:
[1916] Displaying the results
[1917] The user terminal visually presents the annotated search results to the user, specifically, by displaying the annotated search results in a list format and displaying annotations for each result.
[1918] Input: Annotated search results
[1919] Output: what is displayed on the user interface
[1920] Data processing: Convert the annotated search results into a format suitable for the user interface and display them.
[1921] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1922] "Example 1"
[1923] As one embodiment of the present invention, a system is provided that combines an emotion engine that recognizes a user's emotions. This system includes a means for providing information for a user to imitate the thought process of a specific person, a means for the user to perform a search based on the information, and a means for presenting the search results to the user. The emotion engine recognizes emotions from the user's facial expressions, tone of voice, choice of words, etc. For example, when a user is happy, the emotion engine recognizes the user's joy and selects information to imitate the user's thought process based on the user's joy. Also, when a user is sad, the emotion engine recognizes the user's sadness and performs a search based on the user's sadness.
[1924] "Example 2"
[1925] As a specific example, when a user is happy, the emotion engine recognizes the joy and selects information to imitate the thought process of a particular person based on the joy. For example, when a user is happy, the emotion engine recognizes the joy and selects information to imitate the thought process of a comedian based on the joy. Also, when a user is sad, the emotion engine recognizes the sadness and selects information to imitate the thought process of a poet based on the sadness.
[1926] "Example 3"
[1927] The emotion engine also recognizes the user's emotion and performs a search based on that emotion. For example, when the user is happy, the emotion engine recognizes that joy and performs a search based on that joy. This search searches for information related to joy or information that the user is likely to feel happy about. When the user is sad, the emotion engine recognizes that sadness and performs a search based on sadness. This search searches for information related to sadness or information that the user is likely to feel sad about.
[1928] The processing flow of each embodiment will be described below.
[1929] "Example 1"
[1930] Step 1: The emotion engine recognizes the user's emotions from their facial expressions, tone of voice, choice of words, etc.
[1931] Step 2: Based on the emotions recognized by the emotion engine, select information to mimic the thought process of a specific person.
[1932] Step 3: The user performs a search based on the selected information.
[1933] Step 4: Present the search results to the user.
[1934] "Example 2"
[1935] Step 1: When a user is happy, the emotion engine recognizes that joy.
[1936] Step 2: Select information based on pleasure to mimic the comedian's thought process.
[1937] Step 3: The user performs a search based on the selected information.
[1938] Step 4: Present the search results to the user.
[1939] "Example 3"
[1940] Step 1: When a user is sad, the emotion engine recognizes that sadness.
[1941] Step 2: Based on the sadness, information is selected to mimic the poet's thought process. Step 3: The user conducts a search based on the selected information.
[1942] Step 4: Present the search results to the user.
[1943] Example 1
[1944] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1945] Conventional systems were unable to take the user's emotions into account when obtaining information to imitate the thought process of a specific person, which made it difficult to provide appropriate information according to the user's emotional state, limiting the user's experience.
[1946] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1947] In this invention, the server includes: means for providing information that allows a user to imitate the thought process of a specific person; means for the user to perform a search based on the information; means for presenting the search results to the user; means including an emotion engine that recognizes the user's emotions; and means for selecting information based on the emotions recognized by the emotion engine. This makes it possible to provide appropriate information according to the user's emotional state.
[1948] A "user" refers to an individual who uses the system to attempt to mimic the thought process of a particular person.
[1949] "Specific person" refers to a person, past or present, that the user wishes to emulate.
[1950] A "thought process" refers to the flow or pattern of thought that a particular person follows based on their past actions and statements.
[1951] "Means for providing information" refers to a function that provides the user with information about a particular person's thought process.
[1952] "Means for searching" refers to the functionality that allows users to search for more detailed information based on the information provided.
[1953] "Means for presenting search results" refers to the functionality for displaying results for a search conducted by a user.
[1954] An "emotion engine" refers to software or hardware that recognizes emotions from a user's facial expressions, tone of voice, choice of words, etc.
[1955] "Means for selecting information based on emotions" refers to a function for selecting appropriate information from a database based on the user's emotions recognized by the emotion engine.
[1956] The present invention provides a system that provides information for a user to imitate the thought process of a specific person and selects appropriate information based on the user's emotions. Specific embodiments of this system will be described below.
[1957] System configuration
[1958] Hardware
[1959] 1. Device: A device used by a user that has a camera and microphone, which can capture the user's facial expressions and tone of voice.
[1960] 2. Server: A central processing unit that includes a database and emotion engine. The server processes data sent by users and provides appropriate information.
[1961] software
[1962] 1. Emotion Engine: Software that recognizes emotions from the user's facial expressions, tone of voice, choice of words, etc. The emotion engine analyzes the user's emotional state in real time.
[1963] 2. Database: This database contains information that represents a specific person's thought process, which can be inferred from their past actions and statements. The server selects the appropriate information from this database.
[1964] System Operation
[1965] Obtaining user sentiment data
[1966] Users access the system and provide emotional data via a camera and microphone, and the device captures the user's facial expressions and tone of voice in real time.
[1967] Emotional Data Analysis
[1968] The device sends the acquired emotional data to the emotion engine, which analyzes the user's facial expressions and tone of voice to identify the user's emotions.
[1969] Selecting information from a database
[1970] Based on the emotional information received from the emotion engine, the server selects appropriate information from a database that stores information to mimic the thought process of a specific person.
[1971] Providing information
[1972] The server provides the user with selected information that allows the user to understand the thought process of a particular person.
[1973] Processing a user's search query
[1974] The user can then perform further searches based on the information provided. When the user enters a search query, the device sends the query to the server.
[1975] Presenting search results
[1976] The server generates appropriate search results for the user's search query and presents them to the user, allowing the user to gain a deeper understanding of a particular person's thought process.
[1977] Specific examples
[1978] Suppose a user accesses the system and wants to imitate the thought process of a particular person (for example, a famous philosopher in history). When the user says to the system, "I am very happy right now," the emotion engine recognizes the user's joy. The server selects information from the database based on the actions and statements made by the philosopher when he or she felt joy, and provides it to the user. The user can then use that information to conduct further searches and gain a deeper understanding of the philosopher's thought process.
[1979] Prompt Sentence Examples
[1980] "I'm very happy right now. Give me information to mimic the thought process of a particular person."
[1981] The system provides appropriate information based on the user's emotions and helps mimic the thought process of a specific person.
[1982] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1983] Step 1:
[1984] Users access the system and provide emotional data via a camera and microphone, and the device captures the user's facial expressions and tone of voice in real time.
[1985] Input: User's facial expression data, tone of voice
[1986] Output: Captured emotion data
[1987] Specific operation: The user speaks into the camera. The device captures the user's facial expressions with the camera and records the tone of voice with the microphone.
[1988] Step 2:
[1989] The device transmits the acquired emotion data to the emotion engine, which analyzes the user's facial expressions and tone of voice to identify the user's emotion.
[1990] Input: Captured emotion data
[1991] Output: Analyzed emotion information (e.g., joy, sadness)
[1992] Specific operation: The device sends the captured data to the emotion engine, which identifies the user's emotion, such as "happy" or "sad."
[1993] Step 3:
[1994] Based on the emotional information received from the emotion engine, the server selects appropriate information from a database that stores information to mimic the thought process of a specific person.
[1995] Input: Parsed emotion information
[1996] Output: Selected information (e.g., information about a particular person's thought process)
[1997] Specific operation: The server receives information from the emotion engine that "the user is happy." The server selects information from the database to mimic the thought process of a specific person related to "joy."
[1998] Step 4:
[1999] The server provides the user with selected information that allows the user to understand the thought process of a particular person.
[2000] Input: Selected information
[2001] Output: Information provided to the user
[2002] Specific operation: The server sends the selected information to the user's terminal, which then displays the information to the user.
[2003] Step 5:
[2004] The user can then perform further searches based on the provided information. When the user enters a search query, the device sends the query to the server.
[2005] Input: User's search query
[2006] Output: The search query sent to the server
[2007] Specific Action: The user inputs, "What specific action did this philosopher take when he was happy?" The device sends the search query to the server.
[2008] Step 6:
[2009] The server generates appropriate search results for the user's search query and presents them to the user, who can then use the results to gain a deeper understanding of the thought process of a particular person.
[2010] Input: User's search query
[2011] Output: Search results
[2012] Specific operations: The server searches the database based on the search query. The server sends the search results to the user's terminal. The terminal displays the search results to the user.
[2013] (Application example 1)
[2014] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[2015] In conventional systems, the means by which users can imitate the thought processes of specific individuals are limited, making it difficult to provide appropriate information based on the user's emotions. In addition, the range of information that users can independently select is limited, making it difficult to increase user satisfaction.
[2016] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes means for providing information for a user to imitate the thought process of a specific person, means for the user to perform a search based on the information, means for presenting the search results to the user, an emotion engine that recognizes the user's emotions, and means for selecting information for imitating the thought process of a specific person based on the emotion engine. This makes it possible to provide appropriate information based on the user's emotions and expands the range of information that the user can independently select, thereby increasing user satisfaction.
[2017] "User" means any individual or entity that uses the System.
[2018] A "specific person" is an individual whose thought process can be inferred from their past actions and statements.
[2019] A "thought process" is a flow or pattern of thought that can be inferred based on a particular person's past actions and statements.
[2020] "Information" is the data or knowledge required to mimic a particular person's thought process.
[2021] "Means for providing" refers to a method or device for providing information to a user.
[2022] A "means for conducting a search" is a method or device that allows a user to conduct a search based on information provided by the user.
[2023] A "presentation means" is a method or device for displaying search results to a user.
[2024] An "emotion engine" is software or hardware that recognizes a user's emotions and selects appropriate information based on those emotions.
[2025] The "means for selecting" is a method or device for selecting information to imitate the thought process of a particular person based on an emotion engine.
[2026] A system for implementing this invention provides information that allows a user to imitate the thought process of a specific person, and selects and presents appropriate information based on the user's emotions. Specific embodiments of this system are described below.
[2027] System Configuration
[2028] The system consists of the following main components:
[2029] 1. User device: A device such as a smartphone or tablet that has a camera and microphone.
[2030] 2. Server: Includes information provision means, search means, presentation means, emotion engine, and selection means.
[2031] 3. Database: Stores the thought processes inferred from a particular person's past actions and statements.
[2032] Program processing
[2033] emotion recognition
[2034] The camera and microphone on the user's device are used to capture the user's facial expressions and tone of voice. This data is then sent to the emotion engine on the server, which then uses the Emotion Recognition API to recognize the user's emotions.
[2035] Providing information
[2036] The server retrieves information about a specific person's thought process from a database, based on the past actions and statements of the specific person the user wants to emulate.
[2037] Search and Select
[2038] The server uses the search engine to search for relevant content based on the recognized emotion and the acquired thought process. Based on the emotion engine, the server selects information that matches the user's emotion.
[2039] presentation
[2040] The search results are sent to the user's device and displayed to the user, who can then browse the information presented and conduct further detailed searches.
[2041] Specific examples
[2042] For example, if a user wants to search for content that mimics the thought process of a specific author, they can input the following prompt into the generative AI model:
[2043] User Emotion: Delight
[2044] Specific Authors: Specific Authors
[2045] Search results for: Content that mimics the thought process of a particular author
[2046] Based on this prompt, the server searches for content that mimics the thought process of a particular author and provides it to the user, allowing the user to understand the thought process of a particular author and gain inspiration based on it.
[2047] Hardware and software used
[2048] Hardware: Smartphone camera and microphone
[2049] Software: Emotion Recognition API, Content Database, Search Engine
[2050] In this way, it becomes possible to provide appropriate information based on the user's emotions, and the range of information that the user can independently select is expanded, thereby increasing user satisfaction.
[2051] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2052] Step 1:
[2053] The camera and microphone on the user's device are used to capture the user's facial expressions and tone of voice. This data is used as input data for recognizing the user's emotions. Specifically, it includes image data captured by the camera and audio data recorded by the microphone.
[2054] Step 2:
[2055] The user device sends the captured facial expression and tone of voice data to the server. The server then analyzes this data using the Emotion Recognition API to recognize the user's emotions. The input data is image data and voice data, and the output data is the recognized emotion (e.g., joy, sadness, anger, etc.).
[2056] Step 3:
[2057] The server retrieves information about the specific person's thought process from a database based on the recognized emotion. The input data is the recognized emotion and the specific person's identification information, and the output data is information about the specific person's thought process. Specifically, it includes data based on the specific person's past actions and statements.
[2058] Step 4:
[2059] The server uses a search engine to search for related content based on the acquired information about thought processes and the recognized emotions. The input data is the information about thought processes and the recognized emotions, and the output data is a content list as search results. Specifically, it includes related articles, videos, images, etc.
[2060] Step 5:
[2061] The server sends the search results to the...
Claims
1. A means for providing first information for a user to mimic the thought process of a particular person; A means for the user to perform a search based on the first information; means for generating a prompt sentence using a generative AI model to instruct a search for second information related to the first information; means for retrieving the second information related to the first information based on the prompt sentence; means for presenting the searched second information to the user; A system including:
2. The system according to claim 1 , wherein the first information is information representing a thought process inferred from a specific person's past actions and statements.
3. 2. The system of claim 1, wherein the means for providing the first information includes means for allowing a user to autonomously select information for mimicking a particular person's thought process.
Citation Information
Patent Citations
System, method and program for dialogue with pseudo-character
JP2005196356A
Persona chatbot control method and system
JP2022180282A