system

Abstract

We provide the system. [Solution] A method for saving website URLs in a database, A method for periodically crawling a saved list of URLs to collect the latest data, A means for analyzing collected data using a natural language processing engine, and for summarizing and extracting important information, Means for storing extracted summaries and important information in a database, A system that includes means for searching, filtering, and displaying information within a database through a user interface.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In recent years, the analysis of competing companies has played an important role in corporate strategies, but generally requires a lot of time and effort. In the conventional method, it is necessary to manually investigate individual websites, collect information, and analyze it, which is inefficient. Also, it is difficult to always obtain the latest information, which may hinder quick decision-making. Therefore, there is a need for a system that can efficiently collect, analyze, and utilize information of competing companies.

Means for Solving the Problems

[0005] The present invention solves the above problems by providing a system that includes means for storing website URLs in a database, means for periodically crawling the stored URL list to collect the latest data, means for analyzing the collected data using a natural language processing engine to extract summaries and important information, means for storing the extracted summaries and important information in a database, and means for searching, filtering, and displaying the information in the database through a user interface. This makes it possible to efficiently and automatically collect and analyze information on competitors, and users can always quickly obtain the latest information to make decisions.

[0006] A "URL" is a unified resource locator used to point to resources on the web.

[0007] A "database" is a collection of data for efficient storage and management, and a system that allows you to search, add, and update data using queries.

[0008] "Crawling" is the process of using an automated program called a web crawler to visit web pages on the internet and collect data.

[0009] A "natural language processing engine" is a computer system that includes algorithms and models for understanding and analyzing natural language, and can perform tasks such as summarizing text, translating, and extracting keywords.

[0010] A "summary" is a short string of characters that extracts the key points from a document or data, and expresses the content concisely.

[0011] A "user interface" is the part of a system that provides a means for the user to interact with it, and usually refers to a graphical user interface (GUI), which includes search bars, buttons, and display fields.

[0012] "Searching" is the process of finding information within a database based on specific keywords or conditions.

[0013] "Filtering" is the process of narrowing down data based on certain conditions and extracting only the necessary information.

[0014] "Display" refers to the process of outputting collected and analyzed information in a format that is viewable by humans.

[0015] "Exporting" is the process of transferring data stored within a system to another format or device, making it available for storage or use.

[0016] "Frequency" refers to the number of times a certain event occurs within a specific period, and in this system, it indicates how often crawling and analysis are performed. [Brief explanation of the drawing]

[0017] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8]It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a processor with a reference number (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0021] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0022] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0023] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0025] [First Embodiment]

[0026] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0027] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0030] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0037] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0038] The system according to the present invention consists of three main entities: a server, a terminal, and a user. The processes in which each entity is involved are described below.

[0039] Server-side embodiment

[0040] 1. Obtain the URL list

[0041] The server periodically retrieves a list of competitors' website URLs stored in its database. This ensures that it is always prepared to keep up with the latest information.

[0042] 2. Website crawling

[0043] The server executes a web crawler based on the retrieved URL list and collects the latest data from the specified websites. For example, the Python BeautifulSoup library can be used for this.

[0044] 3. Data Extraction

[0045] This involves analyzing web pages obtained through crawling and extracting important information (e.g., pricing plans, update information, etc.). For example, it can analyze a specific section of HTML to extract the desired data.

[0046] 4. Analysis using natural language processing

[0047] The server passes the collected data to a natural language processing engine to extract summaries and key keywords. For example, the BERT model from the Transformers library can be used for this purpose.

[0048] 5. Data Storage

[0049] The analyzed data is stored in a database in JSON format, allowing for efficient access from devices.

[0050] Terminal-side embodiment

[0051] 1. Provision of a web portal

[0052] The device provides a web portal that users can access. This portal is built using, for example, the Django framework and provides user login and search functions.

[0053] 2. User Interface Design

[0054] The device provides a search bar and filtering options to make it easier for users to find information. This allows users to quickly find the information they need.

[0055] 3. Data Acquisition and Display

[0056] The terminal sends a search query to the server and displays the retrieved data to the user. Using HTML and JavaScript (registered trademark), the data is displayed in a visually easy-to-understand format.

[0057] User-side embodiment

[0058] 1. Access to the web portal

[0059] Users access the web portal using a web browser and log in. This grants them permissions to use the system.

[0060] 2. Information Search

[0061] Users enter specific keywords or the names of competitors into the search bar and perform a search. For example, by typing "change pricing plan," they can quickly find relevant information.

[0062] 3. Viewing the results

[0063] Users click on search results to view more detailed information, including summaries of competitors' pricing plans, the latest updates, and user reviews.

[0064] 4. Export information

[0065] Users can export information as needed. For example, they can save it as a PDF file for use in meeting materials.

[0066] Specific example

[0067] 1. Server side

[0068] The server crawls the data from "example-competitor.com" every hour and saves the latest information to the database.

[0069] The crawled data is used to extract information on updated pricing plans, and key changes are saved as a summary.

[0070] 2. Device side

[0071] The web portal that users access displays a search bar and filtering options.

[0072] For example, if a user searches for "change pricing plan," a list of summary information retrieved from the server will be displayed.

[0073] 3. User side

[0074] The user searches for "change pricing plan" and discovers that the latest pricing plan for "example-competitor.com" has been changed.

[0075] Click the details page to see details about the new pricing plan and user reviews.

[0076] Export the necessary information to PDF and use it as meeting material.

[0077] The above describes a specific embodiment of the system of the present invention. By having the server, terminal, and user work in cooperation with each other, it is possible to efficiently collect and analyze information on competitors.

[0078] The following describes the processing flow.

[0079] Server-side processing steps

[0080] Step 1:

[0081] The server retrieves a list of competitors' website URLs from the database. This is a regularly scheduled process, updating the URL list, for example, every hour.

[0082] Step 2:

[0083] The server executes a web crawler based on the retrieved list of URLs. The web crawler accesses each website and retrieves HTML data.

[0084] Step 3:

[0085] The server parses the retrieved HTML data and extracts the necessary information. For example, it might use specific tags or class names to extract the pricing plan section.

[0086] Step 4:

[0087] The server passes the extracted information to a natural language processing engine to generate a summary and key keywords. This uses natural language processing libraries such as the BERT model.

[0088] Step 5:

[0089] The server saves the analyzed data to a database in JSON format. This allows terminals and users to access the data efficiently later.

[0090] Terminal-side processing steps

[0091] Step 1:

[0092] The device provides a web portal that users can access. This web portal includes login and search functions.

[0093] Step 2:

[0094] Through its user interface, the device provides a search bar and filtering options to make it easier for users to find information.

[0095] Step 3:

[0096] When a user enters a search query, the device sends that query to the server. An API call is then made to retrieve data from the server.

[0097] Step 4:

[0098] The terminal receives data returned from the server, parses it, and displays it to the user. The data is displayed in a visually easy-to-understand format using HTML and JavaScript.

[0099] User-side processing steps

[0100] Step 1:

[0101] Users access the web portal using a browser and log in. This grants them access rights to the system.

[0102] Step 2:

[0103] The user enters a specific keyword or the name of a competitor into the search bar and clicks the search button. For example, they might type "change pricing plan".

[0104] Step 3:

[0105] Users click on the displayed search results to view more detailed information, which includes summaries and updates on competitors' pricing plans.

[0106] Step 4:

[0107] Users can export information as needed. For example, they can download search results as a PDF and use them as meeting materials.

[0108] The above outlines the processing steps and specific actions for the server, terminal, and user. By proceeding through these steps, it becomes possible to efficiently collect, analyze, and provide information on competitors to the user.

[0109] (Example 1)

[0110] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0111] Traditional information gathering systems have the problem of being unable to efficiently collect, analyze, and summarize the latest information from competitors' websites. Furthermore, they lack the functionality to easily search, filter, display, and export the information users need. This results in low efficiency in information gathering and analysis, and a poor user experience.

[0112] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0113] In this invention, the server includes means for storing website identifiers in a database, means for periodically processing the stored list of identifiers to collect the latest information, and means for analyzing the collected information using a natural language processing device to extract summaries and important information. This streamlines the collection, analysis, and provision of information to users, enabling users to quickly obtain and export the information they need.

[0114] A "website identifier" is a string of characters or a code used to uniquely identify a website.

[0115] "Information gathering processing" is the process of obtaining data from a website based on a specified list of identifiers.

[0116] A "natural language processing unit" is a computer program or system used to analyze collected data and extract summaries and important information.

[0117] An "identifier list" is a list that compiles the identifiers of multiple websites.

[0118] A "summary" is information that extracts the most important parts from collected information and presents them in a short format.

[0119] "Important information" refers to data collected that is particularly noteworthy or useful to the user.

[0120] A "database" is a collection of information that is organized and stored in a way that allows it to be retrieved.

[0121] A "user interface" is the means by which a user interacts with a system and searches, filters, displays, and exports information.

[0122] "Exportable" means that the user can convert information within the system into an external format (e.g., PDF) and save or share it.

[0123] "Customizable according to user settings" means that the frequency of information collection and analysis, as well as other system operations, can be adjusted to suit the user's preferences.

[0124] This invention provides a system composed of three main entities: a server, a terminal, and a user. The processes in which each entity is involved are described below using specific hardware and software examples.

[0125] Server-side embodiment

[0126] 1. Obtain the URL list

[0127] The server periodically retrieves identifiers (URL lists) of competitors' websites from the database.

[0128] Hardware / software used: Server (e.g., AWS® EC2), PostgreSQL database.

[0129] 2. Website crawling

[0130] Based on the acquired list of identifiers, the server runs a web crawler to collect the latest data from the specified website.

[0131] Hardware / software used: Server (e.g., AWS EC2), Python, BeautifulSoup library.

[0132] 3. Data Extraction

[0133] The server analyzes the crawled web pages and extracts important information such as pricing plans and update information.

[0134] Hardware / software used: Server (e.g., AWS EC2), Python, BeautifulSoup library.

[0135] 4. Analysis using natural language processing

[0136] The server passes the extracted data to a natural language processing engine (NLP engine) to extract a summary and key information.

[0137] Hardware / software used: Server (e.g., AWS EC2), Transformers library, BERT model.

[0138] 5. Data Storage

[0139] The server saves the analyzed data to the database in JSON format.

[0140] Hardware / software used: Server (e.g., AWS EC2), PostgreSQL database.

[0141] Terminal-side embodiment

[0142] 1. Provision of a web portal

[0143] The device provides a web portal that users can access. This portal includes login and search functions.

[0144] Hardware / software used: Client PC, Django framework, HTML, CSS.

[0145] 2. User Interface Design

[0146] The device designs the user interface and provides a search bar and filtering options to make it easier for users to find information.

[0147] Hardware / software used: Client PC, HTML, CSS.

[0148] 3. Data Acquisition and Display

[0149] The terminal sends a search query to the server and displays the retrieved data to the user.

[0150] Hardware / software used: Client PC, JavaScript, AJAX, HTML.

[0151] User-side embodiment

[0152] 1. Access to the web portal

[0153] Users access the web portal using a web browser and log in.

[0154] Hardware / software used: Client PC, web browser (e.g., Chrome, Firefox).

[0155] 2. Information Search

[0156] The user enters specific keywords or the names of competitors into the search bar and performs the search.

[0157] Specific example: Enter "change pricing plan" and perform a search.

[0158] 3. Viewing the results

[0159] Users click on search results to view more information, which includes a summary of pricing plans, new updates, and user reviews.

[0160] Hardware / software used: Client PC, web browser.

[0161] 4. Export information

[0162] Users can export information as needed.

[0163] Specific example: Export search results as a PDF.

[0164] Example of a prompt

[0165] "Use the BERT model to generate a summary of the pricing plans for the collected web pages."

[0166] "For the search query 'change pricing plan,' please extract and display the latest information from competitors."

[0167] The above describes a specific embodiment of the system of the present invention. By having the server, terminal, and user work in cooperation with each other, it is possible to efficiently collect and analyze information on competitors.

[0168] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0169] Step 1:

[0170] The server periodically retrieves identifiers (URL lists) of competitors' websites from the database.

[0171] Input: A list of competitor URLs stored in the database.

[0172] Data processing and calculations: Execute database queries and retrieve a list of URLs.

[0173] Output: List of retrieved URLs.

[0174] Specific operation: The server sends an SQL query to the PostgreSQL database to retrieve a list of competitor site identifiers.

[0175] Step 2:

[0176] The server executes the web crawler based on the retrieved list of URLs.

[0177] Input: The list of URLs obtained in Step 1.

[0178] Data processing and calculation: Based on the URL list, send HTTP requests to each website and retrieve the HTML content.

[0179] Output: Retrieved HTML content.

[0180] Specific operation: The server uses Python and the BeautifulSoup library to access each URL and retrieve the HTML data of the page.

[0181] Step 3:

[0182] The server analyzes the crawled HTML content and extracts important information.

[0183] Input: The HTML content obtained in Step 2.

[0184] Data processing and calculation: The BeautifulSoup library is used to parse the HTML structure and extract the desired information from specific tags and classes.

[0185] Output: Extracted information (e.g., pricing plan, update information).

[0186] Specific operation: The server uses BeautifulSoup to extract important data such as pricing plans and update information from each HTML document.

[0187] Step 4:

[0188] The server passes the extracted data to a natural language processing unit, which extracts a summary and key keywords.

[0189] Input: Information extracted in Step 3.

[0190] Data processing and calculation: Use the BERT model from the Transformers library to summarize text data and extract keywords.

[0191] Output: Summarized information and key keywords.

[0192] Specific operation: The extracted text data is fed into a BERT model to generate a concise summary and keywords.

[0193] Step 5:

[0194] The server saves the analyzed data to the database in JSON format.

[0195] Input: Summary information and keywords generated in Step 4.

[0196] Data processing and calculation: Convert summarized information and keywords into JSON format.

[0197] Output: Data in JSON format.

[0198] Specific operation: Format the summarized information and keywords as a JSON object and save it to a PostgreSQL database.

[0199] Step 6:

[0200] The device provides a web portal that users can access.

[0201] Input: Request to access a web portal.

[0202] Data processing and calculations: Generate a web portal using the Django framework.

[0203] Output: The login page of the web portal displayed to the user.

[0204] Specific operation: The terminal uses Django to build a web portal with login functionality and provides it to the user.

[0205] Step 7:

[0206] The device provides a search bar and filtering options to make it easier for users to find information.

[0207] Input: User's search request.

[0208] Data processing and calculation: Use HTML and CSS to implement a search bar and filtering functionality.

[0209] Output: Search bar and filtering options displayed in the user interface.

[0210] Specific operation: The device will use HTML and CSS to implement an intuitive search bar and detailed filtering functionality in its user interface.

[0211] Step 8:

[0212] The terminal sends a search query to the server and displays the retrieved data to the user.

[0213] Input: User's search query.

[0214] Data processing and calculation: Use JavaScript and AJAX to send search queries to the server and receive responses.

[0215] Output: Search results displayed to the user.

[0216] Specific operation: The device uses JavaScript and AJAX to send search queries to the server and displays the retrieved data to the user in real time.

[0217] Step 9:

[0218] Users access the web portal using a web browser and log in.

[0219] Input: User login information.

[0220] Data processing and calculation: Perform user authentication.

[0221] Output: User interface after successful authentication.

[0222] Specific operation: The user uses a web browser, enters their login information, and accesses the portal after going through the system's authentication process.

[0223] Step 10:

[0224] The user enters specific keywords or the names of competitors into the search bar and performs the search.

[0225] Input: A specific keyword or the name of a competitor.

[0226] Data processing and calculation: Process search queries and retrieve results.

[0227] Output: Related search results.

[0228] Specific action: The user enters "change pricing plan" into the search bar and performs a search.

[0229] Step 11:

[0230] Users click on search results to view more detailed information.

[0231] Input: Link to the search results.

[0232] Data processing / calculation: Displays detailed information about the linked page.

[0233] Output: Detailed information page.

[0234] Specific operation: The user clicks on a search result that interests them, is redirected to a details page, and then views the information.

[0235] Step 12:

[0236] Users can export information as needed.

[0237] Input: Export request.

[0238] Data processing and calculation: Convert information to a specified format (e.g., PDF).

[0239] Output: Exported information file.

[0240] Specific action: The user clicks the "Export" button and saves the information as a PDF.

[0241] (Application Example 1)

[0242] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0243] Current information gathering and analysis systems lack the ability to notify users in real time of new content and trend information from competitors, making it difficult to respond quickly to market changes. There is a need to resolve this issue and improve users' work efficiency by collecting and notifying them of trend information quickly and efficiently.

[0244] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0245] In this invention, the server includes means for storing website location information in an information storage area, means for periodically searching the stored location information list to collect the latest data, and means for analyzing the collected data using a natural language processing engine to extract summaries and important information. This enables means for notifying the user of the key points of the analyzed data using a remote notification device, and means for performing analysis and notification in real time.

[0246] "Website location information" refers to information that indicates the address (URL) or resource of a web page on the internet.

[0247] An "information storage area" refers to a database or memory device used to temporarily or permanently store collected and analyzed data.

[0248] "Exploration" refers to processes such as crawling and scraping that are performed to retrieve data from a specified website or list.

[0249] A "natural language processing engine" is a computer program or algorithm used to analyze collected data and extract summaries and important information.

[0250] A "user interface" is the interface that a user uses to access information storage and perform tasks such as searching and filtering.

[0251] A "remote notification device" is a device, including smartphones and smart glasses, that notifies users of analyzed information in real time.

[0252] "Analysis" is the process of extracting summaries and important information from collected data using a natural language processing engine.

[0253] "Notification" refers to the act of transmitting analyzed information to the user in real time.

[0254] The system according to this invention consists of three main entities: a server, a terminal, and a user. To specifically implement this invention, the following detailed description is provided.

[0255] Server-side embodiment

[0256] The server stores website location information in an information storage area. Specifically, it maintains a list of website URLs that are retrieved periodically. Next, it runs a web crawler based on the stored location information list to collect the latest data from the specified websites. The collected data is parsed using a natural language processing engine to extract summaries and important information. This utilizes, for example, the Requests and BeautifulSoup libraries in Python, as well as the BERT model from the Transformers library. The parsed data is stored in the information storage area in JSON format.

[0257] Terminal-side embodiment

[0258] The terminal provides a user interface accessible to the user. This user interface is designed to make it easy for the user to search for information and is built using, for example, the Django framework. The terminal sends search queries to the server and displays the retrieved data to the user in a visually easy-to-understand format. It also has the function of notifying the user of the key points of the analyzed data on a remote notification device, such as a smartphone or smart glasses.

[0259] User-side embodiment

[0260] Users access the user interface via a web browser or remote notification device and are granted system privileges upon logging in. Users enter specific keywords or competitor names into the search bar and perform searches. For example, by entering "latest pricing plans," they can quickly find relevant information. Furthermore, analyzed information is notified in real time, allowing users to instantly grasp new content and trend information from competitors.

[0261] Specific example

[0262] 1. Server side

[0263] The server crawls the data from "example-competitor.com" every hour and stores the latest information in the data storage area.

[0264] Extract updated pricing plan information from crawled data and save important changes as a summary.

[0265] 2. Device side

[0266] The web portal that users access displays a search bar and filtering options.

[0267] For example, if a user searches for "latest pricing plans," a summary of the information retrieved from the server will be displayed in a list. Furthermore, notifications will be sent to their smartphone or smart glasses.

[0268] 3. User side

[0269] The user searches for "latest pricing plans" and discovers that the latest pricing plans for "example-competitor.com" have changed.

[0270] Click the details page to see details about the new pricing plan and user reviews.

[0271] Export the necessary information to PDF and use it as meeting material.

[0272] Example of a prompt

[0273] "Please extract a content summary and key keywords from this website:"

[0274] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0275] Step 1:

[0276] The server stores website location information in an information storage area. This process involves saving information to a database based on a list of competitor URLs registered by the user. The input is a list of URLs registered by the user, and the output is these URLs stored in the information storage area.

[0277] Step 2:

[0278] The server periodically searches the stored list of location information to collect the latest data. This involves launching a web crawler and retrieving the latest HTML data from each URL. The input is a list of URLs stored in the information storage area, and the output is the retrieved HTML data.

[0279] Step 3:

[0280] The server analyzes the collected data using a natural language processing engine and extracts summaries and important information. Specifically, it uses the BeautifulSoup library to parse HTML and generates summaries with the BERT model of the Transformers library. With the acquired HTML data as input, summaries and keywords are generated as output.

[0281] Step 4:

[0282] The server stores the analyzed summaries and important information in the information storage area. Here, it is the process of storing data in a database in JSON format. With summaries and keywords as input, these data are stored in the information storage area as output.

[0283] Step 5:

[0284] The terminal provides a user interface accessible to the user. This is constructed using the Django framework, and after the user logs in, they can search for information. With the user's search query as input, the corresponding summary information obtained from the server is displayed as output.

[0285] Step 6:

[0286] The terminal notifies the user's remote notification device of the key points of the analyzed data. Specifically, it has the function of sending notifications to smartphones or smart glasses. With the analyzed data as input, notifications are displayed on the user's device as output.

[0287] Step 7:

[0288] Users access the user interface using a web browser or remote notification device to search for and verify information. Specifically, this involves the user entering keywords and retrieving related information. The input is the keywords entered by the user, and the output displays relevant summaries and important information.

[0289] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0290] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[0291] Server-side embodiment

[0292] 1. Obtain the URL list

[0293] The server periodically retrieves a list of competitors' website URLs stored in a database. The database maintains the most up-to-date URL list and is updated at a specified frequency.

[0294] 2. Website crawling

[0295] The server executes a web crawler based on the acquired URL list, collecting the latest data from the specified websites. The crawler retrieves the HTML data of the web pages and saves it locally.

[0296] 3. Data Extraction and Analysis

[0297] The server analyzes the collected HTML data and extracts the necessary information (such as pricing plans and the latest changes). This analysis uses a natural language processing engine to automatically generate summaries and important keywords.

[0298] 4. Data Storage

[0299] The extracted and analyzed data is stored in a database in JSON format. This database also includes indexes to enable users to access the data later.

[0300] Terminal-side Embodiments

[0301] 1. Provision of a Web Portal

[0302] The terminal provides a web portal that users can access. This portal has a login function, a search function, and a filtering function, and is designed to enable users to easily access information.

[0303] 2. Design of the User Interface

[0304] The terminal provides an intuitive user interface so that users can efficiently search for information. By entering keywords in the search bar, users can quickly find the information they are interested in.

[0305] 3. Data Acquisition and Display

[0306] The terminal receives the user's search query and sends a search request to the server. It analyzes the results returned by the server and displays them in an understandable way for the user.

[0307] User-side Embodiments

[0308] 1. Access to the Web Portal

[0309] Users access the web portal using a web browser and log in. This portal stores individual user account information.

[0310] 2. Information Search

[0311] The user enters a specific keyword (for example, "change pricing plan") into the search bar and clicks the search button. This displays relevant information.

[0312] 3. Viewing the results

[0313] Users select from a list of search results and view detailed information. The details page displays summarized information, updates, user reviews, and more.

[0314] 4. Export information

[0315] Users can export the displayed information. Export formats include PDF and CSV.

[0316] Embodiment of an Emotion Engine

[0317] 1. Analysis of emotions

[0318] The emotion engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. This emotion information is used to gain a deeper understanding of the user's intentions and state.

[0319] 2. Information Optimization

[0320] Based on the user's emotions, the system adjusts and suggests the information it displays. For example, it presents more relaxing content and simplified information to users who are feeling stressed.

[0321] 3. Recording emotional information

[0322] The recognized emotion information is stored in a database and used later for analysis and report generation. This information is used to continuously improve the user experience.

[0323] Specific example

[0324] 1. Server side

[0325] The server crawls data from "competitor-site.com" every hour to collect the latest pricing plan information.

[0326] The BERT model is used to generate a summary of the latest changes to pricing plans and store it in a database.

[0327] 2. Device side

[0328] The web portal displays a search bar and filtering options.

[0329] When a user searches for "change pricing plan," a list of relevant summary information is displayed.

[0330] 3. User side

[0331] Users can view detailed information about the latest pricing plan changes for "competitor-site.com" from the search results.

[0332] Download the necessary information as a PDF and use it as meeting material.

[0333] 4. Emotional Engine

[0334] The system analyzes the user's typing speed and patterns in the search bar, and if it determines that the user is in a hurry, it prioritizes displaying simplified information.

[0335] We will collect user sentiment data and use it to improve the system in the future.

[0336] The above describes a specific embodiment of the present invention. By having the server, terminal, user, and emotion engine work together, it is possible to efficiently collect and analyze information on competitors and provide the user with the most optimal information.

[0337] The following describes the processing flow.

[0338] Server-side processing steps

[0339] Step 1:

[0340] The server periodically retrieves a list of URLs of competitors' websites from its database. This URL list is stored on the server and is subject to crawling.

[0341] Step 2:

[0342] The server executes a web crawler based on a list of URLs. The web crawler accesses the specified websites and retrieves HTML data.

[0343] Step 3:

[0344] The server parses the retrieved HTML data and extracts important information based on specific tags and class names. For example, it might extract information about changes to pricing plans or new services.

[0345] Step 4:

[0346] The server passes the extracted data to a natural language processing engine to generate summaries and key keywords. Models such as BERT are used for this purpose.

[0347] Step 5:

[0348] The server stores the analyzed data in JSON format in the database. The JSON data is stored with indexes for efficient searching and post-processing.

[0349] Terminal-side processing steps

[0350] Step 1:

[0351] The device provides a web portal that users can access. This web portal includes login, search, and filtering functions.

[0352] Step 2:

[0353] Through its user interface, the device provides an intuitive interface that makes it easy for users to search for information. By entering keywords into the search bar, users can quickly find the information they need.

[0354] Step 3:

[0355] The terminal receives the user's search query and sends a search request to the server. It receives the response from the server and parses the search results.

[0356] Step 4:

[0357] The device displays the analyzed search results to the user. The data is displayed in a visually easy-to-understand format using HTML and JavaScript.

[0358] User-side processing steps

[0359] Step 1:

[0360] Users access the web portal using a web browser and log in. This grants them permission to access all functions within the system.

[0361] Step 2:

[0362] The user enters a specific keyword (e.g., "change pricing plan") into the search bar and clicks the search button. The user's search query is sent to the server for analysis.

[0363] Step 3:

[0364] Users click on the displayed search results to view more detailed information. This information includes summarized data, updates, and user reviews.

[0365] Step 4:

[0366] Users can export information as needed. Export formats such as PDF and CSV are available, which can be used for meeting materials and other purposes.

[0367] Emotion Engine Processing Steps

[0368] Step 1:

[0369] The emotion engine monitors user input and behavior and analyzes emotions. It collects data such as input speed, patterns, and click frequency.

[0370] Step 2:

[0371] The emotion engine determines the user's state based on analyzed emotional data. For example, it can recognize if the user is in a hurry or feeling stressed.

[0372] Step 3:

[0373] The emotion engine adjusts the information displayed based on the user's emotions. For example, it prioritizes displaying simplified information and relaxing content.

[0374] Step 4:

[0375] The emotion engine stores emotional data in a database, which is then used for analysis and report generation. This enables continuous improvement of the user experience.

[0376] The above outlines the specific processing steps for the server, terminal, user, and emotion engine. By processing at each of these steps, it is possible to efficiently collect and analyze competitor information and provide users with the most relevant information.

[0377] (Example 2)

[0378] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0379] In recent years, the importance of quickly and accurately collecting and analyzing information on competitors has been increasing. However, conventional information gathering systems lack the ability to effectively crawl large amounts of website data and quickly extract and provide necessary information to users. Furthermore, they are insufficient in optimizing information based on user sentiment and responding to individual needs. In addition, there were challenges such as the inability to export collected data and the difficulty in changing settings for data collection and analysis frequency.

[0380] In Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for storing website addresses in a database, means for periodically collecting the stored address list, means for analyzing the collected data using a natural language processing engine and extracting summaries and important information, means for storing the extracted summaries and important information in a database, means for searching, filtering, and displaying information in the database through a user interface, and means for analyzing user sentiment and optimizing displayed information. This enables the provision of optimized information. Furthermore, by adding means for allowing users to export the analyzed data, effective use of the collected data becomes possible. In addition, by adding means for changing the frequency of collection and analysis according to user settings, flexible system operation that meets user needs is realized.

[0381] A "website address" is a unique resource locator (URL) used to identify a specific webpage on the internet.

[0382] A "database" is an information system for efficiently storing, searching, and managing large amounts of data.

[0383] "Means of collection" refers to the collective term for software and hardware used to acquire data from specified resources.

[0384] A "natural language processing engine" is a general term for algorithms and models used by computers to understand and generate human language.

[0385] A "summary" is a short, concise compilation of the most important parts of collected information.

[0386] "Important information" refers to data that is beneficial to the user and essential for making decisions.

[0387] "User interface" is a general term for the screen display and means of operation that a user uses to interact with a system.

[0388] "Searching" is the act of finding information within a database based on specific criteria.

[0389] "Filtering" is the act of displaying only information that matches specific criteria from search results or datasets.

[0390] "Means of display" refers to technologies for outputting acquired information in a way that users can visually recognize.

[0391] "Means of analyzing emotions" refers to a general term for technologies and algorithms used to identify and evaluate emotions based on user behavior and input data.

[0392] "Means of optimizing information" refer to technologies that adjust the way information is displayed and its content based on the user's emotions and needs.

[0393] "Means of exporting" refers to technologies for outputting collected and analyzed data in other formats (e.g., PDF or CSV).

[0394] "Means for making the frequency of data collection and analysis configurable" refers to a function that adjusts the interval and timing of data collection and analysis based on user requests.

[0395] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[0396] ---

[0397] Server-side embodiment

[0398] Retrieving URL List

[0399] The server periodically retrieves a list of competitors' website addresses stored in a database (e.g., PostgreSQL). A Cron job is configured to update this list at regular intervals. This process uses SQL queries to retrieve the addresses and stores them in a Python list format.

[0400] Website crawling

[0401] The server uses Scrapy to run a web crawler based on the acquired address list, collecting the latest data from websites. It sends an HTTP request to each address and retrieves an HTML response. This data is saved to the local disk.

[0402] Data extraction and analysis

[0403] The collected HTML data is parsed using the BERT model as a natural language processing engine. BeautifulSoup is used to parse the HTML and extract important information (e.g., pricing plans and recent changes). After extraction, a summary and key keywords are generated and compiled in JSON format.

[0404] Data storage

[0405] The analyzed data is stored in a PostgreSQL database. This data is indexed to allow users to access it efficiently later.

[0406] Specific example:

[0407] The server crawls data from "competitor-site.com" every hour to collect the latest pricing plan information.

[0408] The BERT model is used to generate a summary of the latest changes to pricing plans and save it to the database in JSON format.

[0409] ---

[0410] Terminal-side embodiment

[0411] Web portal provision

[0412] The device provides a web portal that users can access. This portal is built with React.js and includes login, search, and filtering functions. Firebase Authentication is used for user authentication.

[0413] User interface design

[0414] The device provides intuitive UI components using Material-UI. It implements a real-time suggestion function based on keywords entered in the search bar.

[0415] Data acquisition and display

[0416] The device receives the user's search query and sends a request to the server using Axios. The returned JSON data is then visually displayed using React.js.

[0417] Specific example:

[0418] The web portal displays a search bar and filtering options.

[0419] When a user searches for "change pricing plan," a list of relevant summary information is displayed.

[0420] ---

[0421] User-side embodiment

[0422] Access to the web portal

[0423] Users access the web portal using a web browser such as Google Chrome (registered trademark) and log in with the specified credentials.

[0424] Information Search

[0425] The user enters a specific keyword into the search bar and presses the Enter key to send a search request.

[0426] View results

[0427] Users select information of interest from a list of search results and view the details on the details page. Summary information and user reviews are displayed.

[0428] Export information

[0429] Users can download the displayed information in PDF or CSV format.

[0430] Specific example:

[0431] Users can view detailed information about the latest pricing plan changes for "competitor-site.com" from the search results.

[0432] Download the necessary information as a PDF and use it as meeting material.

[0433] ---

[0434] Embodiment of an Emotion Engine

[0435] Emotional analysis

[0436] The emotion engine analyzes user input and behavior to recognize user emotions. It monitors typing speed and browsing time and analyzes emotions using natural language processing algorithms.

[0437] Information optimization

[0438] The system customizes the displayed information based on the user's emotions. For users who are feeling stressed, simplified information is prioritized.

[0439] Recording of emotional information

[0440] The recognized emotion information is stored in a database and used later for analysis and report generation.

[0441] Specific example:

[0442] The system analyzes the user's typing speed and patterns in the search bar, and if it determines that the user is in a hurry, it prioritizes displaying simplified information.

[0443] We will collect user sentiment data and use it to improve the system in the future.

[0444] ---

[0445] Example of a prompt:

[0446] Please tell me about the changes to the pricing plan.

[0447] I want to check the latest developments of our competitors.

[0448] Please display a summary of this webpage.

[0449] The above describes a specific embodiment of the present invention. By having the server, terminal, user, and emotion engine work together, it is possible to efficiently collect and analyze information on competitors and provide the user with the most optimal information.

[0450] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0451] Step 1:

[0452] The server periodically retrieves a list of competitors' website addresses from a database. A PostgreSQL database is used for this purpose. The server uses a Cron job to execute SQL queries at regular intervals, retrieving the address list in Python list format. This allows the address list to be updated with the latest information.

[0453] Input: PostgreSQL database

[0454] Output: Address list (in Python list format)

[0455] Specific operation: Periodically execute an SQL query like SELECT FROM company_urls.

[0456] Step 2:

[0457] The server uses Scrapy to run a web crawler with the acquired address list as input, collecting the latest data from the specified websites. It sends an HTTP request to each address and saves the acquired HTML response to local disk.

[0458] Input: Address list (Output from Step 1)

[0459] Output: HTML data (saved to local disk)

[0460] Specific operation: Launch a custom crawler that extends Scrapy's Spider class and send an HTTP request to each address.

[0461] Step 3:

[0462] The server uses a natural language processing engine (BERT model) to analyze the collected HTML data as input and extract the necessary information (e.g., pricing plans and recent changes). BeautifulSoup is used to parse the HTML, extract important information, generate a summary, and compile it in JSON format.

[0463] Input: HTML data (Output from Step 2)

[0464] Output: Analysis result (JSON format)

[0465] Specific operation: Parse HTML using BeautifulSoup, and extract and summarize information using the BERT model.

[0466] Step 4:

[0467] The server saves the analyzed data as input to a PostgreSQL database. The analysis results are saved in JSON format and indexed for efficient later access.

[0468] Input: Analysis results (output from step 3)

[0469] Output: Data stored in the database

[0470] Specific operation: Execute an SQL query like INSERT INTO parsed_data (url, data) to save the data.

[0471] Step 5:

[0472] The device provides a web portal that users can access. User authentication (Firebase Authentication), search, and filtering functions are implemented through an interface created with React.js.

[0473] Input: User information, search query

[0474] Output: Interface (Web Portal)

[0475] Specific operation: Navigation is implemented using React Router, and UI components are provided using Material-UI.

[0476] Step 6:

[0477] Users access the web portal via a web browser and log in. They enter the specified credentials to be authenticated.

[0478] Input: Credentials (email address, password)

[0479] Output: Login session

[0480] Specific steps: Open a browser such as Google Chrome, enter the portal's URL, and proceed to the login page.

[0481] Step 7:

[0482] The user enters a specific keyword into the portal's search bar and presses the Enter key to submit a search request.

[0483] Input: Search query

[0484] Output: Search Results List

[0485] Specific steps: Enter keywords such as "change pricing plan" into the search bar and click the search button.

[0486] Step 8:

[0487] The terminal sends a request to the server using the search query as input and displays the analysis results obtained. The results are displayed in real time using technologies such as Ajax.

[0488] Input: Search query (Output from Step 7)

[0489] Output: Display of search results

[0490] Specific operation: Use Axios to send a request to the server via a REST API and display the returned JSON data.

[0491] Step 9:

[0492] Users select information of interest from a list of search results and view the details on the details page. Summary information and user reviews are displayed.

[0493] Input: Search Results List

[0494] Output: Detailed information display

[0495] Specific action: Click the link in the search results to go to the details page.

[0496] Step 10:

[0497] Users can download the displayed information in PDF or CSV format.

[0498] Input: Detailed information

[0499] Output: Export file (PDF, CSV)

[0500] Specific steps: Click the "Export" button, select the export format, and start the download.

[0501] Step 11:

[0502] The emotion engine analyzes user input and behavior to recognize user emotions. It monitors typing speed and browsing time to analyze emotions.

[0503] Input: User behavior data (typing speed, browsing time)

[0504] Output: Sentiment data

[0505] Specific operation: Analyze emotions using natural language processing algorithms.

[0506] Step 12:

[0507] The emotion engine customizes and optimizes displayed information based on the user's emotions.

[0508] Input: Emotional data (Output from Step 11)

[0509] Output: Optimized display information

[0510] Specific action: For users experiencing stress, prioritize displaying simplified information.

[0511] Step 13:

[0512] The emotion engine stores recognized emotion information in a database and uses it later for analysis and report generation.

[0513] Input: Emotional data (Output from Step 11)

[0514] Output: Sentiment information stored in the database

[0515] Specific action: Save emotion data to the database in JSON format.

[0516] The above outlines the specific processing steps of this system. Each process works in conjunction to efficiently collect and analyze information on competitors, enabling the provision of optimal information to users.

[0517] (Application Example 2)

[0518] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0519] Traditional data collection and analysis systems have the drawback of failing to optimize the user experience because they do not provide information based on user emotions and behavior. Furthermore, insufficient export of collected information and inadequate data analysis for system improvement hinder efficient information utilization.

[0520] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for storing website URLs in a database, means for periodically crawling the stored URL list to collect the latest data, means for analyzing the collected data using a natural language processing engine to extract summaries and important information, means for storing the extracted summaries and important information in a database, means for searching, filtering and displaying information in the database through a user interface, means including an emotion analysis engine that analyzes the user's emotions and optimizes the display of information based on them, and means for analyzing user behavior and emotion data and storing it in a database for future system improvements. This makes it possible to provide optimal information based on the user's emotions and behavior, and solves the problems of the past.

[0521] A "website URL" is a unique address used to access a specific webpage online.

[0522] A "database" is a structured collection of information that allows for the efficient storage, management, and retrieval of large amounts of data.

[0523] "Crawling" is the process of automatically visiting websites and collecting specific information.

[0524] A "natural language processing engine" is a software engine that analyzes human language data and extracts and summarizes its meaning.

[0525] A "summary" refers to a document that extracts the key points from a large amount of information and presents them in a concise format.

[0526] "User interface" refers to the screens and means of operation that users use to interact with a system.

[0527] "Searching" is the operation of finding specific information from a large amount of data.

[0528] "Filtering" is the process of narrowing down data based on specific criteria.

[0529] An "emotion analysis engine" is a software engine that analyzes emotions from user input and behavior.

[0530] "Behavioral data" refers to the history of actions and choices made by users when using a system.

[0531] "Export" is the process of outputting data from a system as an external file.

[0532] Modes for carrying out the invention

[0533] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[0534] Server-side embodiment

[0535] The server first stores a list of website URLs in a database. Periodically, it performs web crawling based on this URL list to collect the latest data. The collected data is analyzed using a natural language processing engine to extract summaries and key information. The extracted information is then stored back in the database for later access by users. This entire process utilizes the BERT model as the natural language processing engine.

[0536] Terminal-side embodiment

[0537] The device provides a web portal that users can access. This portal includes login, search, and filtering functions, and is designed to allow users to easily access information. The user interface is intuitive, allowing users to quickly find information of interest by entering keywords into the search bar. The information searched by the user is retrieved in conjunction with the server, and the analyzed information is displayed in an easy-to-understand manner.

[0538] User-side embodiment

[0539] Users access the web portal using a web browser and log in. By entering a specific keyword (for example, "change pricing plan") into the search bar and clicking the search button, relevant information will be displayed. The displayed information can also be exported in PDF or CSV format.

[0540] Embodiment of an Emotion Engine

[0541] The emotion engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. Based on this emotion information, the system adjusts and suggests the information displayed. For example, if it determines that the user is in a hurry, it prioritizes displaying important information. Furthermore, the emotion information is stored in a database and used later to improve the system. This functionality enables continuous improvement of the user experience.

[0542] Specific example

[0543] When a user of an electronic payment service searches for the "latest cashback campaign," they will enter a prompt similar to the following:

[0544] Example prompt:

[0545] Latest cashback campaign

[0546] The system processes this query in the following steps:

[0547] 1. A search request is sent from the client terminal to the server.

[0548] 2. The server retrieves the latest relevant information from the database and sends the summarized results to the client terminal.

[0549] 3. The client terminal displays the results, allowing the user to quickly find the necessary information based on the sentiment analysis.

[0550] 4. If the information is satisfactory, users can download and use it in PDF format.

[0551] In this way, by realizing optimal information provision and export functions based on user emotions and behavior, it is possible to solve conventional problems and improve the user experience.

[0552] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0553] Step 1:

[0554] The server stores a list of website URLs in a database. This list includes pre-collected URLs of competitors and is updated periodically. It takes a URL list as input and saves it to the database. The output is the saved URL list.

[0555] Step 2:

[0556] The server periodically crawls based on the stored URL list to collect the latest data. Specifically, it takes the URL list as input, collects the HTML data of each website, and stores it locally. The output is the collected HTML data.

[0557] Step 3:

[0558] The server analyzes the collected HTML data using a natural language processing engine (e.g., the BERT model) to extract a summary and key information. It receives HTML data as input, performs natural language processing, and generates a summary and key information. The output is the extracted summary and key information.

[0559] Step 4:

[0560] The server stores the extracted summary and key information in JSON format in the database. The input is the summary and key information, which is then processed to save it to the database in the appropriate format. The output is the saved data.

[0561] Step 5:

[0562] The user accesses the web portal using their device. The user logs in and enters a specific keyword (e.g., "latest cashback campaigns") into the search bar. The input is the user's search query, and a search request is generated based on this. The output is the search request.

[0563] Step 6:

[0564] The server receives a search request from the terminal and searches the database for relevant information. The input is the search request; the server retrieves relevant information from the database and returns it as a summarized result. The output is the search result.

[0565] Step 7:

[0566] The terminal analyzes the search results received from the server and displays them in a user-friendly format. The input is the search results, and the user interface displays information based on these results. The output is the displayed information.

[0567] Step 8:

[0568] An emotion analysis engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. The input is user behavior data, which is then analyzed to generate emotion information. The output is this emotion information.

[0569] Step 9:

[0570] The emotion analysis engine optimizes the information displayed by the system based on the recognized emotion information. For example, if it determines that the user is in a hurry, it prioritizes displaying important information. The input is emotion information, and the displayed information is adjusted based on that. The output is the adjusted information display.

[0571] Step 10:

[0572] Users can export the displayed information. Specifically, a function is provided to download the information on the device in PDF or CSV format. The input is the displayed information, which is then exported in the format selected by the user. The output is the exported data.

[0573] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0574] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0575] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0576] [Second Embodiment]

[0577] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0578] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0579] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0580] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0581] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0582] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0583] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0584] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0585] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0586] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0587] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0588] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0589] The system according to the present invention consists of three main entities: a server, a terminal, and a user. The processes in which each entity is involved are described below.

[0590] Server-side embodiment

[0591] 1. Obtain the URL list

[0592] The server periodically retrieves a list of competitors' website URLs stored in its database. This ensures that it is always prepared to keep up with the latest information.

[0593] 2. Website crawling

[0594] The server executes a web crawler based on the retrieved URL list and collects the latest data from the specified websites. For example, the Python BeautifulSoup library can be used for this.

[0595] 3. Data Extraction

[0596] This involves analyzing web pages obtained through crawling and extracting important information (e.g., pricing plans, update information, etc.). For example, it can analyze a specific section of HTML to extract the desired data.

[0597] 4. Analysis using natural language processing

[0598] The server passes the collected data to a natural language processing engine to extract summaries and key keywords. For example, the BERT model from the Transformers library can be used for this purpose.

[0599] 5. Data Storage

[0600] The analyzed data is stored in a database in JSON format, allowing for efficient access from devices.

[0601] Terminal-side embodiment

[0602] 1. Provision of a web portal

[0603] The device provides a web portal that users can access. This portal is built using, for example, the Django framework and provides user login and search functions.

[0604] 2. User Interface Design

[0605] The device provides a search bar and filtering options to make it easier for users to find information. This allows users to quickly find the information they need.

[0606] 3. Data Acquisition and Display

[0607] The terminal sends a search query to the server and displays the retrieved data to the user. Using HTML and JavaScript, the data is displayed in a visually easy-to-understand format.

[0608] User-side embodiment

[0609] 1. Access to the web portal

[0610] Users access the web portal using a web browser and log in. This grants them permissions to use the system.

[0611] 2. Information Search

[0612] Users enter specific keywords or the names of competitors into the search bar and perform a search. For example, by typing "change pricing plan," they can quickly find relevant information.

[0613] 3. Viewing the results

[0614] Users click on search results to view more detailed information, including summaries of competitors' pricing plans, the latest updates, and user reviews.

[0615] 4. Export information

[0616] Users can export information as needed. For example, they can save it as a PDF file for use in meeting materials.

[0617] Specific example

[0618] 1. Server side

[0619] The server crawls the data from "example-competitor.com" every hour and saves the latest information to the database.

[0620] The crawled data is used to extract information on updated pricing plans, and key changes are saved as a summary.

[0621] 2. Device side

[0622] The web portal that users access displays a search bar and filtering options.

[0623] For example, if a user searches for "change pricing plan," a list of summary information retrieved from the server will be displayed.

[0624] 3. User side

[0625] The user searches for "change pricing plan" and discovers that the latest pricing plan for "example-competitor.com" has been changed.

[0626] Click the details page to see details about the new pricing plan and user reviews.

[0627] Export the necessary information to PDF and use it as meeting material.

[0628] The above describes a specific embodiment of the system of the present invention. By having the server, terminal, and user work in cooperation with each other, it is possible to efficiently collect and analyze information on competitors.

[0629] The following describes the processing flow.

[0630] Server-side processing steps

[0631] Step 1:

[0632] The server retrieves a list of competitors' website URLs from the database. This is a regularly scheduled process, updating the URL list, for example, every hour.

[0633] Step 2:

[0634] The server executes a web crawler based on the retrieved list of URLs. The web crawler accesses each website and retrieves HTML data.

[0635] Step 3:

[0636] The server parses the retrieved HTML data and extracts the necessary information. For example, it might use specific tags or class names to extract the pricing plan section.

[0637] Step 4:

[0638] The server passes the extracted information to a natural language processing engine to generate a summary and key keywords. This uses natural language processing libraries such as the BERT model.

[0639] Step 5:

[0640] The server saves the analyzed data to a database in JSON format. This allows terminals and users to access the data efficiently later.

[0641] Terminal-side processing steps

[0642] Step 1:

[0643] The device provides a web portal that users can access. This web portal includes login and search functions.

[0644] Step 2:

[0645] Through its user interface, the device provides a search bar and filtering options to make it easier for users to find information.

[0646] Step 3:

[0647] When a user enters a search query, the device sends that query to the server. An API call is then made to retrieve data from the server.

[0648] Step 4:

[0649] The terminal receives data returned from the server, parses it, and displays it to the user. The data is displayed in a visually easy-to-understand format using HTML and JavaScript.

[0650] User-side processing steps

[0651] Step 1:

[0652] Users access the web portal using a browser and log in. This grants them access rights to the system.

[0653] Step 2:

[0654] The user enters a specific keyword or the name of a competitor into the search bar and clicks the search button. For example, they might type "change pricing plan".

[0655] Step 3:

[0656] Users click on the displayed search results to view more detailed information, which includes summaries and updates on competitors' pricing plans.

[0657] Step 4:

[0658] Users can export information as needed. For example, they can download search results as a PDF and use them as meeting materials.

[0659] The above outlines the processing steps and specific actions for the server, terminal, and user. By proceeding through these steps, it becomes possible to efficiently collect, analyze, and provide information on competitors to the user.

[0660] (Example 1)

[0661] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0662] Traditional information gathering systems have the problem of being unable to efficiently collect, analyze, and summarize the latest information from competitors' websites. Furthermore, they lack the functionality to easily search, filter, display, and export the information users need. This results in low efficiency in information gathering and analysis, and a poor user experience.

[0663] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0664] In this invention, the server includes means for storing website identifiers in a database, means for periodically processing the stored list of identifiers to collect the latest information, and means for analyzing the collected information using a natural language processing device to extract summaries and important information. This streamlines the collection, analysis, and provision of information to users, enabling users to quickly obtain and export the information they need.

[0665] A "website identifier" is a string of characters or a code used to uniquely identify a website.

[0666] "Information gathering processing" is the process of obtaining data from a website based on a specified list of identifiers.

[0667] A "natural language processing unit" is a computer program or system used to analyze collected data and extract summaries and important information.

[0668] An "identifier list" is a list that compiles the identifiers of multiple websites.

[0669] A "summary" is information that extracts the most important parts from collected information and presents them in a short format.

[0670] "Important information" refers to data collected that is particularly noteworthy or useful to the user.

[0671] A "database" is a collection of information that is organized and stored in a way that allows it to be retrieved.

[0672] A "user interface" is the means by which a user interacts with a system and searches, filters, displays, and exports information.

[0673] "Exportable" means that the user can convert information within the system into an external format (e.g., PDF) and save or share it.

[0674] "Customizable according to user settings" means that the frequency of information collection and analysis, as well as other system operations, can be adjusted to suit the user's preferences.

[0675] This invention provides a system composed of three main entities: a server, a terminal, and a user. The processes in which each entity is involved are described below using specific hardware and software examples.

[0676] Server-side embodiment

[0677] 1. Obtain the URL list

[0678] The server periodically retrieves identifiers (URL lists) of competitors' websites from the database.

[0679] Hardware / software used: Server (e.g., AWS EC2), PostgreSQL database.

[0680] 2. Website crawling

[0681] Based on the acquired list of identifiers, the server runs a web crawler to collect the latest data from the specified website.

[0682] Hardware / software used: Server (e.g., AWS EC2), Python, BeautifulSoup library.

[0683] 3. Data Extraction

[0684] The server analyzes the crawled web pages and extracts important information such as pricing plans and update information.

[0685] Hardware / software used: Server (e.g., AWS EC2), Python, BeautifulSoup library.

[0686] 4. Analysis using natural language processing

[0687] The server passes the extracted data to a natural language processing engine (NLP engine) to extract a summary and key information.

[0688] Hardware / software used: Server (e.g., AWS EC2), Transformers library, BERT model.

[0689] 5. Data Storage

[0690] The server saves the analyzed data to the database in JSON format.

[0691] Hardware / software used: Server (e.g., AWS EC2), PostgreSQL database.

[0692] Terminal-side embodiment

[0693] 1. Provision of a web portal

[0694] The device provides a web portal that users can access. This portal includes login and search functions.

[0695] Hardware / software used: Client PC, Django framework, HTML, CSS.

[0696] 2. User Interface Design

[0697] The device designs the user interface and provides a search bar and filtering options to make it easier for users to find information.

[0698] Hardware / software used: Client PC, HTML, CSS.

[0699] 3. Data Acquisition and Display

[0700] The terminal sends a search query to the server and displays the retrieved data to the user.

[0701] Hardware / software used: Client PC, JavaScript, AJAX, HTML.

[0702] User-side embodiment

[0703] 1. Access to the web portal

[0704] Users access the web portal using a web browser and log in.

[0705] Hardware / software used: Client PC, web browser (e.g., Chrome, Firefox).

[0706] 2. Information Search

[0707] The user enters specific keywords or the names of competitors into the search bar and performs the search.

[0708] Specific example: Enter "change pricing plan" and perform a search.

[0709] 3. Viewing the results

[0710] Users click on search results to view more information, which includes a summary of pricing plans, new updates, and user reviews.

[0711] Hardware / software used: Client PC, web browser.

[0712] 4. Export information

[0713] Users can export information as needed.

[0714] Specific example: Export search results as a PDF.

[0715] Example of a prompt

[0716] "Use the BERT model to generate a summary of the pricing plans for the collected web pages."

[0717] "For the search query 'change pricing plan,' please extract and display the latest information from competitors."

[0718] The above describes a specific embodiment of the system of the present invention. By having the server, terminal, and user work in cooperation with each other, it is possible to efficiently collect and analyze information on competitors.

[0719] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0720] Step 1:

[0721] The server periodically retrieves identifiers (URL lists) of competitors' websites from the database.

[0722] Input: A list of competitor URLs stored in the database.

[0723] Data processing and calculations: Execute database queries and retrieve a list of URLs.

[0724] Output: List of retrieved URLs.

[0725] Specific operation: The server sends an SQL query to the PostgreSQL database to retrieve a list of competitor site identifiers.

[0726] Step 2:

[0727] The server executes the web crawler based on the retrieved list of URLs.

[0728] Input: The list of URLs obtained in Step 1.

[0729] Data processing and calculation: Based on the URL list, send HTTP requests to each website and retrieve the HTML content.

[0730] Output: Retrieved HTML content.

[0731] Specific operation: The server uses Python and the BeautifulSoup library to access each URL and retrieve the HTML data of the page.

[0732] Step 3:

[0733] The server analyzes the crawled HTML content and extracts important information.

[0734] Input: The HTML content obtained in Step 2.

[0735] Data processing and calculation: The BeautifulSoup library is used to parse the HTML structure and extract the desired information from specific tags and classes.

[0736] Output: Extracted information (e.g., pricing plan, update information).

[0737] Specific operation: The server uses BeautifulSoup to extract important data such as pricing plans and update information from each HTML document.

[0738] Step 4:

[0739] The server passes the extracted data to a natural language processing unit, which extracts a summary and key keywords.

[0740] Input: Information extracted in Step 3.

[0741] Data processing and calculation: Use the BERT model from the Transformers library to summarize text data and extract keywords.

[0742] Output: Summarized information and key keywords.

[0743] Specific operation: The extracted text data is fed into a BERT model to generate a concise summary and keywords.

[0744] Step 5:

[0745] The server saves the analyzed data to the database in JSON format.

[0746] Input: Summary information and keywords generated in Step 4.

[0747] Data processing and calculation: Convert summarized information and keywords into JSON format.

[0748] Output: Data in JSON format.

[0749] Specific operation: Format the summarized information and keywords as a JSON object and save it to a PostgreSQL database.

[0750] Step 6:

[0751] The device provides a web portal that users can access.

[0752] Input: Request to access a web portal.

[0753] Data processing and calculations: Generate a web portal using the Django framework.

[0754] Output: The login page of the web portal displayed to the user.

[0755] Specific operation: The terminal uses Django to build a web portal with login functionality and provides it to the user.

[0756] Step 7:

[0757] The device provides a search bar and filtering options to make it easier for users to find information.

[0758] Input: User's search request.

[0759] Data processing and calculation: Use HTML and CSS to implement a search bar and filtering functionality.

[0760] Output: Search bar and filtering options displayed in the user interface.

[0761] Specific operation: The device will use HTML and CSS to implement an intuitive search bar and detailed filtering functionality in its user interface.

[0762] Step 8:

[0763] The terminal sends a search query to the server and displays the retrieved data to the user.

[0764] Input: User's search query.

[0765] Data processing and calculation: Use JavaScript and AJAX to send search queries to the server and receive responses.

[0766] Output: Search results displayed to the user.

[0767] Specific operation: The device uses JavaScript and AJAX to send search queries to the server and displays the retrieved data to the user in real time.

[0768] Step 9:

[0769] Users access the web portal using a web browser and log in.

[0770] Input: User login information.

[0771] Data processing and calculation: Perform user authentication.

[0772] Output: User interface after successful authentication.

[0773] Specific operation: The user uses a web browser, enters their login information, and accesses the portal after going through the system's authentication process.

[0774] Step 10:

[0775] The user enters specific keywords or the names of competitors into the search bar and performs the search.

[0776] Input: A specific keyword or the name of a competitor.

[0777] Data processing and calculation: Process search queries and retrieve results.

[0778] Output: Related search results.

[0779] Specific action: The user enters "change pricing plan" into the search bar and performs a search.

[0780] Step 11:

[0781] Users click on search results to view more detailed information.

[0782] Input: Link to the search results.

[0783] Data processing / calculation: Displays detailed information about the linked page.

[0784] Output: Detailed information page.

[0785] Specific operation: The user clicks on a search result that interests them, is redirected to a details page, and then views the information.

[0786] Step 12:

[0787] Users can export information as needed.

[0788] Input: Export request.

[0789] Data processing and calculation: Convert information to a specified format (e.g., PDF).

[0790] Output: Exported information file.

[0791] Specific action: The user clicks the "Export" button and saves the information as a PDF.

[0792] (Application Example 1)

[0793] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0794] Current information gathering and analysis systems lack the ability to notify users in real time of new content and trend information from competitors, making it difficult to respond quickly to market changes. There is a need to resolve this issue and improve users' work efficiency by collecting and notifying them of trend information quickly and efficiently.

[0795] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0796] In this invention, the server includes means for storing website location information in an information storage area, means for periodically searching the stored location information list to collect the latest data, and means for analyzing the collected data using a natural language processing engine to extract summaries and important information. This enables means for notifying the user of the key points of the analyzed data using a remote notification device, and means for performing analysis and notification in real time.

[0797] "Website location information" refers to information that indicates the address (URL) or resource of a web page on the internet.

[0798] An "information storage area" refers to a database or memory device used to temporarily or permanently store collected and analyzed data.

[0799] "Exploration" refers to processes such as crawling and scraping that are performed to retrieve data from a specified website or list.

[0800] A "natural language processing engine" is a computer program or algorithm used to analyze collected data and extract summaries and important information.

[0801] A "user interface" is the interface that a user uses to access information storage and perform tasks such as searching and filtering.

[0802] A "remote notification device" is a device, including smartphones and smart glasses, that notifies users of analyzed information in real time.

[0803] "Analysis" is the process of extracting summaries and important information from collected data using a natural language processing engine.

[0804] "Notification" refers to the act of transmitting analyzed information to the user in real time.

[0805] The system according to this invention consists of three main entities: a server, a terminal, and a user. To specifically implement this invention, the following detailed description is provided.

[0806] Server-side embodiment

[0807] The server stores website location information in an information storage area. Specifically, it maintains a list of website URLs that are retrieved periodically. Next, it runs a web crawler based on the stored location information list to collect the latest data from the specified websites. The collected data is parsed using a natural language processing engine to extract summaries and important information. This utilizes, for example, the Requests and BeautifulSoup libraries in Python, as well as the BERT model from the Transformers library. The parsed data is stored in the information storage area in JSON format.

[0808] Terminal-side embodiment

[0809] The terminal provides a user interface accessible to the user. This user interface is designed to make it easy for the user to search for information and is built using, for example, the Django framework. The terminal sends search queries to the server and displays the retrieved data to the user in a visually easy-to-understand format. It also has the function of notifying the user of the key points of the analyzed data on a remote notification device, such as a smartphone or smart glasses.

[0810] User-side embodiment

[0811] Users access the user interface via a web browser or remote notification device and are granted system privileges upon logging in. Users enter specific keywords or competitor names into the search bar and perform searches. For example, by entering "latest pricing plans," they can quickly find relevant information. Furthermore, analyzed information is notified in real time, allowing users to instantly grasp new content and trend information from competitors.

[0812] Specific example

[0813] 1. Server side

[0814] The server crawls the data from "example-competitor.com" every hour and stores the latest information in the data storage area.

[0815] Extract updated pricing plan information from crawled data and save important changes as a summary.

[0816] 2. Device side

[0817] The web portal that users access displays a search bar and filtering options.

[0818] For example, if a user searches for "latest pricing plans," a summary of the information retrieved from the server will be displayed in a list. Furthermore, notifications will be sent to their smartphone or smart glasses.

[0819] 3. User side

[0820] The user searches for "latest pricing plans" and discovers that the latest pricing plans for "example-competitor.com" have changed.

[0821] Click the details page to see details about the new pricing plan and user reviews.

[0822] Export the necessary information to PDF and use it as meeting material.

[0823] Example of a prompt

[0824] "Please extract a content summary and key keywords from this website:"

[0825] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0826] Step 1:

[0827] The server stores website location information in an information storage area. This process involves saving information to a database based on a list of competitor URLs registered by the user. The input is a list of URLs registered by the user, and the output is these URLs stored in the information storage area.

[0828] Step 2:

[0829] The server periodically searches the stored list of location information to collect the latest data. This involves launching a web crawler and retrieving the latest HTML data from each URL. The input is a list of URLs stored in the information storage area, and the output is the retrieved HTML data.

[0830] Step 3:

[0831] The server analyzes the collected data using a natural language processing engine to extract summaries and key information. Specifically, it parses HTML using the BeautifulSoup library and generates summaries using the BERT model from the Transformers library. The input is the acquired HTML data, and the output is a summary and keywords.

[0832] Step 4:

[0833] The server stores the analyzed summary and key information in an information storage area. This involves storing the data in JSON format in the database. The input consists of the summary and keywords, and the output is the storage of this data in the information storage area.

[0834] Step 5:

[0835] The terminal provides a user interface that users can access. Built using the Django framework, it allows users to search for information after logging in. The input is the user's search query, and the output displays the corresponding summary information retrieved from the server.

[0836] Step 6:

[0837] The terminal notifies the user's remote notification device of the key points of the analyzed data. Specifically, it has the function of sending notifications to smartphones or smart glasses. The input is the analyzed data, and the output is a notification displayed on the user's device.

[0838] Step 7:

[0839] Users access the user interface using a web browser or remote notification device to search for and verify information. Specifically, this involves the user entering keywords and retrieving related information. The input is the keywords entered by the user, and the output displays relevant summaries and important information.

[0840] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0841] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[0842] Server-side embodiment

[0843] 1. Obtain the URL list

[0844] The server periodically retrieves a list of competitors' website URLs stored in a database. The database maintains the most up-to-date URL list and is updated at a specified frequency.

[0845] 2. Website crawling

[0846] The server executes a web crawler based on the acquired URL list, collecting the latest data from the specified websites. The crawler retrieves the HTML data of the web pages and saves it locally.

[0847] 3. Data Extraction and Analysis

[0848] The server analyzes the collected HTML data and extracts the necessary information (e.g., pricing plans and recent changes). This analysis uses a natural language processing engine to automatically generate summaries and key keywords.

[0849] 4. Data Storage

[0850] The extracted and analyzed data is stored in a database in JSON format. This database also includes an index for later access by users.

[0851] Terminal-side embodiment

[0852] 1. Provision of a web portal

[0853] The device provides a web portal that users can access. This portal includes login, search, and filtering functions, and is designed to allow users to easily access information.

[0854] 2. User Interface Design

[0855] The device provides an intuitive user interface that allows users to efficiently search for information. By entering keywords into the search bar, users can quickly find information that interests them.

[0856] 3. Data Acquisition and Display

[0857] The terminal receives the user's search query and sends a search request to the server. It then parses the results returned from the server and displays them to the user in an easy-to-understand format.

[0858] User-side embodiment

[0859] 1. Access to the web portal

[0860] Users access the web portal using a web browser and log in. This portal stores individual user account information.

[0861] 2. Information Search

[0862] The user enters a specific keyword (for example, "change pricing plan") into the search bar and clicks the search button. This displays relevant information.

[0863] 3. Viewing the results

[0864] Users select from a list of search results and view detailed information. The details page displays summarized information, updates, user reviews, and more.

[0865] 4. Export information

[0866] Users can export the displayed information. Export formats include PDF and CSV.

[0867] Embodiment of an Emotion Engine

[0868] 1. Analysis of emotions

[0869] The emotion engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. This emotion information is used to gain a deeper understanding of the user's intentions and state.

[0870] 2. Information Optimization

[0871] Based on the user's emotions, the system adjusts and suggests the information it displays. For example, it presents more relaxing content and simplified information to users who are feeling stressed.

[0872] 3. Recording emotional information

[0873] The recognized emotion information is stored in a database and used later for analysis and report generation. This information is used to continuously improve the user experience.

[0874] Specific example

[0875] 1. Server side

[0876] The server crawls data from "competitor-site.com" every hour to collect the latest pricing plan information.

[0877] The BERT model is used to generate a summary of the latest changes to pricing plans and store it in a database.

[0878] 2. Device side

[0879] The web portal displays a search bar and filtering options.

[0880] When a user searches for "change pricing plan," a list of relevant summary information is displayed.

[0881] 3. User side

[0882] Users can view detailed information about the latest pricing plan changes for "competitor-site.com" from the search results.

[0883] Download the necessary information as a PDF and use it as meeting material.

[0884] 4. Emotional Engine

[0885] The system analyzes the user's typing speed and patterns in the search bar, and if it determines that the user is in a hurry, it prioritizes displaying simplified information.

[0886] We will collect user sentiment data and use it to improve the system in the future.

[0887] The above describes a specific embodiment of the present invention. By having the server, terminal, user, and emotion engine work together, it is possible to efficiently collect and analyze information on competitors and provide the user with the most optimal information.

[0888] The following describes the processing flow.

[0889] Server-side processing steps

[0890] Step 1:

[0891] The server periodically retrieves a list of URLs of competitors' websites from its database. This URL list is stored on the server and is subject to crawling.

[0892] Step 2:

[0893] The server executes a web crawler based on a list of URLs. The web crawler accesses the specified websites and retrieves HTML data.

[0894] Step 3:

[0895] The server parses the retrieved HTML data and extracts important information based on specific tags and class names. For example, it might extract information about changes to pricing plans or new services.

[0896] Step 4:

[0897] The server passes the extracted data to a natural language processing engine to generate summaries and key keywords. Models such as BERT are used for this purpose.

[0898] Step 5:

[0899] The server stores the analyzed data in JSON format in the database. The JSON data is stored with indexes for efficient searching and post-processing.

[0900] Terminal-side processing steps

[0901] Step 1:

[0902] The device provides a web portal that users can access. This web portal includes login, search, and filtering functions.

[0903] Step 2:

[0904] Through its user interface, the device provides an intuitive interface that makes it easy for users to search for information. By entering keywords into the search bar, users can quickly find the information they need.

[0905] Step 3:

[0906] The terminal receives the user's search query and sends a search request to the server. It receives the response from the server and parses the search results.

[0907] Step 4:

[0908] The device displays the analyzed search results to the user. The data is displayed in a visually easy-to-understand format using HTML and JavaScript.

[0909] User-side processing steps

[0910] Step 1:

[0911] Users access the web portal using a web browser and log in. This grants them permission to access all functions within the system.

[0912] Step 2:

[0913] The user enters a specific keyword (e.g., "change pricing plan") into the search bar and clicks the search button. The user's search query is sent to the server for analysis.

[0914] Step 3:

[0915] Users click on the displayed search results to view more detailed information. This information includes summarized data, updates, and user reviews.

[0916] Step 4:

[0917] Users can export information as needed. Export formats such as PDF and CSV are available, which can be used for meeting materials and other purposes.

[0918] Emotion Engine Processing Steps

[0919] Step 1:

[0920] The emotion engine monitors user input and behavior and analyzes emotions. It collects data such as input speed, patterns, and click frequency.

[0921] Step 2:

[0922] The emotion engine determines the user's state based on analyzed emotional data. For example, it can recognize if the user is in a hurry or feeling stressed.

[0923] Step 3:

[0924] The emotion engine adjusts the information displayed based on the user's emotions. For example, it prioritizes displaying simplified information and relaxing content.

[0925] Step 4:

[0926] The emotion engine stores emotional data in a database, which is then used for analysis and report generation. This enables continuous improvement of the user experience.

[0927] The above outlines the specific processing steps for the server, terminal, user, and emotion engine. By processing at each of these steps, it is possible to efficiently collect and analyze competitor information and provide users with the most relevant information.

[0928] (Example 2)

[0929] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0930] In recent years, the importance of quickly and accurately collecting and analyzing information on competitors has been increasing. However, conventional information gathering systems lack the ability to effectively crawl large amounts of website data and quickly extract and provide necessary information to users. Furthermore, they are insufficient in optimizing information based on user sentiment and responding to individual needs. In addition, there were challenges such as the inability to export collected data and the difficulty in changing settings for data collection and analysis frequency.

[0931] In Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for storing website addresses in a database, means for periodically collecting the stored address list, means for analyzing the collected data using a natural language processing engine and extracting summaries and important information, means for storing the extracted summaries and important information in a database, means for searching, filtering, and displaying information in the database through a user interface, and means for analyzing user sentiment and optimizing displayed information. This enables the provision of optimized information. Furthermore, by adding means for allowing users to export the analyzed data, effective use of the collected data becomes possible. In addition, by adding means for changing the frequency of collection and analysis according to user settings, flexible system operation that meets user needs is realized.

[0932] A "website address" is a unique resource locator (URL) used to identify a specific webpage on the internet.

[0933] A "database" is an information system for efficiently storing, searching, and managing large amounts of data.

[0934] "Means of collection" refers to the collective term for software and hardware used to acquire data from specified resources.

[0935] A "natural language processing engine" is a general term for algorithms and models used by computers to understand and generate human language.

[0936] A "summary" is a short, concise compilation of the most important parts of collected information.

[0937] "Important information" refers to data that is beneficial to the user and essential for making decisions.

[0938] "User interface" is a general term for the screen display and means of operation that a user uses to interact with a system.

[0939] "Searching" is the act of finding information within a database based on specific criteria.

[0940] "Filtering" is the act of displaying only information that matches specific criteria from search results or datasets.

[0941] "Means of display" refers to technologies for outputting acquired information in a way that users can visually recognize.

[0942] "Means of analyzing emotions" refers to a general term for technologies and algorithms used to identify and evaluate emotions based on user behavior and input data.

[0943] "Means of optimizing information" refer to technologies that adjust the way information is displayed and its content based on the user's emotions and needs.

[0944] "Means of exporting" refers to technologies for outputting collected and analyzed data in other formats (e.g., PDF or CSV).

[0945] "Means for making the frequency of data collection and analysis configurable" refers to a function that adjusts the interval and timing of data collection and analysis based on user requests.

[0946] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[0947] ---

[0948] Server-side embodiment

[0949] Retrieving URL List

[0950] The server periodically retrieves a list of competitors' website addresses stored in a database (e.g., PostgreSQL). A Cron job is configured to update this list at regular intervals. This process uses SQL queries to retrieve the addresses and stores them in a Python list format.

[0951] Website crawling

[0952] The server uses Scrapy to run a web crawler based on the acquired address list, collecting the latest data from websites. It sends an HTTP request to each address and retrieves an HTML response. This data is saved to the local disk.

[0953] Data extraction and analysis

[0954] The collected HTML data is parsed using the BERT model as a natural language processing engine. BeautifulSoup is used to parse the HTML and extract important information (e.g., pricing plans and recent changes). After extraction, a summary and key keywords are generated and compiled in JSON format.

[0955] Data storage

[0956] The analyzed data is stored in a PostgreSQL database. This data is indexed to allow users to access it efficiently later.

[0957] Specific example:

[0958] The server crawls data from "competitor-site.com" every hour to collect the latest pricing plan information.

[0959] The BERT model is used to generate a summary of the latest changes to pricing plans and save it to the database in JSON format.

[0960] ---

[0961] Terminal-side embodiment

[0962] Web portal provision

[0963] The device provides a web portal that users can access. This portal is built with React.js and includes login, search, and filtering functions. Firebase Authentication is used for user authentication.

[0964] User interface design

[0965] The device provides intuitive UI components using Material-UI. It implements a real-time suggestion function based on keywords entered in the search bar.

[0966] Data acquisition and display

[0967] The device receives the user's search query and sends a request to the server using Axios. The returned JSON data is then visually displayed using React.js.

[0968] Specific example:

[0969] The web portal displays a search bar and filtering options.

[0970] When a user searches for "change pricing plan," a list of relevant summary information is displayed.

[0971] ---

[0972] User-side embodiment

[0973] Access to the web portal

[0974] Users access the web portal using a web browser such as Google Chrome and log in with the specified credentials.

[0975] Information Search

[0976] The user enters a specific keyword into the search bar and presses the Enter key to send a search request.

[0977] View results

[0978] Users select information of interest from a list of search results and view the details on the details page. Summary information and user reviews are displayed.

[0979] Export information

[0980] Users can download the displayed information in PDF or CSV format.

[0981] Specific example:

[0982] Users can view detailed information about the latest pricing plan changes for "competitor-site.com" from the search results.

[0983] Download the necessary information as a PDF and use it as meeting material.

[0984] ---

[0985] Embodiment of an Emotion Engine

[0986] Emotional analysis

[0987] The emotion engine analyzes user input and behavior to recognize user emotions. It monitors typing speed and browsing time and analyzes emotions using natural language processing algorithms.

[0988] Information optimization

[0989] The system customizes the displayed information based on the user's emotions. For users who are feeling stressed, simplified information is prioritized.

[0990] Recording of emotional information

[0991] The recognized emotion information is stored in a database and used later for analysis and report generation.

[0992] Specific example:

[0993] The system analyzes the user's typing speed and patterns in the search bar, and if it determines that the user is in a hurry, it prioritizes displaying simplified information.

[0994] We will collect user sentiment data and use it to improve the system in the future.

[0995] ---

[0996] Example of a prompt:

[0997] Please tell me about the changes to the pricing plan.

[0998] I want to check the latest developments of our competitors.

[0999] Please display a summary of this webpage.

[1000] The above describes a specific embodiment of the present invention. By having the server, terminal, user, and emotion engine work together, it is possible to efficiently collect and analyze information on competitors and provide the user with the most optimal information.

[1001] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1002] Step 1:

[1003] The server periodically retrieves a list of competitors' website addresses from a database. A PostgreSQL database is used for this purpose. The server uses a Cron job to execute SQL queries at regular intervals, retrieving the address list in Python list format. This allows the address list to be updated with the latest information.

[1004] Input: PostgreSQL database

[1005] Output: Address list (in Python list format)

[1006] Specific operation: Periodically execute an SQL query like SELECT FROM company_urls.

[1007] Step 2:

[1008] The server uses Scrapy to run a web crawler with the acquired address list as input, collecting the latest data from the specified websites. It sends an HTTP request to each address and saves the acquired HTML response to local disk.

[1009] Input: Address list (Output from Step 1)

[1010] Output: HTML data (saved to local disk)

[1011] Specific operation: Launch a custom crawler that extends Scrapy's Spider class and send an HTTP request to each address.

[1012] Step 3:

[1013] The server uses a natural language processing engine (BERT model) to analyze the collected HTML data as input and extract the necessary information (e.g., pricing plans and recent changes). BeautifulSoup is used to parse the HTML, extract important information, generate a summary, and compile it in JSON format.

[1014] Input: HTML data (Output from Step 2)

[1015] Output: Analysis result (JSON format)

[1016] Specific operation: Parse HTML using BeautifulSoup, and extract and summarize information using the BERT model.

[1017] Step 4:

[1018] The server saves the analyzed data as input to a PostgreSQL database. The analysis results are saved in JSON format and indexed for efficient later access.

[1019] Input: Analysis results (output from step 3)

[1020] Output: Data stored in the database

[1021] Specific operation: Execute an SQL query like INSERT INTO parsed_data (url, data) to save the data.

[1022] Step 5:

[1023] The device provides a web portal that users can access. User authentication (Firebase Authentication), search, and filtering functions are implemented through an interface created with React.js.

[1024] Input: User information, search query

[1025] Output: Interface (Web Portal)

[1026] Specific operation: Navigation is implemented using React Router, and UI components are provided using Material-UI.

[1027] Step 6:

[1028] Users access the web portal via a web browser and log in. They enter the specified credentials to be authenticated.

[1029] Input: Credentials (email address, password)

[1030] Output: Login session

[1031] Specific steps: Open a browser such as Google Chrome, enter the portal's URL, and go to the login page.

[1032] Step 7:

[1033] The user enters a specific keyword into the portal's search bar and presses the Enter key to submit a search request.

[1034] Input: Search query

[1035] Output: Search Results List

[1036] Specific steps: Enter keywords such as "change pricing plan" into the search bar and click the search button.

[1037] Step 8:

[1038] The terminal sends a request to the server using the search query as input and displays the analysis results obtained. The results are displayed in real time using technologies such as Ajax.

[1039] Input: Search query (Output from Step 7)

[1040] Output: Display of search results

[1041] Specific operation: Use Axios to send a request to the server via a REST API and display the returned JSON data.

[1042] Step 9:

[1043] Users select information of interest from a list of search results and view the details on the details page. Summary information and user reviews are displayed.

[1044] Input: Search Results List

[1045] Output: Detailed information display

[1046] Specific action: Click the link in the search results to go to the details page.

[1047] Step 10:

[1048] Users can download the displayed information in PDF or CSV format.

[1049] Input: Detailed information

[1050] Output: Export file (PDF, CSV)

[1051] Specific steps: Click the "Export" button, select the export format, and start the download.

[1052] Step 11:

[1053] The emotion engine analyzes user input and behavior to recognize user emotions. It monitors typing speed and browsing time to analyze emotions.

[1054] Input: User behavior data (typing speed, browsing time)

[1055] Output: Sentiment data

[1056] Specific operation: Analyze emotions using natural language processing algorithms.

[1057] Step 12:

[1058] The emotion engine customizes and optimizes displayed information based on the user's emotions.

[1059] Input: Emotional data (Output from Step 11)

[1060] Output: Optimized display information

[1061] Specific action: For users experiencing stress, prioritize displaying simplified information.

[1062] Step 13:

[1063] The emotion engine stores recognized emotion information in a database and uses it later for analysis and report generation.

[1064] Input: Emotional data (Output from Step 11)

[1065] Output: Sentiment information stored in the database

[1066] Specific action: Save emotion data to the database in JSON format.

[1067] The above outlines the specific processing steps of this system. Each process works in conjunction to efficiently collect and analyze information on competitors, enabling the provision of optimal information to users.

[1068] (Application Example 2)

[1069] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1070] Traditional data collection and analysis systems have the drawback of failing to optimize the user experience because they do not provide information based on user emotions and behavior. Furthermore, insufficient export of collected information and inadequate data analysis for system improvement hinder efficient information utilization.

[1071] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for storing website URLs in a database, means for periodically crawling the stored URL list to collect the latest data, means for analyzing the collected data using a natural language processing engine to extract summaries and important information, means for storing the extracted summaries and important information in a database, means for searching, filtering and displaying information in the database through a user interface, means including an emotion analysis engine that analyzes the user's emotions and optimizes the display of information based on them, and means for analyzing user behavior and emotion data and storing it in a database for future system improvements. This makes it possible to provide optimal information based on the user's emotions and behavior, and solves the problems of the past.

[1072] A "website URL" is a unique address used to access a specific webpage online.

[1073] A "database" is a structured collection of information that allows for the efficient storage, management, and retrieval of large amounts of data.

[1074] "Crawling" is the process of automatically visiting websites and collecting specific information.

[1075] A "natural language processing engine" is a software engine that analyzes human language data and extracts and summarizes its meaning.

[1076] A "summary" refers to a document that extracts the key points from a large amount of information and presents them in a concise format.

[1077] "User interface" refers to the screens and means of operation that users use to interact with a system.

[1078] "Searching" is the operation of finding specific information from a large amount of data.

[1079] "Filtering" is the process of narrowing down data based on specific criteria.

[1080] An "emotion analysis engine" is a software engine that analyzes emotions from user input and behavior.

[1081] "Behavioral data" refers to the history of actions and choices made by users when using a system.

[1082] "Export" is the process of outputting data from a system as an external file.

[1083] Modes for carrying out the invention

[1084] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[1085] Server-side embodiment

[1086] The server first stores a list of website URLs in a database. Periodically, it performs web crawling based on this URL list to collect the latest data. The collected data is analyzed using a natural language processing engine to extract summaries and key information. The extracted information is then stored back in the database for later access by users. This entire process utilizes the BERT model as the natural language processing engine.

[1087] Terminal-side embodiment

[1088] The device provides a web portal that users can access. This portal includes login, search, and filtering functions, and is designed to allow users to easily access information. The user interface is intuitive, allowing users to quickly find information of interest by entering keywords into the search bar. The information searched by the user is retrieved in conjunction with the server, and the analyzed information is displayed in an easy-to-understand manner.

[1089] User-side embodiment

[1090] Users access the web portal using a web browser and log in. By entering a specific keyword (for example, "change pricing plan") into the search bar and clicking the search button, relevant information will be displayed. The displayed information can also be exported in PDF or CSV format.

[1091] Embodiment of an Emotion Engine

[1092] The emotion engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. Based on this emotion information, the system adjusts and suggests the information displayed. For example, if it determines that the user is in a hurry, it prioritizes displaying important information. Furthermore, the emotion information is stored in a database and used later to improve the system. This functionality enables continuous improvement of the user experience.

[1093] Specific example

[1094] When a user of an electronic payment service searches for the "latest cashback campaign," they will enter a prompt similar to the following:

[1095] Example prompt:

[1096] Latest cashback campaign

[1097] The system processes this query in the following steps:

[1098] 1. A search request is sent from the client terminal to the server.

[1099] 2. The server retrieves the latest relevant information from the database and sends the summarized results to the client terminal.

[1100] 3. The client terminal displays the results, allowing the user to quickly find the necessary information based on the sentiment analysis.

[1101] 4. If the information is satisfactory, users can download and use it in PDF format.

[1102] In this way, by realizing optimal information provision and export functions based on user emotions and behavior, it is possible to solve conventional problems and improve the user experience.

[1103] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1104] Step 1:

[1105] The server stores a list of website URLs in a database. This list includes pre-collected URLs of competitors and is updated periodically. It takes a URL list as input and saves it to the database. The output is the saved URL list.

[1106] Step 2:

[1107] The server periodically crawls based on the stored URL list to collect the latest data. Specifically, it takes the URL list as input, collects the HTML data of each website, and stores it locally. The output is the collected HTML data.

[1108] Step 3:

[1109] The server analyzes the collected HTML data using a natural language processing engine (e.g., the BERT model) to extract a summary and key information. It receives HTML data as input, performs natural language processing, and generates a summary and key information. The output is the extracted summary and key information.

[1110] Step 4:

[1111] The server stores the extracted summary and key information in JSON format in the database. The input is the summary and key information, which is then processed to save it to the database in the appropriate format. The output is the saved data.

[1112] Step 5:

[1113] The user accesses the web portal using their device. The user logs in and enters a specific keyword (e.g., "latest cashback campaigns") into the search bar. The input is the user's search query, and a search request is generated based on this. The output is the search request.

[1114] Step 6:

[1115] The server receives a search request from the terminal and searches the database for relevant information. The input is the search request; the server retrieves relevant information from the database and returns it as a summarized result. The output is the search result.

[1116] Step 7:

[1117] The terminal analyzes the search results received from the server and displays them in a user-friendly format. The input is the search results, and the user interface displays information based on these results. The output is the displayed information.

[1118] Step 8:

[1119] An emotion analysis engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. The input is user behavior data, which is then analyzed to generate emotion information. The output is this emotion information.

[1120] Step 9:

[1121] The emotion analysis engine optimizes the information displayed by the system based on the recognized emotion information. For example, if it determines that the user is in a hurry, it prioritizes displaying important information. The input is emotion information, and the displayed information is adjusted based on that. The output is the adjusted information display.

[1122] Step 10:

[1123] Users can export the displayed information. Specifically, a function is provided to download the information on the device in PDF or CSV format. The input is the displayed information, which is then exported in the format selected by the user. The output is the exported data.

[1124] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1125] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1126] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1127] [Third Embodiment]

[1128] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1129] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1130] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1131] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1132] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1133] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1134] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1135] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1136] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1137] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1138] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1139] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1140] The system according to the present invention consists of three main entities: a server, a terminal, and a user. The processes in which each entity is involved are described below.

[1141] Server-side embodiment

[1142] 1. Obtain the URL list

[1143] The server periodically retrieves a list of competitors' website URLs stored in its database. This ensures that it is always prepared to keep up with the latest information.

[1144] 2. Website crawling

[1145] The server executes a web crawler based on the retrieved URL list and collects the latest data from the specified websites. For example, the Python BeautifulSoup library can be used for this.

[1146] 3. Data Extraction

[1147] This involves analyzing web pages obtained through crawling and extracting important information (e.g., pricing plans, update information, etc.). For example, it can analyze a specific section of HTML to extract the desired data.

[1148] 4. Analysis using natural language processing

[1149] The server passes the collected data to a natural language processing engine to extract summaries and key keywords. For example, the BERT model from the Transformers library can be used for this purpose.

[1150] 5. Data Storage

[1151] The analyzed data is stored in a database in JSON format, allowing for efficient access from devices.

[1152] Terminal-side embodiment

[1153] 1. Provision of a web portal

[1154] The device provides a web portal that users can access. This portal is built using, for example, the Django framework and provides user login and search functions.

[1155] 2. User Interface Design

[1156] The device provides a search bar and filtering options to make it easier for users to find information. This allows users to quickly find the information they need.

[1157] 3. Data Acquisition and Display

[1158] The terminal sends a search query to the server and displays the retrieved data to the user. Using HTML and JavaScript, the data is displayed in a visually easy-to-understand format.

[1159] User-side embodiment

[1160] 1. Access to the web portal

[1161] Users access the web portal using a web browser and log in. This grants them permissions to use the system.

[1162] 2. Information Search

[1163] Users enter specific keywords or the names of competitors into the search bar and perform a search. For example, by typing "change pricing plan," they can quickly find relevant information.

[1164] 3. Viewing the results

[1165] Users click on search results to view more detailed information, including summaries of competitors' pricing plans, the latest updates, and user reviews.

[1166] 4. Export information

[1167] Users can export information as needed. For example, they can save it as a PDF file for use in meeting materials.

[1168] Specific example

[1169] 1. Server side

[1170] The server crawls the data from "example-competitor.com" every hour and saves the latest information to the database.

[1171] The crawled data is used to extract information on updated pricing plans, and key changes are saved as a summary.

[1172] 2. Device side

[1173] The web portal that users access displays a search bar and filtering options.

[1174] For example, if a user searches for "change pricing plan," a list of summary information retrieved from the server will be displayed.

[1175] 3. User side

[1176] The user searches for "change pricing plan" and discovers that the latest pricing plan for "example-competitor.com" has been changed.

[1177] Click the details page to see details about the new pricing plan and user reviews.

[1178] Export the necessary information to PDF and use it as meeting material.

[1179] The above describes a specific embodiment of the system of the present invention. By having the server, terminal, and user work in cooperation with each other, it is possible to efficiently collect and analyze information on competitors.

[1180] The following describes the processing flow.

[1181] Server-side processing steps

[1182] Step 1:

[1183] The server retrieves a list of competitors' website URLs from the database. This is a regularly scheduled process, updating the URL list, for example, every hour.

[1184] Step 2:

[1185] The server executes a web crawler based on the retrieved list of URLs. The web crawler accesses each website and retrieves HTML data.

[1186] Step 3:

[1187] The server parses the retrieved HTML data and extracts the necessary information. For example, it might use specific tags or class names to extract the pricing plan section.

[1188] Step 4:

[1189] The server passes the extracted information to a natural language processing engine to generate a summary and key keywords. This uses natural language processing libraries such as the BERT model.

[1190] Step 5:

[1191] The server saves the analyzed data to a database in JSON format. This allows terminals and users to access the data efficiently later.

[1192] Terminal-side processing steps

[1193] Step 1:

[1194] The device provides a web portal that users can access. This web portal includes login and search functions.

[1195] Step 2:

[1196] Through its user interface, the device provides a search bar and filtering options to make it easier for users to find information.

[1197] Step 3:

[1198] When a user enters a search query, the device sends that query to the server. An API call is then made to retrieve data from the server.

[1199] Step 4:

[1200] The terminal receives data returned from the server, parses it, and displays it to the user. The data is displayed in a visually easy-to-understand format using HTML and JavaScript.

[1201] User-side processing steps

[1202] Step 1:

[1203] Users access the web portal using a browser and log in. This grants them access rights to the system.

[1204] Step 2:

[1205] The user enters a specific keyword or the name of a competitor into the search bar and clicks the search button. For example, they might type "change pricing plan".

[1206] Step 3:

[1207] Users click on the displayed search results to view more detailed information, which includes summaries and updates on competitors' pricing plans.

[1208] Step 4:

[1209] Users can export information as needed. For example, they can download search results as a PDF and use them as meeting materials.

[1210] The above outlines the processing steps and specific actions for the server, terminal, and user. By proceeding through these steps, it becomes possible to efficiently collect, analyze, and provide information on competitors to the user.

[1211] (Example 1)

[1212] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1213] Traditional information gathering systems have the problem of being unable to efficiently collect, analyze, and summarize the latest information from competitors' websites. Furthermore, they lack the functionality to easily search, filter, display, and export the information users need. This results in low efficiency in information gathering and analysis, and a poor user experience.

[1214] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1215] In this invention, the server includes means for storing website identifiers in a database, means for periodically processing the stored list of identifiers to collect the latest information, and means for analyzing the collected information using a natural language processing device to extract summaries and important information. This streamlines the collection, analysis, and provision of information to users, enabling users to quickly obtain and export the information they need.

[1216] A "website identifier" is a string of characters or a code used to uniquely identify a website.

[1217] "Information gathering processing" is the process of obtaining data from a website based on a specified list of identifiers.

[1218] A "natural language processing unit" is a computer program or system used to analyze collected data and extract summaries and important information.

[1219] An "identifier list" is a list that compiles the identifiers of multiple websites.

[1220] A "summary" is information that extracts the most important parts from collected information and presents them in a short format.

[1221] "Important information" refers to data collected that is particularly noteworthy or useful to the user.

[1222] A "database" is a collection of information that is organized and stored in a way that allows it to be retrieved.

[1223] A "user interface" is the means by which a user interacts with a system and searches, filters, displays, and exports information.

[1224] "Exportable" means that the user can convert information within the system into an external format (e.g., PDF) and save or share it.

[1225] "Customizable according to user settings" means that the frequency of information collection and analysis, as well as other system operations, can be adjusted to suit the user's preferences.

[1226] This invention provides a system composed of three main entities: a server, a terminal, and a user. The processes in which each entity is involved are described below using specific hardware and software examples.

[1227] Server-side embodiment

[1228] 1. Obtain the URL list

[1229] The server periodically retrieves identifiers (URL lists) of competitors' websites from the database.

[1230] Hardware / software used: Server (e.g., AWS EC2), PostgreSQL database.

[1231] 2. Website crawling

[1232] Based on the acquired list of identifiers, the server runs a web crawler to collect the latest data from the specified website.

[1233] Hardware / software used: Server (e.g., AWS EC2), Python, BeautifulSoup library.

[1234] 3. Data Extraction

[1235] The server analyzes the crawled web pages and extracts important information such as pricing plans and update information.

[1236] Hardware / software used: Server (e.g., AWS EC2), Python, BeautifulSoup library.

[1237] 4. Analysis using natural language processing

[1238] The server passes the extracted data to a natural language processing engine (NLP engine) to extract a summary and key information.

[1239] Hardware / software used: Server (e.g., AWS EC2), Transformers library, BERT model.

[1240] 5. Data Storage

[1241] The server saves the analyzed data to the database in JSON format.

[1242] Hardware / software used: Server (e.g., AWS EC2), PostgreSQL database.

[1243] Terminal-side embodiment

[1244] 1. Provision of a web portal

[1245] The device provides a web portal that users can access. This portal includes login and search functions.

[1246] Hardware / software used: Client PC, Django framework, HTML, CSS.

[1247] 2. User Interface Design

[1248] The device designs the user interface and provides a search bar and filtering options to make it easier for users to find information.

[1249] Hardware / software used: Client PC, HTML, CSS.

[1250] 3. Data Acquisition and Display

[1251] The terminal sends a search query to the server and displays the retrieved data to the user.

[1252] Hardware / software used: Client PC, JavaScript, AJAX, HTML.

[1253] User-side embodiment

[1254] 1. Access to the web portal

[1255] Users access the web portal using a web browser and log in.

[1256] Hardware / software used: Client PC, web browser (e.g., Chrome, Firefox).

[1257] 2. Information Search

[1258] The user enters specific keywords or the names of competitors into the search bar and performs the search.

[1259] Specific example: Enter "change pricing plan" and perform a search.

[1260] 3. Viewing the results

[1261] Users click on search results to view more information, which includes a summary of pricing plans, new updates, and user reviews.

[1262] Hardware / software used: Client PC, web browser.

[1263] 4. Export information

[1264] Users can export information as needed.

[1265] Specific example: Export search results as a PDF.

[1266] Example of a prompt

[1267] "Use the BERT model to generate a summary of the pricing plans for the collected web pages."

[1268] "For the search query 'change pricing plan,' please extract and display the latest information from competitors."

[1269] The above describes a specific embodiment of the system of the present invention. By having the server, terminal, and user work in cooperation with each other, it is possible to efficiently collect and analyze information on competitors.

[1270] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1271] Step 1:

[1272] The server periodically retrieves identifiers (URL lists) of competitors' websites from the database.

[1273] Input: A list of competitor URLs stored in the database.

[1274] Data processing and calculations: Execute database queries and retrieve a list of URLs.

[1275] Output: List of retrieved URLs.

[1276] Specific operation: The server sends an SQL query to the PostgreSQL database to retrieve a list of competitor site identifiers.

[1277] Step 2:

[1278] The server executes the web crawler based on the retrieved list of URLs.

[1279] Input: The list of URLs obtained in Step 1.

[1280] Data processing and calculation: Based on the URL list, send HTTP requests to each website and retrieve the HTML content.

[1281] Output: Retrieved HTML content.

[1282] Specific operation: The server uses Python and the BeautifulSoup library to access each URL and retrieve the HTML data of the page.

[1283] Step 3:

[1284] The server analyzes the crawled HTML content and extracts important information.

[1285] Input: The HTML content obtained in Step 2.

[1286] Data processing and calculation: The BeautifulSoup library is used to parse the HTML structure and extract the desired information from specific tags and classes.

[1287] Output: Extracted information (e.g., pricing plan, update information).

[1288] Specific operation: The server uses BeautifulSoup to extract important data such as pricing plans and update information from each HTML document.

[1289] Step 4:

[1290] The server passes the extracted data to a natural language processing unit, which extracts a summary and key keywords.

[1291] Input: Information extracted in Step 3.

[1292] Data processing and calculation: Use the BERT model from the Transformers library to summarize text data and extract keywords.

[1293] Output: Summarized information and key keywords.

[1294] Specific operation: The extracted text data is fed into a BERT model to generate a concise summary and keywords.

[1295] Step 5:

[1296] The server saves the analyzed data to the database in JSON format.

[1297] Input: Summary information and keywords generated in Step 4.

[1298] Data processing and calculation: Convert summarized information and keywords into JSON format.

[1299] Output: Data in JSON format.

[1300] Specific operation: Format the summarized information and keywords as a JSON object and save it to a PostgreSQL database.

[1301] Step 6:

[1302] The device provides a web portal that users can access.

[1303] Input: Request to access a web portal.

[1304] Data processing and calculations: Generate a web portal using the Django framework.

[1305] Output: The login page of the web portal displayed to the user.

[1306] Specific operation: The terminal uses Django to build a web portal with login functionality and provides it to the user.

[1307] Step 7:

[1308] The device provides a search bar and filtering options to make it easier for users to find information.

[1309] Input: User's search request.

[1310] Data processing and calculation: Use HTML and CSS to implement a search bar and filtering functionality.

[1311] Output: Search bar and filtering options displayed in the user interface.

[1312] Specific operation: The device will use HTML and CSS to implement an intuitive search bar and detailed filtering functionality in its user interface.

[1313] Step 8:

[1314] The terminal sends a search query to the server and displays the retrieved data to the user.

[1315] Input: User's search query.

[1316] Data processing and calculation: Use JavaScript and AJAX to send search queries to the server and receive responses.

[1317] Output: Search results displayed to the user.

[1318] Specific operation: The device uses JavaScript and AJAX to send search queries to the server and displays the retrieved data to the user in real time.

[1319] Step 9:

[1320] Users access the web portal using a web browser and log in.

[1321] Input: User login information.

[1322] Data processing and calculation: Perform user authentication.

[1323] Output: User interface after successful authentication.

[1324] Specific operation: The user uses a web browser, enters their login information, and accesses the portal after going through the system's authentication process.

[1325] Step 10:

[1326] The user enters specific keywords or the names of competitors into the search bar and performs the search.

[1327] Input: A specific keyword or the name of a competitor.

[1328] Data processing and calculation: Process search queries and retrieve results.

[1329] Output: Related search results.

[1330] Specific action: The user enters "change pricing plan" into the search bar and performs a search.

[1331] Step 11:

[1332] Users click on search results to view more detailed information.

[1333] Input: Link to the search results.

[1334] Data processing / calculation: Displays detailed information about the linked page.

[1335] Output: Detailed information page.

[1336] Specific operation: The user clicks on a search result that interests them, is redirected to a details page, and then views the information.

[1337] Step 12:

[1338] Users can export information as needed.

[1339] Input: Export request.

[1340] Data processing and calculation: Convert information to a specified format (e.g., PDF).

[1341] Output: Exported information file.

[1342] Specific action: The user clicks the "Export" button and saves the information as a PDF.

[1343] (Application Example 1)

[1344] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1345] Current information gathering and analysis systems lack the ability to notify users in real time of new content and trend information from competitors, making it difficult to respond quickly to market changes. There is a need to resolve this issue and improve users' work efficiency by collecting and notifying them of trend information quickly and efficiently.

[1346] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1347] In this invention, the server includes means for storing website location information in an information storage area, means for periodically searching the stored location information list to collect the latest data, and means for analyzing the collected data using a natural language processing engine to extract summaries and important information. This enables means for notifying the user of the key points of the analyzed data using a remote notification device, and means for performing analysis and notification in real time.

[1348] "Website location information" refers to information that indicates the address (URL) or resource of a web page on the internet.

[1349] An "information storage area" refers to a database or memory device used to temporarily or permanently store collected and analyzed data.

[1350] "Exploration" refers to processes such as crawling and scraping that are performed to retrieve data from a specified website or list.

[1351] A "natural language processing engine" is a computer program or algorithm used to analyze collected data and extract summaries and important information.

[1352] A "user interface" is the interface that a user uses to access information storage and perform tasks such as searching and filtering.

[1353] A "remote notification device" is a device, including smartphones and smart glasses, that notifies users of analyzed information in real time.

[1354] "Analysis" is the process of extracting summaries and important information from collected data using a natural language processing engine.

[1355] "Notification" refers to the act of transmitting analyzed information to the user in real time.

[1356] The system according to this invention consists of three main entities: a server, a terminal, and a user. To specifically implement this invention, the following detailed description is provided.

[1357] Server-side embodiment

[1358] The server stores website location information in an information storage area. Specifically, it maintains a list of website URLs that are retrieved periodically. Next, it runs a web crawler based on the stored location information list to collect the latest data from the specified websites. The collected data is parsed using a natural language processing engine to extract summaries and important information. This utilizes, for example, the Requests and BeautifulSoup libraries in Python, as well as the BERT model from the Transformers library. The parsed data is stored in the information storage area in JSON format.

[1359] Terminal-side embodiment

[1360] The terminal provides a user interface accessible to the user. This user interface is designed to make it easy for the user to search for information and is built using, for example, the Django framework. The terminal sends search queries to the server and displays the retrieved data to the user in a visually easy-to-understand format. It also has the function of notifying the user of the key points of the analyzed data on a remote notification device, such as a smartphone or smart glasses.

[1361] User-side embodiment

[1362] Users access the user interface via a web browser or remote notification device and are granted system privileges upon logging in. Users enter specific keywords or competitor names into the search bar and perform searches. For example, by entering "latest pricing plans," they can quickly find relevant information. Furthermore, analyzed information is notified in real time, allowing users to instantly grasp new content and trend information from competitors.

[1363] Specific example

[1364] 1. Server side

[1365] The server crawls the data from "example-competitor.com" every hour and stores the latest information in the data storage area.

[1366] Extract updated pricing plan information from crawled data and save important changes as a summary.

[1367] 2. Device side

[1368] The web portal that users access displays a search bar and filtering options.

[1369] For example, if a user searches for "latest pricing plans," a summary of the information retrieved from the server will be displayed in a list. Furthermore, notifications will be sent to their smartphone or smart glasses.

[1370] 3. User side

[1371] The user searches for "latest pricing plans" and discovers that the latest pricing plans for "example-competitor.com" have changed.

[1372] Click the details page to see details about the new pricing plan and user reviews.

[1373] Export the necessary information to PDF and use it as meeting material.

[1374] Example of a prompt

[1375] "Please extract a content summary and key keywords from this website:"

[1376] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1377] Step 1:

[1378] The server stores website location information in an information storage area. This process involves saving information to a database based on a list of competitor URLs registered by the user. The input is a list of URLs registered by the user, and the output is these URLs stored in the information storage area.

[1379] Step 2:

[1380] The server periodically searches the stored list of location information to collect the latest data. This involves launching a web crawler and retrieving the latest HTML data from each URL. The input is a list of URLs stored in the information storage area, and the output is the retrieved HTML data.

[1381] Step 3:

[1382] The server analyzes the collected data using a natural language processing engine to extract summaries and key information. Specifically, it parses HTML using the BeautifulSoup library and generates summaries using the BERT model from the Transformers library. The input is the acquired HTML data, and the output is a summary and keywords.

[1383] Step 4:

[1384] The server stores the analyzed summary and key information in an information storage area. This involves storing the data in JSON format in the database. The input consists of the summary and keywords, and the output is the storage of this data in the information storage area.

[1385] Step 5:

[1386] The terminal provides a user interface that users can access. Built using the Django framework, it allows users to search for information after logging in. The input is the user's search query, and the output displays the corresponding summary information retrieved from the server.

[1387] Step 6:

[1388] The terminal notifies the user's remote notification device of the key points of the analyzed data. Specifically, it has the function of sending notifications to smartphones or smart glasses. The input is the analyzed data, and the output is a notification displayed on the user's device.

[1389] Step 7:

[1390] Users access the user interface using a web browser or remote notification device to search for and verify information. Specifically, this involves the user entering keywords and retrieving related information. The input is the keywords entered by the user, and the output displays relevant summaries and important information.

[1391] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1392] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[1393] Server-side embodiment

[1394] 1. Obtain the URL list

[1395] The server periodically retrieves a list of competitors' website URLs stored in a database. The database maintains the most up-to-date URL list and is updated at a specified frequency.

[1396] 2. Website crawling

[1397] The server executes a web crawler based on the acquired URL list, collecting the latest data from the specified websites. The crawler retrieves the HTML data of the web pages and saves it locally.

[1398] 3. Data Extraction and Analysis

[1399] The server analyzes the collected HTML data and extracts the necessary information (e.g., pricing plans and recent changes). This analysis uses a natural language processing engine to automatically generate summaries and key keywords.

[1400] 4. Data Storage

[1401] The extracted and analyzed data is stored in a database in JSON format. This database also includes an index for later access by users.

[1402] Terminal-side embodiment

[1403] 1. Provision of a web portal

[1404] The device provides a web portal that users can access. This portal includes login, search, and filtering functions, and is designed to allow users to easily access information.

[1405] 2. User Interface Design

[1406] The device provides an intuitive user interface that allows users to efficiently search for information. By entering keywords into the search bar, users can quickly find information that interests them.

[1407] 3. Data Acquisition and Display

[1408] The terminal receives the user's search query and sends a search request to the server. It then parses the results returned from the server and displays them to the user in an easy-to-understand format.

[1409] User-side embodiment

[1410] 1. Access to the web portal

[1411] Users access the web portal using a web browser and log in. This portal stores individual user account information.

[1412] 2. Information Search

[1413] The user enters a specific keyword (for example, "change pricing plan") into the search bar and clicks the search button. This displays relevant information.

[1414] 3. Viewing the results

[1415] Users select from a list of search results and view detailed information. The details page displays summarized information, updates, user reviews, and more.

[1416] 4. Export information

[1417] Users can export the displayed information. Export formats include PDF and CSV.

[1418] Embodiment of an Emotion Engine

[1419] 1. Analysis of emotions

[1420] The emotion engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. This emotion information is used to gain a deeper understanding of the user's intentions and state.

[1421] 2. Information Optimization

[1422] Based on the user's emotions, the system adjusts and suggests the information it displays. For example, it presents more relaxing content and simplified information to users who are feeling stressed.

[1423] 3. Recording emotional information

[1424] The recognized emotion information is stored in a database and used later for analysis and report generation. This information is used to continuously improve the user experience.

[1425] Specific example

[1426] 1. Server side

[1427] The server crawls data from "competitor-site.com" every hour to collect the latest pricing plan information.

[1428] The BERT model is used to generate a summary of the latest changes to pricing plans and store it in a database.

[1429] 2. Device side

[1430] The web portal displays a search bar and filtering options.

[1431] When a user searches for "change pricing plan," a list of relevant summary information is displayed.

[1432] 3. User side

[1433] Users can view detailed information about the latest pricing plan changes for "competitor-site.com" from the search results.

[1434] Download the necessary information as a PDF and use it as meeting material.

[1435] 4. Emotional Engine

[1436] The system analyzes the user's typing speed and patterns in the search bar, and if it determines that the user is in a hurry, it prioritizes displaying simplified information.

[1437] We will collect user sentiment data and use it to improve the system in the future.

[1438] The above describes a specific embodiment of the present invention. By having the server, terminal, user, and emotion engine work together, it is possible to efficiently collect and analyze information on competitors and provide the user with the most optimal information.

[1439] The following describes the processing flow.

[1440] Server-side processing steps

[1441] Step 1:

[1442] The server periodically retrieves a list of URLs of competitors' websites from its database. This URL list is stored on the server and is subject to crawling.

[1443] Step 2:

[1444] The server executes a web crawler based on a list of URLs. The web crawler accesses the specified websites and retrieves HTML data.

[1445] Step 3:

[1446] The server parses the retrieved HTML data and extracts important information based on specific tags and class names. For example, it might extract information about changes to pricing plans or new services.

[1447] Step 4:

[1448] The server passes the extracted data to a natural language processing engine to generate summaries and key keywords. Models such as BERT are used for this purpose.

[1449] Step 5:

[1450] The server stores the analyzed data in JSON format in the database. The JSON data is stored with indexes for efficient searching and post-processing.

[1451] Terminal-side processing steps

[1452] Step 1:

[1453] The device provides a web portal that users can access. This web portal includes login, search, and filtering functions.

[1454] Step 2:

[1455] Through its user interface, the device provides an intuitive interface that makes it easy for users to search for information. By entering keywords into the search bar, users can quickly find the information they need.

[1456] Step 3:

[1457] The terminal receives the user's search query and sends a search request to the server. It receives the response from the server and parses the search results.

[1458] Step 4:

[1459] The device displays the analyzed search results to the user. The data is displayed in a visually easy-to-understand format using HTML and JavaScript.

[1460] User-side processing steps

[1461] Step 1:

[1462] Users access the web portal using a web browser and log in. This grants them permission to access all functions within the system.

[1463] Step 2:

[1464] The user enters a specific keyword (e.g., "change pricing plan") into the search bar and clicks the search button. The user's search query is sent to the server for analysis.

[1465] Step 3:

[1466] Users click on the displayed search results to view more detailed information. This information includes summarized data, updates, and user reviews.

[1467] Step 4:

[1468] Users can export information as needed. Export formats such as PDF and CSV are available, which can be used for meeting materials and other purposes.

[1469] Emotion Engine Processing Steps

[1470] Step 1:

[1471] The emotion engine monitors user input and behavior and analyzes emotions. It collects data such as input speed, patterns, and click frequency.

[1472] Step 2:

[1473] The emotion engine determines the user's state based on analyzed emotional data. For example, it can recognize if the user is in a hurry or feeling stressed.

[1474] Step 3:

[1475] The emotion engine adjusts the information displayed based on the user's emotions. For example, it prioritizes displaying simplified information and relaxing content.

[1476] Step 4:

[1477] The emotion engine stores emotional data in a database, which is then used for analysis and report generation. This enables continuous improvement of the user experience.

[1478] The above outlines the specific processing steps for the server, terminal, user, and emotion engine. By processing at each of these steps, it is possible to efficiently collect and analyze competitor information and provide users with the most relevant information.

[1479] (Example 2)

[1480] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1481] In recent years, the importance of quickly and accurately collecting and analyzing information on competitors has been increasing. However, conventional information gathering systems lack the ability to effectively crawl large amounts of website data and quickly extract and provide necessary information to users. Furthermore, they are insufficient in optimizing information based on user sentiment and responding to individual needs. In addition, there were challenges such as the inability to export collected data and the difficulty in changing settings for data collection and analysis frequency.

[1482] In Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for storing website addresses in a database, means for periodically collecting the stored address list, means for analyzing the collected data using a natural language processing engine and extracting summaries and important information, means for storing the extracted summaries and important information in a database, means for searching, filtering, and displaying information in the database through a user interface, and means for analyzing user sentiment and optimizing displayed information. This enables the provision of optimized information. Furthermore, by adding means for allowing users to export the analyzed data, effective use of the collected data becomes possible. In addition, by adding means for changing the frequency of collection and analysis according to user settings, flexible system operation that meets user needs is realized.

[1483] A "website address" is a unique resource locator (URL) used to identify a specific webpage on the internet.

[1484] A "database" is an information system for efficiently storing, searching, and managing large amounts of data.

[1485] "Means of collection" refers to the collective term for software and hardware used to acquire data from specified resources.

[1486] A "natural language processing engine" is a general term for algorithms and models used by computers to understand and generate human language.

[1487] A "summary" is a short, concise compilation of the most important parts of collected information.

[1488] "Important information" refers to data that is beneficial to the user and essential for making decisions.

[1489] "User interface" is a general term for the screen display and means of operation that a user uses to interact with a system.

[1490] "Searching" is the act of finding information within a database based on specific criteria.

[1491] "Filtering" is the act of displaying only information that matches specific criteria from search results or datasets.

[1492] "Means of display" refers to technologies for outputting acquired information in a way that users can visually recognize.

[1493] "Means of analyzing emotions" refers to a general term for technologies and algorithms used to identify and evaluate emotions based on user behavior and input data.

[1494] "Means of optimizing information" refer to technologies that adjust the way information is displayed and its content based on the user's emotions and needs.

[1495] "Means of exporting" refers to technologies for outputting collected and analyzed data in other formats (e.g., PDF or CSV).

[1496] "Means for making the frequency of data collection and analysis configurable" refers to a function that adjusts the interval and timing of data collection and analysis based on user requests.

[1497] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[1498] ---

[1499] Server-side embodiment

[1500] Retrieving URL List

[1501] The server periodically retrieves a list of competitors' website addresses stored in a database (e.g., PostgreSQL). A Cron job is configured to update this list at regular intervals. This process uses SQL queries to retrieve the addresses and stores them in a Python list format.

[1502] Website crawling

[1503] The server uses Scrapy to run a web crawler based on the acquired address list, collecting the latest data from websites. It sends an HTTP request to each address and retrieves an HTML response. This data is saved to the local disk.

[1504] Data extraction and analysis

[1505] The collected HTML data is parsed using the BERT model as a natural language processing engine. BeautifulSoup is used to parse the HTML and extract important information (e.g., pricing plans and recent changes). After extraction, a summary and key keywords are generated and compiled in JSON format.

[1506] Data storage

[1507] The analyzed data is stored in a PostgreSQL database. This data is indexed to allow users to access it efficiently later.

[1508] Specific example:

[1509] The server crawls data from "competitor-site.com" every hour to collect the latest pricing plan information.

[1510] The BERT model is used to generate a summary of the latest changes to pricing plans and save it to the database in JSON format.

[1511] ---

[1512] Terminal-side embodiment

[1513] Web portal provision

[1514] The device provides a web portal that users can access. This portal is built with React.js and includes login, search, and filtering functions. Firebase Authentication is used for user authentication.

[1515] User interface design

[1516] The device provides intuitive UI components using Material-UI. It implements a real-time suggestion function based on keywords entered in the search bar.

[1517] Data acquisition and display

[1518] The device receives the user's search query and sends a request to the server using Axios. The returned JSON data is then visually displayed using React.js.

[1519] Specific example:

[1520] The web portal displays a search bar and filtering options.

[1521] When a user searches for "change pricing plan," a list of relevant summary information is displayed.

[1522] ---

[1523] User-side embodiment

[1524] Access to the web portal

[1525] Users access the web portal using a web browser such as Google Chrome and log in with the specified credentials.

[1526] Information Search

[1527] The user enters a specific keyword into the search bar and presses the Enter key to send a search request.

[1528] View results

[1529] Users select information of interest from a list of search results and view the details on the details page. Summary information and user reviews are displayed.

[1530] Export information

[1531] Users can download the displayed information in PDF or CSV format.

[1532] Specific example:

[1533] Users can view detailed information about the latest pricing plan changes for "competitor-site.com" from the search results.

[1534] Download the necessary information as a PDF and use it as meeting material.

[1535] ---

[1536] Embodiment of an Emotion Engine

[1537] Emotional analysis

[1538] The emotion engine analyzes user input and behavior to recognize user emotions. It monitors typing speed and browsing time and analyzes emotions using natural language processing algorithms.

[1539] Information optimization

[1540] The system customizes the displayed information based on the user's emotions. For users who are feeling stressed, simplified information is prioritized.

[1541] Recording of emotional information

[1542] The recognized emotion information is stored in a database and used later for analysis and report generation.

[1543] Specific example:

[1544] The system analyzes the user's typing speed and patterns in the search bar, and if it determines that the user is in a hurry, it prioritizes displaying simplified information.

[1545] We will collect user sentiment data and use it to improve the system in the future.

[1546] ---

[1547] Example of a prompt:

[1548] Please tell me about the changes to the pricing plan.

[1549] I want to check the latest developments of our competitors.

[1550] Please display a summary of this webpage.

[1551] The above describes a specific embodiment of the present invention. By having the server, terminal, user, and emotion engine work together, it is possible to efficiently collect and analyze information on competitors and provide the user with the most optimal information.

[1552] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1553] Step 1:

[1554] The server periodically retrieves a list of competitors' website addresses from a database. A PostgreSQL database is used for this purpose. The server uses a Cron job to execute SQL queries at regular intervals, retrieving the address list in Python list format. This allows the address list to be updated with the latest information.

[1555] Input: PostgreSQL database

[1556] Output: Address list (in Python list format)

[1557] Specific operation: Periodically execute an SQL query like SELECT FROM company_urls.

[1558] Step 2:

[1559] The server uses Scrapy to run a web crawler with the acquired address list as input, collecting the latest data from the specified websites. It sends an HTTP request to each address and saves the acquired HTML response to local disk.

[1560] Input: Address list (Output from Step 1)

[1561] Output: HTML data (saved to local disk)

[1562] Specific operation: Launch a custom crawler that extends Scrapy's Spider class and send an HTTP request to each address.

[1563] Step 3:

[1564] The server uses a natural language processing engine (BERT model) to analyze the collected HTML data as input and extract the necessary information (e.g., pricing plans and recent changes). BeautifulSoup is used to parse the HTML, extract important information, generate a summary, and compile it in JSON format.

[1565] Input: HTML data (Output from Step 2)

[1566] Output: Analysis result (JSON format)

[1567] Specific operation: Parse HTML using BeautifulSoup, and extract and summarize information using the BERT model.

[1568] Step 4:

[1569] The server saves the analyzed data as input to a PostgreSQL database. The analysis results are saved in JSON format and indexed for efficient later access.

[1570] Input: Analysis results (output from step 3)

[1571] Output: Data stored in the database

[1572] Specific operation: Execute an SQL query like INSERT INTO parsed_data (url, data) to save the data.

[1573] Step 5:

[1574] The device provides a web portal that users can access. User authentication (Firebase Authentication), search, and filtering functions are implemented through an interface created with React.js.

[1575] Input: User information, search query

[1576] Output: Interface (Web Portal)

[1577] Specific operation: Navigation is implemented using React Router, and UI components are provided using Material-UI.

[1578] Step 6:

[1579] Users access the web portal via a web browser and log in. They enter the specified credentials to be authenticated.

[1580] Input: Credentials (email address, password)

[1581] Output: Login session

[1582] Specific steps: Open a browser such as Google Chrome, enter the portal's URL, and go to the login page.

[1583] Step 7:

[1584] The user enters a specific keyword into the portal's search bar and presses the Enter key to submit a search request.

[1585] Input: Search query

[1586] Output: Search Results List

[1587] Specific steps: Enter keywords such as "change pricing plan" into the search bar and click the search button.

[1588] Step 8:

[1589] The terminal sends a request to the server using the search query as input and displays the analysis results obtained. The results are displayed in real time using technologies such as Ajax.

[1590] Input: Search query (Output from Step 7)

[1591] Output: Display of search results

[1592] Specific operation: Use Axios to send a request to the server via a REST API and display the returned JSON data.

[1593] Step 9:

[1594] Users select information of interest from a list of search results and view the details on the details page. Summary information and user reviews are displayed.

[1595] Input: Search Results List

[1596] Output: Detailed information display

[1597] Specific action: Click the link in the search results to go to the details page.

[1598] Step 10:

[1599] Users can download the displayed information in PDF or CSV format.

[1600] Input: Detailed information

[1601] Output: Export file (PDF, CSV)

[1602] Specific steps: Click the "Export" button, select the export format, and start the download.

[1603] Step 11:

[1604] The emotion engine analyzes user input and behavior to recognize user emotions. It monitors typing speed and browsing time to analyze emotions.

[1605] Input: User behavior data (typing speed, browsing time)

[1606] Output: Sentiment data

[1607] Specific operation: Analyze emotions using natural language processing algorithms.

[1608] Step 12:

[1609] The emotion engine customizes and optimizes displayed information based on the user's emotions.

[1610] Input: Emotional data (Output from Step 11)

[1611] Output: Optimized display information

[1612] Specific action: For users experiencing stress, prioritize displaying simplified information.

[1613] Step 13:

[1614] The emotion engine stores recognized emotion information in a database and uses it later for analysis and report generation.

[1615] Input: Emotional data (Output from Step 11)

[1616] Output: Sentiment information stored in the database

[1617] Specific action: Save emotion data to the database in JSON format.

[1618] The above outlines the specific processing steps of this system. Each process works in conjunction to efficiently collect and analyze information on competitors, enabling the provision of optimal information to users.

[1619] (Application Example 2)

[1620] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1621] Traditional data collection and analysis systems have the drawback of failing to optimize the user experience because they do not provide information based on user emotions and behavior. Furthermore, insufficient export of collected information and inadequate data analysis for system improvement hinder efficient information utilization.

[1622] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for storing website URLs in a database, means for periodically crawling the stored URL list to collect the latest data, means for analyzing the collected data using a natural language processing engine to extract summaries and important information, means for storing the extracted summaries and important information in a database, means for searching, filtering and displaying information in the database through a user interface, means including an emotion analysis engine that analyzes the user's emotions and optimizes the display of information based on them, and means for analyzing user behavior and emotion data and storing it in a database for future system improvements. This makes it possible to provide optimal information based on the user's emotions and behavior, and solves the problems of the past.

[1623] A "website URL" is a unique address used to access a specific webpage online.

[1624] A "database" is a structured collection of information that allows for the efficient storage, management, and retrieval of large amounts of data.

[1625] "Crawling" is the process of automatically visiting websites and collecting specific information.

[1626] A "natural language processing engine" is a software engine that analyzes human language data and extracts and summarizes its meaning.

[1627] A "summary" refers to a document that extracts the key points from a large amount of information and presents them in a concise format.

[1628] "User interface" refers to the screens and means of operation that users use to interact with a system.

[1629] "Searching" is the operation of finding specific information from a large amount of data.

[1630] "Filtering" is the process of narrowing down data based on specific criteria.

[1631] An "emotion analysis engine" is a software engine that analyzes emotions from user input and behavior.

[1632] "Behavioral data" refers to the history of actions and choices made by users when using a system.

[1633] "Export" is the process of outputting data from a system as an external file.

[1634] Modes for carrying out the invention

[1635] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[1636] Server-side embodiment

[1637] The server first stores a list of website URLs in a database. Periodically, it performs web crawling based on this URL list to collect the latest data. The collected data is analyzed using a natural language processing engine to extract summaries and key information. The extracted information is then stored back in the database for later access by users. This entire process utilizes the BERT model as the natural language processing engine.

[1638] Terminal-side embodiment

[1639] The device provides a web portal that users can access. This portal includes login, search, and filtering functions, and is designed to allow users to easily access information. The user interface is intuitive, allowing users to quickly find information of interest by entering keywords into the search bar. The information searched by the user is retrieved in conjunction with the server, and the analyzed information is displayed in an easy-to-understand manner.

[1640] User-side embodiment

[1641] Users access the web portal using a web browser and log in. By entering a specific keyword (for example, "change pricing plan") into the search bar and clicking the search button, relevant information will be displayed. The displayed information can also be exported in PDF or CSV format.

[1642] Embodiment of an Emotion Engine

[1643] The emotion engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. Based on this emotion information, the system adjusts and suggests the information displayed. For example, if it determines that the user is in a hurry, it prioritizes displaying important information. Furthermore, the emotion information is stored in a database and used later to improve the system. This functionality enables continuous improvement of the user experience.

[1644] Specific example

[1645] When a user of an electronic payment service searches for the "latest cashback campaign," they will enter a prompt similar to the following:

[1646] Example prompt:

[1647] Latest cashback campaign

[1648] The system processes this query in the following steps:

[1649] 1. A search request is sent from the client terminal to the server.

[1650] 2. The server retrieves the latest relevant information from the database and sends the summarized results to the client terminal.

[1651] 3. The client terminal displays the results, allowing the user to quickly find the necessary information based on the sentiment analysis.

[1652] 4. If the information is satisfactory, users can download and use it in PDF format.

[1653] In this way, by realizing optimal information provision and export functions based on user emotions and behavior, it is possible to solve conventional problems and improve the user experience.

[1654] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1655] Step 1:

[1656] The server stores a list of website URLs in a database. This list includes pre-collected URLs of competitors and is updated periodically. It takes a URL list as input and saves it to the database. The output is the saved URL list.

[1657] Step 2:

[1658] The server periodically crawls based on the stored URL list to collect the latest data. Specifically, it takes the URL list as input, collects the HTML data of each website, and stores it locally. The output is the collected HTML data.

[1659] Step 3:

[1660] The server analyzes the collected HTML data using a natural language processing engine (e.g., the BERT model) to extract a summary and key information. It receives HTML data as input, performs natural language processing, and generates a summary and key information. The output is the extracted summary and key information.

[1661] Step 4:

[1662] The server stores the extracted summary and key information in JSON format in the database. The input is the summary and key information, which is then processed to save it to the database in the appropriate format. The output is the saved data.

[1663] Step 5:

[1664] The user accesses the web portal using their device. The user logs in and enters a specific keyword (e.g., "latest cashback campaigns") into the search bar. The input is the user's search query, and a search request is generated based on this. The output is the search request.

[1665] Step 6:

[1666] The server receives a search request from the terminal and searches the database for relevant information. The input is the search request; the server retrieves relevant information from the database and returns it as a summarized result. The output is the search result.

[1667] Step 7:

[1668] The terminal analyzes the search results received from the server and displays them in a user-friendly format. The input is the search results, and the user interface displays information based on these results. The output is the displayed information.

[1669] Step 8:

[1670] An emotion analysis engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. The input is user behavior data, which is then analyzed to generate emotion information. The output is this emotion information.

[1671] Step 9:

[1672] The emotion analysis engine optimizes the information displayed by the system based on the recognized emotion information. For example, if it determines that the user is in a hurry, it prioritizes displaying important information. The input is emotion information, and the displayed information is adjusted based on that. The output is the adjusted information display.

[1673] Step 10:

[1674] Users can export the displayed information. Specifically, a function is provided to download the information on the device in PDF or CSV format. The input is the displayed information, which is then exported in the format selected by the user. The output is the exported data.

[1675] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1676] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1677] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1678] [Fourth Embodiment]

[1679] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1680] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1681] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1682] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1683] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1684] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1685] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1686] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1687] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1688] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1689] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1690] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1691] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1692] The system according to the present invention consists of three main entities: a server, a terminal, and a user. The processes in which each entity is involved are described below.

[1693] Server-side embodiment

[1694] 1. Obtain the URL list

[1695] The server periodically retrieves a list of competitors' website URLs stored in its database. This ensures that it is always prepared to keep up with the latest information.

[1696] 2. Website crawling

[1697] The server executes a web crawler based on the retrieved URL list and collects the latest data from the specified websites. For example, the Python BeautifulSoup library can be used for this.

[1698] 3. Data Extraction

[1699] This involves analyzing web pages obtained through crawling and extracting important information (e.g., pricing plans, update information, etc.). For example, it can analyze a specific section of HTML to extract the desired data.

[1700] 4. Analysis using natural language processing

[1701] The server passes the collected data to a natural language processing engine to extract summaries and key keywords. For example, the BERT model from the Transformers library can be used for this purpose.

[1702] 5. Data Storage

[1703] The analyzed data is stored in a database in JSON format, allowing for efficient access from devices.

[1704] Terminal-side embodiment

[1705] 1. Provision of a web portal

[1706] The device provides a web portal that users can access. This portal is built using, for example, the Django framework and provides user login and search functions.

[1707] 2. User Interface Design

[1708] The device provides a search bar and filtering options to make it easier for users to find information. This allows users to quickly find the information they need.

[1709] 3. Data Acquisition and Display

[1710] The terminal sends a search query to the server and displays the retrieved data to the user. Using HTML and JavaScript, the data is displayed in a visually easy-to-understand format.

[1711] User-side embodiment

[1712] 1. Access to the web portal

[1713] Users access the web portal using a web browser and log in. This grants them permissions to use the system.

[1714] 2. Information Search

[1715] Users enter specific keywords or the names of competitors into the search bar and perform a search. For example, by typing "change pricing plan," they can quickly find relevant information.

[1716] 3. Viewing the results

[1717] Users click on search results to view more detailed information, including summaries of competitors' pricing plans, the latest updates, and user reviews.

[1718] 4. Export information

[1719] Users can export information as needed. For example, they can save it as a PDF file for use in meeting materials.

[1720] Specific example

[1721] 1. Server side

[1722] The server crawls the data from "example-competitor.com" every hour and saves the latest information to the database.

[1723] The crawled data is used to extract information on updated pricing plans, and key changes are saved as a summary.

[1724] 2. Device side

[1725] The web portal that users access displays a search bar and filtering options.

[1726] For example, if a user searches for "change pricing plan," a list of summary information retrieved from the server will be displayed.

[1727] 3. User side

[1728] The user searches for "change pricing plan" and discovers that the latest pricing plan for "example-competitor.com" has been changed.

[1729] Click the details page to see details about the new pricing plan and user reviews.

[1730] Export the necessary information to PDF and use it as meeting material.

[1731] The above describes a specific embodiment of the system of the present invention. By having the server, terminal, and user work in cooperation with each other, it is possible to efficiently collect and analyze information on competitors.

[1732] The following describes the processing flow.

[1733] Server-side processing steps

[1734] Step 1:

[1735] The server retrieves a list of competitors' website URLs from the database. This is a regularly scheduled process, updating the URL list, for example, every hour.

[1736] Step 2:

[1737] The server executes a web crawler based on the retrieved list of URLs. The web crawler accesses each website and retrieves HTML data.

[1738] Step 3:

[1739] The server parses the retrieved HTML data and extracts the necessary information. For example, it might use specific tags or class names to extract the pricing plan section.

[1740] Step 4:

[1741] The server passes the extracted information to a natural language processing engine to generate a summary and key keywords. This uses natural language processing libraries such as the BERT model.

[1742] Step 5:

[1743] The server saves the analyzed data to a database in JSON format. This allows terminals and users to access the data efficiently later.

[1744] Terminal-side processing steps

[1745] Step 1:

[1746] The device provides a web portal that users can access. This web portal includes login and search functions.

[1747] Step 2:

[1748] Through its user interface, the device provides a search bar and filtering options to make it easier for users to find information.

[1749] Step 3:

[1750] When a user enters a search query, the device sends that query to the server. An API call is then made to retrieve data from the server.

[1751] Step 4:

[1752] The terminal receives data returned from the server, parses it, and displays it to the user. The data is displayed in a visually easy-to-understand format using HTML and JavaScript.

[1753] User-side processing steps

[1754] Step 1:

[1755] Users access the web portal using a browser and log in. This grants them access rights to the system.

[1756] Step 2:

[1757] The user enters a specific keyword or the name of a competitor into the search bar and clicks the search button. For example, they might type "change pricing plan".

[1758] Step 3:

[1759] Users click on the displayed search results to view more detailed information, which includes summaries and updates on competitors' pricing plans.

[1760] Step 4:

[1761] Users can export information as needed. For example, they can download search results as a PDF and use them as meeting materials.

[1762] The above outlines the processing steps and specific actions for the server, terminal, and user. By proceeding through these steps, it becomes possible to efficiently collect, analyze, and provide information on competitors to the user.

[1763] (Example 1)

[1764] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1765] Traditional information gathering systems have the problem of being unable to efficiently collect, analyze, and summarize the latest information from competitors' websites. Furthermore, they lack the functionality to easily search, filter, display, and export the information users need. This results in low efficiency in information gathering and analysis, and a poor user experience.

[1766] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1767] In this invention, the server includes means for storing website identifiers in a database, means for periodically processing the stored list of identifiers to collect the latest information, and means for analyzing the collected information using a natural language processing device to extract summaries and important information. This streamlines the collection, analysis, and provision of information to users, enabling users to quickly obtain and export the information they need.

[1768] A "website identifier" is a string of characters or a code used to uniquely identify a website.

[1769] "Information gathering processing" is the process of obtaining data from a website based on a specified list of identifiers.

[1770] A "natural language processing unit" is a computer program or system used to analyze collected data and extract summaries and important information.

[1771] An "identifier list" is a list that compiles the identifiers of multiple websites.

[1772] A "summary" is information that extracts the most important parts from collected information and presents them in a short format.

[1773] "Important information" refers to data collected that is particularly noteworthy or useful to the user.

[1774] A "database" is a collection of information that is organized and stored in a way that allows it to be retrieved.

[1775] A "user interface" is the means by which a user interacts with a system and searches, filters, displays, and exports information.

[1776] "Exportable" means that the user can convert information within the system into an external format (e.g., PDF) and save or share it.

[1777] "Customizable according to user settings" means that the frequency of information collection and analysis, as well as other system operations, can be adjusted to suit the user's preferences.

[1778] This invention provides a system composed of three main entities: a server, a terminal, and a user. The processes in which each entity is involved are described below using specific hardware and software examples.

[1779] Server-side embodiment

[1780] 1. Obtain the URL list

[1781] The server periodically retrieves identifiers (URL lists) of competitors' websites from the database.

[1782] Hardware / software used: Server (e.g., AWS EC2), PostgreSQL database.

[1783] 2. Website crawling

[1784] Based on the acquired list of identifiers, the server runs a web crawler to collect the latest data from the specified website.

[1785] Hardware / software used: Server (e.g., AWS EC2), Python, BeautifulSoup library.

[1786] 3. Data Extraction

[1787] The server analyzes the crawled web pages and extracts important information such as pricing plans and update information.

[1788] Hardware / software used: Server (e.g., AWS EC2), Python, BeautifulSoup library.

[1789] 4. Analysis using natural language processing

[1790] The server passes the extracted data to a natural language processing engine (NLP engine) to extract a summary and key information.

[1791] Hardware / software used: Server (e.g., AWS EC2), Transformers library, BERT model.

[1792] 5. Data Storage

[1793] The server saves the analyzed data to the database in JSON format.

[1794] Hardware / software used: Server (e.g., AWS EC2), PostgreSQL database.

[1795] Terminal-side embodiment

[1796] 1. Provision of a web portal

[1797] The device provides a web portal that users can access. This portal includes login and search functions.

[1798] Hardware / software used: Client PC, Django framework, HTML, CSS.

[1799] 2. User Interface Design

[1800] The device designs the user interface and provides a search bar and filtering options to make it easier for users to find information.

[1801] Hardware / software used: Client PC, HTML, CSS.

[1802] 3. Data Acquisition and Display

[1803] The terminal sends a search query to the server and displays the retrieved data to the user.

[1804] Hardware / software used: Client PC, JavaScript, AJAX, HTML.

[1805] User-side embodiment

[1806] 1. Access to the web portal

[1807] Users access the web portal using a web browser and log in.

[1808] Hardware / software used: Client PC, web browser (e.g., Chrome, Firefox).

[1809] 2. Information Search

[1810] The user enters specific keywords or the names of competitors into the search bar and performs the search.

[1811] Specific example: Enter "change pricing plan" and perform a search.

[1812] 3. Viewing the results

[1813] Users click on search results to view more information, which includes a summary of pricing plans, new updates, and user reviews.

[1814] Hardware / software used: Client PC, web browser.

[1815] 4. Export information

[1816] Users can export information as needed.

[1817] Specific example: Export search results as a PDF.

[1818] Example of a prompt

[1819] "Use the BERT model to generate a summary of the pricing plans for the collected web pages."

[1820] "For the search query 'change pricing plan,' please extract and display the latest information from competitors."

[1821] The above describes a specific embodiment of the system of the present invention. By having the server, terminal, and user work in cooperation with each other, it is possible to efficiently collect and analyze information on competitors.

[1822] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1823] Step 1:

[1824] The server periodically retrieves identifiers (URL lists) of competitors' websites from the database.

[1825] Input: A list of competitor URLs stored in the database.

[1826] Data processing and calculations: Execute database queries and retrieve a list of URLs.

[1827] Output: List of retrieved URLs.

[1828] Specific operation: The server sends an SQL query to the PostgreSQL database to retrieve a list of competitor site identifiers.

[1829] Step 2:

[1830] The server executes the web crawler based on the retrieved list of URLs.

[1831] Input: The list of URLs obtained in Step 1.

[1832] Data processing and calculation: Based on the URL list, send HTTP requests to each website and retrieve the HTML content.

[1833] Output: Retrieved HTML content.

[1834] Specific operation: The server uses Python and the BeautifulSoup library to access each URL and retrieve the HTML data of the page.

[1835] Step 3:

[1836] The server analyzes the crawled HTML content and extracts important information.

[1837] Input: The HTML content obtained in Step 2.

[1838] Data processing and calculation: The BeautifulSoup library is used to parse the HTML structure and extract the desired information from specific tags and classes.

[1839] Output: Extracted information (e.g., pricing plan, update information).

[1840] Specific operation: The server uses BeautifulSoup to extract important data such as pricing plans and update information from each HTML document.

[1841] Step 4:

[1842] The server passes the extracted data to a natural language processing unit, which extracts a summary and key keywords.

[1843] Input: Information extracted in Step 3.

[1844] Data processing and calculation: Use the BERT model from the Transformers library to summarize text data and extract keywords.

[1845] Output: Summarized information and key keywords.

[1846] Specific operation: The extracted text data is fed into a BERT model to generate a concise summary and keywords.

[1847] Step 5:

[1848] The server saves the analyzed data to the database in JSON format.

[1849] Input: Summary information and keywords generated in Step 4.

[1850] Data processing and calculation: Convert summarized information and keywords into JSON format.

[1851] Output: Data in JSON format.

[1852] Specific operation: Format the summarized information and keywords as a JSON object and save it to a PostgreSQL database.

[1853] Step 6:

[1854] The device provides a web portal that users can access.

[1855] Input: Request to access a web portal.

[1856] Data processing and calculations: Generate a web portal using the Django framework.

[1857] Output: The login page of the web portal displayed to the user.

[1858] Specific operation: The terminal uses Django to build a web portal with login functionality and provides it to the user.

[1859] Step 7:

[1860] The device provides a search bar and filtering options to make it easier for users to find information.

[1861] Input: User's search request.

[1862] Data processing and calculation: Use HTML and CSS to implement a search bar and filtering functionality.

[1863] Output: Search bar and filtering options displayed in the user interface.

[1864] Specific operation: The device will use HTML and CSS to implement an intuitive search bar and detailed filtering functionality in its user interface.

[1865] Step 8:

[1866] The terminal sends a search query to the server and displays the retrieved data to the user.

[1867] Input: User's search query.

[1868] Data processing and calculation: Use JavaScript and AJAX to send search queries to the server and receive responses.

[1869] Output: Search results displayed to the user.

[1870] Specific operation: The device uses JavaScript and AJAX to send search queries to the server and displays the retrieved data to the user in real time.

[1871] Step 9:

[1872] Users access the web portal using a web browser and log in.

[1873] Input: User login information.

[1874] Data processing and calculation: Perform user authentication.

[1875] Output: User interface after successful authentication.

[1876] Specific operation: The user uses a web browser, enters their login information, and accesses the portal after going through the system's authentication process.

[1877] Step 10:

[1878] The user enters specific keywords or the names of competitors into the search bar and performs the search.

[1879] Input: A specific keyword or the name of a competitor.

[1880] Data processing and calculation: Process search queries and retrieve results.

[1881] Output: Related search results.

[1882] Specific action: The user enters "change pricing plan" into the search bar and performs a search.

[1883] Step 11:

[1884] Users click on search results to view more detailed information.

[1885] Input: Link to the search results.

[1886] Data processing / calculation: Displays detailed information about the linked page.

[1887] Output: Detailed information page.

[1888] Specific operation: The user clicks on a search result that interests them, is redirected to a details page, and then views the information.

[1889] Step 12:

[1890] Users can export information as needed.

[1891] Input: Export request.

[1892] Data processing and calculation: Convert information to a specified format (e.g., PDF).

[1893] Output: Exported information file.

[1894] Specific action: The user clicks the "Export" button and saves the information as a PDF.

[1895] (Application Example 1)

[1896] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1897] Current information gathering and analysis systems lack the ability to notify users in real time of new content and trend information from competitors, making it difficult to respond quickly to market changes. There is a need to resolve this issue and improve users' work efficiency by collecting and notifying them of trend information quickly and efficiently.

[1898] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1899] In this invention, the server includes means for storing website location information in an information storage area, means for periodically searching the stored location information list to collect the latest data, and means for analyzing the collected data using a natural language processing engine to extract summaries and important information. This enables means for notifying the user of the key points of the analyzed data using a remote notification device, and means for performing analysis and notification in real time.

[1900] "Website location information" refers to information that indicates the address (URL) or resource of a web page on the internet.

[1901] An "information storage area" refers to a database or memory device used to temporarily or permanently store collected and analyzed data.

[1902] "Exploration" refers to processes such as crawling and scraping that are performed to retrieve data from a specified website or list.

[1903] A "natural language processing engine" is a computer program or algorithm used to analyze collected data and extract summaries and important information.

[1904] A "user interface" is the interface that a user uses to access information storage and perform tasks such as searching and filtering.

[1905] A "remote notification device" is a device, including smartphones and smart glasses, that notifies users of analyzed information in real time.

[1906] "Analysis" is the process of extracting summaries and important information from collected data using a natural language processing engine.

[1907] "Notification" refers to the act of transmitting analyzed information to the user in real time.

[1908] The system according to this invention consists of three main entities: a server, a terminal, and a user. To specifically implement this invention, the following detailed description is provided.

[1909] Server-side embodiment

[1910] The server stores website location information in an information storage area. Specifically, it maintains a list of website URLs that are retrieved periodically. Next, it runs a web crawler based on the stored location information list to collect the latest data from the specified websites. The collected data is parsed using a natural language processing engine to extract summaries and important information. This utilizes, for example, the Requests and BeautifulSoup libraries in Python, as well as the BERT model from the Transformers library. The parsed data is stored in the information storage area in JSON format.

[1911] Terminal-side embodiment

[1912] The terminal provides a user interface accessible to the user. This user interface is designed to make it easy for the user to search for information and is built using, for example, the Django framework. The terminal sends search queries to the server and displays the retrieved data to the user in a visually easy-to-understand format. It also has the function of notifying the user of the key points of the analyzed data on a remote notification device, such as a smartphone or smart glasses.

[1913] User-side embodiment

[1914] Users access the user interface via a web browser or remote notification device and are granted system privileges upon logging in. Users enter specific keywords or competitor names into the search bar and perform searches. For example, by entering "latest pricing plans," they can quickly find relevant information. Furthermore, analyzed information is notified in real time, allowing users to instantly grasp new content and trend information from competitors.

[1915] Specific example

[1916] 1. Server side

[1917] The server crawls the data from "example-competitor.com" every hour and stores the latest information in the data storage area.

[1918] Extract updated pricing plan information from crawled data and save important changes as a summary.

[1919] 2. Device side

[1920] The web portal that users access displays a search bar and filtering options.

[1921] For example, if a user searches for "latest pricing plans," a summary of the information retrieved from the server will be displayed in a list. Furthermore, notifications will be sent to their smartphone or smart glasses.

[1922] 3. User side

[1923] The user searches for "latest pricing plans" and discovers that the latest pricing plans for "example-competitor.com" have changed.

[1924] Click the details page to see details about the new pricing plan and user reviews.

[1925] Export the necessary information to PDF and use it as meeting material.

[1926] Example of a prompt

[1927] "Please extract a content summary and key keywords from this website:"

[1928] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1929] Step 1:

[1930] The server stores website location information in an information storage area. This process involves saving information to a database based on a list of competitor URLs registered by the user. The input is a list of URLs registered by the user, and the output is these URLs stored in the information storage area.

[1931] Step 2:

[1932] The server periodically searches the stored list of location information to collect the latest data. This involves launching a web crawler and retrieving the latest HTML data from each URL. The input is a list of URLs stored in the information storage area, and the output is the retrieved HTML data.

[1933] Step 3:

[1934] The server analyzes the collected data using a natural language processing engine to extract summaries and key information. Specifically, it parses HTML using the BeautifulSoup library and generates summaries using the BERT model from the Transformers library. The input is the acquired HTML data, and the output is a summary and keywords.

[1935] Step 4:

[1936] The server stores the analyzed summary and key information in an information storage area. This involves storing the data in JSON format in the database. The input consists of the summary and keywords, and the output is the storage of this data in the information storage area.

[1937] Step 5:

[1938] The terminal provides a user interface that users can access. Built using the Django framework, it allows users to search for information after logging in. The input is the user's search query, and the output displays the corresponding summary information retrieved from the server.

[1939] Step 6:

[1940] The terminal notifies the user's remote notification device of the key points of the analyzed data. Specifically, it has the function of sending notifications to smartphones or smart glasses. The input is the analyzed data, and the output is a notification displayed on the user's device.

[1941] Step 7:

[1942] Users access the user interface using a web browser or remote notification device to search for and verify information. Specifically, this involves the user entering keywords and retrieving related information. The input is the keywords entered by the user, and the output displays relevant summaries and important information.

[1943] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1944] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[1945] Server-side embodiment

[1946] 1. Obtain the URL list

[1947] The server periodically retrieves a list of competitors' website URLs stored in a database. The database maintains the most up-to-date URL list and is updated at a specified frequency.

[1948] 2. Website crawling

[1949] The server executes a web crawler based on the acquired URL list, collecting the latest data from the specified websites. The crawler retrieves the HTML data of the web pages and saves it locally.

[1950] 3. Data Extraction and Analysis

[1951] The server analyzes the collected HTML data and extracts the necessary information (e.g., pricing plans and recent changes). This analysis uses a natural language processing engine to automatically generate summaries and key keywords.

[1952] 4. Data Storage

[1953] The extracted and analyzed data is stored in a database in JSON format. This database also includes an index for later access by users.

[1954] Terminal-side embodiment

[1955] 1. Provision of a web portal

[1956] The device provides a web portal that users can access. This portal includes login, search, and filtering functions, and is designed to allow users to easily access information.

[1957] 2. User Interface Design

[1958] The device provides an intuitive user interface that allows users to efficiently search for information. By entering keywords into the search bar, users can quickly find information that interests them.

[1959] 3. Data Acquisition and Display

[1960] The terminal receives the user's search query and sends a search request to the server. It then parses the results returned from the server and displays them to the user in an easy-to-understand format.

[1961] User-side embodiment

[1962] 1. Access to the web portal

[1963] Users access the web portal using a web browser and log in. This portal stores individual user account information.

[1964] 2. Information Search

[1965] The user enters a specific keyword (for example, "change pricing plan") into the search bar and clicks the search button. This displays relevant information.

[1966] 3. Viewing the results

[1967] Users select from a list of search results and view detailed information. The details page displays summarized information, updates, user reviews, and more.

[1968] 4. Export information

[1969] Users can export the displayed information. Export formats include PDF and CSV.

[1970] Embodiment of an Emotion Engine

[1971] 1. Analysis of emotions

[1972] The emotion engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. This emotion information is used to gain a deeper understanding of the user's intentions and state.

[1973] 2. Information Optimization

[1974] Based on the user's emotions, the system adjusts and suggests the information it displays. For example, it presents more relaxing content and simplified information to users who are feeling stressed.

[1975] 3. Recording emotional information

[1976] The recognized emotion information is stored in a database and used later for analysis and report generation. This information is used to continuously improve the user experience.

[1977] Specific example

[1978] 1. Server side

[1979] The server crawls data from "competitor-site.com" every hour to collect the latest pricing plan information.

[1980] The BERT model is used to generate a summary of the latest changes to pricing plans and store it in a database.

[1981] 2. Device side

[1982] The web portal displays a search bar and filtering options.

[1983] When a user searches for "change pricing plan," a list of relevant summary information is displayed.

[1984] 3. User side

[1985] Users can view detailed information about the latest pricing plan changes for "competitor-site.com" from the search results.

[1986] Download the necessary information as a PDF and use it as meeting material.

[1987] 4. Emotional Engine

[1988] The system analyzes the user's typing speed and patterns in the search bar, and if it determines that the user is in a hurry, it prioritizes displaying simplified information.

[1989] We will collect user sentiment data and use it to improve the system in the future.

[1990] The above describes a specific embodiment of the present invention. By having the server, terminal, user, and emotion engine work together, it is possible to efficiently collect and analyze information on competitors and provide the user with the most optimal information.

[1991] The following describes the processing flow.

[1992] Server-side processing steps

[1993] Step 1:

[1994] The server periodically retrieves a list of URLs of competitors' websites from its database. This URL list is stored on the server and is subject to crawling.

[1995] Step 2:

[1996] The server executes a web crawler based on a list of URLs. The web crawler accesses the specified websites and retrieves HTML data.

[1997] Step 3:

[1998] The server parses the retrieved HTML data and extracts important information based on specific tags and class names. For example, it might extract information about changes to pricing plans or new services.

[1999] Step 4:

[2000] The server passes the extracted data to a natural language processing engine to generate summaries and key keywords. Models such as BERT are used for this purpose.

[2001] Step 5:

[2002] The server stores the analyzed data in JSON format in the database. The JSON data is stored with indexes for efficient searching and post-processing.

[2003] Terminal-side processing steps

[2004] Step 1:

[2005] The device provides a web portal that users can access. This web portal includes login, search, and filtering functions.

[2006] Step 2:

[2007] Through its user interface, the device provides an intuitive interface that makes it easy for users to search for information. By entering keywords into the search bar, users can quickly find the information they need.

[2008] Step 3:

[2009] The terminal receives the user's search query and sends a search request to the server. It receives the response from the server and parses the search results.

[2010] Step 4:

[2011] The device displays the analyzed search results to the user. The data is displayed in a visually easy-to-understand format using HTML and JavaScript.

[2012] User-side processing steps

[2013] Step 1:

[2014] Users access the web portal using a web browser and log in. This grants them permission to access all functions within the system.

[2015] Step 2:

[2016] The user enters a specific keyword (e.g., "change pricing plan") into the search bar and clicks the search button. The user's search query is sent to the server for analysis.

[2017] Step 3:

[2018] Users click on the displayed search results to view more detailed information. This information includes summarized data, updates, and user reviews.

[2019] Step 4:

[2020] Users can export information as needed. Export formats such as PDF and CSV are available, which can be used for meeting materials and other purposes.

[2021] Emotion Engine Processing Steps

[2022] Step 1:

[2023] The emotion engine monitors user input and behavior and analyzes emotions. It collects data such as input speed, patterns, and click frequency.

[2024] Step 2:

[2025] The emotion engine determines the user's state based on analyzed emotional data. For example, it can recognize if the user is in a hurry or feeling stressed.

[2026] Step 3:

[2027] The emotion engine adjusts the information displayed based on the user's emotions. For example, it prioritizes displaying simplified information and relaxing content.

[2028] Step 4:

[2029] The emotion engine stores emotional data in a database, which is then used for analysis and report generation. This enables continuous improvement of the user experience.

[2030] The above outlines the specific processing steps for the server, terminal, user, and emotion engine. By processing at each of these steps, it is possible to efficiently collect and analyze competitor information and provide users with the most relevant information.

[2031] (Example 2)

[2032] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2033] In recent years, the importance of quickly and accurately collecting and analyzing information on competitors has been increasing. However, conventional information gathering systems lack the ability to effectively crawl large amounts of website data and quickly extract and provide necessary information to users. Furthermore, they are insufficient in optimizing information based on user sentiment and responding to individual needs. In addition, there were challenges such as the inability to export collected data and the difficulty in changing settings for data collection and analysis frequency.

[2034] In Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for storing website addresses in a database, means for periodically collecting the stored address list, means for analyzing the collected data using a natural language processing engine and extracting summaries and important information, means for storing the extracted summaries and important information in a database, means for searching, filtering, and displaying information in the database through a user interface, and means for analyzing user sentiment and optimizing displayed information. This enables the provision of optimized information. Furthermore, by adding means for allowing users to export the analyzed data, effective use of the collected data becomes possible. In addition, by adding means for changing the frequency of collection and analysis according to user settings, flexible system operation that meets user needs is realized.

[2035] A "website address" is a unique resource locator (URL) used to identify a specific webpage on the internet.

[2036] A "database" is an information system for efficiently storing, searching, and managing large amounts of data.

[2037] "Means of collection" refers to the collective term for software and hardware used to acquire data from specified resources.

[2038] A "natural language processing engine" is a general term for algorithms and models used by computers to understand and generate human language.

[2039] A "summary" is a short, concise compilation of the most important parts of collected information.

[2040] "Important information" refers to data that is beneficial to the user and essential for making decisions.

[2041] "User interface" is a general term for the screen display and means of operation that a user uses to interact with a system.

[2042] "Searching" is the act of finding information within a database based on specific criteria.

[2043] "Filtering" is the act of displaying only information that matches specific criteria from search results or datasets.

[2044] "Means of display" refers to technologies for outputting acquired information in a way that users can visually recognize.

[2045] "Means of analyzing emotions" refers to a general term for technologies and algorithms used to identify and evaluate emotions based on user behavior and input data.

[2046] "Means of optimizing information" refer to technologies that adjust the way information is displayed and its content based on the user's emotions and needs.

[2047] "Means of exporting" refers to technologies for outputting collected and analyzed data in other formats (e.g., PDF or CSV).

[2048] "Means for making the frequency of data collection and analysis configurable" refers to a function that adjusts the interval and timing of data collection and analysis based on user requests.

[2049] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[2050] ---

[2051] Server-side embodiment

[2052] Retrieving URL List

[2053] The server periodically retrieves a list of competitors' website addresses stored in a database (e.g., PostgreSQL). A Cron job is configured to update this list at regular intervals. This process uses SQL queries to retrieve the addresses and stores them in a Python list format.

[2054] Website crawling

[2055] The server uses Scrapy to run a web crawler based on the acquired address list, collecting the latest data from websites. It sends an HTTP request to each address and retrieves an HTML response. This data is saved to the local disk.

[2056] Data extraction and analysis

[2057] The collected HTML data is parsed using the BERT model as a natural language processing engine. BeautifulSoup is used to parse the HTML and extract important information (e.g., pricing plans and recent changes). After extraction, a summary and key keywords are generated and compiled in JSON format.

[2058] Data storage

[2059] The analyzed data is stored in a PostgreSQL database. This data is indexed to allow users to access it efficiently later.

[2060] Specific example:

[2061] The server crawls data from "competitor-site.com" every hour to collect the latest pricing plan information.

[2062] The BERT model is used to generate a summary of the latest changes to pricing plans and save it to the database in JSON format.

[2063] ---

[2064] Terminal-side embodiment

[2065] Web portal provision

[2066] The device provides a web portal that users can access. This portal is built with React.js and includes login, search, and filtering functions. Firebase Authentication is used for user authentication.

[2067] User interface design

[2068] The device provides intuitive UI components using Material-UI. It implements a real-time suggestion function based on keywords entered in the search bar.

[2069] Data acquisition and display

[2070] The device receives the user's search query and sends a request to the server using Axios. The returned JSON data is then visually displayed using React.js.

[2071] Specific example:

[2072] The web portal displays a search bar and filtering options.

[2073] When a user searches for "change pricing plan," a list of relevant summary information is displayed.

[2074] ---

[2075] User-side embodiment

[2076] Access to the web portal

[2077] Users access the web portal using a web browser such as Google Chrome and log in with the specified credentials.

[2078] Information Search

[2079] The user enters a specific keyword into the search bar and presses the Enter key to send a search request.

[2080] View results

[2081] Users select information of interest from a list of search results and view the details on the details page. Summary information and user reviews are displayed.

[2082] Export information

[2083] Users can download the displayed information in PDF or CSV format.

[2084] Specific example:

[2085] Users can view detailed information about the latest pricing plan changes for "competitor-site.com" from the search results.

[2086] Download the necessary information as a PDF and use it as meeting material.

[2087] ---

[2088] Embodiment of an Emotion Engine

[2089] Emotional analysis

[2090] The emotion engine analyzes user input and behavior to recognize user emotions. It monitors typing speed and browsing time and analyzes emotions using natural language processing algorithms.

[2091] Information optimization

[2092] The system customizes the displayed information based on the user's emotions. For users who are feeling stressed, simplified information is prioritized.

[2093] Recording of emotional information

[2094] The recognized emotion information is stored in a database and used later for analysis and report generation.

[2095] Specific example:

[2096] The system analyzes the user's typing speed and patterns in the search bar, and if it determines that the user is in a hurry, it prioritizes displaying simplified information.

[2097] We will collect user sentiment data and use it to improve the system in the future.

[2098] ---

[2099] Example of a prompt:

[2100] Please tell me about the changes to the pricing plan.

[2101] I want to check the latest developments of our competitors.

[2102] Please display a summary of this webpage.

[2103] The above describes a specific embodiment of the present invention. By having the server, terminal, user, and emotion engine work together, it is possible to efficiently collect and analyze information on competitors and provide the user with the most optimal information.

[2104] The flow of the specific processing in Example 2 will be explained using Figure 13.

[2105] Step 1:

[2106] The server periodically retrieves a list of competitors' website addresses from a database. A PostgreSQL database is used for this purpose. The server uses a Cron job to execute SQL queries at regular intervals, retrieving the address list in Python list format. This allows the address list to be updated with the latest information.

[2107] Input: PostgreSQL database

[2108] Output: Address list (in Python list format)

[2109] Specific operation: Periodically execute an SQL query like SELECT FROM company_urls.

[2110] Step 2:

[2111] The server uses Scrapy to run a web crawler with the acquired address list as input, collecting the latest data from the specified websites. It sends an HTTP request to each address and saves the acquired HTML response to local disk.

[2112] Input: Address list (Output from Step 1)

[2113] Output: HTML data (saved to local disk)

[2114] Specific operation: Launch a custom crawler that extends Scrapy's Spider class and send an HTTP request to each address.

[2115] Step 3:

[2116] The server uses a natural language processing engine (BERT model) to analyze the collected HTML data as input and extract the necessary information (e.g., pricing plans and recent changes). BeautifulSoup is used to parse the HTML, extract important information, generate a summary, and compile it in JSON format.

[2117] Input: HTML data (Output from Step 2)

[2118] Output: Analysis result (JSON format)

[2119] Specific operation: Parse HTML using BeautifulSoup, and extract and summarize information using the BERT model.

[2120] Step 4:

[2121] The server saves the analyzed data as input to a PostgreSQL database. The analysis results are saved in JSON format and indexed for efficient later access.

[2122] Input: Analysis results (output from step 3)

[2123] Output: Data stored in the database

[2124] Specific operation: Execute an SQL query like INSERT INTO parsed_data (url, data) to save the data.

[2125] Step 5:

[2126] The device provides a web portal that users can access. User authentication (Firebase Authentication), search, and filtering functions are implemented through an interface created with React.js.

[2127] Input: User information, search query

[2128] Output: Interface (Web Portal)

[2129] Specific operation: Navigation is implemented using React Router, and UI components are provided using Material-UI.

[2130] Step 6:

[2131] Users access the web portal via a web browser and log in. They enter the specified credentials to be authenticated.

[2132] Input: Credentials (email address, password)

[2133] Output: Login session

[2134] Specific steps: Open a browser such as Google Chrome, enter the portal's URL, and go to the login page.

[2135] Step 7:

[2136] The user enters a specific keyword into the portal's search bar and presses the Enter key to submit a search request.

[2137] Input: Search query

[2138] Output: Search Results List

[2139] Specific steps: Enter keywords such as "change pricing plan" into the search bar and click the search button.

[2140] Step 8:

[2141] The terminal sends a request to the server using the search query as input and displays the analysis results obtained. The results are displayed in real time using technologies such as Ajax.

[2142] Input: Search query (Output from Step 7)

[2143] Output: Display of search results

[2144] Specific operation: Use Axios to send a request to the server via a REST API and display the returned JSON data.

[2145] Step 9:

[2146] Users select information of interest from a list of search results and view the details on the details page. Summary information and user reviews are displayed.

[2147] Input: Search Results List

[2148] Output: Detailed information display

[2149] Specific action: Click the link in the search results to go to the details page.

[2150] Step 10:

[2151] Users can download the displayed information in PDF or CSV format.

[2152] Input: Detailed information

[2153] Output: Export file (PDF, CSV)

[2154] Specific steps: Click the "Export" button, select the export format, and start the download.

[2155] Step 11:

[2156] The emotion engine analyzes user input and behavior to recognize user emotions. It monitors typing speed and browsing time to analyze emotions.

[2157] Input: User behavior data (typing speed, browsing time)

[2158] Output: Sentiment data

[2159] Specific operation: Analyze emotions using natural language processing algorithms.

[2160] Step 12:

[2161] The emotion engine customizes and optimizes displayed information based on the user's emotions.

[2162] Input: Emotional data (Output from Step 11)

[2163] Output: Optimized display information

[2164] Specific action: For users experiencing stress, prioritize displaying simplified information.

[2165] Step 13:

[2166] The emotion engine stores recognized emotion information in a database and uses it later for analysis and report generation.

[2167] Input: Emotional data (Output from Step 11)

[2168] Output: Sentiment information stored in the database

[2169] Specific action: Save emotion data to the database in JSON format.

[2170] The above outlines the specific processing steps of this system. Each process works in conjunction to efficiently collect and analyze information on competitors, enabling the provision of optimal information to users.

[2171] (Application Example 2)

[2172] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2173] Traditional data collection and analysis systems have the drawback of failing to optimize the user experience because they do not provide information based on user emotions and behavior. Furthermore, insufficient export of collected information and inadequate data analysis for system improvement hinder efficient information utilization.

[2174] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for storing website URLs in a database, means for periodically crawling the stored URL list to collect the latest data, means for analyzing the collected data using a natural language processing engine to extract summaries and important information, means for storing the extracted summaries and important information in a database, means for searching, filtering and displaying information in the database through a user interface, means including an emotion analysis engine that analyzes the user's emotions and optimizes the display of information based on them, and means for analyzing user behavior and emotion data and storing it in a database for future system improvements. This makes it possible to provide optimal information based on the user's emotions and behavior, and solves the problems of the past.

[2175] A "website URL" is a unique address used to access a specific webpage online.

[2176] A "database" is a structured collection of information that allows for the efficient storage, management, and retrieval of large amounts of data.

[2177] "Crawling" is the process of automatically visiting websites and collecting specific information.

[2178] A "natural language processing engine" is a software engine that analyzes human language data and extracts and summarizes its meaning.

[2179] A "summary" refers to a document that extracts the key points from a large amount of information and presents them in a concise format.

[2180] "User interface" refers to the screens and means of operation that users use to interact with a system.

[2181] "Searching" is the operation of finding specific information from a large amount of data.

[2182] "Filtering" is the process of narrowing down data based on specific criteria.

[2183] An "emotion analysis engine" is a software engine that analyzes emotions from user input and behavior.

[2184] "Behavioral data" refers to the history of actions and choices made by users when using a system.

[2185] "Export" is the process of outputting data from a system as an external file.

[2186] Modes for carrying out the invention

[2187] The system according to the present invention consists of three main entities: a server, a terminal, and a user, combined with an emotion engine that analyzes the user's emotions. The specific processes in which each entity is involved are described below.

[2188] Server-side embodiment

[2189] The server first stores a list of website URLs in a database. Periodically, it performs web crawling based on this URL list to collect the latest data. The collected data is analyzed using a natural language processing engine to extract summaries and key information. The extracted information is then stored back in the database for later access by users. This entire process utilizes the BERT model as the natural language processing engine.

[2190] Terminal-side embodiment

[2191] The device provides a web portal that users can access. This portal includes login, search, and filtering functions, and is designed to allow users to easily access information. The user interface is intuitive, allowing users to quickly find information of interest by entering keywords into the search bar. The information searched by the user is retrieved in conjunction with the server, and the analyzed information is displayed in an easy-to-understand manner.

[2192] User-side embodiment

[2193] Users access the web portal using a web browser and log in. By entering a specific keyword (for example, "change pricing plan") into the search bar and clicking the search button, relevant information will be displayed. The displayed information can also be exported in PDF or CSV format.

[2194] Embodiment of an Emotion Engine

[2195] The emotion engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. Based on this emotion information, the system adjusts and suggests the information displayed. For example, if it determines that the user is in a hurry, it prioritizes displaying important information. Furthermore, the emotion information is stored in a database and used later to improve the system. This functionality enables continuous improvement of the user experience.

[2196] Specific example

[2197] When a user of an electronic payment service searches for the "latest cashback campaign," they will enter a prompt similar to the following:

[2198] Example prompt:

[2199] Latest cashback campaign

[2200] The system processes this query in the following steps:

[2201] 1. A search request is sent from the client terminal to the server.

[2202] 2. The server retrieves the latest relevant information from the database and sends the summarized results to the client terminal.

[2203] 3. The client terminal displays the results, allowing the user to quickly find the necessary information based on the sentiment analysis.

[2204] 4. If the information is satisfactory, users can download and use it in PDF format.

[2205] In this way, by realizing optimal information provision and export functions based on user emotions and behavior, it is possible to solve conventional problems and improve the user experience.

[2206] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[2207] Step 1:

[2208] The server stores a list of website URLs in a database. This list includes pre-collected URLs of competitors and is updated periodically. It takes a URL list as input and saves it to the database. The output is the saved URL list.

[2209] Step 2:

[2210] The server periodically crawls based on the stored URL list to collect the latest data. Specifically, it takes the URL list as input, collects the HTML data of each website, and stores it locally. The output is the collected HTML data.

[2211] Step 3:

[2212] The server analyzes the collected HTML data using a natural language processing engine (e.g., the BERT model) to extract a summary and key information. It receives HTML data as input, performs natural language processing, and generates a summary and key information. The output is the extracted summary and key information.

[2213] Step 4:

[2214] The server stores the extracted summary and key information in JSON format in the database. The input is the summary and key information, which is then processed to save it to the database in the appropriate format. The output is the saved data.

[2215] Step 5:

[2216] The user accesses the web portal using their device. The user logs in and enters a specific keyword (e.g., "latest cashback campaigns") into the search bar. The input is the user's search query, and a search request is generated based on this. The output is the search request.

[2217] Step 6:

[2218] The server receives a search request from the terminal and searches the database for relevant information. The input is the search request; the server retrieves relevant information from the database and returns it as a summarized result. The output is the search result.

[2219] Step 7:

[2220] The terminal analyzes the search results received from the server and displays them in a user-friendly format. The input is the search results, and the user interface displays information based on these results. The output is the displayed information.

[2221] Step 8:

[2222] An emotion analysis engine analyzes user input and actions (e.g., search queries and clicks) to recognize the user's emotions. The input is user behavior data, which is then analyzed to generate emotion information. The output is this emotion information.

[2223] Step 9:

[2224] The emotion analysis engine optimizes the information displayed by the system based on the recognized emotion information. For example, if it determines that the user is in a hurry, it prioritizes displaying important information. The input is emotion information, and the displayed information is adjusted based on that. The output is the adjusted information display.

[2225] Step 10:

[2226] Users can export the displayed information. Specifically, a function is provided to download the information on the device in PDF or CSV format. The input is the displayed information, which is then exported in the format selected by the user. The output is the exported data.

[2227] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[2228] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2229] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[2230] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2231] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[2232] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[2233] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[2234] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[2235] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[2236] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[2237] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[2238] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[2239] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[2240] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2241] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[2242] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[2243] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[2244] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[2245] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[2246] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[2247] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[2248] The following is further disclosed regarding the embodiments described above.

[2249] (Claim 1)

[2250] A method for saving website URLs in a database,

[2251] A method for periodically crawling a saved list of URLs to collect the latest data,

[2252] A means for analyzing collected data using a natural language processing engine, and for summarizing and extracting important information,

[2253] Means for storing extracted summaries and important information in a database,

[2254] A system that includes means for searching, filtering, and displaying information within a database through a user interface.

[2255] (Claim 2)

[2256] The system according to claim 1, further comprising means for enabling the user to export the analyzed data described above.

[2257] (Claim 3)

[2258] The system according to claim 1, further comprising means for changing the frequency of the above-mentioned crawling and analysis according to user settings.

[2259] "Example 1"

[2260] (Claim 1)

[2261] A means of storing website identifiers in a database,

[2262] A means of periodically collecting and processing information from a stored list of identifiers to gather the latest information,

[2263] A means for analyzing collected information using a natural language processing device, summarizing it, and extracting important information,

[2264] Means for storing extracted summaries and important information in a database,

[2265] A system that includes means for searching, filtering, and displaying information within a database through a user interface.

[2266] (Claim 2)

[2267] The system according to claim 1, further comprising means for enabling the user to export the analyzed data described above.

[2268] (Claim 3)

[2269] The system according to claim 1, further comprising means for changing the frequency of the above-mentioned information collection and analysis according to user settings.

[2270] "Application Example 1"

[2271] (Claim 1)

[2272] A means of storing website location information in an information storage area,

[2273] A means of periodically searching the saved list of location information to collect the latest data,

[2274] A means for analyzing collected data using a natural language processing engine, and for summarizing and extracting important information,

[2275] Means for storing extracted summaries and important information in an information storage area,

[2276] A means for searching, filtering, and displaying information within an information storage area through a user interface,

[2277] A means of notifying the user of the key points of the analyzed data using a remote notification device,

[2278] A system that includes means for real-time analysis and notification.

[2279] (Claim 2)

[2280] The system according to claim 1, further comprising means for enabling the user to export the analyzed data described above.

[2281] (Claim 3)

[2282] The system according to claim 1, further comprising means for changing the frequency of the above-mentioned exploration and analysis according to user settings.

[2283] "Example 2 of combining an emotion engine"

[2284] (Claim 1)

[2285] A means of storing website addresses in a database,

[2286] A means of periodically collecting the saved address list,

[2287] A means for analyzing collected data using a natural language processing engine, and for summarizing and extracting important information,

[2288] Means for storing extracted summaries and important information in a database,

[2289] A means of searching, filtering, and displaying information within a database through a user interface,

[2290] A system that includes means for analyzing user emotions and optimizing displayed information.

[2291] (Claim 2)

[2292] The system according to claim 1, further comprising means for enabling the user to export the analyzed data described above.

[2293] (Claim 3)

[2294] The system according to claim 1, further comprising means for changing the frequency of the above-mentioned collection and analysis according to user settings.

[2295] "Application example 2 when combining with an emotional engine"

[2296] (Claim 1)

[2297] A method for saving website URLs in a database,

[2298] A method for periodically crawling a saved list of URLs to collect the latest data,

[2299] A means for analyzing collected data using a natural language processing engine, and for summarizing and extracting important information,

[2300] Means for storing extracted summaries and important information in a database,

[2301] A means of searching, filtering, and displaying information within a database through a user interface,

[2302] A means including an emotion analysis engine that analyzes the user's emotions and optimizes the display of information based on that analysis,

[2303] A system that includes means for analyzing user behavior and emotional data and storing it in a database for future system improvements.

[2304] (Claim 2)

[2305] The system according to claim 1, further comprising means for enabling the user to export the analyzed data described above.

[2306] (Claim 3)

[2307] The system according to claim 1, further comprising means for changing the frequency of the above-mentioned crawling and analysis according to user settings. [Explanation of Symbols]

[2308] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A method for saving website URLs in a database, A method for periodically crawling a saved list of URLs to collect the latest data, A means for analyzing collected data using a natural language processing engine and extracting summaries and important information, Means for storing extracted summaries and important information in a database, A system that includes means for searching, filtering, and displaying information within a database through a user interface.

2. The system according to claim 1, further comprising means for enabling the user to export the analyzed data described above.

3. The system according to claim 1, further comprising means for changing the frequency of the above-mentioned crawling and analysis according to user settings.

Images