system

Abstract

We provide the system. [Solution] Web scraping means, A database means for organizing and storing the data collected by that web scraping method, An interface means for receiving queries from users, A means of filtering relevant information from the database based on that query, A means of analyzing filtered information and providing it to the user, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The present invention relates to a research system aimed at improving the results of mobile sales. Conventionally, the work of separately collecting and analyzing information such as neighboring commercial facility information, event information, school events, and enhanced product information of home appliance manufacturers has been very laborious and inefficient. Therefore, there has been a demand for a system that can integrally collect information, organize and analyze it, and provide necessary information to users.

Means for Solving the Problems

[0005] To solve the above problems, the present invention provides the following means. First, it automatically collects information on nearby commercial facilities, events, school events, and enhanced product information from home appliance manufacturers using web scraping means. Next, it provides a database means for organizing and storing the collected data. Furthermore, it provides an interface means for receiving queries from users and means for filtering relevant information from the database based on those queries. Finally, it provides means for analyzing the filtered information and providing it to the user, thereby realizing a system that can efficiently provide information.

[0006] "Web scraping" refers to a method or tool for automatically collecting information from websites on the internet.

[0007] A "database means" is a system or storage for organizing and saving collected information.

[0008] An "interface means" is a means of communication between the user and the system for receiving queries and inputs from the user.

[0009] A "filtering method" is a process or function that extracts relevant information from a database based on specified conditions.

[0010] "Analysis methods" refer to techniques or tools that analyze filtered information to derive useful insights and results for the user. [Brief explanation of the drawing]

[0011] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0012] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0013] First, let's explain the terminology used in the following explanation.

[0014] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0015] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0016] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs, various parameters, and the like. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0017] In the following embodiments, the numbered communication I / F (Interface) is an interface including a communication processor, an antenna, and the like. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0019] [First Embodiment]

[0020] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0021] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0022] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0023] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0024] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0026] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0027] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0028] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0029] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0030] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0031] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0032] The research system according to the present invention aims to improve mobile phone sales performance by efficiently collecting, organizing, and analyzing information, and providing useful information to users. The core components of this system include web scraping means, database means, interface means, filtering means, and analysis means.

[0033] 1. Web scraping methods

[0034] The server uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. This allows for the constant acquisition of the latest information in a centralized manner.

[0035] 2. Database means

[0036] The server organizes and stores the collected data in a database. This database enables highly efficient data management by separating and storing information by category. For example, it might be divided into categories such as commercial facility information, event information, and product information.

[0037] 3. Interface means

[0038] The terminal provides an interface for receiving queries (requests) from users. Users enter queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[0039] 4. Filtering means

[0040] The server filters the information in the database based on user queries received through the interface. This filtering process allows the server to extract only the specific information the user needs. For example, it can extract only event information scheduled for the "next month."

[0041] 5. Analysis tools

[0042] The server analyzes the filtered information in detail to derive useful insights and results. This analysis makes it possible to provide users with highly valuable information.

[0043] Specific example

[0044] For example, if a user enters "I want to know about events happening in my neighborhood next month" into their device, the device sends this request to the server. The server filters the database for events in the "next month" and analyzes the details of the collected events (e.g., event name, date, location, etc.). The server then sends the analysis results to the device, which provides the information to the user in the following format:

[0045] Event Information:

[0046] 1. Commercial facility A: Summer festival (July 15th)

[0047] 2. Elementary School B: Sports day (July 21st)

[0048] In this way, users can quickly obtain the information they need, which helps improve mobile phone sales performance. Similarly, information on notable products from consumer electronics manufacturers is collected, filtered, and analyzed, and then provided to users. This system allows users to effectively plan promotional activities and sales strategies.

[0049] The above describes the embodiments for carrying out the present invention. This system solves the problem of improving mobile phone sales performance through efficient information collection and provision.

[0050] The following describes the processing flow.

[0051] Step 1:

[0052] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. Specifically, it retrieves HTML data from specified URLs and extracts the necessary information (e.g., event name, date, and location).

[0053] Step 2:

[0054] The server organizes the collected data by category. For example, it separates it into commercial facility information, event information, and product information, and stores each type of data in a database. This organization allows for more efficient filtering and analysis later on.

[0055] Step 3:

[0056] The user uses the terminal to enter a query to search for information. For example, they might enter, "I want to know about events happening in my neighborhood next month."

[0057] Step 4:

[0058] The terminal sends user queries to the server. These queries are then converted into a format that can be processed directly by the server.

[0059] Step 5:

[0060] The server searches the database for information based on the received query. For example, it might filter for event information scheduled for the next month. This filtering process extracts records that match the query criteria.

[0061] Step 6:

[0062] The server further analyzes the filtered information to derive useful insights and results. For example, it organizes the extracted event information to find the most relevant information.

[0063] Step 7:

[0064] The server sends the analysis results to the terminal. For example, it might create a list of events scheduled for the following month and return it to the terminal.

[0065] Step 8:

[0066] The device displays the received information in a format that is easy for the user to understand. For example, the user can view event information in the following format:

[0067] Event Information:

[0068] 1. Commercial facility A: Summer festival (July 15th)

[0069] 2. Elementary School B: Sports day (July 21st)

[0070] Step 9:

[0071] Users use the provided information to plan their mobile sales strategies and promotional activities. Specifically, this includes preparing campaigns and exhibitions tailored to events.

[0072] As described above, this system supports users in improving their mobile phone sales performance through efficient information gathering and provision.

[0073] (Example 1)

[0074] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0075] Conventional information gathering systems lack efficiency at each stage of data collection, organization, filtering, and analysis, making it difficult for users to quickly and accurately obtain the necessary information, especially when the goal is to improve mobile phone sales performance. Furthermore, the collection and analysis of information in specific categories, such as event information and consumer electronics information, is not sufficiently automated, resulting in a heavy reliance on manual work. In contrast, the present invention aims to solve these problems and to make the process from information collection to analysis efficient and automated.

[0076] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0077] In this invention, the server includes means for automatically collecting information from the internet, means for organizing and storing the collected data, means for receiving inquiries from users, means for selecting relevant information from the information storage means based on the inquiries, and means for analyzing the selected information and providing it to the user. This makes it possible to efficiently and automatically collect, organize, filter, and analyze data, and to quickly provide useful information to users.

[0078] "Means of automatically collecting information from the Internet" refers to software or scripts used to automatically collect specific information from multiple websites on the Internet.

[0079] "Information storage means for organizing and saving collected data" refers to database systems and storage systems for classifying collected data and saving it in an appropriate format.

[0080] A "means of receiving inquiries from users" refers to an interface where users enter queries to search for specific information, allowing the server to receive user requests.

[0081] "Means for selecting relevant information from information storage means" refers to algorithms and filtering functions for searching data within information storage means based on user queries and extracting relevant data.

[0082] "Information processing means for analyzing selected information and providing it to users" refers to analytical software or data processing systems that analyze selected information in detail and provide the results to users.

[0083] The research system according to the present invention aims to improve mobile phone sales performance by efficiently collecting, organizing, and analyzing information and providing useful information to users. The core components of this system include means for automatically collecting information from the internet, information storage means for organizing and saving the collected data, inquiry means for receiving inquiries from users, means for selecting relevant information from the information storage means, and information processing means for analyzing the selected information and providing it to users.

[0084] A method for automatically collecting information from the internet

[0085] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect information on commercial facilities, events, school events, and home appliances from various websites on the internet. For example, it can retrieve the latest event information from specific news sites or blogs.

[0086] Information storage means for organizing and saving collected data

[0087] The server uses MySQL® or PostgreSQL to organize and store the collected data in a database. This database stores information separately by category, enabling efficient data management. For example, it can be categorized into categories such as commercial facility information, event information, and product information.

[0088] Inquiry method for receiving inquiries from users

[0089] The terminal provides an interface for receiving user queries using HTML / CSS and JavaScript (registered trademark). Users enter queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[0090] Means for selecting relevant information from information storage means

[0091] The server filters the information in the database based on the user's query. For example, to extract only event information related to "next month," it uses an SQL query to retrieve the necessary records.

[0092] Information processing means that analyzes selected information and provides it to the user.

[0093] The server analyzes the filtered data in detail using Python's Pandas and NumPy libraries. For example, it derives insights such as the popularity of an event and the optimality of its venue. The analysis results are then formatted and presented to the user in an easy-to-understand format.

[0094] Specific example

[0095] For example, if a user enters "I want to know about events scheduled to be held in my neighborhood next month" on their device, the process will proceed as follows:

[0096] 1. The user enters the query using the terminal interface.

[0097] 2. The terminal sends the entered query to the server.

[0098] 3. The server collects the necessary data from the internet using web scraping tools (such as BeautifulSoup or Scrapy).

[0099] 4. The server stores the collected data in MySQL or PostgreSQL.

[0100] 5. The server uses SQL queries to filter event information for the "next month" from the database.

[0101] 6. The server analyzes the filtered data using Pandas and derives the necessary insights.

[0102] 7. The server sends the analysis results to the terminal.

[0103] 8. The terminal provides information to the user in the following format:

[0104] Event Information:

[0105] 1. Commercial facility A: Summer festival (July 15th)

[0106] 2. Elementary School B: Sports day (July 21st)

[0107] This system allows users to quickly obtain the information they need, which in turn contributes to improving mobile phone sales performance.

[0108] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0109] The specific processing flow of the program

[0110] Step 1: User query input

[0111] The terminal provides an interface for the user to input information. The user enters a query such as, "I want to know about events scheduled to be held in my neighborhood next month." This query constitutes the input data.

[0112] Input: The query that the user enters into the terminal interface.

[0113] Data processing: Convert user queries into HTTP request format.

[0114] Output: Generates an HTTP request to the server.

[0115] Step 2: Received the request

[0116] The terminal sends the entered query to the server. The query is sent in HTTP request format.

[0117] Input: HTTP request containing a user query

[0118] Data processing: Parsing HTTP requests and extracting data.

[0119] Output: Query data parsed on the server

[0120] Step 3: Data Collection (Web Scraping)

[0121] The server uses web scraping tools such as BeautifulSoup and Scrapy to collect information from the internet. For example, it might retrieve event information from specific news sites or blogs.

[0122] Input: User query passed to the server

[0123] Data processing: Information gathering through web scraping

[0124] Output: Collected raw data

[0125] Step 4: Data storage (database)

[0126] The server organizes and stores the collected data in a database running MySQL or PostgreSQL. The database stores the information categorized by type.

[0127] Input: Collected raw data

[0128] Data processing: Data organization and categorization

[0129] Output: Save to an organized database

[0130] Step 5: Data Filtering

[0131] The server filters information in the database based on the user's query. For example, it extracts information related to "next month" using an SQL query.

[0132] Input: Information stored in the database and user queries

[0133] Data Calculation: Data Extraction using SQL Queries

[0134] Output: Filtered dataset

[0135] Step 6: Data Analysis

[0136] The server uses Python's Pandas and NumPy to perform detailed analysis of the filtered data. For example, it analyzes the popularity of events and the optimality of venues.

[0137] Input: Filtered dataset

[0138] Data processing: Data analysis and statistical processing

[0139] Output: Analysis results

[0140] Step 7: Return the analysis results

[0141] The server formats the analysis results and sends them back to the user's terminal in an easy-to-understand format. This includes information such as the event name, date, and location.

[0142] Input: Analysis results

[0143] Data processing: Data formatting and transformation

[0144] Output: Analysis results sent back to the user

[0145] Step 8: Providing information to users

[0146] The terminal displays the results received from the server to the user. For example, it provides the following information:

[0147] Event Information:

[0148] 1. Commercial facility A: Summer festival (July 15th)

[0149] 2. Elementary School B: Sports day (July 21st)

[0150] Input: Analysis results returned from the server

[0151] Data processing: Formatting results for display.

[0152] Output: Information provided to the user

[0153] This series of steps allows users to efficiently obtain the necessary information, which contributes to improved mobile phone sales performance.

[0154] (Application Example 1)

[0155] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0156] Traditional information gathering systems have struggled to quickly collect and provide real-time data on categories of user interest. Therefore, there is a need to efficiently collect, organize, and analyze frequently changing product and promotional information from mobile sales and e-commerce sites. This will enable users to make quick purchasing decisions based on the latest information.

[0157] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0158] In this invention, the server includes web scraping means, database means, interface means, filtering means, analysis means, application means for collecting and providing data in categories of interest to the user in real time, and backend processing means for frequently updating detailed information on products or services. This enables the user to quickly and efficiently obtain the latest information.

[0159] "Web scraping" refers to software or programs used to automatically collect information from websites on the internet.

[0160] A "database system" is a system for organizing, storing, and efficiently managing collected data.

[0161] An "interface means" is a user interface that allows a user to input queries to a system and receive the results.

[0162] A "filtering method" is a processing method that narrows down relevant information within a database based on a user's query.

[0163] "Analysis tools" are means of analyzing filtered information to provide users with useful insights and results.

[0164] An "application means" is a software application that collects and provides data in real time on categories of interest to the user.

[0165] A "backend processing system" is a processing system that operates in the backend to frequently update and manage detailed information about a product or service.

[0166] This invention relates to a system for collecting, organizing, and analyzing information used in mobile phone sales and online shopping sites. To realize this system, the following components and their interconnections will be described in detail.

[0167] The server includes the following measures:

[0168] 1. Web scraping methods:

[0169] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect product and event information from specific websites. This allows for efficient acquisition of the latest information from the internet.

[0170] 2. Database methods:

[0171] The collected information is stored in MongoDB. The data is organized by category, for example, into categories such as home appliances, event information, and new product information.

[0172] 3. Interface means:

[0173] Users enter queries and receive results via a smartphone application. Developed using React Native, this application provides a user interface that allows users to easily find the information they need.

[0174] 4. Filtering methods:

[0175] Based on the query entered by the user, the server filters the data in MongoDB. For example, it can extract product information released within a specific period or product information belonging to a specific category.

[0176] 5. Analysis methods:

[0177] The filtered information is analyzed using Pandas and NumPy to derive useful insights and results for the user. For example, information on popular products and the most noteworthy promotions may be provided.

[0178] 6. Application methods:

[0179] A dedicated software application has been implemented to collect and provide data on categories of user interest in real time. This application can send push notifications to users with the latest information on products and brands they have registered as being of interest.

[0180] 7. Backend processing means:

[0181] The process for frequently updating detailed product and service information is implemented using Node.js and Express. This ensures that the information in the database is always up-to-date.

[0182] As a concrete example, if a user enters "Please tell me the latest information on electronic products to be released next week" into a smartphone app, the server receives the request and filters the database based on the specified conditions. Next, it analyzes the filtering results and provides the user with information on the relevant electronic products. In this way, the user can obtain the necessary information quickly and efficiently.

[0183] Example of a prompt:

[0184] "Please tell me the latest information on the electronics products that will be released next week."

[0185] This system allows users to obtain the latest information in real time and make purchasing decisions quickly.

[0186] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0187] Step 1:

[0188] The server uses BeautifulSoup and Scrapy to collect product and event information from websites. This information includes product names, prices, categories, and release dates. The collected information is temporarily stored in a data structure.

[0189] Input: Website URL

[0190] Output: Collected product and event information

[0191] Step 2:

[0192] The server organizes and stores the collected information in a MongoDB database. The data is divided into categories, such as home appliances, event information, and new product information.

[0193] Input: Data collected by scraping

[0194] Output: Information organized and stored in the database

[0195] Step 3:

[0196] The user enters a search query through a smartphone application developed with React Native. For example, they might enter a request to find information about electronic products that will be released next week.

[0197] Input: Query entered by the user into the smartphone application.

[0198] Output: Search queries sent to the server

[0199] Step 4:

[0200] The server receives queries from users and filters relevant information from within MongoDB. For example, it might extract information on electronics products released within a specific time period.

[0201] Input: Search query

[0202] Output: Filtered product information

[0203] Step 5:

[0204] The server analyzes the filtered information using Pandas and NumPy. For example, it identifies the most popular or highest-rated products among the filtered items.

[0205] Input: Filtered product information

[0206] Output: Analysis results and insights

[0207] Step 6:

[0208] The server provides analysis results to the user through a React Native application. Users can view categories and product information of interest in real time.

[0209] Input: Analysis results

[0210] Output: Insights and product information displayed to the user.

[0211] Step 7:

[0212] The server uses Node.js and Express to perform backend processing that frequently updates product and service details. This ensures that the information in the database is always up-to-date.

[0213] Input: Details of new products or services

[0214] Output: Updated database contents

[0215] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0216] The research system according to the present invention aims to improve mobile phone sales performance by collecting, organizing, and analyzing information, and further adjusting the information provided by recognizing user emotions. The core components of this system include web scraping means, database means, interface means, filtering means, analysis means, and emotion engine.

[0217] 1. Web scraping methods

[0218] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. This allows for the constant acquisition of up-to-date information in a centralized manner.

[0219] 2. Database means

[0220] The server organizes the collected data by category and stores it in a database. This allows for efficient filtering and analysis later on. For example, data can be stored in categories such as commercial facility information, event information, and product information.

[0221] 3. Interface means

[0222] The terminal provides an interface for receiving queries from users. Users enter queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[0223] 4. Filtering means

[0224] The server filters the information in the database based on user queries received through the interface. For example, it might extract only event information scheduled for the "next month."

[0225] 5. Analysis tools

[0226] The server analyzes the filtered information in detail to derive useful insights and results. This analysis makes it possible to provide users with information that is highly valuable to them.

[0227] 6. Emotional Engine

[0228] The device uses an emotion engine to recognize the user's emotions. For example, it analyzes emotions from the user's facial expressions and tone of voice using voice input or the camera. This allows it to understand the user's emotional state.

[0229] 7. Information Coordination

[0230] The server adjusts the information it provides based on the user's emotions, as recognized by the emotion engine. For example, if a user is excited, it can prioritize providing positive news and campaign information. Emotional data is also stored in a database and referenced in subsequent query processing.

[0231] Specific example

[0232] For example, if a user enters "I want to know about events happening in my neighborhood next month" into their device, the device sends this request to the server. The server filters event information related to "next month" from its database and analyzes the details of the collected events (e.g., event name, date, location, etc.). In doing so, the device recognizes the user's emotions and, if it determines that the user is feeling down, adjusts the information to prioritize providing uplifting event information. The server then sends the analysis results to the device, which provides the information to the user in the following format:

[0233] Event Information:

[0234] 1. Commercial facility A: Summer festival (July 15th)

[0235] 2. Elementary School B: Sports day (July 21st)

[0236] In this way, users can quickly obtain the information they need, which can help improve mobile phone sales performance. Similarly, information on notable products from consumer electronics manufacturers is collected, filtered, and analyzed, and then provided to users. This system allows users to effectively plan promotional activities and sales strategies.

[0237] The above describes the embodiments for carrying out the present invention. This system solves the problem of improving mobile phone sales performance through efficient information collection and provision, as well as emotion recognition functionality.

[0238] The following describes the processing flow.

[0239] Step 1:

[0240] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, such as commercial facility information, event information, school events, and enhanced product information from home appliance manufacturers. For example, it retrieves HTML data from a specified URL and extracts the necessary information (e.g., event name, date, location).

[0241] Step 2:

[0242] The server organizes the collected data by category and stores it in a database. For example, it stores data separately for commercial facilities, events, and products. This makes data management and subsequent filtering more efficient.

[0243] Step 3:

[0244] The user uses the terminal to enter a query to search for information. For example, they might enter, "I want to know about events happening in my neighborhood next month." The terminal provides an interface that makes it easy for the user to enter queries.

[0245] Step 4:

[0246] The terminal sends queries from the user to the server. The queries include all the conditions related to the information the user wants to find.

[0247] Step 5:

[0248] The server searches and filters information within the database based on the received query. For example, it might extract information about events taking place in the "next month." This filtering process extracts records that match the query criteria.

[0249] Step 6:

[0250] The server then analyzes the filtered information in detail. For example, it organizes the extracted event information to identify the most relevant events. This analysis process takes into account factors such as the scale and prominence of the events.

[0251] Step 7:

[0252] The device uses an emotion engine to recognize the user's emotions. For example, it analyzes emotions from the user's facial expressions and voice using voice input or a camera. This allows the device to understand the user's emotional state.

[0253] Step 8:

[0254] The server adjusts the information it provides based on the user's emotions, as recognized by the emotion engine. For example, if a user is feeling down, it prioritizes providing uplifting event information. This adjustment ensures that the information provided is optimal for the user's emotional state.

[0255] Step 9:

[0256] The server sends the analyzed and adjusted data to the terminal. For example, it might compile a list of events scheduled for the following month and return it to the terminal.

[0257] Step 10:

[0258] The device displays the received information in a format that is easy for the user to understand. For example, the user can view event information in the following format:

[0259] Event Information:

[0260] 1. Commercial facility A: Summer festival (July 15th)

[0261] 2. Elementary School B: Sports day (July 21st)

[0262] Step 11:

[0263] Users use the provided information to plan their mobile sales strategies and promotional activities. Specifically, this includes preparing campaigns and exhibitions tailored to events.

[0264] As described above, this system supports users in improving their mobile phone sales performance through efficient information gathering and provision, as well as emotion recognition functionality.

[0265] (Example 2)

[0266] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0267] Conventional information gathering and provision systems have the problem of not adequately providing information that meets the diverse needs and emotional states of users, making efficient sales promotion and promotional activities difficult. Furthermore, there was a need for a system that could appropriately classify and organize acquired data and quickly provide necessary information in real time.

[0268] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0269] In this invention, the server includes means for automatically collecting data from web pages on a regular basis, means for organizing the collected data by category and storing it in a database, means for receiving user inquiries, means for selecting relevant information in the database based on the inquiries, means for analyzing the selected information in detail, means for recognizing the user's emotional state, and means for adjusting the information provided based on the emotional state. This enables the provision of appropriate information in accordance with the user's emotions, thereby realizing efficient sales promotion and promotional activities.

[0270] "Means for automatically collecting data from web pages on a regular basis" refers to software or hardware that has the function of automatically collecting information from multiple websites on the internet at specified time intervals.

[0271] "Means for organizing collected data by category and storing it in a database" refers to software or hardware that has the function of classifying acquired data into predetermined categories and storing that data in a database system.

[0272] "User interface means" refers to software or hardware that has the function of providing an interface for receiving queries or requests that users enter to obtain specific information.

[0273] "Means for selecting relevant information within a database based on queries" refers to software or hardware that has the function of searching for relevant information within a database and extracting the necessary data in accordance with queries or requests from users.

[0274] "Means for detailed analysis of selected information" refers to software or hardware that has the function of analyzing data obtained as search results and deriving statistical information or useful insights.

[0275] "Means for recognizing a user's emotional state" refers to software or hardware that has the function of analyzing input information such as the user's voice and facial expressions to determine their emotional state.

[0276] "Means for adjusting information provided based on emotional state" refers to software or hardware that has the function of adjusting the content and order of information provided in accordance with the recognized emotional state of the user.

[0277] The system according to the present invention mainly consists of three main functions: a server, a terminal, and a user. These will be described in detail below.

[0278] Server Functions

[0279] Regular data collection methods

[0280] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and new product information from home appliance manufacturers. This automated collection process runs at regular intervals, ensuring that the latest information is always available.

[0281] Data organization and storage methods

[0282] The collected data is sorted by category by the server. Specifically, commercial facility information is classified into the "Commercial Facility" category, and event information is classified into the "Event" category. The sorted data is stored in a database such as MySQL or PostgreSQL, enabling efficient data management.

[0283] Data selection means

[0284] When a query from the user is sent to the server through the interface, the server selects relevant information in the database based on that query. For example, for a query like "I want to know the events scheduled to be held in the neighborhood next month", events to be held next month are extracted from the event information.

[0285] Information analysis means

[0286] The selected information is analyzed in detail using statistical analysis and machine learning algorithms. By referring to the number of past participants and review evaluations, etc., the most useful data is extracted. This analysis result becomes the basic data for providing the most valuable information to the user.

[0287] Functions of the terminal

[0288] User query reception means

[0289] The terminal provides an interface for the user to input a query to obtain specific information. The user can input a query such as "I want to know the events scheduled to be held in the neighborhood next month" via the terminal. This query information is sent to the server, and the processing is started.

[0290] Emotional state recognition means

[0291] The device is equipped with an emotion engine to recognize the user's emotional state. Using software such as IBM Watson® Tone Analyzer and Microsoft® Azure® Emotion API, it can analyze the user's voice and facial expressions to determine their emotional state in real time.

[0292] Information provision means

[0293] The terminal, upon receiving the final analysis results sent from the server, displays them to the user. For example, if prioritizing the display of uplifting event information for the user, the information would be provided in the following format:

[0294] Event Information:

[0295] 1. Commercial facility A: Summer festival (July 15th)

[0296] 2. Elementary School B: Sports day (July 21st)

[0297] User convenience

[0298] User interaction

[0299] Users can operate the terminal and enter queries to quickly obtain the information they need. For example, by entering a prompt such as, "I want to know about events happening in my neighborhood next month. Also, please prioritize displaying information about uplifting events," the necessary information will be provided immediately.

[0300] This system enables the provision of appropriate information tailored to the user's emotional state, facilitating efficient information gathering and sales promotion.

[0301] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0302] Step 1:

[0303] The server launches a web scraping tool (e.g., BeautifulSoup or Scrapy) at a specified time. It uses a list of website URLs as input. By accessing each URL and analyzing the HTML document, it automatically collects commercial facility information, event information, school events, and new product information of home appliance manufacturers. As output, the extracted data is saved in a temporary file. Specifically, a crawling process is executed, and the necessary information is extracted from specific HTML tags.

[0304] Step 2:

[0305] The server analyzes the content of the collected temporary file and organizes it by category. It uses the raw data in the temporary file as input. Depending on the content of the data, data processing is performed to classify it into categories such as the "commercial facility" category or the "event" category. As output, data organized by each category is obtained. Specifically, the categorize_data() function is used to classify the data, and the result is saved in a database.

[0306] Step 3:

[0307] The terminal provides an interface for the user to input a query to obtain specific information. The user inputs a query such as "want to know the events scheduled to be held in the neighborhood next month". It uses the query input by the user to the terminal as input. As output, the query information is sent to the server. Specifically, an input form is displayed, the user inputs a query, and the query is passed to the server by pressing the send button.

[0308] Step 4:

[0309] The server filters relevant information from the database based on queries received from the user. It uses the user query and data from the database as input. For example, it might execute a database query with the condition "events scheduled nearby in the next month" to extract relevant information. The output would be the filtered event information. Specifically, an SQL query is generated and used to retrieve the necessary data from the database.

[0310] Step 5:

[0311] The server analyzes the selected information in detail. It uses the selected data as input. Statistical analysis is performed using past participant numbers and review ratings. The output yields useful insights and the most valuable information. Specifically, it generates analysis results using data analysis algorithms (e.g., clustering and recommendation algorithms).

[0312] Step 6:

[0313] The device activates an emotion engine to recognize the user's emotional state. It uses the user's voice and facial expression data as input. Specifically, it analyzes the emotional state using speech recognition and facial recognition technologies. The user's emotional state is obtained as output. In terms of specific actions, a voice assistant and camera module are used to analyze the input data.

[0314] Step 7:

[0315] The server adjusts the information it provides based on the recognized emotional state. It uses the results of the emotion engine's analysis and filtered / analyzed data as input. For example, if the server detects that the user is depressed, it prioritizes selecting uplifting event information. The output is the adjusted information. Specifically, it uses the `adjust_information_based_on_emotion()` function to filter the information and select what is appropriate for the user.

[0316] Step 8:

[0317] The server sends the final adjustment results to the terminal. The terminal displays them to the user. The adjusted information is used as input. The information is provided to the user visually or audibly as output. Specifically, event information is displayed in a list view on the terminal screen, or a voice assistant reads the information aloud.

[0318] (Application Example 2)

[0319] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0320] To maximize the effectiveness of advertising, it is crucial to deliver the most relevant ads based on the user's current emotional state. However, conventional advertising systems deliver ads uniformly without considering the user's emotional state. This leads to problems such as users perceiving ads as inappropriate or reduced advertising effectiveness. The present invention aims to improve advertising effectiveness by providing a system that delivers the most relevant ads based on the user's emotional state.

[0321] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a web scraping means, a database means, and an interface means. This allows for efficient subsequent filtering and analysis by organizing the collected data by category and storing it in the database. It also includes filtering means, analysis means, emotion engine means, and information adjustment means. This makes it possible not only to provide information based on user queries, but also to provide information appropriate to the user's emotional state.

[0322] "Web scraping" refers to a technique for automatically collecting specific information from various websites on the internet.

[0323] A "database system" is a system for classifying collected data into categories and efficiently storing and managing it.

[0324] An "interface means" is a means of receiving queries from a user and interacting with the system based on the information the user inputs.

[0325] A "filtering method" is a means of searching for information within a database based on a user's query, eliminating unnecessary information, and extracting only the relevant information.

[0326] "Analysis tools" are means for analyzing filtered information in detail and deriving and providing useful insights for the user.

[0327] An "emotional engine" is a technology that recognizes and analyzes a user's emotional state from their voice and facial expressions.

[0328] An "information adjustment mechanism" is a means of adjusting the information provided based on the user's emotions recognized by the emotion engine, and delivering the optimal information to the user at the optimal time.

[0329] "Advertising information" refers to content that includes information such as product features, price, and promotions, and is intended to advertise a specific product or service to users.

[0330] The advertising system according to the present invention aims to deliver optimal advertisements based on the user's emotional state and consists of web scraping means, database means, interface means, filtering means, analysis means, emotion engine means, and information adjustment means.

[0331] 1. Web scraping methods

[0332] The server periodically uses web scraping tools to automatically collect advertising information from various websites on the internet. This information includes product features, prices, and promotional details. This ensures that the server always has access to the latest advertising information.

[0333] 2. Database means

[0334] The server organizes the collected advertising information by category and stores it in a database. For example, it stores information categorized by product type, promotion period, target audience, etc. This allows for efficient filtering and analysis later on.

[0335] 3. Interface means

[0336] The terminal provides an interface for receiving queries from users. Users enter queries about the advertising information they want to find through the terminal. For example, they might enter a request such as, "I want to know about the promotions happening next month."

[0337] 4. Filtering means

[0338] The server filters advertising information in the database based on user queries received through the interface. For example, it might extract only promotional information for the "next month."

[0339] 5. Analysis tools

[0340] The server analyzes filtered ad information in detail to derive useful insights and results. This analysis makes it possible to deliver ads that are highly valuable to users.

[0341] 6. Emotional Engine Means

[0342] The device uses an emotion engine to recognize the user's emotions. It analyzes emotions from the user's facial expressions and tone of voice using voice input and the camera. For example, it uses the TextBlob library to perform emotion analysis, thereby understanding the user's emotional state.

[0343] 7. Information coordination means

[0344] The server adjusts the advertising information it provides based on the user's emotions, as recognized by the emotion engine. For example, if the user is excited, positive advertising information can be prioritized. Emotional data is also stored in a database and referenced in subsequent query processing.

[0345] Specific example

[0346] If a user types "I want to know about promotions happening next month" on their device and indicates a positive emotional state, the system will provide advertising information that is appropriate for that positive emotion. Specifically, it will provide information such as "Summer Sale" or "New Product Launch Event."

[0347] Example of a prompt

[0348] Please tell me about the promotions taking place next month.

[0349] Current feelings: Happy

[0350] Examples of possible promotions:

[0351] 1. Summer Sale (July 10th)

[0352] 2. New Product Launch Event (July 15th)

[0353] 3. Discount campaigns at high-end restaurants (July 20th)

[0354] In implementing this invention, terminals such as smartphones, smart glasses, and head-mounted displays are used. Furthermore, a web scraping tool implemented in Python, an SQLite database, and the TextBlob library are utilized. By considering the user's emotional state, more effective advertising delivery becomes possible.

[0355] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0356] Step 1:

[0357] The server uses web scraping tools to collect advertising information from various websites on the internet. This collected data includes product features, prices, and promotional details. The input is a list of URLs of the websites to be collected, and the output is the advertising information scraped from each site.

[0358] Step 2:

[0359] The server organizes the advertising information collected in Step 1 by category and stores it in a database. Categories include product type, promotion period, target audience, etc. The specific input is the collected advertising information, and the output is the database records organized by category.

[0360] Step 3:

[0361] The terminal provides an interface for receiving queries from users. Users input queries through the terminal, such as "I want to know about the promotions happening next month." The specific input is the user's query, and the output is the query request sent to the server.

[0362] Step 4:

[0363] The server filters advertising information in the database based on user queries received through the interface. For example, it might extract promotional information related to "next month." The specific inputs are the user's query and database records, and the output is the filtered advertising information.

[0364] Step 5:

[0365] The server analyzes the filtered ad information in step 4 in detail to derive useful insights and results. The specific input is the filtered ad information, and the output is the insights resulting from the analysis. For example, it analyzes which promotions are most appealing to users.

[0366] Step 6:

[0367] The device uses an emotion engine to recognize the user's emotions. It analyzes emotions from the user's facial expressions and tone of voice using voice input and the camera. The specific input is the user's voice and facial expression data, and the output is the analyzed emotional state (e.g., positive, negative).

[0368] Step 7:

[0369] The server adjusts the ad information it provides based on the user's emotions, as recognized by the emotion engine. If the user is in an excited state, it prioritizes providing positive ad information. The specific inputs are the user's emotional state and the analysis results, and the output is ad information appropriate to that emotion.

[0370] Step 8:

[0371] The server sends the adjusted ad information from step 7 to the device. This allows the user to receive ad information that is appropriate to their current emotional state. The specific input is the adjusted ad information, and the output is the ad information displayed to the user.

[0372] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0373] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0374] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0375] [Second Embodiment]

[0376] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0377] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0378] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0379] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0380] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0381] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0382] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0383] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0384] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0385] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0386] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0387] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0388] The research system according to the present invention aims to improve mobile phone sales performance by efficiently collecting, organizing, and analyzing information, and providing useful information to users. The core components of this system include web scraping means, database means, interface means, filtering means, and analysis means.

[0389] 1. Web scraping methods

[0390] The server uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. This allows for the constant acquisition of the latest information in a centralized manner.

[0391] 2. Database means

[0392] The server organizes and stores the collected data in a database. This database enables highly efficient data management by separating and storing information by category. For example, it might be divided into categories such as commercial facility information, event information, and product information.

[0393] 3. Interface means

[0394] The terminal provides an interface for receiving queries (requests) from users. Users enter queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[0395] 4. Filtering means

[0396] The server filters the information in the database based on user queries received through the interface. This filtering process allows the server to extract only the specific information the user needs. For example, it can extract only event information scheduled for the "next month."

[0397] 5. Analysis tools

[0398] The server analyzes the filtered information in detail to derive useful insights and results. This analysis makes it possible to provide users with highly valuable information.

[0399] Specific example

[0400] For example, if a user enters "I want to know about events happening in my neighborhood next month" into their device, the device sends this request to the server. The server filters the database for events in the "next month" and analyzes the details of the collected events (e.g., event name, date, location, etc.). The server then sends the analysis results to the device, which provides the information to the user in the following format:

[0401] Event Information:

[0402] 1. Commercial facility A: Summer festival (July 15th)

[0403] 2. Elementary School B: Sports day (July 21st)

[0404] In this way, users can quickly obtain the information they need, which helps improve mobile phone sales performance. Similarly, information on notable products from consumer electronics manufacturers is collected, filtered, and analyzed, and then provided to users. This system allows users to effectively plan promotional activities and sales strategies.

[0405] The above describes the embodiments for carrying out the present invention. This system solves the problem of improving mobile phone sales performance through efficient information collection and provision.

[0406] The following describes the processing flow.

[0407] Step 1:

[0408] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. Specifically, it retrieves HTML data from specified URLs and extracts the necessary information (e.g., event name, date, and location).

[0409] Step 2:

[0410] The server organizes the collected data by category. For example, it separates it into commercial facility information, event information, and product information, and stores each type of data in a database. This organization allows for more efficient filtering and analysis later on.

[0411] Step 3:

[0412] The user uses the terminal to enter a query to search for information. For example, they might enter, "I want to know about events happening in my neighborhood next month."

[0413] Step 4:

[0414] The terminal sends user queries to the server. These queries are then converted into a format that can be processed directly by the server.

[0415] Step 5:

[0416] The server searches the database for information based on the received query. For example, it might filter for event information scheduled for the next month. This filtering process extracts records that match the query criteria.

[0417] Step 6:

[0418] The server further analyzes the filtered information to derive useful insights and results. For example, it organizes the extracted event information to find the most relevant information.

[0419] Step 7:

[0420] The server sends the analysis results to the terminal. For example, it might create a list of events scheduled for the following month and return it to the terminal.

[0421] Step 8:

[0422] The device displays the received information in a format that is easy for the user to understand. For example, the user can view event information in the following format:

[0423] Event Information:

[0424] 1. Commercial facility A: Summer festival (July 15th)

[0425] 2. Elementary School B: Sports day (July 21st)

[0426] Step 9:

[0427] Users use the provided information to plan their mobile sales strategies and promotional activities. Specifically, this includes preparing campaigns and exhibitions tailored to events.

[0428] As described above, this system supports users in improving their mobile phone sales performance through efficient information gathering and provision.

[0429] (Example 1)

[0430] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0431] Conventional information gathering systems lack efficiency at each stage of data collection, organization, filtering, and analysis, making it difficult for users to quickly and accurately obtain the necessary information, especially when the goal is to improve mobile phone sales performance. Furthermore, the collection and analysis of information in specific categories, such as event information and consumer electronics information, is not sufficiently automated, resulting in a heavy reliance on manual work. In contrast, the present invention aims to solve these problems and to make the process from information collection to analysis efficient and automated.

[0432] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0433] In this invention, the server includes means for automatically collecting information from the internet, means for organizing and storing the collected data, means for receiving inquiries from users, means for selecting relevant information from the information storage means based on the inquiries, and means for analyzing the selected information and providing it to the user. This makes it possible to efficiently and automatically collect, organize, filter, and analyze data, and to quickly provide useful information to users.

[0434] "Means of automatically collecting information from the Internet" refers to software or scripts used to automatically collect specific information from multiple websites on the Internet.

[0435] "Information storage means for organizing and saving collected data" refers to database systems and storage systems for classifying collected data and saving it in an appropriate format.

[0436] A "means of receiving inquiries from users" refers to an interface where users enter queries to search for specific information, allowing the server to receive user requests.

[0437] "Means for selecting relevant information from information storage means" refers to algorithms and filtering functions for searching data within information storage means based on user queries and extracting relevant data.

[0438] "Information processing means for analyzing selected information and providing it to users" refers to analytical software or data processing systems that analyze selected information in detail and provide the results to users.

[0439] The research system according to the present invention aims to improve mobile phone sales performance by efficiently collecting, organizing, and analyzing information and providing useful information to users. The core components of this system include means for automatically collecting information from the internet, information storage means for organizing and saving the collected data, inquiry means for receiving inquiries from users, means for selecting relevant information from the information storage means, and information processing means for analyzing the selected information and providing it to users.

[0440] A method for automatically collecting information from the internet

[0441] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect information on commercial facilities, events, school events, and home appliances from various websites on the internet. For example, it can retrieve the latest event information from specific news sites or blogs.

[0442] Information storage means for organizing and saving collected data

[0443] The server uses MySQL or PostgreSQL to organize and store the collected data in a database. This database stores information separately by category, enabling efficient data management. For example, it can be categorized into categories such as commercial facility information, event information, and product information.

[0444] Inquiry method for receiving inquiries from users

[0445] The terminal uses HTML / CSS and JavaScript to provide an interface for receiving queries from the user. The user enters queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[0446] Means for selecting relevant information from information storage means

[0447] The server filters the information in the database based on the user's query. For example, to extract only event information related to "next month," it uses an SQL query to retrieve the necessary records.

[0448] Information processing means that analyzes selected information and provides it to the user.

[0449] The server analyzes the filtered data in detail using Python's Pandas and NumPy libraries. For example, it derives insights such as the popularity of an event and the optimality of its venue. The analysis results are then formatted and presented to the user in an easy-to-understand format.

[0450] Specific example

[0451] For example, if a user enters "I want to know about events scheduled to be held in my neighborhood next month" on their device, the process will proceed as follows:

[0452] 1. The user enters the query using the terminal interface.

[0453] 2. The terminal sends the entered query to the server.

[0454] 3. The server collects the necessary data from the internet using web scraping tools (such as BeautifulSoup or Scrapy).

[0455] 4. The server stores the collected data in MySQL or PostgreSQL.

[0456] 5. The server uses SQL queries to filter event information for the "next month" from the database.

[0457] 6. The server analyzes the filtered data using Pandas and derives the necessary insights.

[0458] 7. The server sends the analysis results to the terminal.

[0459] 8. The terminal provides information to the user in the following format:

[0460] Event Information:

[0461] 1. Commercial facility A: Summer festival (July 15th)

[0462] 2. Elementary School B: Sports day (July 21st)

[0463] This system allows users to quickly obtain the information they need, which in turn contributes to improving mobile phone sales performance.

[0464] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0465] The specific processing flow of the program

[0466] Step 1: User query input

[0467] The terminal provides an interface for the user to input information. The user enters a query such as, "I want to know about events scheduled to be held in my neighborhood next month." This query constitutes the input data.

[0468] Input: The query that the user enters into the terminal interface.

[0469] Data processing: Convert user queries into HTTP request format.

[0470] Output: Generates an HTTP request to the server.

[0471] Step 2: Received the request

[0472] The terminal sends the entered query to the server. The query is sent in HTTP request format.

[0473] Input: HTTP request containing a user query

[0474] Data processing: Parsing HTTP requests and extracting data.

[0475] Output: Query data parsed on the server

[0476] Step 3: Data Collection (Web Scraping)

[0477] The server uses web scraping tools such as BeautifulSoup and Scrapy to collect information from the internet. For example, it might retrieve event information from specific news sites or blogs.

[0478] Input: User query passed to the server

[0479] Data processing: Information gathering through web scraping

[0480] Output: Collected raw data

[0481] Step 4: Data storage (database)

[0482] The server organizes and stores the collected data in a database running MySQL or PostgreSQL. The database stores the information categorized by type.

[0483] Input: Collected raw data

[0484] Data processing: Data organization and categorization

[0485] Output: Save to an organized database

[0486] Step 5: Data Filtering

[0487] The server filters information in the database based on the user's query. For example, it extracts information related to "next month" using an SQL query.

[0488] Input: Information stored in the database and user queries

[0489] Data Calculation: Data Extraction using SQL Queries

[0490] Output: Filtered dataset

[0491] Step 6: Data Analysis

[0492] The server uses Python's Pandas and NumPy to perform detailed analysis of the filtered data. For example, it analyzes the popularity of events and the optimality of venues.

[0493] Input: Filtered dataset

[0494] Data processing: Data analysis and statistical processing

[0495] Output: Analysis results

[0496] Step 7: Return the analysis results

[0497] The server formats the analysis results and sends them back to the user's terminal in an easy-to-understand format. This includes information such as the event name, date, and location.

[0498] Input: Analysis results

[0499] Data processing: Data formatting and transformation

[0500] Output: Analysis results sent back to the user

[0501] Step 8: Providing information to users

[0502] The terminal displays the results received from the server to the user. For example, it provides the following information:

[0503] Event Information:

[0504] 1. Commercial facility A: Summer festival (July 15th)

[0505] 2. Elementary School B: Sports day (July 21st)

[0506] Input: Analysis results returned from the server

[0507] Data processing: Formatting results for display.

[0508] Output: Information provided to the user

[0509] This series of steps allows users to efficiently obtain the necessary information, which contributes to improved mobile phone sales performance.

[0510] (Application Example 1)

[0511] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0512] Traditional information gathering systems have struggled to quickly collect and provide real-time data on categories of user interest. Therefore, there is a need to efficiently collect, organize, and analyze frequently changing product and promotional information from mobile sales and e-commerce sites. This will enable users to make quick purchasing decisions based on the latest information.

[0513] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0514] In this invention, the server includes web scraping means, database means, interface means, filtering means, analysis means, application means for collecting and providing data in categories of interest to the user in real time, and backend processing means for frequently updating detailed information on products or services. This enables the user to quickly and efficiently obtain the latest information.

[0515] "Web scraping" refers to software or programs used to automatically collect information from websites on the internet.

[0516] A "database system" is a system for organizing, storing, and efficiently managing collected data.

[0517] An "interface means" is a user interface that allows a user to input queries to a system and receive the results.

[0518] A "filtering method" is a processing method that narrows down relevant information within a database based on a user's query.

[0519] "Analysis tools" are means of analyzing filtered information to provide users with useful insights and results.

[0520] An "application means" is a software application that collects and provides data in real time on categories of interest to the user.

[0521] A "backend processing system" is a processing system that operates in the backend to frequently update and manage detailed information about a product or service.

[0522] This invention relates to a system for collecting, organizing, and analyzing information used in mobile phone sales and online shopping sites. To realize this system, the following components and their interconnections will be described in detail.

[0523] The server includes the following measures:

[0524] 1. Web scraping methods:

[0525] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect product and event information from specific websites. This allows for efficient acquisition of the latest information from the internet.

[0526] 2. Database methods:

[0527] The collected information is stored in MongoDB. The data is organized by category, for example, into categories such as home appliances, event information, and new product information.

[0528] 3. Interface means:

[0529] Users enter queries and receive results via a smartphone application. Developed using React Native, this application provides a user interface that allows users to easily find the information they need.

[0530] 4. Filtering methods:

[0531] Based on the query entered by the user, the server filters the data in MongoDB. For example, it can extract product information released within a specific period or product information belonging to a specific category.

[0532] 5. Analysis methods:

[0533] The filtered information is analyzed using Pandas and NumPy to derive useful insights and results for the user. For example, information on popular products and the most noteworthy promotions may be provided.

[0534] 6. Application methods:

[0535] A dedicated software application has been implemented to collect and provide data on categories of user interest in real time. This application can send push notifications to users with the latest information on products and brands they have registered as being of interest.

[0536] 7. Backend processing means:

[0537] The process for frequently updating detailed product and service information is implemented using Node.js and Express. This ensures that the information in the database is always up-to-date.

[0538] As a concrete example, if a user enters "Please tell me the latest information on electronic products to be released next week" into a smartphone app, the server receives the request and filters the database based on the specified conditions. Next, it analyzes the filtering results and provides the user with information on the relevant electronic products. In this way, the user can obtain the necessary information quickly and efficiently.

[0539] Example of a prompt:

[0540] "Please tell me the latest information on the electronics products that will be released next week."

[0541] This system allows users to obtain the latest information in real time and make purchasing decisions quickly.

[0542] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0543] Step 1:

[0544] The server uses BeautifulSoup and Scrapy to collect product and event information from websites. This information includes product names, prices, categories, and release dates. The collected information is temporarily stored in a data structure.

[0545] Input: Website URL

[0546] Output: Collected product and event information

[0547] Step 2:

[0548] The server organizes and stores the collected information in a MongoDB database. The data is divided into categories, such as home appliances, event information, and new product information.

[0549] Input: Data collected by scraping

[0550] Output: Information organized and stored in the database

[0551] Step 3:

[0552] The user enters a search query through a smartphone application developed with React Native. For example, they might enter a request to find information about electronic products that will be released next week.

[0553] Input: Query entered by the user into the smartphone application.

[0554] Output: Search queries sent to the server

[0555] Step 4:

[0556] The server receives queries from users and filters relevant information from within MongoDB. For example, it might extract information on electronics products released within a specific time period.

[0557] Input: Search query

[0558] Output: Filtered product information

[0559] Step 5:

[0560] The server analyzes the filtered information using Pandas and NumPy. For example, it identifies the most popular or highest-rated products among the filtered items.

[0561] Input: Filtered product information

[0562] Output: Analysis results and insights

[0563] Step 6:

[0564] The server provides analysis results to the user through a React Native application. Users can view categories and product information of interest in real time.

[0565] Input: Analysis results

[0566] Output: Insights and product information displayed to the user.

[0567] Step 7:

[0568] The server uses Node.js and Express to perform backend processing that frequently updates product and service details. This ensures that the information in the database is always up-to-date.

[0569] Input: Details of new products or services

[0570] Output: Updated database contents

[0571] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0572] The research system according to the present invention aims to improve mobile phone sales performance by collecting, organizing, and analyzing information, and further adjusting the information provided by recognizing user emotions. The core components of this system include web scraping means, database means, interface means, filtering means, analysis means, and emotion engine.

[0573] 1. Web scraping methods

[0574] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. This allows for the constant acquisition of up-to-date information in a centralized manner.

[0575] 2. Database means

[0576] The server organizes the collected data by category and stores it in a database. This allows for efficient filtering and analysis later on. For example, data can be stored in categories such as commercial facility information, event information, and product information.

[0577] 3. Interface means

[0578] The terminal provides an interface for receiving queries from users. Users enter queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[0579] 4. Filtering means

[0580] The server filters the information in the database based on user queries received through the interface. For example, it might extract only event information scheduled for the "next month."

[0581] 5. Analysis tools

[0582] The server analyzes the filtered information in detail to derive useful insights and results. This analysis makes it possible to provide users with information that is highly valuable to them.

[0583] 6. Emotional Engine

[0584] The device uses an emotion engine to recognize the user's emotions. For example, it analyzes emotions from the user's facial expressions and tone of voice using voice input or the camera. This allows it to understand the user's emotional state.

[0585] 7. Information Coordination

[0586] The server adjusts the information it provides based on the user's emotions, as recognized by the emotion engine. For example, if a user is excited, it can prioritize providing positive news and campaign information. Emotional data is also stored in a database and referenced in subsequent query processing.

[0587] Specific example

[0588] For example, if a user enters "I want to know about events happening in my neighborhood next month" into their device, the device sends this request to the server. The server filters event information related to "next month" from its database and analyzes the details of the collected events (e.g., event name, date, location, etc.). In doing so, the device recognizes the user's emotions and, if it determines that the user is feeling down, adjusts the information to prioritize providing uplifting event information. The server then sends the analysis results to the device, which provides the information to the user in the following format:

[0589] Event Information:

[0590] 1. Commercial facility A: Summer festival (July 15th)

[0591] 2. Elementary School B: Sports day (July 21st)

[0592] In this way, users can quickly obtain the information they need, which can help improve mobile phone sales performance. Similarly, information on notable products from consumer electronics manufacturers is collected, filtered, and analyzed, and then provided to users. This system allows users to effectively plan promotional activities and sales strategies.

[0593] The above describes the embodiments for carrying out the present invention. This system solves the problem of improving mobile phone sales performance through efficient information collection and provision, as well as emotion recognition functionality.

[0594] The following describes the processing flow.

[0595] Step 1:

[0596] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, such as commercial facility information, event information, school events, and enhanced product information from home appliance manufacturers. For example, it retrieves HTML data from a specified URL and extracts the necessary information (e.g., event name, date, location).

[0597] Step 2:

[0598] The server organizes the collected data by category and stores it in a database. For example, it stores data separately for commercial facilities, events, and products. This makes data management and subsequent filtering more efficient.

[0599] Step 3:

[0600] The user uses the terminal to enter a query to search for information. For example, they might enter, "I want to know about events happening in my neighborhood next month." The terminal provides an interface that makes it easy for the user to enter queries.

[0601] Step 4:

[0602] The terminal sends queries from the user to the server. The queries include all the conditions related to the information the user wants to find.

[0603] Step 5:

[0604] The server searches and filters information within the database based on the received query. For example, it might extract information about events taking place in the "next month." This filtering process extracts records that match the query criteria.

[0605] Step 6:

[0606] The server then analyzes the filtered information in detail. For example, it organizes the extracted event information to identify the most relevant events. This analysis process takes into account factors such as the scale and prominence of the events.

[0607] Step 7:

[0608] The device uses an emotion engine to recognize the user's emotions. For example, it analyzes emotions from the user's facial expressions and voice using voice input or a camera. This allows the device to understand the user's emotional state.

[0609] Step 8:

[0610] The server adjusts the information it provides based on the user's emotions, as recognized by the emotion engine. For example, if a user is feeling down, it prioritizes providing uplifting event information. This adjustment ensures that the information provided is optimal for the user's emotional state.

[0611] Step 9:

[0612] The server sends the analyzed and adjusted data to the terminal. For example, it might compile a list of events scheduled for the following month and return it to the terminal.

[0613] Step 10:

[0614] The device displays the received information in a format that is easy for the user to understand. For example, the user can view event information in the following format:

[0615] Event Information:

[0616] 1. Commercial facility A: Summer festival (July 15th)

[0617] 2. Elementary School B: Sports day (July 21st)

[0618] Step 11:

[0619] Users use the provided information to plan their mobile sales strategies and promotional activities. Specifically, this includes preparing campaigns and exhibitions tailored to events.

[0620] As described above, this system supports users in improving their mobile phone sales performance through efficient information gathering and provision, as well as emotion recognition functionality.

[0621] (Example 2)

[0622] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0623] Conventional information gathering and provision systems have the problem of not adequately providing information that meets the diverse needs and emotional states of users, making efficient sales promotion and promotional activities difficult. Furthermore, there was a need for a system that could appropriately classify and organize acquired data and quickly provide necessary information in real time.

[0624] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0625] In this invention, the server includes means for automatically collecting data from web pages on a regular basis, means for organizing the collected data by category and storing it in a database, means for receiving user inquiries, means for selecting relevant information in the database based on the inquiries, means for analyzing the selected information in detail, means for recognizing the user's emotional state, and means for adjusting the information provided based on the emotional state. This enables the provision of appropriate information in accordance with the user's emotions, thereby realizing efficient sales promotion and promotional activities.

[0626] "Means for automatically collecting data from web pages on a regular basis" refers to software or hardware that has the function of automatically collecting information from multiple websites on the internet at specified time intervals.

[0627] "Means for organizing collected data by category and storing it in a database" refers to software or hardware that has the function of classifying acquired data into predetermined categories and storing that data in a database system.

[0628] "User interface means" refers to software or hardware that has the function of providing an interface for receiving queries or requests that users enter to obtain specific information.

[0629] "Means for selecting relevant information within a database based on queries" refers to software or hardware that has the function of searching for relevant information within a database and extracting the necessary data in accordance with queries or requests from users.

[0630] "Means for detailed analysis of selected information" refers to software or hardware that has the function of analyzing data obtained as search results and deriving statistical information or useful insights.

[0631] "Means for recognizing a user's emotional state" refers to software or hardware that has the function of analyzing input information such as the user's voice and facial expressions to determine their emotional state.

[0632] "Means for adjusting information provided based on emotional state" refers to software or hardware that has the function of adjusting the content and order of information provided in accordance with the recognized emotional state of the user.

[0633] The system according to the present invention mainly consists of three main functions: a server, a terminal, and a user. These will be described in detail below.

[0634] Server Functions

[0635] Regular data collection methods

[0636] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and new product information from home appliance manufacturers. This automated collection process runs at regular intervals, ensuring that the latest information is always available.

[0637] Data organization and storage methods

[0638] The collected data is organized by category by the server. Specifically, commercial facility information is classified into the "Commercial Facilities" category, and event information into the "Events" category. The organized data is stored in databases such as MySQL or PostgreSQL, enabling efficient data management.

[0639] Data sorting method

[0640] When a user sends a query to the server through the interface, the server selects relevant information from the database based on that query. For example, in response to a query like "I want to know about events scheduled to be held in my neighborhood next month," the server will extract events that will be held in the next month from the event information.

[0641] Information analysis means

[0642] The selected information is analyzed in detail using statistical analysis and machine learning algorithms. The most useful data is extracted, taking into account factors such as past participant numbers and review ratings. This analysis provides the foundational data for delivering the most valuable information to users.

[0643] Device functions

[0644] User query acceptance method

[0645] The terminal provides an interface for users to enter queries to obtain specific information. Through the terminal, a user can enter a query such as, "I want to know about events happening in my neighborhood next month." This query information is sent to the server, and processing begins.

[0646] Means for recognizing emotional states

[0647] The device is equipped with an emotion engine to recognize the user's emotional state. Using software such as IBM Watson Tone Analyzer and Microsoft Azure Emotion API, it can analyze the user's voice and facial expressions to determine their emotional state in real time.

[0648] Information provision means

[0649] The terminal, upon receiving the final analysis results sent from the server, displays them to the user. For example, if prioritizing the display of uplifting event information for the user, the information would be provided in the following format:

[0650] Event Information:

[0651] 1. Commercial facility A: Summer festival (July 15th)

[0652] 2. Elementary School B: Sports day (July 21st)

[0653] User convenience

[0654] User interaction

[0655] Users can operate the terminal and enter queries to quickly obtain the information they need. For example, by entering a prompt such as, "I want to know about events happening in my neighborhood next month. Also, please prioritize displaying information about uplifting events," the necessary information will be provided immediately.

[0656] This system enables the provision of appropriate information tailored to the user's emotional state, facilitating efficient information gathering and sales promotion.

[0657] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0658] Step 1:

[0659] The server launches a web scraping tool (e.g., BeautifulSoup or Scrapy) at a specified time. It uses a list of website URLs as input. By accessing each URL and parsing the HTML document, it automatically collects information on commercial facilities, events, school activities, and new products from electronics manufacturers. The extracted data is saved as output to a temporary file. Specifically, the crawling process is performed, and the necessary information is extracted from specific HTML tags.

[0660] Step 2:

[0661] The server analyzes the contents of the collected temporary files and organizes them by category. It uses the raw data within the temporary files as input. Depending on the data content, it performs data processing, such as classifying it into categories like "commercial facilities" or "events." The output is data organized by each category. Specifically, it uses the `categorize_data()` function to classify the data and saves the results to the database.

[0662] Step 3:

[0663] The terminal provides an interface for users to enter queries to obtain specific information. For example, a user might enter a query such as, "I want to know about events happening in my neighborhood next month." The system uses the user's query as input. The query information is sent to the server as output. Specifically, an input form is displayed, the user enters the query, and the query is sent to the server when the submit button is pressed.

[0664] Step 4:

[0665] The server filters relevant information from the database based on queries received from the user. It uses the user query and data from the database as input. For example, it might execute a database query with the condition "events scheduled nearby in the next month" to extract relevant information. The output would be the filtered event information. Specifically, an SQL query is generated and used to retrieve the necessary data from the database.

[0666] Step 5:

[0667] The server analyzes the selected information in detail. It uses the selected data as input. Statistical analysis is performed using past participant numbers and review ratings. The output yields useful insights and the most valuable information. Specifically, it generates analysis results using data analysis algorithms (e.g., clustering and recommendation algorithms).

[0668] Step 6:

[0669] The device activates an emotion engine to recognize the user's emotional state. It uses the user's voice and facial expression data as input. Specifically, it analyzes the emotional state using speech recognition and facial recognition technologies. The user's emotional state is obtained as output. In terms of specific actions, a voice assistant and camera module are used to analyze the input data.

[0670] Step 7:

[0671] The server adjusts the information it provides based on the recognized emotional state. It uses the results of the emotion engine's analysis and filtered / analyzed data as input. For example, if the server detects that the user is depressed, it prioritizes selecting uplifting event information. The output is the adjusted information. Specifically, it uses the `adjust_information_based_on_emotion()` function to filter the information and select what is appropriate for the user.

[0672] Step 8:

[0673] The server sends the final adjustment results to the terminal. The terminal displays them to the user. The adjusted information is used as input. The information is provided to the user visually or audibly as output. Specifically, event information is displayed in a list view on the terminal screen, or a voice assistant reads the information aloud.

[0674] (Application Example 2)

[0675] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0676] To maximize the effectiveness of advertising, it is crucial to deliver the most relevant ads based on the user's current emotional state. However, conventional advertising systems deliver ads uniformly without considering the user's emotional state. This leads to problems such as users perceiving ads as inappropriate or reduced advertising effectiveness. The present invention aims to improve advertising effectiveness by providing a system that delivers the most relevant ads based on the user's emotional state.

[0677] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a web scraping means, a database means, and an interface means. This allows for efficient subsequent filtering and analysis by organizing the collected data by category and storing it in the database. It also includes filtering means, analysis means, emotion engine means, and information adjustment means. This makes it possible not only to provide information based on user queries, but also to provide information appropriate to the user's emotional state.

[0678] "Web scraping" refers to a technique for automatically collecting specific information from various websites on the internet.

[0679] A "database system" is a system for classifying collected data into categories and efficiently storing and managing it.

[0680] An "interface means" is a means of receiving queries from a user and interacting with the system based on the information the user inputs.

[0681] A "filtering method" is a means of searching for information within a database based on a user's query, eliminating unnecessary information, and extracting only the relevant information.

[0682] "Analysis tools" are means for analyzing filtered information in detail and deriving and providing useful insights for the user.

[0683] An "emotional engine" is a technology that recognizes and analyzes a user's emotional state from their voice and facial expressions.

[0684] An "information adjustment mechanism" is a means of adjusting the information provided based on the user's emotions recognized by the emotion engine, and delivering the optimal information to the user at the optimal time.

[0685] "Advertising information" refers to content that includes information such as product features, price, and promotions, and is intended to advertise a specific product or service to users.

[0686] The advertising system according to the present invention aims to deliver optimal advertisements based on the user's emotional state and consists of web scraping means, database means, interface means, filtering means, analysis means, emotion engine means, and information adjustment means.

[0687] 1. Web scraping methods

[0688] The server periodically uses web scraping tools to automatically collect advertising information from various websites on the internet. This information includes product features, prices, and promotional details. This ensures that the server always has access to the latest advertising information.

[0689] 2. Database means

[0690] The server organizes the collected advertising information by category and stores it in a database. For example, it stores information categorized by product type, promotion period, target audience, etc. This allows for efficient filtering and analysis later on.

[0691] 3. Interface means

[0692] The terminal provides an interface for receiving queries from users. Users enter queries about the advertising information they want to find through the terminal. For example, they might enter a request such as, "I want to know about the promotions happening next month."

[0693] 4. Filtering means

[0694] The server filters advertising information in the database based on user queries received through the interface. For example, it might extract only promotional information for the "next month."

[0695] 5. Analysis tools

[0696] The server analyzes filtered ad information in detail to derive useful insights and results. This analysis makes it possible to deliver ads that are highly valuable to users.

[0697] 6. Emotional Engine Means

[0698] The device uses an emotion engine to recognize the user's emotions. It analyzes emotions from the user's facial expressions and tone of voice using voice input and the camera. For example, it uses the TextBlob library to perform emotion analysis, thereby understanding the user's emotional state.

[0699] 7. Information coordination means

[0700] The server adjusts the advertising information it provides based on the user's emotions, as recognized by the emotion engine. For example, if the user is excited, positive advertising information can be prioritized. Emotional data is also stored in a database and referenced in subsequent query processing.

[0701] Specific example

[0702] If a user types "I want to know about promotions happening next month" on their device and indicates a positive emotional state, the system will provide advertising information that is appropriate for that positive emotion. Specifically, it will provide information such as "Summer Sale" or "New Product Launch Event."

[0703] Example of a prompt

[0704] Please tell me about the promotions taking place next month.

[0705] Current feelings: Happy

[0706] Examples of possible promotions:

[0707] 1. Summer Sale (July 10th)

[0708] 2. New Product Launch Event (July 15th)

[0709] 3. Discount campaigns at high-end restaurants (July 20th)

[0710] In implementing this invention, terminals such as smartphones, smart glasses, and head-mounted displays are used. Furthermore, a web scraping tool implemented in Python, an SQLite database, and the TextBlob library are utilized. By considering the user's emotional state, more effective advertising delivery becomes possible.

[0711] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0712] Step 1:

[0713] The server uses web scraping tools to collect advertising information from various websites on the internet. This collected data includes product features, prices, and promotional details. The input is a list of URLs of the websites to be collected, and the output is the advertising information scraped from each site.

[0714] Step 2:

[0715] The server organizes the advertising information collected in Step 1 by category and stores it in a database. Categories include product type, promotion period, target audience, etc. The specific input is the collected advertising information, and the output is the database records organized by category.

[0716] Step 3:

[0717] The terminal provides an interface for receiving queries from users. Users input queries through the terminal, such as "I want to know about the promotions happening next month." The specific input is the user's query, and the output is the query request sent to the server.

[0718] Step 4:

[0719] The server filters advertising information in the database based on user queries received through the interface. For example, it might extract promotional information related to "next month." The specific inputs are the user's query and database records, and the output is the filtered advertising information.

[0720] Step 5:

[0721] The server analyzes the filtered ad information in step 4 in detail to derive useful insights and results. The specific input is the filtered ad information, and the output is the insights resulting from the analysis. For example, it analyzes which promotions are most appealing to users.

[0722] Step 6:

[0723] The device uses an emotion engine to recognize the user's emotions. It analyzes emotions from the user's facial expressions and tone of voice using voice input and the camera. The specific input is the user's voice and facial expression data, and the output is the analyzed emotional state (e.g., positive, negative).

[0724] Step 7:

[0725] The server adjusts the ad information it provides based on the user's emotions, as recognized by the emotion engine. If the user is in an excited state, it prioritizes providing positive ad information. The specific inputs are the user's emotional state and the analysis results, and the output is ad information appropriate to that emotion.

[0726] Step 8:

[0727] The server sends the adjusted ad information from step 7 to the device. This allows the user to receive ad information that is appropriate to their current emotional state. The specific input is the adjusted ad information, and the output is the ad information displayed to the user.

[0728] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0729] The data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of the data generation model 58 is ChatGPT (Internet Search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0730] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0731] [Third Embodiment]

[0732] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0733] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0734] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0735] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0736] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0737] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0738] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0739] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0740] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0741] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0742] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0743] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0744] The research system according to the present invention aims to improve mobile phone sales performance by efficiently collecting, organizing, and analyzing information, and providing useful information to users. The core components of this system include web scraping means, database means, interface means, filtering means, and analysis means.

[0745] 1. Web scraping methods

[0746] The server uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. This allows for the constant acquisition of the latest information in a centralized manner.

[0747] 2. Database means

[0748] The server organizes and stores the collected data in a database. This database enables highly efficient data management by separating and storing information by category. For example, it might be divided into categories such as commercial facility information, event information, and product information.

[0749] 3. Interface means

[0750] The terminal provides an interface for receiving queries (requests) from users. Users enter queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[0751] 4. Filtering means

[0752] The server filters the information in the database based on user queries received through the interface. This filtering process allows the server to extract only the specific information the user needs. For example, it can extract only event information scheduled for the "next month."

[0753] 5. Analysis tools

[0754] The server analyzes the filtered information in detail to derive useful insights and results. This analysis makes it possible to provide users with highly valuable information.

[0755] Specific example

[0756] For example, if a user enters "I want to know about events happening in my neighborhood next month" into their device, the device sends this request to the server. The server filters the database for events in the "next month" and analyzes the details of the collected events (e.g., event name, date, location, etc.). The server then sends the analysis results to the device, which provides the information to the user in the following format:

[0757] Event Information:

[0758] 1. Commercial facility A: Summer festival (July 15th)

[0759] 2. Elementary School B: Sports day (July 21st)

[0760] In this way, users can quickly obtain the information they need, which helps improve mobile phone sales performance. Similarly, information on notable products from consumer electronics manufacturers is collected, filtered, and analyzed, and then provided to users. This system allows users to effectively plan promotional activities and sales strategies.

[0761] The above describes the embodiments for carrying out the present invention. This system solves the problem of improving mobile phone sales performance through efficient information collection and provision.

[0762] The following describes the processing flow.

[0763] Step 1:

[0764] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. Specifically, it retrieves HTML data from specified URLs and extracts the necessary information (e.g., event name, date, and location).

[0765] Step 2:

[0766] The server organizes the collected data by category. For example, it separates it into commercial facility information, event information, and product information, and stores each type of data in a database. This organization allows for more efficient filtering and analysis later on.

[0767] Step 3:

[0768] The user uses the terminal to enter a query to search for information. For example, they might enter, "I want to know about events happening in my neighborhood next month."

[0769] Step 4:

[0770] The terminal sends user queries to the server. These queries are then converted into a format that can be processed directly by the server.

[0771] Step 5:

[0772] The server searches the database for information based on the received query. For example, it might filter for event information scheduled for the next month. This filtering process extracts records that match the query criteria.

[0773] Step 6:

[0774] The server further analyzes the filtered information to derive useful insights and results. For example, it organizes the extracted event information to find the most relevant information.

[0775] Step 7:

[0776] The server sends the analysis results to the terminal. For example, it might create a list of events scheduled for the following month and return it to the terminal.

[0777] Step 8:

[0778] The device displays the received information in a format that is easy for the user to understand. For example, the user can view event information in the following format:

[0779] Event Information:

[0780] 1. Commercial facility A: Summer festival (July 15th)

[0781] 2. Elementary School B: Sports day (July 21st)

[0782] Step 9:

[0783] Users use the provided information to plan their mobile sales strategies and promotional activities. Specifically, this includes preparing campaigns and exhibitions tailored to events.

[0784] As described above, this system supports users in improving their mobile phone sales performance through efficient information gathering and provision.

[0785] (Example 1)

[0786] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0787] Conventional information gathering systems lack efficiency at each stage of data collection, organization, filtering, and analysis, making it difficult for users to quickly and accurately obtain the necessary information, especially when the goal is to improve mobile phone sales performance. Furthermore, the collection and analysis of information in specific categories, such as event information and consumer electronics information, is not sufficiently automated, resulting in a heavy reliance on manual work. In contrast, the present invention aims to solve these problems and to make the process from information collection to analysis efficient and automated.

[0788] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0789] In this invention, the server includes means for automatically collecting information from the internet, means for organizing and storing the collected data, means for receiving inquiries from users, means for selecting relevant information from the information storage means based on the inquiries, and means for analyzing the selected information and providing it to the user. This makes it possible to efficiently and automatically collect, organize, filter, and analyze data, and to quickly provide useful information to users.

[0790] "Means of automatically collecting information from the Internet" refers to software or scripts used to automatically collect specific information from multiple websites on the Internet.

[0791] "Information storage means for organizing and saving collected data" refers to database systems and storage systems for classifying collected data and saving it in an appropriate format.

[0792] A "means of receiving inquiries from users" refers to an interface where users enter queries to search for specific information, allowing the server to receive user requests.

[0793] "Means for selecting relevant information from information storage means" refers to algorithms and filtering functions for searching data within information storage means based on user queries and extracting relevant data.

[0794] "Information processing means for analyzing selected information and providing it to users" refers to analytical software or data processing systems that analyze selected information in detail and provide the results to users.

[0795] The research system according to the present invention aims to improve mobile phone sales performance by efficiently collecting, organizing, and analyzing information and providing useful information to users. The core components of this system include means for automatically collecting information from the internet, information storage means for organizing and saving the collected data, inquiry means for receiving inquiries from users, means for selecting relevant information from the information storage means, and information processing means for analyzing the selected information and providing it to users.

[0796] A method for automatically collecting information from the internet

[0797] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect information on commercial facilities, events, school events, and home appliances from various websites on the internet. For example, it can retrieve the latest event information from specific news sites or blogs.

[0798] Information storage means for organizing and saving collected data

[0799] The server uses MySQL or PostgreSQL to organize and store the collected data in a database. This database stores information separately by category, enabling efficient data management. For example, it can be categorized into categories such as commercial facility information, event information, and product information.

[0800] Inquiry method for receiving inquiries from users

[0801] The terminal uses HTML / CSS and JavaScript to provide an interface for receiving queries from the user. The user enters queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[0802] Means for selecting relevant information from information storage means

[0803] The server filters the information in the database based on the user's query. For example, to extract only event information related to "next month," it uses an SQL query to retrieve the necessary records.

[0804] Information processing means that analyzes selected information and provides it to the user.

[0805] The server analyzes the filtered data in detail using Python's Pandas and NumPy libraries. For example, it derives insights such as the popularity of an event and the optimality of its venue. The analysis results are then formatted and presented to the user in an easy-to-understand format.

[0806] Specific example

[0807] For example, if a user enters "I want to know about events scheduled to be held in my neighborhood next month" on their device, the process will proceed as follows:

[0808] 1. The user enters the query using the terminal interface.

[0809] 2. The terminal sends the entered query to the server.

[0810] 3. The server collects the necessary data from the internet using web scraping tools (such as BeautifulSoup or Scrapy).

[0811] 4. The server stores the collected data in MySQL or PostgreSQL.

[0812] 5. The server uses SQL queries to filter event information for the "next month" from the database.

[0813] 6. The server analyzes the filtered data using Pandas and derives the necessary insights.

[0814] 7. The server sends the analysis results to the terminal.

[0815] 8. The terminal provides information to the user in the following format:

[0816] Event Information:

[0817] 1. Commercial facility A: Summer festival (July 15th)

[0818] 2. Elementary School B: Sports day (July 21st)

[0819] This system allows users to quickly obtain the information they need, which in turn contributes to improving mobile phone sales performance.

[0820] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0821] The specific processing flow of the program

[0822] Step 1: User query input

[0823] The terminal provides an interface for the user to input information. The user enters a query such as, "I want to know about events scheduled to be held in my neighborhood next month." This query constitutes the input data.

[0824] Input: The query that the user enters into the terminal interface.

[0825] Data processing: Convert user queries into HTTP request format.

[0826] Output: Generates an HTTP request to the server.

[0827] Step 2: Received the request

[0828] The terminal sends the entered query to the server. The query is sent in HTTP request format.

[0829] Input: HTTP request containing a user query

[0830] Data processing: Parsing HTTP requests and extracting data.

[0831] Output: Query data parsed on the server

[0832] Step 3: Data Collection (Web Scraping)

[0833] The server uses web scraping tools such as BeautifulSoup and Scrapy to collect information from the internet. For example, it might retrieve event information from specific news sites or blogs.

[0834] Input: User query passed to the server

[0835] Data processing: Information gathering through web scraping

[0836] Output: Collected raw data

[0837] Step 4: Data storage (database)

[0838] The server organizes and stores the collected data in a database running MySQL or PostgreSQL. The database stores the information categorized by type.

[0839] Input: Collected raw data

[0840] Data processing: Data organization and categorization

[0841] Output: Save to an organized database

[0842] Step 5: Data Filtering

[0843] The server filters information in the database based on the user's query. For example, it extracts information related to "next month" using an SQL query.

[0844] Input: Information stored in the database and user queries

[0845] Data Calculation: Data Extraction using SQL Queries

[0846] Output: Filtered dataset

[0847] Step 6: Data Analysis

[0848] The server uses Python's Pandas and NumPy to perform detailed analysis of the filtered data. For example, it analyzes the popularity of events and the optimality of venues.

[0849] Input: Filtered dataset

[0850] Data processing: Data analysis and statistical processing

[0851] Output: Analysis results

[0852] Step 7: Return the analysis results

[0853] The server formats the analysis results and sends them back to the user's terminal in an easy-to-understand format. This includes information such as the event name, date, and location.

[0854] Input: Analysis results

[0855] Data processing: Data formatting and transformation

[0856] Output: Analysis results sent back to the user

[0857] Step 8: Providing information to users

[0858] The terminal displays the results received from the server to the user. For example, it provides the following information:

[0859] Event Information:

[0860] 1. Commercial facility A: Summer festival (July 15th)

[0861] 2. Elementary School B: Sports day (July 21st)

[0862] Input: Analysis results returned from the server

[0863] Data processing: Formatting results for display.

[0864] Output: Information provided to the user

[0865] This series of steps allows users to efficiently obtain the necessary information, which contributes to improved mobile phone sales performance.

[0866] (Application Example 1)

[0867] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0868] Traditional information gathering systems have struggled to quickly collect and provide real-time data on categories of user interest. Therefore, there is a need to efficiently collect, organize, and analyze frequently changing product and promotional information from mobile sales and e-commerce sites. This will enable users to make quick purchasing decisions based on the latest information.

[0869] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0870] In this invention, the server includes web scraping means, database means, interface means, filtering means, analysis means, application means for collecting and providing data in categories of interest to the user in real time, and backend processing means for frequently updating detailed information on products or services. This enables the user to quickly and efficiently obtain the latest information.

[0871] "Web scraping" refers to software or programs used to automatically collect information from websites on the internet.

[0872] A "database system" is a system for organizing, storing, and efficiently managing collected data.

[0873] An "interface means" is a user interface that allows a user to input queries to a system and receive the results.

[0874] A "filtering method" is a processing method that narrows down relevant information within a database based on a user's query.

[0875] "Analysis tools" are means of analyzing filtered information to provide users with useful insights and results.

[0876] An "application means" is a software application that collects and provides data in real time on categories of interest to the user.

[0877] A "backend processing system" is a processing system that operates in the backend to frequently update and manage detailed information about a product or service.

[0878] This invention relates to a system for collecting, organizing, and analyzing information used in mobile phone sales and online shopping sites. To realize this system, the following components and their interconnections will be described in detail.

[0879] The server includes the following measures:

[0880] 1. Web scraping methods:

[0881] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect product and event information from specific websites. This allows for efficient acquisition of the latest information from the internet.

[0882] 2. Database methods:

[0883] The collected information is stored in MongoDB. The data is organized by category, for example, into categories such as home appliances, event information, and new product information.

[0884] 3. Interface means:

[0885] Users enter queries and receive results via a smartphone application. Developed using React Native, this application provides a user interface that allows users to easily find the information they need.

[0886] 4. Filtering methods:

[0887] Based on the query entered by the user, the server filters the data in MongoDB. For example, it can extract product information released within a specific period or product information belonging to a specific category.

[0888] 5. Analysis methods:

[0889] The filtered information is analyzed using Pandas and NumPy to derive useful insights and results for the user. For example, information on popular products and the most noteworthy promotions may be provided.

[0890] 6. Application methods:

[0891] A dedicated software application has been implemented to collect and provide data on categories of user interest in real time. This application can send push notifications to users with the latest information on products and brands they have registered as being of interest.

[0892] 7. Backend processing means:

[0893] The process for frequently updating detailed product and service information is implemented using Node.js and Express. This ensures that the information in the database is always up-to-date.

[0894] As a concrete example, if a user enters "Please tell me the latest information on electronic products to be released next week" into a smartphone app, the server receives the request and filters the database based on the specified conditions. Next, it analyzes the filtering results and provides the user with information on the relevant electronic products. In this way, the user can obtain the necessary information quickly and efficiently.

[0895] Example of a prompt:

[0896] "Please tell me the latest information on the electronics products that will be released next week."

[0897] This system allows users to obtain the latest information in real time and make purchasing decisions quickly.

[0898] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0899] Step 1:

[0900] The server uses BeautifulSoup and Scrapy to collect product and event information from websites. This information includes product names, prices, categories, and release dates. The collected information is temporarily stored in a data structure.

[0901] Input: Website URL

[0902] Output: Collected product and event information

[0903] Step 2:

[0904] The server organizes and stores the collected information in a MongoDB database. The data is divided into categories, such as home appliances, event information, and new product information.

[0905] Input: Data collected by scraping

[0906] Output: Information organized and stored in the database

[0907] Step 3:

[0908] The user enters a search query through a smartphone application developed with React Native. For example, they might enter a request to find information about electronic products that will be released next week.

[0909] Input: Query entered by the user into the smartphone application.

[0910] Output: Search queries sent to the server

[0911] Step 4:

[0912] The server receives queries from users and filters relevant information from within MongoDB. For example, it might extract information on electronics products released within a specific time period.

[0913] Input: Search query

[0914] Output: Filtered product information

[0915] Step 5:

[0916] The server analyzes the filtered information using Pandas and NumPy. For example, it identifies the most popular or highest-rated products among the filtered items.

[0917] Input: Filtered product information

[0918] Output: Analysis results and insights

[0919] Step 6:

[0920] The server provides analysis results to the user through a React Native application. Users can view categories and product information of interest in real time.

[0921] Input: Analysis results

[0922] Output: Insights and product information displayed to the user.

[0923] Step 7:

[0924] The server uses Node.js and Express to perform backend processing that frequently updates product and service details. This ensures that the information in the database is always up-to-date.

[0925] Input: Details of new products or services

[0926] Output: Updated database contents

[0927] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0928] The research system according to the present invention aims to improve mobile phone sales performance by collecting, organizing, and analyzing information, and further adjusting the information provided by recognizing user emotions. The core components of this system include web scraping means, database means, interface means, filtering means, analysis means, and emotion engine.

[0929] 1. Web scraping methods

[0930] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. This allows for the constant acquisition of up-to-date information in a centralized manner.

[0931] 2. Database means

[0932] The server organizes the collected data by category and stores it in a database. This allows for efficient filtering and analysis later on. For example, data can be stored in categories such as commercial facility information, event information, and product information.

[0933] 3. Interface means

[0934] The terminal provides an interface for receiving queries from users. Users enter queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[0935] 4. Filtering means

[0936] The server filters the information in the database based on user queries received through the interface. For example, it might extract only event information scheduled for the "next month."

[0937] 5. Analysis tools

[0938] The server analyzes the filtered information in detail to derive useful insights and results. This analysis makes it possible to provide users with information that is highly valuable to them.

[0939] 6. Emotional Engine

[0940] The device uses an emotion engine to recognize the user's emotions. For example, it analyzes emotions from the user's facial expressions and tone of voice using voice input or the camera. This allows it to understand the user's emotional state.

[0941] 7. Information Coordination

[0942] The server adjusts the information it provides based on the user's emotions, as recognized by the emotion engine. For example, if a user is excited, it can prioritize providing positive news and campaign information. Emotional data is also stored in a database and referenced in subsequent query processing.

[0943] Specific example

[0944] For example, if a user enters "I want to know about events happening in my neighborhood next month" into their device, the device sends this request to the server. The server filters event information related to "next month" from its database and analyzes the details of the collected events (e.g., event name, date, location, etc.). In doing so, the device recognizes the user's emotions and, if it determines that the user is feeling down, adjusts the information to prioritize providing uplifting event information. The server then sends the analysis results to the device, which provides the information to the user in the following format:

[0945] Event Information:

[0946] 1. Commercial facility A: Summer festival (July 15th)

[0947] 2. Elementary School B: Sports day (July 21st)

[0948] In this way, users can quickly obtain the information they need, which can help improve mobile phone sales performance. Similarly, information on notable products from consumer electronics manufacturers is collected, filtered, and analyzed, and then provided to users. This system allows users to effectively plan promotional activities and sales strategies.

[0949] The above describes the embodiments for carrying out the present invention. This system solves the problem of improving mobile phone sales performance through efficient information collection and provision, as well as emotion recognition functionality.

[0950] The following describes the processing flow.

[0951] Step 1:

[0952] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, such as commercial facility information, event information, school events, and enhanced product information from home appliance manufacturers. For example, it retrieves HTML data from a specified URL and extracts the necessary information (e.g., event name, date, location).

[0953] Step 2:

[0954] The server organizes the collected data by category and stores it in a database. For example, it stores data separately for commercial facilities, events, and products. This makes data management and subsequent filtering more efficient.

[0955] Step 3:

[0956] The user uses the terminal to enter a query to search for information. For example, they might enter, "I want to know about events happening in my neighborhood next month." The terminal provides an interface that makes it easy for the user to enter queries.

[0957] Step 4:

[0958] The terminal sends queries from the user to the server. The queries include all the conditions related to the information the user wants to find.

[0959] Step 5:

[0960] The server searches and filters information within the database based on the received query. For example, it might extract information about events taking place in the "next month." This filtering process extracts records that match the query criteria.

[0961] Step 6:

[0962] The server then analyzes the filtered information in detail. For example, it organizes the extracted event information to identify the most relevant events. This analysis process takes into account factors such as the scale and prominence of the events.

[0963] Step 7:

[0964] The device uses an emotion engine to recognize the user's emotions. For example, it analyzes emotions from the user's facial expressions and voice using voice input or a camera. This allows the device to understand the user's emotional state.

[0965] Step 8:

[0966] The server adjusts the information it provides based on the user's emotions, as recognized by the emotion engine. For example, if a user is feeling down, it prioritizes providing uplifting event information. This adjustment ensures that the information provided is optimal for the user's emotional state.

[0967] Step 9:

[0968] The server sends the analyzed and adjusted data to the terminal. For example, it might compile a list of events scheduled for the following month and return it to the terminal.

[0969] Step 10:

[0970] The device displays the received information in a format that is easy for the user to understand. For example, the user can view event information in the following format:

[0971] Event Information:

[0972] 1. Commercial facility A: Summer festival (July 15th)

[0973] 2. Elementary School B: Sports day (July 21st)

[0974] Step 11:

[0975] Users use the provided information to plan their mobile sales strategies and promotional activities. Specifically, this includes preparing campaigns and exhibitions tailored to events.

[0976] As described above, this system supports users in improving their mobile phone sales performance through efficient information gathering and provision, as well as emotion recognition functionality.

[0977] (Example 2)

[0978] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0979] Conventional information gathering and provision systems have the problem of not adequately providing information that meets the diverse needs and emotional states of users, making efficient sales promotion and promotional activities difficult. Furthermore, there was a need for a system that could appropriately classify and organize acquired data and quickly provide necessary information in real time.

[0980] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0981] In this invention, the server includes means for automatically collecting data from web pages on a regular basis, means for organizing the collected data by category and storing it in a database, means for receiving user inquiries, means for selecting relevant information in the database based on the inquiries, means for analyzing the selected information in detail, means for recognizing the user's emotional state, and means for adjusting the information provided based on the emotional state. This enables the provision of appropriate information in accordance with the user's emotions, thereby realizing efficient sales promotion and promotional activities.

[0982] "Means for automatically collecting data from web pages on a regular basis" refers to software or hardware that has the function of automatically collecting information from multiple websites on the internet at specified time intervals.

[0983] "Means for organizing collected data by category and storing it in a database" refers to software or hardware that has the function of classifying acquired data into predetermined categories and storing that data in a database system.

[0984] "User interface means" refers to software or hardware that has the function of providing an interface for receiving queries or requests that users enter to obtain specific information.

[0985] "Means for selecting relevant information within a database based on queries" refers to software or hardware that has the function of searching for relevant information within a database and extracting the necessary data in accordance with queries or requests from users.

[0986] "Means for detailed analysis of selected information" refers to software or hardware that has the function of analyzing data obtained as search results and deriving statistical information or useful insights.

[0987] "Means for recognizing a user's emotional state" refers to software or hardware that has the function of analyzing input information such as the user's voice and facial expressions to determine their emotional state.

[0988] "Means for adjusting information provided based on emotional state" refers to software or hardware that has the function of adjusting the content and order of information provided in accordance with the recognized emotional state of the user.

[0989] The system according to the present invention mainly consists of three main functions: a server, a terminal, and a user. These will be described in detail below.

[0990] Server Functions

[0991] Regular data collection methods

[0992] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and new product information from home appliance manufacturers. This automated collection process runs at regular intervals, ensuring that the latest information is always available.

[0993] Data organization and storage methods

[0994] The collected data is organized by category by the server. Specifically, commercial facility information is classified into the "Commercial Facilities" category, and event information into the "Events" category. The organized data is stored in databases such as MySQL or PostgreSQL, enabling efficient data management.

[0995] Data sorting method

[0996] When a user sends a query to the server through the interface, the server selects relevant information from the database based on that query. For example, in response to a query like "I want to know about events scheduled to be held in my neighborhood next month," the server will extract events that will be held in the next month from the event information.

[0997] Information analysis means

[0998] The selected information is analyzed in detail using statistical analysis and machine learning algorithms. The most useful data is extracted, taking into account factors such as past participant numbers and review ratings. This analysis provides the foundational data for delivering the most valuable information to users.

[0999] Device functions

[1000] User query acceptance method

[1001] The terminal provides an interface for users to enter queries to obtain specific information. Through the terminal, a user can enter a query such as, "I want to know about events happening in my neighborhood next month." This query information is sent to the server, and processing begins.

[1002] Means for recognizing emotional states

[1003] The device is equipped with an emotion engine to recognize the user's emotional state. Using software such as IBM Watson Tone Analyzer and Microsoft Azure Emotion API, it can analyze the user's voice and facial expressions to determine their emotional state in real time.

[1004] Information provision means

[1005] The terminal, upon receiving the final analysis results sent from the server, displays them to the user. For example, if prioritizing the display of uplifting event information for the user, the information would be provided in the following format:

[1006] Event Information:

[1007] 1. Commercial facility A: Summer festival (July 15th)

[1008] 2. Elementary School B: Sports day (July 21st)

[1009] User convenience

[1010] User interaction

[1011] Users can operate the terminal and enter queries to quickly obtain the information they need. For example, by entering a prompt such as, "I want to know about events happening in my neighborhood next month. Also, please prioritize displaying information about uplifting events," the necessary information will be provided immediately.

[1012] This system enables the provision of appropriate information tailored to the user's emotional state, facilitating efficient information gathering and sales promotion.

[1013] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1014] Step 1:

[1015] The server launches a web scraping tool (e.g., BeautifulSoup or Scrapy) at a specified time. It uses a list of website URLs as input. By accessing each URL and parsing the HTML document, it automatically collects information on commercial facilities, events, school activities, and new products from electronics manufacturers. The extracted data is saved as output to a temporary file. Specifically, the crawling process is performed, and the necessary information is extracted from specific HTML tags.

[1016] Step 2:

[1017] The server analyzes the contents of the collected temporary files and organizes them by category. It uses the raw data within the temporary files as input. Depending on the data content, it performs data processing, such as classifying it into categories like "commercial facilities" or "events." The output is data organized by each category. Specifically, it uses the `categorize_data()` function to classify the data and saves the results to the database.

[1018] Step 3:

[1019] The terminal provides an interface for users to enter queries to obtain specific information. For example, a user might enter a query such as, "I want to know about events happening in my neighborhood next month." The system uses the user's query as input. The query information is sent to the server as output. Specifically, an input form is displayed, the user enters the query, and the query is sent to the server when the submit button is pressed.

[1020] Step 4:

[1021] The server filters relevant information from the database based on queries received from the user. It uses the user query and data from the database as input. For example, it might execute a database query with the condition "events scheduled nearby in the next month" to extract relevant information. The output would be the filtered event information. Specifically, an SQL query is generated and used to retrieve the necessary data from the database.

[1022] Step 5:

[1023] The server analyzes the selected information in detail. It uses the selected data as input. Statistical analysis is performed using past participant numbers and review ratings. The output yields useful insights and the most valuable information. Specifically, it generates analysis results using data analysis algorithms (e.g., clustering and recommendation algorithms).

[1024] Step 6:

[1025] The device activates an emotion engine to recognize the user's emotional state. It uses the user's voice and facial expression data as input. Specifically, it analyzes the emotional state using speech recognition and facial recognition technologies. The user's emotional state is obtained as output. In terms of specific actions, a voice assistant and camera module are used to analyze the input data.

[1026] Step 7:

[1027] The server adjusts the information it provides based on the recognized emotional state. It uses the results of the emotion engine's analysis and filtered / analyzed data as input. For example, if the server detects that the user is depressed, it prioritizes selecting uplifting event information. The output is the adjusted information. Specifically, it uses the `adjust_information_based_on_emotion()` function to filter the information and select what is appropriate for the user.

[1028] Step 8:

[1029] The server sends the final adjustment results to the terminal. The terminal displays them to the user. The adjusted information is used as input. The information is provided to the user visually or audibly as output. Specifically, event information is displayed in a list view on the terminal screen, or a voice assistant reads the information aloud.

[1030] (Application Example 2)

[1031] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1032] To maximize the effectiveness of advertising, it is crucial to deliver the most relevant ads based on the user's current emotional state. However, conventional advertising systems deliver ads uniformly without considering the user's emotional state. This leads to problems such as users perceiving ads as inappropriate or reduced advertising effectiveness. The present invention aims to improve advertising effectiveness by providing a system that delivers the most relevant ads based on the user's emotional state.

[1033] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a web scraping means, a database means, and an interface means. This allows for efficient subsequent filtering and analysis by organizing the collected data by category and storing it in the database. It also includes filtering means, analysis means, emotion engine means, and information adjustment means. This makes it possible not only to provide information based on user queries, but also to provide information appropriate to the user's emotional state.

[1034] "Web scraping" refers to a technique for automatically collecting specific information from various websites on the internet.

[1035] A "database system" is a system for classifying collected data into categories and efficiently storing and managing it.

[1036] An "interface means" is a means of receiving queries from a user and interacting with the system based on the information the user inputs.

[1037] A "filtering method" is a means of searching for information within a database based on a user's query, eliminating unnecessary information, and extracting only the relevant information.

[1038] "Analysis tools" are means for analyzing filtered information in detail and deriving and providing useful insights for the user.

[1039] An "emotional engine" is a technology that recognizes and analyzes a user's emotional state from their voice and facial expressions.

[1040] An "information adjustment mechanism" is a means of adjusting the information provided based on the user's emotions recognized by the emotion engine, and delivering the optimal information to the user at the optimal time.

[1041] "Advertising information" refers to content that includes information such as product features, price, and promotions, and is intended to advertise a specific product or service to users.

[1042] The advertising system according to the present invention aims to deliver optimal advertisements based on the user's emotional state and consists of web scraping means, database means, interface means, filtering means, analysis means, emotion engine means, and information adjustment means.

[1043] 1. Web scraping methods

[1044] The server periodically uses web scraping tools to automatically collect advertising information from various websites on the internet. This information includes product features, prices, and promotional details. This ensures that the server always has access to the latest advertising information.

[1045] 2. Database means

[1046] The server organizes the collected advertising information by category and stores it in a database. For example, it stores information categorized by product type, promotion period, target audience, etc. This allows for efficient filtering and analysis later on.

[1047] 3. Interface means

[1048] The terminal provides an interface for receiving queries from users. Users enter queries about the advertising information they want to find through the terminal. For example, they might enter a request such as, "I want to know about the promotions happening next month."

[1049] 4. Filtering means

[1050] The server filters advertising information in the database based on user queries received through the interface. For example, it might extract only promotional information for the "next month."

[1051] 5. Analysis tools

[1052] The server analyzes filtered ad information in detail to derive useful insights and results. This analysis makes it possible to deliver ads that are highly valuable to users.

[1053] 6. Emotional Engine Means

[1054] The device uses an emotion engine to recognize the user's emotions. It analyzes emotions from the user's facial expressions and tone of voice using voice input and the camera. For example, it uses the TextBlob library to perform emotion analysis, thereby understanding the user's emotional state.

[1055] 7. Information coordination means

[1056] The server adjusts the advertising information it provides based on the user's emotions, as recognized by the emotion engine. For example, if the user is excited, positive advertising information can be prioritized. Emotional data is also stored in a database and referenced in subsequent query processing.

[1057] Specific example

[1058] If a user types "I want to know about promotions happening next month" on their device and indicates a positive emotional state, the system will provide advertising information that is appropriate for that positive emotion. Specifically, it will provide information such as "Summer Sale" or "New Product Launch Event."

[1059] Example of a prompt

[1060] Please tell me about the promotions taking place next month.

[1061] Current feelings: Happy

[1062] Examples of possible promotions:

[1063] 1. Summer Sale (July 10th)

[1064] 2. New Product Launch Event (July 15th)

[1065] 3. Discount campaigns at high-end restaurants (July 20th)

[1066] In implementing this invention, terminals such as smartphones, smart glasses, and head-mounted displays are used. Furthermore, a web scraping tool implemented in Python, an SQLite database, and the TextBlob library are utilized. By considering the user's emotional state, more effective advertising delivery becomes possible.

[1067] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1068] Step 1:

[1069] The server uses web scraping tools to collect advertising information from various websites on the internet. This collected data includes product features, prices, and promotional details. The input is a list of URLs of the websites to be collected, and the output is the advertising information scraped from each site.

[1070] Step 2:

[1071] The server organizes the advertising information collected in Step 1 by category and stores it in a database. Categories include product type, promotion period, target audience, etc. The specific input is the collected advertising information, and the output is the database records organized by category.

[1072] Step 3:

[1073] The terminal provides an interface for receiving queries from users. Users input queries through the terminal, such as "I want to know about the promotions happening next month." The specific input is the user's query, and the output is the query request sent to the server.

[1074] Step 4:

[1075] The server filters advertising information in the database based on user queries received through the interface. For example, it might extract promotional information related to "next month." The specific inputs are the user's query and database records, and the output is the filtered advertising information.

[1076] Step 5:

[1077] The server analyzes the filtered ad information in step 4 in detail to derive useful insights and results. The specific input is the filtered ad information, and the output is the insights resulting from the analysis. For example, it analyzes which promotions are most appealing to users.

[1078] Step 6:

[1079] The device uses an emotion engine to recognize the user's emotions. It analyzes emotions from the user's facial expressions and tone of voice using voice input and the camera. The specific input is the user's voice and facial expression data, and the output is the analyzed emotional state (e.g., positive, negative).

[1080] Step 7:

[1081] The server adjusts the ad information it provides based on the user's emotions, as recognized by the emotion engine. If the user is in an excited state, it prioritizes providing positive ad information. The specific inputs are the user's emotional state and the analysis results, and the output is ad information appropriate to that emotion.

[1082] Step 8:

[1083] The server sends the adjusted ad information from step 7 to the device. This allows the user to receive ad information that is appropriate to their current emotional state. The specific input is the adjusted ad information, and the output is the ad information displayed to the user.

[1084] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1085] The data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of the data generation model 58 is ChatGPT (Internet Search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1086] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1087] [Fourth Embodiment]

[1088] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1089] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1090] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1091] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1092] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1093] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1094] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1095] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1096] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1097] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1098] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1099] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1100] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1101] The research system according to the present invention aims to improve mobile phone sales performance by efficiently collecting, organizing, and analyzing information, and providing useful information to users. The core components of this system include web scraping means, database means, interface means, filtering means, and analysis means.

[1102] 1. Web scraping methods

[1103] The server uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. This allows for the constant acquisition of the latest information in a centralized manner.

[1104] 2. Database means

[1105] The server organizes and stores the collected data in a database. This database enables highly efficient data management by separating and storing information by category. For example, it might be divided into categories such as commercial facility information, event information, and product information.

[1106] 3. Interface means

[1107] The terminal provides an interface for receiving queries (requests) from users. Users enter queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[1108] 4. Filtering means

[1109] The server filters the information in the database based on user queries received through the interface. This filtering process allows the server to extract only the specific information the user needs. For example, it can extract only event information scheduled for the "next month."

[1110] 5. Analysis tools

[1111] The server analyzes the filtered information in detail to derive useful insights and results. This analysis makes it possible to provide users with highly valuable information.

[1112] Specific example

[1113] For example, if a user enters "I want to know about events happening in my neighborhood next month" into their device, the device sends this request to the server. The server filters the database for events in the "next month" and analyzes the details of the collected events (e.g., event name, date, location, etc.). The server then sends the analysis results to the device, which provides the information to the user in the following format:

[1114] Event Information:

[1115] 1. Commercial facility A: Summer festival (July 15th)

[1116] 2. Elementary School B: Sports day (July 21st)

[1117] In this way, users can quickly obtain the information they need, which helps improve mobile phone sales performance. Similarly, information on notable products from consumer electronics manufacturers is collected, filtered, and analyzed, and then provided to users. This system allows users to effectively plan promotional activities and sales strategies.

[1118] The above describes the embodiments for carrying out the present invention. This system solves the problem of improving mobile phone sales performance through efficient information collection and provision.

[1119] The following describes the processing flow.

[1120] Step 1:

[1121] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. Specifically, it retrieves HTML data from specified URLs and extracts the necessary information (e.g., event name, date, and location).

[1122] Step 2:

[1123] The server organizes the collected data by category. For example, it separates it into commercial facility information, event information, and product information, and stores each type of data in a database. This organization allows for more efficient filtering and analysis later on.

[1124] Step 3:

[1125] The user uses the terminal to enter a query to search for information. For example, they might enter, "I want to know about events happening in my neighborhood next month."

[1126] Step 4:

[1127] The terminal sends user queries to the server. These queries are then converted into a format that can be processed directly by the server.

[1128] Step 5:

[1129] The server searches the database for information based on the received query. For example, it might filter for event information scheduled for the next month. This filtering process extracts records that match the query criteria.

[1130] Step 6:

[1131] The server further analyzes the filtered information to derive useful insights and results. For example, it organizes the extracted event information to find the most relevant information.

[1132] Step 7:

[1133] The server sends the analysis results to the terminal. For example, it might create a list of events scheduled for the following month and return it to the terminal.

[1134] Step 8:

[1135] The device displays the received information in a format that is easy for the user to understand. For example, the user can view event information in the following format:

[1136] Event Information:

[1137] 1. Commercial facility A: Summer festival (July 15th)

[1138] 2. Elementary School B: Sports day (July 21st)

[1139] Step 9:

[1140] Users use the provided information to plan their mobile sales strategies and promotional activities. Specifically, this includes preparing campaigns and exhibitions tailored to events.

[1141] As described above, this system supports users in improving their mobile phone sales performance through efficient information gathering and provision.

[1142] (Example 1)

[1143] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1144] Conventional information gathering systems lack efficiency at each stage of data collection, organization, filtering, and analysis, making it difficult for users to quickly and accurately obtain the necessary information, especially when the goal is to improve mobile phone sales performance. Furthermore, the collection and analysis of information in specific categories, such as event information and consumer electronics information, is not sufficiently automated, resulting in a heavy reliance on manual work. In contrast, the present invention aims to solve these problems and to make the process from information collection to analysis efficient and automated.

[1145] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1146] In this invention, the server includes means for automatically collecting information from the internet, means for organizing and storing the collected data, means for receiving inquiries from users, means for selecting relevant information from the information storage means based on the inquiries, and means for analyzing the selected information and providing it to the user. This makes it possible to efficiently and automatically collect, organize, filter, and analyze data, and to quickly provide useful information to users.

[1147] "Means of automatically collecting information from the Internet" refers to software or scripts used to automatically collect specific information from multiple websites on the Internet.

[1148] "Information storage means for organizing and saving collected data" refers to database systems and storage systems for classifying collected data and saving it in an appropriate format.

[1149] A "means of receiving inquiries from users" refers to an interface where users enter queries to search for specific information, allowing the server to receive user requests.

[1150] "Means for selecting relevant information from information storage means" refers to algorithms and filtering functions for searching data within information storage means based on user queries and extracting relevant data.

[1151] "Information processing means for analyzing selected information and providing it to users" refers to analytical software or data processing systems that analyze selected information in detail and provide the results to users.

[1152] The research system according to the present invention aims to improve mobile phone sales performance by efficiently collecting, organizing, and analyzing information and providing useful information to users. The core components of this system include means for automatically collecting information from the internet, information storage means for organizing and saving the collected data, inquiry means for receiving inquiries from users, means for selecting relevant information from the information storage means, and information processing means for analyzing the selected information and providing it to users.

[1153] A method for automatically collecting information from the internet

[1154] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect information on commercial facilities, events, school events, and home appliances from various websites on the internet. For example, it can retrieve the latest event information from specific news sites or blogs.

[1155] Information storage means for organizing and saving collected data

[1156] The server uses MySQL or PostgreSQL to organize and store the collected data in a database. This database stores information separately by category, enabling efficient data management. For example, it can be categorized into categories such as commercial facility information, event information, and product information.

[1157] Inquiry method for receiving inquiries from users

[1158] The terminal uses HTML / CSS and JavaScript to provide an interface for receiving queries from the user. The user enters queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[1159] Means for selecting relevant information from information storage means

[1160] The server filters the information in the database based on the user's query. For example, to extract only event information related to "next month," it uses an SQL query to retrieve the necessary records.

[1161] Information processing means that analyzes selected information and provides it to the user.

[1162] The server analyzes the filtered data in detail using Python's Pandas and NumPy libraries. For example, it derives insights such as the popularity of an event and the optimality of its venue. The analysis results are then formatted and presented to the user in an easy-to-understand format.

[1163] Specific example

[1164] For example, if a user enters "I want to know about events scheduled to be held in my neighborhood next month" on their device, the process will proceed as follows:

[1165] 1. The user enters the query using the terminal interface.

[1166] 2. The terminal sends the entered query to the server.

[1167] 3. The server collects the necessary data from the internet using web scraping tools (such as BeautifulSoup or Scrapy).

[1168] 4. The server stores the collected data in MySQL or PostgreSQL.

[1169] 5. The server uses SQL queries to filter event information for the "next month" from the database.

[1170] 6. The server analyzes the filtered data using Pandas and derives the necessary insights.

[1171] 7. The server sends the analysis results to the terminal.

[1172] 8. The terminal provides information to the user in the following format:

[1173] Event Information:

[1174] 1. Commercial facility A: Summer festival (July 15th)

[1175] 2. Elementary School B: Sports day (July 21st)

[1176] This system allows users to quickly obtain the information they need, which in turn contributes to improving mobile phone sales performance.

[1177] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1178] The specific processing flow of the program

[1179] Step 1: User query input

[1180] The terminal provides an interface for the user to input information. The user enters a query such as, "I want to know about events scheduled to be held in my neighborhood next month." This query constitutes the input data.

[1181] Input: The query that the user enters into the terminal interface.

[1182] Data processing: Convert user queries into HTTP request format.

[1183] Output: Generates an HTTP request to the server.

[1184] Step 2: Received the request

[1185] The terminal sends the entered query to the server. The query is sent in HTTP request format.

[1186] Input: HTTP request containing a user query

[1187] Data processing: Parsing HTTP requests and extracting data.

[1188] Output: Query data parsed on the server

[1189] Step 3: Data Collection (Web Scraping)

[1190] The server uses web scraping tools such as BeautifulSoup and Scrapy to collect information from the internet. For example, it might retrieve event information from specific news sites or blogs.

[1191] Input: User query passed to the server

[1192] Data processing: Information gathering through web scraping

[1193] Output: Collected raw data

[1194] Step 4: Data storage (database)

[1195] The server organizes and stores the collected data in a database running MySQL or PostgreSQL. The database stores the information categorized by type.

[1196] Input: Collected raw data

[1197] Data processing: Data organization and categorization

[1198] Output: Save to an organized database

[1199] Step 5: Data Filtering

[1200] The server filters information in the database based on the user's query. For example, it extracts information related to "next month" using an SQL query.

[1201] Input: Information stored in the database and user queries

[1202] Data Calculation: Data Extraction using SQL Queries

[1203] Output: Filtered dataset

[1204] Step 6: Data Analysis

[1205] The server uses Python's Pandas and NumPy to perform detailed analysis of the filtered data. For example, it analyzes the popularity of events and the optimality of venues.

[1206] Input: Filtered dataset

[1207] Data processing: Data analysis and statistical processing

[1208] Output: Analysis results

[1209] Step 7: Return the analysis results

[1210] The server formats the analysis results and sends them back to the user's terminal in an easy-to-understand format. This includes information such as the event name, date, and location.

[1211] Input: Analysis results

[1212] Data processing: Data formatting and transformation

[1213] Output: Analysis results sent back to the user

[1214] Step 8: Providing information to users

[1215] The terminal displays the results received from the server to the user. For example, it provides the following information:

[1216] Event Information:

[1217] 1. Commercial facility A: Summer festival (July 15th)

[1218] 2. Elementary School B: Sports day (July 21st)

[1219] Input: Analysis results returned from the server

[1220] Data processing: Formatting results for display.

[1221] Output: Information provided to the user

[1222] This series of steps allows users to efficiently obtain the necessary information, which contributes to improved mobile phone sales performance.

[1223] (Application Example 1)

[1224] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1225] Traditional information gathering systems have struggled to quickly collect and provide real-time data on categories of user interest. Therefore, there is a need to efficiently collect, organize, and analyze frequently changing product and promotional information from mobile sales and e-commerce sites. This will enable users to make quick purchasing decisions based on the latest information.

[1226] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1227] In this invention, the server includes web scraping means, database means, interface means, filtering means, analysis means, application means for collecting and providing data in categories of interest to the user in real time, and backend processing means for frequently updating detailed information on products or services. This enables the user to quickly and efficiently obtain the latest information.

[1228] "Web scraping" refers to software or programs used to automatically collect information from websites on the internet.

[1229] A "database system" is a system for organizing, storing, and efficiently managing collected data.

[1230] An "interface means" is a user interface that allows a user to input queries to a system and receive the results.

[1231] A "filtering method" is a processing method that narrows down relevant information within a database based on a user's query.

[1232] "Analysis tools" are means of analyzing filtered information to provide users with useful insights and results.

[1233] An "application means" is a software application that collects and provides data in real time on categories of interest to the user.

[1234] A "backend processing system" is a processing system that operates in the backend to frequently update and manage detailed information about a product or service.

[1235] This invention relates to a system for collecting, organizing, and analyzing information used in mobile phone sales and online shopping sites. To realize this system, the following components and their interconnections will be described in detail.

[1236] The server includes the following measures:

[1237] 1. Web scraping methods:

[1238] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect product and event information from specific websites. This allows for efficient acquisition of the latest information from the internet.

[1239] 2. Database methods:

[1240] The collected information is stored in MongoDB. The data is organized by category, for example, into categories such as home appliances, event information, and new product information.

[1241] 3. Interface means:

[1242] Users enter queries and receive results via a smartphone application. Developed using React Native, this application provides a user interface that allows users to easily find the information they need.

[1243] 4. Filtering methods:

[1244] Based on the query entered by the user, the server filters the data in MongoDB. For example, it can extract product information released within a specific period or product information belonging to a specific category.

[1245] 5. Analysis methods:

[1246] The filtered information is analyzed using Pandas and NumPy to derive useful insights and results for the user. For example, information on popular products and the most noteworthy promotions may be provided.

[1247] 6. Application methods:

[1248] A dedicated software application has been implemented to collect and provide data on categories of user interest in real time. This application can send push notifications to users with the latest information on products and brands they have registered as being of interest.

[1249] 7. Backend processing means:

[1250] The process for frequently updating detailed product and service information is implemented using Node.js and Express. This ensures that the information in the database is always up-to-date.

[1251] As a concrete example, if a user enters "Please tell me the latest information on electronic products to be released next week" into a smartphone app, the server receives the request and filters the database based on the specified conditions. Next, it analyzes the filtering results and provides the user with information on the relevant electronic products. In this way, the user can obtain the necessary information quickly and efficiently.

[1252] Example of a prompt:

[1253] "Please tell me the latest information on the electronics products that will be released next week."

[1254] This system allows users to obtain the latest information in real time and make purchasing decisions quickly.

[1255] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1256] Step 1:

[1257] The server uses BeautifulSoup and Scrapy to collect product and event information from websites. This information includes product names, prices, categories, and release dates. The collected information is temporarily stored in a data structure.

[1258] Input: Website URL

[1259] Output: Collected product and event information

[1260] Step 2:

[1261] The server organizes and stores the collected information in a MongoDB database. The data is divided into categories, such as home appliances, event information, and new product information.

[1262] Input: Data collected by scraping

[1263] Output: Information organized and stored in the database

[1264] Step 3:

[1265] The user enters a search query through a smartphone application developed with React Native. For example, they might enter a request to find information about electronic products that will be released next week.

[1266] Input: Query entered by the user into the smartphone application.

[1267] Output: Search queries sent to the server

[1268] Step 4:

[1269] The server receives queries from users and filters relevant information from within MongoDB. For example, it might extract information on electronics products released within a specific time period.

[1270] Input: Search query

[1271] Output: Filtered product information

[1272] Step 5:

[1273] The server analyzes the filtered information using Pandas and NumPy. For example, it identifies the most popular or highest-rated products among the filtered items.

[1274] Input: Filtered product information

[1275] Output: Analysis results and insights

[1276] Step 6:

[1277] The server provides analysis results to the user through a React Native application. Users can view categories and product information of interest in real time.

[1278] Input: Analysis results

[1279] Output: Insights and product information displayed to the user.

[1280] Step 7:

[1281] The server uses Node.js and Express to perform backend processing that frequently updates product and service details. This ensures that the information in the database is always up-to-date.

[1282] Input: Details of new products or services

[1283] Output: Updated database contents

[1284] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1285] The research system according to the present invention aims to improve mobile phone sales performance by collecting, organizing, and analyzing information, and further adjusting the information provided by recognizing user emotions. The core components of this system include web scraping means, database means, interface means, filtering means, analysis means, and emotion engine.

[1286] 1. Web scraping methods

[1287] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and information on enhanced products from home appliance manufacturers. This allows for the constant acquisition of up-to-date information in a centralized manner.

[1288] 2. Database means

[1289] The server organizes the collected data by category and stores it in a database. This allows for efficient filtering and analysis later on. For example, data can be stored in categories such as commercial facility information, event information, and product information.

[1290] 3. Interface means

[1291] The terminal provides an interface for receiving queries from users. Users enter queries about the information they want to find through the terminal. For example, they might enter a request such as, "I want to know about events happening in my neighborhood next month."

[1292] 4. Filtering means

[1293] The server filters the information in the database based on user queries received through the interface. For example, it might extract only event information scheduled for the "next month."

[1294] 5. Analysis tools

[1295] The server analyzes the filtered information in detail to derive useful insights and results. This analysis makes it possible to provide users with information that is highly valuable to them.

[1296] 6. Emotional Engine

[1297] The device uses an emotion engine to recognize the user's emotions. For example, it analyzes emotions from the user's facial expressions and tone of voice using voice input or the camera. This allows it to understand the user's emotional state.

[1298] 7. Information Coordination

[1299] The server adjusts the information it provides based on the user's emotions, as recognized by the emotion engine. For example, if a user is excited, it can prioritize providing positive news and campaign information. Emotional data is also stored in a database and referenced in subsequent query processing.

[1300] Specific example

[1301] For example, if a user enters "I want to know about events happening in my neighborhood next month" into their device, the device sends this request to the server. The server filters event information related to "next month" from its database and analyzes the details of the collected events (e.g., event name, date, location, etc.). In doing so, the device recognizes the user's emotions and, if it determines that the user is feeling down, adjusts the information to prioritize providing uplifting event information. The server then sends the analysis results to the device, which provides the information to the user in the following format:

[1302] Event Information:

[1303] 1. Commercial facility A: Summer festival (July 15th)

[1304] 2. Elementary School B: Sports day (July 21st)

[1305] In this way, users can quickly obtain the information they need, which can help improve mobile phone sales performance. Similarly, information on notable products from consumer electronics manufacturers is collected, filtered, and analyzed, and then provided to users. This system allows users to effectively plan promotional activities and sales strategies.

[1306] The above describes the embodiments for carrying out the present invention. This system solves the problem of improving mobile phone sales performance through efficient information collection and provision, as well as emotion recognition functionality.

[1307] The following describes the processing flow.

[1308] Step 1:

[1309] The server periodically uses web scraping tools to automatically collect information from various websites on the internet, such as commercial facility information, event information, school events, and enhanced product information from home appliance manufacturers. For example, it retrieves HTML data from a specified URL and extracts the necessary information (e.g., event name, date, location).

[1310] Step 2:

[1311] The server organizes the collected data by category and stores it in a database. For example, it stores data separately for commercial facilities, events, and products. This makes data management and subsequent filtering more efficient.

[1312] Step 3:

[1313] The user uses the terminal to enter a query to search for information. For example, they might enter, "I want to know about events happening in my neighborhood next month." The terminal provides an interface that makes it easy for the user to enter queries.

[1314] Step 4:

[1315] The terminal sends queries from the user to the server. The queries include all the conditions related to the information the user wants to find.

[1316] Step 5:

[1317] The server searches and filters information within the database based on the received query. For example, it might extract information about events taking place in the "next month." This filtering process extracts records that match the query criteria.

[1318] Step 6:

[1319] The server then analyzes the filtered information in detail. For example, it organizes the extracted event information to identify the most relevant events. This analysis process takes into account factors such as the scale and prominence of the events.

[1320] Step 7:

[1321] The device uses an emotion engine to recognize the user's emotions. For example, it analyzes emotions from the user's facial expressions and voice using voice input or a camera. This allows the device to understand the user's emotional state.

[1322] Step 8:

[1323] The server adjusts the information it provides based on the user's emotions, as recognized by the emotion engine. For example, if a user is feeling down, it prioritizes providing uplifting event information. This adjustment ensures that the information provided is optimal for the user's emotional state.

[1324] Step 9:

[1325] The server sends the analyzed and adjusted data to the terminal. For example, it might compile a list of events scheduled for the following month and return it to the terminal.

[1326] Step 10:

[1327] The device displays the received information in a format that is easy for the user to understand. For example, the user can view event information in the following format:

[1328] Event Information:

[1329] 1. Commercial facility A: Summer festival (July 15th)

[1330] 2. Elementary School B: Sports day (July 21st)

[1331] Step 11:

[1332] Users use the provided information to plan their mobile sales strategies and promotional activities. Specifically, this includes preparing campaigns and exhibitions tailored to events.

[1333] As described above, this system supports users in improving their mobile phone sales performance through efficient information gathering and provision, as well as emotion recognition functionality.

[1334] (Example 2)

[1335] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1336] Conventional information gathering and provision systems have the problem of not adequately providing information that meets the diverse needs and emotional states of users, making efficient sales promotion and promotional activities difficult. Furthermore, there was a need for a system that could appropriately classify and organize acquired data and quickly provide necessary information in real time.

[1337] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1338] In this invention, the server includes means for automatically collecting data from web pages on a regular basis, means for organizing the collected data by category and storing it in a database, means for receiving user inquiries, means for selecting relevant information in the database based on the inquiries, means for analyzing the selected information in detail, means for recognizing the user's emotional state, and means for adjusting the information provided based on the emotional state. This enables the provision of appropriate information in accordance with the user's emotions, thereby realizing efficient sales promotion and promotional activities.

[1339] "Means for automatically collecting data from web pages on a regular basis" refers to software or hardware that has the function of automatically collecting information from multiple websites on the internet at specified time intervals.

[1340] "Means for organizing collected data by category and storing it in a database" refers to software or hardware that has the function of classifying acquired data into predetermined categories and storing that data in a database system.

[1341] "User interface means" refers to software or hardware that has the function of providing an interface for receiving queries or requests that users enter to obtain specific information.

[1342] "Means for selecting relevant information within a database based on queries" refers to software or hardware that has the function of searching for relevant information within a database and extracting the necessary data in accordance with queries or requests from users.

[1343] "Means for detailed analysis of selected information" refers to software or hardware that has the function of analyzing data obtained as search results and deriving statistical information or useful insights.

[1344] "Means for recognizing a user's emotional state" refers to software or hardware that has the function of analyzing input information such as the user's voice and facial expressions to determine their emotional state.

[1345] "Means for adjusting information provided based on emotional state" refers to software or hardware that has the function of adjusting the content and order of information provided in accordance with the recognized emotional state of the user.

[1346] The system according to the present invention mainly consists of three main functions: a server, a terminal, and a user. These will be described in detail below.

[1347] Server Functions

[1348] Regular data collection methods

[1349] The server uses web scraping tools such as BeautifulSoup and Scrapy to automatically collect information from various websites on the internet, including commercial facility information, event information, school events, and new product information from home appliance manufacturers. This automated collection process runs at regular intervals, ensuring that the latest information is always available.

[1350] Data organization and storage methods

[1351] The collected data is organized by category by the server. Specifically, commercial facility information is classified into the "Commercial Facilities" category, and event information into the "Events" category. The organized data is stored in databases such as MySQL or PostgreSQL, enabling efficient data management.

[1352] Data sorting method

[1353] When a user sends a query to the server through the interface, the server selects relevant information from the database based on that query. For example, in response to a query like "I want to know about events scheduled to be held in my neighborhood next month," the server will extract events that will be held in the next month from the event information.

[1354] Information analysis means

[1355] The selected information is analyzed in detail using statistical analysis and machine learning algorithms. The most useful data is extracted, taking into account factors such as past participant numbers and review ratings. This analysis provides the foundational data for delivering the most valuable information to users.

[1356] Device functions

[1357] User query acceptance method

[1358] The terminal provides an interface for users to enter queries to obtain specific information. Through the terminal, a user can enter a query such as, "I want to know about events happening in my neighborhood next month." This query information is sent to the server, and processing begins.

[1359] Means for recognizing emotional states

[1360] The device is equipped with an emotion engine to recognize the user's emotional state. Using software such as IBM Watson Tone Analyzer and Microsoft Azure Emotion API, it can analyze the user's voice and facial expressions to determine their emotional state in real time.

[1361] Information provision means

[1362] The terminal, upon receiving the final analysis results sent from the server, displays them to the user. For example, if prioritizing the display of uplifting event information for the user, the information would be provided in the following format:

[1363] Event Information:

[1364] 1. Commercial facility A: Summer festival (July 15th)

[1365] 2. Elementary School B: Sports day (July 21st)

[1366] User convenience

[1367] User interaction

[1368] Users can operate the terminal and enter queries to quickly obtain the information they need. For example, by entering a prompt such as, "I want to know about events happening in my neighborhood next month. Also, please prioritize displaying information about uplifting events," the necessary information will be provided immediately.

[1369] This system enables the provision of appropriate information tailored to the user's emotional state, facilitating efficient information gathering and sales promotion.

[1370] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1371] Step 1:

[1372] The server launches a web scraping tool (e.g., BeautifulSoup or Scrapy) at a specified time. It uses a list of website URLs as input. By accessing each URL and parsing the HTML document, it automatically collects information on commercial facilities, events, school activities, and new products from electronics manufacturers. The extracted data is saved as output to a temporary file. Specifically, the crawling process is performed, and the necessary information is extracted from specific HTML tags.

[1373] Step 2:

[1374] The server analyzes the contents of the collected temporary files and organizes them by category. It uses the raw data within the temporary files as input. Depending on the data content, it performs data processing, such as classifying it into categories like "commercial facilities" or "events." The output is data organized by each category. Specifically, it uses the `categorize_data()` function to classify the data and saves the results to the database.

[1375] Step 3:

[1376] The terminal provides an interface for users to enter queries to obtain specific information. For example, a user might enter a query such as, "I want to know about events happening in my neighborhood next month." The system uses the user's query as input. The query information is sent to the server as output. Specifically, an input form is displayed, the user enters the query, and the query is sent to the server when the submit button is pressed.

[1377] Step 4:

[1378] The server filters relevant information from the database based on queries received from the user. It uses the user query and data from the database as input. For example, it might execute a database query with the condition "events scheduled nearby in the next month" to extract relevant information. The output would be the filtered event information. Specifically, an SQL query is generated and used to retrieve the necessary data from the database.

[1379] Step 5:

[1380] The server analyzes the selected information in detail. It uses the selected data as input. Statistical analysis is performed using past participant numbers and review ratings. The output yields useful insights and the most valuable information. Specifically, it generates analysis results using data analysis algorithms (e.g., clustering and recommendation algorithms).

[1381] Step 6:

[1382] The device activates an emotion engine to recognize the user's emotional state. It uses the user's voice and facial expression data as input. Specifically, it analyzes the emotional state using speech recognition and facial recognition technologies. The user's emotional state is obtained as output. In terms of specific actions, a voice assistant and camera module are used to analyze the input data.

[1383] Step 7:

[1384] The server adjusts the information it provides based on the recognized emotional state. It uses the results of the emotion engine's analysis and filtered / analyzed data as input. For example, if the server detects that the user is depressed, it prioritizes selecting uplifting event information. The output is the adjusted information. Specifically, it uses the `adjust_information_based_on_emotion()` function to filter the information and select what is appropriate for the user.

[1385] Step 8:

[1386] The server sends the final adjustment results to the terminal. The terminal displays them to the user. The adjusted information is used as input. The information is provided to the user visually or audibly as output. Specifically, event information is displayed in a list view on the terminal screen, or a voice assistant reads the information aloud.

[1387] (Application Example 2)

[1388] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1389] To maximize the effectiveness of advertising, it is crucial to deliver the most relevant ads based on the user's current emotional state. However, conventional advertising systems deliver ads uniformly without considering the user's emotional state. This leads to problems such as users perceiving ads as inappropriate or reduced advertising effectiveness. The present invention aims to improve advertising effectiveness by providing a system that delivers the most relevant ads based on the user's emotional state.

[1390] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a web scraping means, a database means, and an interface means. This allows for efficient subsequent filtering and analysis by organizing the collected data by category and storing it in the database. It also includes filtering means, analysis means, emotion engine means, and information adjustment means. This makes it possible not only to provide information based on user queries, but also to provide information appropriate to the user's emotional state.

[1391] "Web scraping" refers to a technique for automatically collecting specific information from various websites on the internet.

[1392] A "database system" is a system for classifying collected data into categories and efficiently storing and managing it.

[1393] An "interface means" is a means of receiving queries from a user and interacting with the system based on the information the user inputs.

[1394] A "filtering method" is a means of searching for information within a database based on a user's query, eliminating unnecessary information, and extracting only the relevant information.

[1395] "Analysis tools" are means for analyzing filtered information in detail and deriving and providing useful insights for the user.

[1396] An "emotional engine" is a technology that recognizes and analyzes a user's emotional state from their voice and facial expressions.

[1397] An "information adjustment mechanism" is a means of adjusting the information provided based on the user's emotions recognized by the emotion engine, and delivering the optimal information to the user at the optimal time.

[1398] "Advertising information" refers to content that includes information such as product features, price, and promotions, and is intended to advertise a specific product or service to users.

[1399] The advertising system according to the present invention aims to deliver optimal advertisements based on the user's emotional state and consists of web scraping means, database means, interface means, filtering means, analysis means, emotion engine means, and information adjustment means.

[1400] 1. Web scraping methods

[1401] The server periodically uses web scraping tools to automatically collect advertising information from various websites on the internet. This information includes product features, prices, and promotional details. This ensures that the server always has access to the latest advertising information.

[1402] 2. Database means

[1403] The server organizes the collected advertising information by category and stores it in a database. For example, it stores information categorized by product type, promotion period, target audience, etc. This allows for efficient filtering and analysis later on.

[1404] 3. Interface means

[1405] The terminal provides an interface for receiving queries from users. Users enter queries about the advertising information they want to find through the terminal. For example, they might enter a request such as, "I want to know about the promotions happening next month."

[1406] 4. Filtering means

[1407] The server filters advertising information in the database based on user queries received through the interface. For example, it might extract only promotional information for the "next month."

[1408] 5. Analysis tools

[1409] The server analyzes filtered ad information in detail to derive useful insights and results. This analysis makes it possible to deliver ads that are highly valuable to users.

[1410] 6. Emotional Engine Means

[1411] The device uses an emotion engine to recognize the user's emotions. It analyzes emotions from the user's facial expressions and tone of voice using voice input and the camera. For example, it uses the TextBlob library to perform emotion analysis, thereby understanding the user's emotional state.

[1412] 7. Information coordination means

[1413] The server adjusts the advertising information it provides based on the user's emotions, as recognized by the emotion engine. For example, if the user is excited, positive advertising information can be prioritized. Emotional data is also stored in a database and referenced in subsequent query processing.

[1414] Specific example

[1415] If a user types "I want to know about promotions happening next month" on their device and indicates a positive emotional state, the system will provide advertising information that is appropriate for that positive emotion. Specifically, it will provide information such as "Summer Sale" or "New Product Launch Event."

[1416] Example of a prompt

[1417] Please tell me about the promotions taking place next month.

[1418] Current feelings: Happy

[1419] Examples of possible promotions:

[1420] 1. Summer Sale (July 10th)

[1421] 2. New Product Launch Event (July 15th)

[1422] 3. Discount campaigns at high-end restaurants (July 20th)

[1423] In implementing this invention, terminals such as smartphones, smart glasses, and head-mounted displays are used. Furthermore, a web scraping tool implemented in Python, an SQLite database, and the TextBlob library are utilized. By considering the user's emotional state, more effective advertising delivery becomes possible.

[1424] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1425] Step 1:

[1426] The server uses web scraping tools to collect advertising information from various websites on the internet. This collected data includes product features, prices, and promotional details. The input is a list of URLs of the websites to be collected, and the output is the advertising information scraped from each site.

[1427] Step 2:

[1428] The server organizes the advertising information collected in Step 1 by category and stores it in a database. Categories include product type, promotion period, target audience, etc. The specific input is the collected advertising information, and the output is the database records organized by category.

[1429] Step 3:

[1430] The terminal provides an interface for receiving queries from users. Users input queries through the terminal, such as "I want to know about the promotions happening next month." The specific input is the user's query, and the output is the query request sent to the server.

[1431] Step 4:

[1432] The server filters advertising information in the database based on user queries received through the interface. For example, it might extract promotional information related to "next month." The specific inputs are the user's query and database records, and the output is the filtered advertising information.

[1433] Step 5:

[1434] The server analyzes the filtered ad information in step 4 in detail to derive useful insights and results. The specific input is the filtered ad information, and the output is the insights resulting from the analysis. For example, it analyzes which promotions are most appealing to users.

[1435] Step 6:

[1436] The device uses an emotion engine to recognize the user's emotions. It analyzes emotions from the user's facial expressions and tone of voice using voice input and the camera. The specific input is the user's voice and facial expression data, and the output is the analyzed emotional state (e.g., positive, negative).

[1437] Step 7:

[1438] The server adjusts the ad information it provides based on the user's emotions, as recognized by the emotion engine. If the user is in an excited state, it prioritizes providing positive ad information. The specific inputs are the user's emotional state and the analysis results, and the output is ad information appropriate to that emotion.

[1439] Step 8:

[1440] The server sends the adjusted ad information from step 7 to the device. This allows the user to receive ad information that is appropriate to their current emotional state. The specific input is the adjusted ad information, and the output is the ad information displayed to the user.

[1441] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1442] The data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of the data generation model 58 is ChatGPT (Internet Search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1443] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1444] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1445] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1446] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1447] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1448] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1449] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1450] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1451] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1452] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1453] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1454] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1455] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1456] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1457] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1458] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1459] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1460] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1461] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[1462] The following is further disclosed regarding the embodiments described above.

[1463] (Claim 1)

[1464] Web scraping methods,

[1465] A database means for organizing and storing the data collected by that web scraping method,

[1466] An interface means for receiving queries from users,

[1467] A means of filtering relevant information from the database based on that query,

[1468] A means of analyzing filtered information and providing it to the user,

[1469] A system that includes this.

[1470] (Claim 2)

[1471] The system according to claim 1, comprising a web scraping means for collecting event information.

[1472] (Claim 3)

[1473] The system according to claim 1, comprising a web scraping means for collecting information on home appliances.

[1474] "Example 1"

[1475] (Claim 1)

[1476] A means of automatically collecting information from the internet,

[1477] An information storage means for organizing and saving the collected data,

[1478] A means of receiving inquiries from users,

[1479] A means for selecting relevant information from the information storage means based on that inquiry,

[1480] Information processing means that analyzes selected information and provides it to the user,

[1481] A system that includes this.

[1482] (Claim 2)

[1483] The system according to claim 1 for collecting event information.

[1484] (Claim 3)

[1485] A system according to claim 1 for collecting information on household electrical appliances.

[1486] "Application Example 1"

[1487] (Claim 1)

[1488] Web scraping methods,

[1489] A database means for organizing and storing the data collected by that web scraping method,

[1490] An interface means for receiving queries from users,

[1491] A means of filtering relevant information from the database based on that query,

[1492] A means of analyzing filtered information and providing it to the user,

[1493] An application means for collecting and providing data in real time on categories of interest to users,

[1494] A backend processing means for frequently updating detailed information about a product or service,

[1495] A system that includes this.

[1496] (Claim 2)

[1497] The system according to claim 1, comprising a web scraping means for collecting event information.

[1498] (Claim 3)

[1499] The system according to claim 1, comprising a web scraping means for collecting product information.

[1500] "Example 2 of combining an emotion engine"

[1501] (Claim 1)

[1502] A method for automatically collecting data from web pages on a regular basis,

[1503] A means of organizing the collected data by category and storing it in a database,

[1504] An interface for receiving inquiries from users,

[1505] A means of selecting relevant information within the database based on that query,

[1506] A means of analyzing the selected information in detail,

[1507] A means of recognizing the user's emotional state,

[1508] A means of adjusting the information provided based on that emotional state,

[1509] A system that includes this.

[1510] (Claim 2)

[1511] The system according to claim 1, comprising means for automatically collecting data from a periodic web page that collects event data.

[1512] (Claim 3)

[1513] The system according to claim 1, comprising means for automatically collecting data from a regular web page that collects product data.

[1514] "Application example 2 when combining with an emotional engine"

[1515] (Claim 1)

[1516] Web scraping methods,

[1517] A database means for organizing and storing the data collected by that web scraping method,

[1518] An interface means for receiving queries from users,

[1519] A means of filtering relevant information from the database based on that query,

[1520] A means of analyzing filtered information and providing it to the user,

[1521] An emotion engine means for recognizing user emotions,

[1522] A means of adjusting the information provided based on the user's emotions recognized by the emotion engine,

[1523] A system that includes this.

[1524] (Claim 2)

[1525] The system according to claim 1, comprising a web scraping means for collecting advertising information.

[1526] (Claim 3)

[1527] The system according to claim 1, comprising an emotion engine means for analyzing the user's emotions using voice input or a camera. [Explanation of symbols]

[1528] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. Web scraping methods, A database for organizing and storing the data collected by the web scraping method, An interface means for receiving queries from users, A means of filtering relevant information from the database based on that query, A means of analyzing filtered information and providing it to the user, A system that includes this.

2. The system according to claim 1, comprising a web scraping means for collecting event information.

3. The system according to claim 1, comprising a web scraping means for collecting information on home appliances.

Images