system

Abstract

We provide the system. [Solution] A means for creating a database that stores information on the person in charge of each web page, A means for a user to request contact person information for the web page they are viewing, A means of retrieving the corresponding contact person information from a database based on the URL of the requested web page, A means of returning the contact person information obtained as a search result to the user, A system that includes this.

Description

Technical Field

[0001] The technology of this disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the current web page management system, there is a problem that the person in charge cannot be quickly identified. When a user wants to modify or consult a web page, it often takes a lot of time and effort to find the person in charge. Also, due to insufficient management of the person-in-charge information, the information cannot be found, and as a result, the inquiry may become complicated and cause misunderstandings. There is thus a problem that efficient information management and prompt response become difficult.

Means for Solving the Problems

[0005] To solve this problem, the present invention employs the following measures. First, it provides a database that stores information on the person in charge of each web page. This database includes the department in charge, the name of the person in charge, contact information, etc., for a specific web page. Next, it provides an interface that allows the user to request person in charge information for the web page they are currently viewing. Based on the user's request, it uses means to automatically obtain the URL of the current web page and search the database for the corresponding person in charge information based on that URL. Then, it returns and displays the person in charge information obtained as a search result to the user, thereby providing a system that realizes efficient information management and rapid response. Specifically, it also includes a function to generate a pop-up and display the person in charge information. This allows the user to easily access person in charge information, reducing inquiry time and misunderstandings.

[0006] A "database" is an information system built to efficiently store, manage, search, and update specific data.

[0007] A "web page" is an HTML file or a collection of HTML files that are published on the internet and can be viewed by users using a browser.

[0008] A "responsible department" refers to a department that is directly responsible for managing and operating a specific task or project.

[0009] "Contact person information" refers to detailed information (e.g., name, contact information, department) of the individual or department responsible for managing and operating a particular web page.

[0010] A "user" refers to a person who uses the system to view a web page and attempt to obtain contact person information.

[0011] "To request" refers to the act of a user asking a system to provide information through a specific operation or interface.

[0012] "Searching" refers to the act of finding data that meets specific criteria within an existing database.

[0013] An "interface" refers to software or devices that provide the means or methods for a user to interact with a system.

[0014] A "pop-up" refers to a method of displaying a new, small window on the screen to provide information or instructions to the user.

[0015] "URL" refers to a unified resource identifier used to specify the location of a resource on the internet (for example, a web page). [Brief explanation of the drawing]

[0016] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be described.

[0019] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0020] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0021] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] As an embodiment of the present invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly retrieve that information. This system consists of a database, a user interface, a server-side program, and a client-side script.

[0038] First, the server builds a specific database to store information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[0039] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0040] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0041] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, this could be done by generating a pop-up window that displays the contact person's department name, name, and contact information.

[0042] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0043] As described above, through the embodiments of the present invention, users can quickly and easily obtain contact information for web pages, providing a system that improves the efficiency of inquiries and reduces errors.

[0044] The following describes the processing flow.

[0045] Step 1:

[0046] The server creates a database to store information about the person in charge of each web page. The database includes fields to store the web page's URL, the department responsible, the person in charge's name, and contact information.

[0047] Step 2:

[0048] When a user creates a new webpage or makes changes to an existing one, they enter the corresponding user information into the database. This saves both the webpage and the user information in the database.

[0049] Step 3:

[0050] If a user is browsing a specific webpage and wants to know the "contact person information" for that page, the user clicks the displayed "Contact Person Information" button.

[0051] Step 4:

[0052] The device captures a button click event and automatically retrieves the URL of the currently viewed webpage. It then generates an HTTP GET request to send the retrieved URL to the server.

[0053] Step 5:

[0054] The device sends an HTTP GET request to the server. The request includes the URL of the web page as a parameter.

[0055] Step 6:

[0056] The server parses the received request and searches the database based on the provided URL to retrieve the relevant personnel information. It uses SQL queries to select the necessary information from the database.

[0057] Step 7:

[0058] The server converts the acquired contact person information into JSON format and sends it to the terminal as an HTTP response. The JSON data includes the department, contact person's name, and contact information.

[0059] Step 8:

[0060] The terminal receives an HTTP response from the server and parses the JSON data. Based on the parsed data, it displays the person in charge's information on the user interface.

[0061] Step 9:

[0062] The device generates a pop-up window displaying the analyzed contact information (department name, name, and contact details). This allows the user to quickly find the necessary contact information.

[0063] (Example 1)

[0064] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0065] Traditional systems made it difficult to quickly and accurately retrieve contact information for web pages. Furthermore, manual management of contact information led to errors and delays in data updates. The challenge lies in improving user convenience, streamlining inquiries, and accelerating information retrieval.

[0066] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0067] In this invention, the server includes means for creating a database to store information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for searching the database for the corresponding person in charge information based on the URL of the requested web page; means for returning the person in charge information obtained as a search result to the user; means for managing the data entered into the database based on appropriate authentication; means for automatically obtaining the URL of the web page currently being viewed based on the user's request and sending a GET request including the obtained URL to the server; and means for parsing the JSON format data returned from the server and displaying the person in charge information. This makes it possible to search for and display person in charge information quickly and accurately. In addition, since the user can easily obtain the person in charge information corresponding to the page currently being viewed simply by clicking the "Person in Charge Information" button on the web page, the efficiency and convenience of inquiries are improved.

[0068] A "database" is a relational database management system used to store and manage information about the person in charge of each web page.

[0069] "Information on the person in charge" refers to data that includes the URL of the web page, the department in charge, the name of the person in charge, and contact information.

[0070] "A means of requesting contact person information for a web page a user is viewing" refers to a "Contact Person Information" button implemented on a part of the web page, where the user requests contact person information by clicking this button.

[0071] A "URL" refers to the address of a requested web page and is used as a parameter when creating an HTTP request.

[0072] A "GET request" is a request method based on the HTTP protocol used to retrieve specific information from a server.

[0073] "JSON format" is an abbreviation for JavaScript (registered trademark) Object Notation, and is a lightweight data exchange format for structurally representing data.

[0074] "Analysis" refers to the process of interpreting JSON-formatted data received from a server and extracting its contents.

[0075] A "pop-up window" is a window that appears on the user's screen and serves as a means of visually providing the user with information about the person in charge.

[0076] "Appropriate authentication" refers to the authentication process that ensures data entered into a database is managed accurately and securely.

[0077] As an embodiment of this invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly retrieve that information. This system consists of a database, a user interface, a server-side program, and a client-side script.

[0078] First, the server uses MySQL (registered trademark) to build a database and store information such as the URL of each web page, the department in charge, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[0079] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0080] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0081] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, this could be done by generating a pop-up window that displays the contact person's department name, name, and contact information.

[0082] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0083] Examples of prompt statements for a generative AI model are as follows:

[0084] "Please provide a detailed explanation of the system's process for returning contact person information corresponding to a specific URL. For example, please describe the specific steps involved in retrieving and displaying the contact person information for https: / / example.com / page1."

[0085] As described above, through the embodiments of the present invention, users can quickly and easily obtain contact information for web pages, providing a system that improves the efficiency of inquiries and reduces errors.

[0086] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0087] Step 1:

[0088] The server will build a new database using MySQL. The input will include the URL of each web page, the department responsible, the contact person's name, and contact information. The server will input this data into a relational database management system (RDBMS) and store each piece of information in the appropriate format. This will build the database.

[0089] Step 2:

[0090] The server manages the data entered into the database based on appropriate authentication. Specifically, this involves setting access permissions based on user login information to prevent unauthorized access. The input for this step is authentication information, and the output is the database with the access permissions set.

[0091] Step 3:

[0092] The user clicks the "Contact Person Information" button on the web page they are viewing. This causes the device to automatically retrieve the URL of the current web page. The input in this step is the user's action, and the output is the retrieved URL.

[0093] Step 4:

[0094] The device uses the acquired URL to request contact information corresponding to that URL from the server. This request is executed as a GET request based on the HTTP protocol. The input is a URL, and the output is an HTTP GET request. The device sends this request to the server.

[0095] Step 5:

[0096] The server processes the received GET request and retrieves the corresponding contact person information from the database based on the URL in the request. The input for this step is the URL included in the GET request, and the output is the corresponding contact person information. The server retrieves the data from the database and converts it to JSON format.

[0097] Step 6:

[0098] The server returns the person in charge information in JSON format to the client (user's terminal). The input for this step is the person in charge information and its conversion to JSON format, and the output is the JSON data sent as a response.

[0099] Step 7:

[0100] The terminal receives JSON data returned from the server. The input is JSON data, and the output is the personnel information to be parsed.

[0101] Step 8:

[0102] The terminal generates a pop-up window based on the analyzed contact person information and displays the information to the user. Specifically, the contact person's department name, name, and contact information are displayed. The input for this step is the analyzed contact person information, and the output is a pop-up window on the user interface.

[0103] By following these steps, users can quickly and easily obtain the contact person information for a web page.

[0104] (Application Example 1)

[0105] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0106] In electronic payment services, it is difficult for users to quickly obtain information about support personnel from specific payment pages, hindering the efficiency of inquiries. Furthermore, current systems make it cumbersome for users to access the information they need, resulting in longer support times. This can degrade the user experience and potentially reduce the willingness to use the service. Therefore, the present invention aims to solve these problems.

[0107] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0108] In this invention, the server includes means for creating a database that stores information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for searching the database for the corresponding person in charge information based on the URL of the requested web page; means for returning the person in charge information obtained as a search result to the user; means for quickly obtaining information on the support person for a specific web page while using the electronic payment service; and means for displaying the obtained person in charge information as a pop-up on the user interface of a smartphone. This makes it possible for users to quickly and easily obtain support person information from a specific payment page, improving the efficiency of inquiries and the ease of receiving support.

[0109] A "database" is an information management system used to store information about the person in charge of each web page.

[0110] A "user" is an individual or organization that browses web pages on the internet and requests information.

[0111] "URL" is an abbreviation for Unified Resource Locator, which indicates the address of a web page.

[0112] "Contact person information" refers to information such as the department responsible for a specific web page, the name of the person in charge, and contact information.

[0113] "Electronic payment services" refer to systems and services that support online payment processes.

[0114] A "support staff member" is responsible for handling inquiries and problems related to electronic payment services.

[0115] A "smartphone" is a portable device that has internet connectivity and application execution capabilities.

[0116] A "user interface" is an interface through which a user interacts with a system or application.

[0117] A "pop-up" is a small window that appears on top of an existing window or screen.

[0118] A "server" is a computer system that provides various services and data in response to requests from clients.

[0119] To implement this invention, it is necessary to construct a system using a combination of various hardware and software. This invention is a system for quickly obtaining information about support personnel based on the URL of a specific web page and displaying it to the user. The details are described below.

[0120] The server first builds a database to store information about the person in charge of each web page. This database will contain URLs, departments, contact information, etc. A relational database management system such as SQL is used to manage this database.

[0121] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This interface is implemented as a "Contact Information" button on a part of the web page, and a request is generated when the user clicks this button. The request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0122] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. The user's terminal parses the received JSON data and displays the contact person information as a pop-up window on the user interface.

[0123] Examples of hardware and software

[0124] Hardware: Servers, smartphones

[0125] Software: SQL (database management system), Flask (web framework), HTTP (communication protocol)

[0126] Specific example

[0127] For example, suppose there is a sample web page "https: / / example.com / payment". The person in charge of this page is "Taro Yamada (yamada@example.com) from the Support Department", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the user's device retrieves the URL "https: / / example.com / payment" and sends a request to the server. The server retrieves the information "Taro Yamada (yamada@example.com) from the Support Department" from the database and returns the result in JSON format. The user's device parses the received JSON data and displays this information to the user as a pop-up.

[0128] Example of a prompt

[0129] "Create a prompt message for when a user wants to retrieve contact information from a specific page of an electronic payment service. Specify the URL of that page, and the prompt should respond with the name and contact information of the corresponding support representative. URL: https: / / example.com / payment"

[0130] As described above, the present invention enables users to quickly and easily obtain support personnel information for a specific page while using an electronic payment service, thereby improving the efficiency of inquiries and making it easier to receive support.

[0131] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0132] Step 1:

[0133] The user clicks the "Contact Person Information" button while browsing a specific webpage for an electronic payment service. This action triggers the user interface to receive the user's request.

[0134] (Input): The user clicks the "Contact Person Information" button.

[0135] (Data processing): Get the URL of the currently viewed webpage.

[0136] (Output): Preparation for sending the acquired URL to the server

[0137] Step 2:

[0138] The device automatically retrieves the URL of the web page the user is currently viewing. This prevents user input errors and allows for the collection of accurate information.

[0139] (Input): URL of the webpage the user clicked

[0140] (Data processing): Passing URL information as parameters to send to the server.

[0141] (Output): Send URL information to the server in HTTP GET request format.

[0142] Step 3:

[0143] The server receives the URL information sent from the terminal and executes a query in the database to search for the corresponding contact person information.

[0144] (Input): Submitted URL information

[0145] (Data processing): Generate an SQL query and search the database for the relevant person's information.

[0146] (Output): Person in charge information obtained as search results

[0147] Step 4:

[0148] The server converts the personnel information retrieved from the database into JSON format and sends it back to the terminal.

[0149] (Input): Person in charge information obtained as search results

[0150] (Data processing): Convert to JSON format

[0151] (Output): Sends the person in charge information in JSON format back to the terminal.

[0152] Step 5:

[0153] The terminal receives the returned JSON-formatted contact person information and displays it as a pop-up window on the user interface. Here, the contact person's department name, name, and contact information are displayed.

[0154] (Input): Contact person information in JSON format

[0155] (Data Processing): Parse JSON data and convert it into a format that can be displayed in the user interface.

[0156] (Output): Display contact person information as a pop-up window.

[0157] Step 6:

[0158] Users can review the contact person information displayed in the pop-up window and contact the person if necessary. This process improves the efficiency of inquiries.

[0159] (Input): Confirmation of the displayed contact person information

[0160] (Data processing): Select contact method based on contact person information.

[0161] (Output): Contact support staff

[0162] In this way, a system is realized that collects the necessary information at each step and provides users with contact person information quickly and accurately. This improves user support while using electronic payment services and streamlines inquiries.

[0163] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0164] As an embodiment of the present invention, a system is described that manages information on the person in charge of each web page and allows users to quickly obtain this information, as well as a system that recognizes the user's emotions and recommends appropriate responses. This system consists of a database, a user interface, a server-side program, a client-side script, and an emotion engine.

[0165] First, the server builds a specific database to store information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[0166] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0167] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact person information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0168] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, the display method may be to generate a pop-up window and display the contact person's department name, name, and contact information.

[0169] Furthermore, an emotion engine is incorporated to analyze user emotions. When a user requests contact information, the emotion engine analyzes the user's tone of voice, facial expressions, etc., to recognize their current emotional state. Based on this information, the system provides the most appropriate response to the user.

[0170] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0171] At this stage, the emotion engine recognizes the user's emotions. For example, if the user is exhibiting an unpleasant attitude or stress, the system takes this information into consideration and notifies the relevant personnel that a prompt and courteous response is required. It is also possible to display friendly messages to the user depending on their specific emotional state.

[0172] As described above, through the embodiments of the present invention, users can not only quickly and easily obtain information about the person in charge of a web page, but also receive suggestions and support that appropriately address their emotions at the time. This provides a system that improves the efficiency of inquiries and enhances user satisfaction.

[0173] The following describes the processing flow.

[0174] Step 1:

[0175] The server creates a database to store information about the person in charge of each web page. The database includes fields to store the web page's URL, the department responsible, the person in charge's name, and contact information.

[0176] Step 2:

[0177] When a user creates a new webpage or makes changes to an existing one, they enter the corresponding user information into the database. This saves both the webpage and the user information in the database.

[0178] Step 3:

[0179] If a user is browsing a specific webpage and wants to know the "contact person information" for that page, the user clicks the displayed "Contact Person Information" button.

[0180] Step 4:

[0181] The device captures a button click event and automatically retrieves the URL of the currently viewed webpage. It then generates an HTTP GET request to send the retrieved URL to the server.

[0182] Step 5:

[0183] The device sends an HTTP GET request to the server. The request includes the URL of the web page as a parameter.

[0184] Step 6:

[0185] The server parses the received request and searches the database based on the provided URL to retrieve the relevant personnel information. It uses SQL queries to select the necessary information from the database.

[0186] Step 7:

[0187] The server converts the acquired contact person information into JSON format and sends it to the terminal as an HTTP response. The JSON data includes the department, contact person's name, and contact information.

[0188] Step 8:

[0189] The terminal receives an HTTP response from the server and parses the JSON data. Based on the parsed data, it displays the person in charge's information on the user interface.

[0190] Step 9:

[0191] The emotion engine analyzes the user's tone of voice, facial expressions, or input content to recognize their current emotion. This is done, for example, using speech recognition or image analysis technologies.

[0192] Step 10:

[0193] Based on the user's emotions recognized by the emotion engine, the system determines the appropriate response. For example, if signs of anger or stress are detected, the system notifies the person in charge that a prompt and courteous response is required.

[0194] Step 11:

[0195] The device generates a pop-up window displaying the analyzed contact information (department name, name, and contact details). It may also display additional information or messages based on the user's sentiment.

[0196] Step 12:

[0197] Users can review the contact person information displayed in a pop-up window and contact them if necessary. The system can also provide additional support based on the user's emotions. For example, if a user is feeling dissatisfied, it may display an encouraging message.

[0198] (Example 2)

[0199] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0200] While systems exist that quickly provide information on who is in charge of a web page, they lack mechanisms for providing appropriate responses based on the user's emotions. As a result, responses when users experience unpleasant emotions may be insufficient, potentially leading to decreased user satisfaction. This invention aims to improve user satisfaction by enabling users to easily obtain information on who is in charge of a web page and by recommending responses that are appropriate to the user's emotional state.

[0201] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0202] In this invention, the server includes means for creating an information management device that stores information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for retrieving the corresponding person in charge information from the information management device based on the identifier of the requested web page; means for returning the person in charge information obtained as a search result to the user; and means including an emotion analysis device that analyzes the user's emotions and recommends an appropriate response based on the results. As a result, the user can quickly obtain person in charge information for web pages and receive an appropriate response that is in line with the user's emotions.

[0203] An "information management device" is a database system used to store and manage information about the person in charge of each web page.

[0204] A "user" is an end-user who views a web page and requests contact information.

[0205] An "identifier" is a unique string of characters, such as a URL, used to identify a web page.

[0206] "Searching" refers to the act of querying data within an information management device based on an identifier and obtaining the corresponding personnel information.

[0207] An "emotion analysis device" is a system that analyzes the user's voice tone, facial expressions, and other data to recognize and estimate their current emotional state.

[0208] A "window" is a display area that visualizes the contact person information obtained as a search result for the user.

[0209] As an embodiment of the present invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly obtain this information, as well as a system that recognizes the user's emotions and recommends appropriate responses. This system consists of an information management device, a user interface, a server-side program, a client-side script, and an emotion analysis device.

[0210] First, the server establishes a specific information management device that stores identifiers for each web page, responsible departments, contact persons, and contact information. This information management device is implemented using a relational database management system such as SQL. Furthermore, the data entered into the information management device is managed based on appropriate authentication.

[0211] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request obtains the identifier of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0212] When a user clicks a button, the device automatically retrieves the identifier of the current web page and requests the server for the contact person information corresponding to this identifier. This request is executed as a GET request based on the HTTP protocol, and the identifier information is passed as a parameter.

[0213] The server processes the received request and retrieves the corresponding contact person information from the information management device. The contact person information obtained as a search result is returned to the client side (user's terminal) in data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, the display method may involve generating a pop-up window that displays the contact person's department name, name, and contact information.

[0214] Furthermore, the system incorporates an emotion analysis device to analyze the user's emotions. When a user requests information about a representative, the emotion analysis device analyzes the user's tone of voice, facial expressions, etc., to recognize their current emotional state. Based on this information, the system provides the most appropriate response to the user.

[0215] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Marketing Department Representative (tanaka@example.com)", and this information is pre-entered in the information management device. When a user clicks the button to request "Representative Information" while browsing this page, the device obtains the identifier "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Marketing Department Representative (tanaka@example.com)" from the information management device and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0216] At this stage, the emotion analyzer recognizes the user's emotions. For example, if the user exhibits an unpleasant attitude or stress, the system takes this information into consideration and notifies the person in charge that a prompt and courteous response is required. It can also display friendly messages to the user depending on their specific emotional state.

[0217] In this way, through embodiments of the present invention, users can not only quickly and easily obtain information about the person in charge of a web page, but also receive suggestions and support that appropriately address their emotions at the time. This provides a system that improves the efficiency of inquiries and enhances user satisfaction.

[0218] Example of a prompt

[0219] A user visits the webpage "https: / / example.com / page1" and clicks the "Contact Person Information" button. The contact person for this page is "Marketing Department Staff," and this information is stored in the information management system. The system recommends an appropriate response based on the user's emotional state. Please describe the specific system operation and suggest how to make user support even more effective.

[0220] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0221] Program processing flow

[0222] Step 1: Building the Database

[0223] server

[0224] Input: Defines the database table structure based on configuration files or scripts.

[0225] Process: Use a relational database management system such as SQL to create tables to store the identifier (URL), department, contact person's name, and contact information for each web page.

[0226] Output: A database table is created.

[0227] Specific actions: For example, create a table called "Contact Person Information" with columns such as "url", "department", "contact_person", and "contact_info".

[0228] Step 2: Install the contact person information button.

[0229] terminal

[0230] Input: HTML code of a web page.

[0231] Process: Use JavaScript and CSS to place the "Contact Person Information" button on the web page.

[0232] Output: A button is displayed on the web page.

[0233] Specific action: For example, add the following code to your HTML.

[0234] html

[0235] <button id="contact-info-button"> Person in charge information< / button>

[0236] Step 3: Submit a request for contact person information.

[0237] User

[0238] Input: Click the "Contact Person Information" button on the web page.

[0239] Process: Use JavaScript to obtain the identifier (URL) of the current web page.

[0240] Output: The retrieved URL is sent to the server.

[0241] Specific operation: Capture the button click event, execute the following JavaScript code to obtain the URL, and send a request to the server.

[0242] JavaScript

[0243] document.getElementById('contact-info-button').addEventListener('click', function() {

[0244] const currentURL = window.location.href;

[0245] fetch(https: / / example-server.com / get-contact-info?url=${encodeURIComponent(currentURL)})

[0246] .then(response => response.json())

[0247] .then(data => displayContactInfo(data));

[0248] });

[0249] Step 4: Receive the request and query the database.

[0250] server

[0251] Input: HTTP GET request and its URL parameters.

[0252] Processing: Based on the received URL, the information management device (database) is searched, and the corresponding personnel information is retrieved.

[0253] Output: The responsible person information is returned to the client (user's terminal) in JSON format.

[0254] Specific operation: For example, construct an SQL statement using the received URL as a query parameter.

[0255] Python

[0256] @app.route(' / get-contact-info', methods=['GET'])

[0257] def get_contact_info():

[0258] url = request.args.get('url')

[0259] db_data = query_database(url) Execute the query and retrieve the data.

[0260] return jsonify(db_data)

[0261] Step 5: Displaying the person in charge information

[0262] terminal

[0263] Input: JSON data of contact person information received from the server.

[0264] Processing: The received JSON data is parsed, and the person in charge's information is displayed on the user interface.

[0265] Output: A pop-up window will appear displaying the department name, name, and contact information of the person in charge.

[0266] Specific actions: For example, execute the following JavaScript code to generate a popup and display information.

[0267] JavaScript

[0268] function displayContactInfo(data) {

[0269] const popup = window.open('', 'Contact Person Information', 'width=400,height=300');

[0270] popup.document.write( Department: ${data.department} );

[0271] popup.document.write( Contact person: ${data.contact_person} );

[0272] popup.document.write( Contact: ${data.contact_info} );

[0273] }

[0274] Step 6: Analyzing User Sentiment

[0275] terminal

[0276] Input: Real-time data such as the user's voice tone and facial expressions.

[0277] Processing: Data from the camera and microphone is acquired using WebRTC, etc., and transmitted to an emotion analysis device.

[0278] Output: Data regarding the user's emotional state can be obtained.

[0279] Specific operation: For example, execute the following JavaScript code to obtain data from the microphone and camera.

[0280] javascript

[0281] navigator.mediaDevices.getUserMedia({ video: true, audio: true})

[0282] .then(stream => {

[0283] / / Use the microphone and camera stream data

[0284] });

[0285] Step 7: Recommendation of appropriate response

[0286] Server

[0287] Input: Emotional data sent from the emotion analysis device.

[0288] Process: Analyze the user's emotional state based on the emotional data and recommend appropriate responses.

[0289] Output: Notifications and messages regarding response guidelines are generated.

[0290] Specific operation: For example, if the user shows a negative emotion, send a notification to the responsible person that a prompt response is required.

[0291] javascript

[0292] if (detectedEmotion === 'angry') {

[0293] alert('The user is showing signs of distress. Please respond promptly.');

[0294] }

[0295] In this way, the entire system goes through a series of processing steps, allowing the user to quickly obtain contact information and receive appropriate responses tailored to their emotions at the time.

[0296] (Application Example 2)

[0297] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0298] Current web page browsing systems have problems with quickly obtaining information about the person in charge and providing appropriate responses that take into account the user's emotional state. In particular, in autonomous vehicles, prompt and courteous responses are required when passengers feel stressed or anxious, and conventional systems are insufficient to handle this.

[0299] The identification processing performed by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for creating a database that stores information on the person in charge of each web page, means for requesting person in charge information for the web page being viewed by the user, means for searching the database for the corresponding person in charge information based on the URL of the requested web page, and means for determining a response based on the user's emotions using an emotion recognition engine that analyzes the user's emotional state. This makes it possible not only to quickly obtain the person in charge information for the web page being viewed by the user, but also to provide an appropriate response according to the user's emotional state.

[0300] A "web page" is a document or information resource that can be accessed via the internet.

[0301] The "supervising department" refers to the department responsible for specific operations or projects.

[0302] The "person in charge information" refers to the information of the person in charge and contact details regarding specific operations or projects.

[0303] The "database" refers to a system that organizes and stores data and can be searched and updated as needed.

[0304] The "URL" is the abbreviation of Uniform Resource Locator and refers to the address indicating the location of a specific resource on the Internet.

[0305] The "emotion recognition engine" refers to an algorithm or system that analyzes the user's expression, tone of voice, etc. to recognize their emotional state.

[0306] The "popup" refers to a small window that suddenly appears on the user interface and is used to display specific information.

[0307] The "autonomous vehicle" refers to a vehicle that uses artificial intelligence and sensor technology to drive autonomously without a human driver.

[0308] As a form for implementing the present invention, in addition to a system for managing the supervising department person in charge information of a web page and enabling the user to quickly obtain such information, a system for recognizing the user's emotion and recommending appropriate responses will be described.

[0309] This system is composed of a database, a user interface, a server-side program, a client-side script, and an emotion recognition engine. Specifically, the database stores the URL, responsible department, name of the person in charge, contact information, etc. of each web page. The database is realized by a relational database management system such as PostgreSQL.

[0310] The server receives HTTP requests to retrieve contact information for specific web pages from a database and returns the results to the client in JSON format. It also automatically retrieves the URL of the currently viewed web page based on the user's request and searches for the contact information corresponding to that URL. Furthermore, it includes a mechanism for displaying the retrieved contact information as a pop-up.

[0311] In the system of the present invention, when a user clicks a button requesting "person in charge information" while browsing a specific web page, the URL is automatically retrieved, and an SQL query is executed against the database based on that information. The resulting person in charge information is displayed in a pop-up format on the user interface, allowing the user to easily check the person in charge information.

[0312] Next, the user's emotional state is analyzed using an emotion recognition engine. The emotion recognition engine uses models built with deep learning frameworks such as TENSORFLOW® and PyTorch, and recognizes the user's emotions by analyzing the user's voice and image data. Based on this analysis, the server can provide appropriate responses according to the user's emotional state.

[0313] As a concrete example, let's explain the system's operation inside an autonomous vehicle. Suppose a passenger requests customer support while browsing a specific webpage inside the autonomous vehicle. The system obtains the URL of that page and retrieves the contact person's information from the database. At the same time, it inputs the passenger's voice and facial expression data into an emotion recognition engine, and if the analysis results in an emotion such as "stress," it recommends a prompt and courteous response.

[0314] Examples of prompt statements include the following:

[0315] "Please retrieve the contact person information corresponding to the URL 'https: / / example.com / page1'. Analyze the user's emotions based on their facial expression data and recommend an appropriate response. The user's facial expression data indicates 'stress'."

[0316] In this way, the system of the present invention can not only quickly obtain information about the person in charge of the web page viewed by the user, but also provide appropriate responses according to the user's emotional state.

[0317] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0318] Step 1:

[0319] The user clicks a button to request contact person information.

[0320] Input: User click action

[0321] Specific action: Click the "Request contact information" button on the webpage.

[0322] Output: URL of the webpage currently being viewed

[0323] Step 2:

[0324] The device automatically retrieves the URL of the web page it is currently viewing and sends the URL to the server.

[0325] Input: URL of the webpage you are currently viewing

[0326] Specific operation: Parses the DOM to obtain the URL and sends an HTTP GET request to the server.

[0327] Output: HTTP request (including URL information)

[0328] Step 3:

[0329] The server searches the database for the corresponding contact person information based on the URL.

[0330] Input: URL information

[0331] Specific operation: Send an SQL query to the database to retrieve information about the person in charge.

[0332] Output: Person in charge information (department name, name, contact information)

[0333] Step 4:

[0334] The server returns the contact person information obtained as a search result to the client in JSON format.

[0335] Input: Person in charge information

[0336] Specific operation: Convert the person in charge information into JSON format and send it to the client as an HTTP response.

[0337] Output: Person in charge information in JSON format

[0338] Step 5:

[0339] The terminal displays the contact person information it received as a pop-up.

[0340] Input: Contact person information in JSON format

[0341] Specific operation: Parse JSON data, generate a popup window, and display the person in charge's information.

[0342] Output: Person in charge information displayed in the pop-up window

[0343] Step 6:

[0344] The device sends the user's voice and facial expression data to an emotion recognition engine, which then analyzes their emotions.

[0345] Input: User voice and facial expression data

[0346] Specific operation: Data collected by the camera and microphone is sent to the emotion recognition engine.

[0347] Output: User's emotional state

[0348] Step 7:

[0349] The emotion recognition engine analyzes the user's emotional state and returns the analysis results to the server.

[0350] Input: User voice and facial expression data

[0351] Specific operation: Analyze emotions using a deep learning model.

[0352] Output: Emotion analysis results (stress, anger, joy, etc.)

[0353] Step 8:

[0354] The server provides responses tailored to the user's emotional state based on the emotion analysis results.

[0355] Input: Sentiment analysis results

[0356] Specific actions: Determine and present messages and responses to the user based on their emotional state.

[0357] Output: Appropriate response (e.g., "A prompt and courteous response is required.")

[0358] Through the steps described above, the system of the present invention can not only quickly obtain information about the person in charge of the web page viewed by the user, but also provide appropriate responses according to the user's emotional state.

[0359] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0360] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0361] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0362] [Second Embodiment]

[0363] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0364] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0365] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0366] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0367] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0368] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0369] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0370] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0371] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0372] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0373] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0374] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0375] As an embodiment of the present invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly retrieve that information. This system consists of a database, a user interface, a server-side program, and a client-side script.

[0376] First, the server builds a specific database to store information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[0377] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0378] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0379] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, this could be done by generating a pop-up window that displays the contact person's department name, name, and contact information.

[0380] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0381] As described above, through the embodiments of the present invention, users can quickly and easily obtain contact information for web pages, providing a system that improves the efficiency of inquiries and reduces errors.

[0382] The following describes the processing flow.

[0383] Step 1:

[0384] The server creates a database to store information about the person in charge of each web page. The database includes fields to store the web page's URL, the department responsible, the person in charge's name, and contact information.

[0385] Step 2:

[0386] When a user creates a new webpage or makes changes to an existing one, they enter the corresponding user information into the database. This saves both the webpage and the user information in the database.

[0387] Step 3:

[0388] If a user is browsing a specific webpage and wants to know the "contact person information" for that page, the user clicks the displayed "Contact Person Information" button.

[0389] Step 4:

[0390] The device captures a button click event and automatically retrieves the URL of the currently viewed webpage. It then generates an HTTP GET request to send the retrieved URL to the server.

[0391] Step 5:

[0392] The device sends an HTTP GET request to the server. The request includes the URL of the web page as a parameter.

[0393] Step 6:

[0394] The server parses the received request and searches the database based on the provided URL to retrieve the relevant personnel information. It uses SQL queries to select the necessary information from the database.

[0395] Step 7:

[0396] The server converts the acquired contact person information into JSON format and sends it to the terminal as an HTTP response. The JSON data includes the department, contact person's name, and contact information.

[0397] Step 8:

[0398] The terminal receives an HTTP response from the server and parses the JSON data. Based on the parsed data, it displays the person in charge's information on the user interface.

[0399] Step 9:

[0400] The device generates a pop-up window displaying the analyzed contact information (department name, name, and contact details). This allows the user to quickly find the necessary contact information.

[0401] (Example 1)

[0402] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0403] Traditional systems made it difficult to quickly and accurately retrieve contact information for web pages. Furthermore, manual management of contact information led to errors and delays in data updates. The challenge lies in improving user convenience, streamlining inquiries, and accelerating information retrieval.

[0404] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0405] In this invention, the server includes means for creating a database to store information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for searching the database for the corresponding person in charge information based on the URL of the requested web page; means for returning the person in charge information obtained as a search result to the user; means for managing the data entered into the database based on appropriate authentication; means for automatically obtaining the URL of the web page currently being viewed based on the user's request and sending a GET request including the obtained URL to the server; and means for parsing the JSON format data returned from the server and displaying the person in charge information. This makes it possible to search for and display person in charge information quickly and accurately. In addition, since the user can easily obtain the person in charge information corresponding to the page currently being viewed simply by clicking the "Person in Charge Information" button on the web page, the efficiency and convenience of inquiries are improved.

[0406] A "database" is a relational database management system used to store and manage information about the person in charge of each web page.

[0407] "Information on the person in charge" refers to data that includes the URL of the web page, the department in charge, the name of the person in charge, and contact information.

[0408] "A means of requesting contact person information for a web page a user is viewing" refers to a "Contact Person Information" button implemented on a part of the web page, where the user requests contact person information by clicking this button.

[0409] A "URL" refers to the address of a requested web page and is used as a parameter when creating an HTTP request.

[0410] A "GET request" is a request method based on the HTTP protocol used to retrieve specific information from a server.

[0411] "JSON format" is an abbreviation for JavaScript Object Notation, and it is a lightweight data exchange format for structurally representing data.

[0412] "Analysis" refers to the process of interpreting JSON-formatted data received from a server and extracting its contents.

[0413] A "pop-up window" is a window that appears on the user's screen and serves as a means of visually providing the user with information about the person in charge.

[0414] "Appropriate authentication" refers to the authentication process that ensures data entered into a database is managed accurately and securely.

[0415] As an embodiment of this invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly retrieve that information. This system consists of a database, a user interface, a server-side program, and a client-side script.

[0416] First, the server uses MySQL to build a database, storing information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[0417] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0418] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0419] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, this could be done by generating a pop-up window that displays the contact person's department name, name, and contact information.

[0420] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0421] Examples of prompt statements for a generative AI model are as follows:

[0422] "Please provide a detailed explanation of the system's process for returning contact person information corresponding to a specific URL. For example, please describe the specific steps involved in retrieving and displaying the contact person information for https: / / example.com / page1."

[0423] As described above, through the embodiments of the present invention, users can quickly and easily obtain contact information for web pages, providing a system that improves the efficiency of inquiries and reduces errors.

[0424] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0425] Step 1:

[0426] The server will build a new database using MySQL. The input will include the URL of each web page, the department responsible, the contact person's name, and contact information. The server will input this data into a relational database management system (RDBMS) and store each piece of information in the appropriate format. This will build the database.

[0427] Step 2:

[0428] The server manages the data entered into the database based on appropriate authentication. Specifically, this involves setting access permissions based on user login information to prevent unauthorized access. The input for this step is authentication information, and the output is the database with the access permissions set.

[0429] Step 3:

[0430] The user clicks the "Contact Person Information" button on the web page they are viewing. This causes the device to automatically retrieve the URL of the current web page. The input in this step is the user's action, and the output is the retrieved URL.

[0431] Step 4:

[0432] The device uses the acquired URL to request contact information corresponding to that URL from the server. This request is executed as a GET request based on the HTTP protocol. The input is a URL, and the output is an HTTP GET request. The device sends this request to the server.

[0433] Step 5:

[0434] The server processes the received GET request and retrieves the corresponding contact person information from the database based on the URL in the request. The input for this step is the URL included in the GET request, and the output is the corresponding contact person information. The server retrieves the data from the database and converts it to JSON format.

[0435] Step 6:

[0436] The server returns the person in charge information in JSON format to the client (user's terminal). The input for this step is the person in charge information and its conversion to JSON format, and the output is the JSON data sent as a response.

[0437] Step 7:

[0438] The terminal receives JSON data returned from the server. The input is JSON data, and the output is the personnel information to be parsed.

[0439] Step 8:

[0440] The terminal generates a pop-up window based on the analyzed contact person information and displays the information to the user. Specifically, the contact person's department name, name, and contact information are displayed. The input for this step is the analyzed contact person information, and the output is a pop-up window on the user interface.

[0441] By following these steps, users can quickly and easily obtain the contact person information for a web page.

[0442] (Application Example 1)

[0443] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0444] In electronic payment services, it is difficult for users to quickly obtain information about support personnel from specific payment pages, hindering the efficiency of inquiries. Furthermore, current systems make it cumbersome for users to access the information they need, resulting in longer support times. This can degrade the user experience and potentially reduce the willingness to use the service. Therefore, the present invention aims to solve these problems.

[0445] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0446] In this invention, the server includes means for creating a database that stores information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for searching the database for the corresponding person in charge information based on the URL of the requested web page; means for returning the person in charge information obtained as a search result to the user; means for quickly obtaining information on the support person for a specific web page while using the electronic payment service; and means for displaying the obtained person in charge information as a pop-up on the user interface of a smartphone. This makes it possible for users to quickly and easily obtain support person information from a specific payment page, improving the efficiency of inquiries and the ease of receiving support.

[0447] A "database" is an information management system used to store information about the person in charge of each web page.

[0448] A "user" is an individual or organization that browses web pages on the internet and requests information.

[0449] "URL" is an abbreviation for Unified Resource Locator, which indicates the address of a web page.

[0450] "Contact person information" refers to information such as the department responsible for a specific web page, the name of the person in charge, and contact information.

[0451] "Electronic payment services" refer to systems and services that support online payment processes.

[0452] A "support staff member" is responsible for handling inquiries and problems related to electronic payment services.

[0453] A "smartphone" is a portable device that has internet connectivity and application execution capabilities.

[0454] A "user interface" is an interface through which a user interacts with a system or application.

[0455] A "pop-up" is a small window that appears on top of an existing window or screen.

[0456] A "server" is a computer system that provides various services and data in response to requests from clients.

[0457] To implement this invention, it is necessary to construct a system using a combination of various hardware and software. This invention is a system for quickly obtaining information about support personnel based on the URL of a specific web page and displaying it to the user. The details are described below.

[0458] The server first builds a database to store information about the person in charge of each web page. This database will contain URLs, departments, contact information, etc. A relational database management system such as SQL is used to manage this database.

[0459] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This interface is implemented as a "Contact Information" button on a part of the web page, and a request is generated when the user clicks this button. The request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0460] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. The user's terminal parses the received JSON data and displays the contact person information as a pop-up window on the user interface.

[0461] Examples of hardware and software

[0462] Hardware: Servers, smartphones

[0463] Software: SQL (database management system), Flask (web framework), HTTP (communication protocol)

[0464] Specific example

[0465] For example, suppose there is a sample web page "https: / / example.com / payment". The person in charge of this page is "Taro Yamada (yamada@example.com) from the Support Department", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the user's device retrieves the URL "https: / / example.com / payment" and sends a request to the server. The server retrieves the information "Taro Yamada (yamada@example.com) from the Support Department" from the database and returns the result in JSON format. The user's device parses the received JSON data and displays this information to the user as a pop-up.

[0466] Example of a prompt

[0467] "Create a prompt message for when a user wants to retrieve contact information from a specific page of an electronic payment service. Specify the URL of that page, and the prompt should respond with the name and contact information of the corresponding support representative. URL: https: / / example.com / payment"

[0468] As described above, the present invention enables users to quickly and easily obtain support personnel information for a specific page while using an electronic payment service, thereby improving the efficiency of inquiries and making it easier to receive support.

[0469] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0470] Step 1:

[0471] The user clicks the "Contact Person Information" button while browsing a specific webpage for an electronic payment service. This action triggers the user interface to receive the user's request.

[0472] (Input): The user clicks the "Contact Person Information" button.

[0473] (Data processing): Get the URL of the currently viewed webpage.

[0474] (Output): Preparation for sending the acquired URL to the server

[0475] Step 2:

[0476] The device automatically retrieves the URL of the web page the user is currently viewing. This prevents user input errors and allows for the collection of accurate information.

[0477] (Input): URL of the webpage the user clicked

[0478] (Data processing): Passing URL information as parameters to send to the server.

[0479] (Output): Send URL information to the server in HTTP GET request format.

[0480] Step 3:

[0481] The server receives the URL information sent from the terminal and executes a query in the database to search for the corresponding contact person information.

[0482] (Input): Submitted URL information

[0483] (Data processing): Generate an SQL query and search the database for the relevant person's information.

[0484] (Output): Person in charge information obtained as search results

[0485] Step 4:

[0486] The server converts the personnel information retrieved from the database into JSON format and sends it back to the terminal.

[0487] (Input): Person in charge information obtained as search results

[0488] (Data processing): Convert to JSON format

[0489] (Output): Sends the person in charge information in JSON format back to the terminal.

[0490] Step 5:

[0491] The terminal receives the returned JSON-formatted contact person information and displays it as a pop-up window on the user interface. Here, the contact person's department name, name, and contact information are displayed.

[0492] (Input): Contact person information in JSON format

[0493] (Data Processing): Parse JSON data and convert it into a format that can be displayed in the user interface.

[0494] (Output): Display contact person information as a pop-up window.

[0495] Step 6:

[0496] Users can review the contact person information displayed in the pop-up window and contact the person if necessary. This process improves the efficiency of inquiries.

[0497] (Input): Confirmation of the displayed contact person information

[0498] (Data processing): Select contact method based on contact person information.

[0499] (Output): Contact support staff

[0500] In this way, a system is realized that collects the necessary information at each step and provides users with contact person information quickly and accurately. This improves user support while using electronic payment services and streamlines inquiries.

[0501] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0502] As an embodiment of the present invention, a system is described that manages information on the person in charge of each web page and allows users to quickly obtain this information, as well as a system that recognizes the user's emotions and recommends appropriate responses. This system consists of a database, a user interface, a server-side program, a client-side script, and an emotion engine.

[0503] First, the server builds a specific database to store information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[0504] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0505] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact person information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0506] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, the display method may be to generate a pop-up window and display the contact person's department name, name, and contact information.

[0507] Furthermore, an emotion engine is incorporated to analyze user emotions. When a user requests contact information, the emotion engine analyzes the user's tone of voice, facial expressions, etc., to recognize their current emotional state. Based on this information, the system provides the most appropriate response to the user.

[0508] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0509] At this stage, the emotion engine recognizes the user's emotions. For example, if the user is exhibiting an unpleasant attitude or stress, the system takes this information into consideration and notifies the relevant personnel that a prompt and courteous response is required. It is also possible to display friendly messages to the user depending on their specific emotional state.

[0510] As described above, through the embodiments of the present invention, users can not only quickly and easily obtain information about the person in charge of a web page, but also receive suggestions and support that appropriately address their emotions at the time. This provides a system that improves the efficiency of inquiries and enhances user satisfaction.

[0511] The following describes the processing flow.

[0512] Step 1:

[0513] The server creates a database to store information about the person in charge of each web page. The database includes fields to store the web page's URL, the department responsible, the person in charge's name, and contact information.

[0514] Step 2:

[0515] When a user creates a new webpage or makes changes to an existing one, they enter the corresponding user information into the database. This saves both the webpage and the user information in the database.

[0516] Step 3:

[0517] If a user is browsing a specific webpage and wants to know the "contact person information" for that page, the user clicks the displayed "Contact Person Information" button.

[0518] Step 4:

[0519] The device captures a button click event and automatically retrieves the URL of the currently viewed webpage. It then generates an HTTP GET request to send the retrieved URL to the server.

[0520] Step 5:

[0521] The device sends an HTTP GET request to the server. The request includes the URL of the web page as a parameter.

[0522] Step 6:

[0523] The server parses the received request and searches the database based on the provided URL to retrieve the relevant personnel information. It uses SQL queries to select the necessary information from the database.

[0524] Step 7:

[0525] The server converts the acquired contact person information into JSON format and sends it to the terminal as an HTTP response. The JSON data includes the department, contact person's name, and contact information.

[0526] Step 8:

[0527] The terminal receives an HTTP response from the server and parses the JSON data. Based on the parsed data, it displays the person in charge's information on the user interface.

[0528] Step 9:

[0529] The emotion engine analyzes the user's tone of voice, facial expressions, or input content to recognize their current emotion. This is done, for example, using speech recognition or image analysis technologies.

[0530] Step 10:

[0531] Based on the user's emotions recognized by the emotion engine, the system determines the appropriate response. For example, if signs of anger or stress are detected, the system notifies the person in charge that a prompt and courteous response is required.

[0532] Step 11:

[0533] The device generates a pop-up window displaying the analyzed contact information (department name, name, and contact details). It may also display additional information or messages based on the user's sentiment.

[0534] Step 12:

[0535] Users can review the contact person information displayed in a pop-up window and contact them if necessary. The system can also provide additional support based on the user's emotions. For example, if a user is feeling dissatisfied, it may display an encouraging message.

[0536] (Example 2)

[0537] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0538] While systems exist that quickly provide information on who is in charge of a web page, they lack mechanisms for providing appropriate responses based on the user's emotions. As a result, responses when users experience unpleasant emotions may be insufficient, potentially leading to decreased user satisfaction. This invention aims to improve user satisfaction by enabling users to easily obtain information on who is in charge of a web page and by recommending responses that are appropriate to the user's emotional state.

[0539] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0540] In this invention, the server includes means for creating an information management device that stores information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for retrieving the corresponding person in charge information from the information management device based on the identifier of the requested web page; means for returning the person in charge information obtained as a search result to the user; and means including an emotion analysis device that analyzes the user's emotions and recommends an appropriate response based on the results. As a result, the user can quickly obtain person in charge information for web pages and receive an appropriate response that is in line with the user's emotions.

[0541] An "information management device" is a database system used to store and manage information about the person in charge of each web page.

[0542] A "user" is an end-user who views a web page and requests contact information.

[0543] An "identifier" is a unique string of characters, such as a URL, used to identify a web page.

[0544] "Searching" refers to the act of querying data within an information management device based on an identifier and obtaining the corresponding personnel information.

[0545] An "emotion analysis device" is a system that analyzes the user's voice tone, facial expressions, and other data to recognize and estimate their current emotional state.

[0546] A "window" is a display area that visualizes the contact person information obtained as a search result for the user.

[0547] As an embodiment of the present invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly obtain this information, as well as a system that recognizes the user's emotions and recommends appropriate responses. This system consists of an information management device, a user interface, a server-side program, a client-side script, and an emotion analysis device.

[0548] First, the server establishes a specific information management device that stores identifiers for each web page, responsible departments, contact persons, and contact information. This information management device is implemented using a relational database management system such as SQL. Furthermore, the data entered into the information management device is managed based on appropriate authentication.

[0549] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request obtains the identifier of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0550] When a user clicks a button, the device automatically retrieves the identifier of the current web page and requests the server for the contact person information corresponding to this identifier. This request is executed as a GET request based on the HTTP protocol, and the identifier information is passed as a parameter.

[0551] The server processes the received request and retrieves the corresponding contact person information from the information management device. The contact person information obtained as a search result is returned to the client side (user's terminal) in data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, the display method may involve generating a pop-up window that displays the contact person's department name, name, and contact information.

[0552] Furthermore, the system incorporates an emotion analysis device to analyze the user's emotions. When a user requests information about a representative, the emotion analysis device analyzes the user's tone of voice, facial expressions, etc., to recognize their current emotional state. Based on this information, the system provides the most appropriate response to the user.

[0553] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Marketing Department Representative (tanaka@example.com)", and this information is pre-entered in the information management device. When a user clicks the button to request "Representative Information" while browsing this page, the device obtains the identifier "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Marketing Department Representative (tanaka@example.com)" from the information management device and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0554] At this stage, the emotion analyzer recognizes the user's emotions. For example, if the user exhibits an unpleasant attitude or stress, the system takes this information into consideration and notifies the person in charge that a prompt and courteous response is required. It can also display friendly messages to the user depending on their specific emotional state.

[0555] In this way, through embodiments of the present invention, users can not only quickly and easily obtain information about the person in charge of a web page, but also receive suggestions and support that appropriately address their emotions at the time. This provides a system that improves the efficiency of inquiries and enhances user satisfaction.

[0556] Example of a prompt

[0557] A user visits the webpage "https: / / example.com / page1" and clicks the "Contact Person Information" button. The contact person for this page is "Marketing Department Staff," and this information is stored in the information management system. The system recommends an appropriate response based on the user's emotional state. Please describe the specific system operation and suggest how to make user support even more effective.

[0558] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0559] Program processing flow

[0560] Step 1: Building the Database

[0561] server

[0562] Input: Defines the database table structure based on configuration files or scripts.

[0563] Process: Use a relational database management system such as SQL to create tables to store the identifier (URL), department, contact person's name, and contact information for each web page.

[0564] Output: A database table is created.

[0565] Specific actions: For example, create a table called "Contact Person Information" with columns such as "url", "department", "contact_person", and "contact_info".

[0566] Step 2: Install the contact person information button.

[0567] terminal

[0568] Input: HTML code of a web page.

[0569] Process: Use JavaScript and CSS to place the "Contact Person Information" button on the web page.

[0570] Output: A button is displayed on the web page.

[0571] Specific action: For example, add the following code to your HTML.

[0572] html

[0573] <button id="contact-info-button"> Person in charge information< / button>

[0574] Step 3: Submit a request for contact person information.

[0575] User

[0576] Input: Click the "Contact Person Information" button on the web page.

[0577] Process: Use JavaScript to obtain the identifier (URL) of the current web page.

[0578] Output: The retrieved URL is sent to the server.

[0579] Specific operation: Capture the button click event, execute the following JavaScript code to obtain the URL, and send a request to the server.

[0580] JavaScript

[0581] document.getElementById('contact-info-button').addEventListener('click', function() {

[0582] const currentURL = window.location.href;

[0583] fetch(https: / / example-server.com / get-contact-info?url=${encodeURIComponent(currentURL)})

[0584] .then(response => response.json())

[0585] .then(data => displayContactInfo(data));

[0586] });

[0587] Step 4: Receive the request and query the database.

[0588] server

[0589] Input: HTTP GET request and its URL parameters.

[0590] Processing: Based on the received URL, the information management device (database) is searched, and the corresponding personnel information is retrieved.

[0591] Output: The responsible person information is returned to the client (user's terminal) in JSON format.

[0592] Specific operation: For example, construct an SQL statement using the received URL as a query parameter.

[0593] Python

[0594] @app.route(' / get-contact-info', methods=['GET'])

[0595] def get_contact_info():

[0596] url = request.args.get('url')

[0597] db_data = query_database(url) Execute the query and retrieve the data.

[0598] return jsonify(db_data)

[0599] Step 5: Displaying the person in charge information

[0600] terminal

[0601] Input: JSON data of contact person information received from the server.

[0602] Processing: The received JSON data is parsed, and the person in charge's information is displayed on the user interface.

[0603] Output: A pop-up window will appear displaying the department name, name, and contact information of the person in charge.

[0604] Specific actions: For example, execute the following JavaScript code to generate a popup and display information.

[0605] JavaScript

[0606] function displayContactInfo(data) {

[0607] const popup = window.open('', 'Contact Person Information', 'width=400,height=300');

[0608] popup.document.write( Department: ${data.department} );

[0609] popup.document.write( Contact person: ${data.contact_person} );

[0610] popup.document.write( Contact: ${data.contact_info} );

[0611] }

[0612] Step 6: Analyzing User Sentiment

[0613] terminal

[0614] Input: Real-time data such as the user's voice tone and facial expressions.

[0615] Processing: Data from the camera and microphone is acquired using WebRTC, etc., and transmitted to an emotion analysis device.

[0616] Output: Data regarding the user's emotional state is obtained.

[0617] Specific actions: For example, execute the following JavaScript code to obtain microphone and camera data.

[0618] JavaScript

[0619] navigator.mediaDevices.getUserMedia({ video: true, audio: true})

[0620] .then(stream => {

[0621] / / Uses microphone and camera stream data

[0622] });

[0623] Step 7: Recommendation of appropriate action

[0624] server

[0625] Input: Emotional data transmitted from the emotion analysis device.

[0626] Processing: Analyze the user's emotional state based on emotional data and recommend appropriate actions.

[0627] Output: Notifications and messages regarding the response policy are generated.

[0628] Specific actions: For example, if a user is showing signs of displeasure, a notification will be sent to the person in charge requesting prompt action.

[0629] JavaScript

[0630] if (detectedEmotion === 'angry') {

[0631] alert('The user is showing signs of distress. Please respond promptly.');

[0632] }

[0633] In this way, the entire system goes through a series of processing steps, allowing the user to quickly obtain contact information and receive appropriate responses tailored to their emotions at the time.

[0634] (Application Example 2)

[0635] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0636] Current web page browsing systems have problems with quickly obtaining information about the person in charge and providing appropriate responses that take into account the user's emotional state. In particular, in autonomous vehicles, prompt and courteous responses are required when passengers feel stressed or anxious, and conventional systems are insufficient to handle this.

[0637] The identification processing performed by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for creating a database that stores information on the person in charge of each web page, means for requesting person in charge information for the web page being viewed by the user, means for searching the database for the corresponding person in charge information based on the URL of the requested web page, and means for determining a response based on the user's emotions using an emotion recognition engine that analyzes the user's emotional state. This makes it possible not only to quickly obtain the person in charge information for the web page being viewed by the user, but also to provide an appropriate response according to the user's emotional state.

[0638] A "web page" is a document or information resource that can be accessed via the internet.

[0639] A "responsible department" is a department that is responsible for a specific task or project.

[0640] "Contact person information" refers to information about the person responsible for a specific task or project, as well as contact details.

[0641] A "database" is a system that organizes and stores data, and allows it to be searched and updated as needed.

[0642] "URL" stands for Uniform Resource Locator, and it is an address that indicates the location of a specific resource on the internet.

[0643] An "emotion recognition engine" is an algorithm or system that analyzes a user's facial expressions, tone of voice, etc., to recognize their emotional state.

[0644] A "pop-up" is a small window that suddenly appears on a user interface, used to display specific information.

[0645] An "autonomous vehicle" is a vehicle that uses artificial intelligence and sensor technology to drive autonomously without a human driver.

[0646] As an embodiment of the present invention, we will describe a system that manages information on the person in charge of a web page and allows users to quickly obtain that information, as well as a system that recognizes the user's emotions and recommends appropriate responses.

[0647] This system consists of a database, user interface, server-side programs, client-side scripts, and an emotion recognition engine. Specifically, the database stores information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. The database is implemented using a relational database management system such as PostgreSQL.

[0648] The server receives HTTP requests to retrieve contact information for specific web pages from a database and returns the results to the client in JSON format. It also automatically retrieves the URL of the currently viewed web page based on the user's request and searches for the contact information corresponding to that URL. Furthermore, it includes a mechanism for displaying the retrieved contact information as a pop-up.

[0649] In the system of the present invention, when a user clicks a button requesting "person in charge information" while browsing a specific web page, the URL is automatically retrieved, and an SQL query is executed against the database based on that information. The resulting person in charge information is displayed in a pop-up format on the user interface, allowing the user to easily check the person in charge information.

[0650] Next, the user's emotional state is analyzed using an emotion recognition engine. This engine utilizes models built with deep learning frameworks such as TensorFlow and PyTorch, recognizing the user's emotions by analyzing their voice and image data. Based on this analysis, the server can provide appropriate responses according to the user's emotional state.

[0651] As a concrete example, let's explain the system's operation inside an autonomous vehicle. Suppose a passenger requests customer support while browsing a specific webpage inside the autonomous vehicle. The system obtains the URL of that page and retrieves the contact person's information from the database. At the same time, it inputs the passenger's voice and facial expression data into an emotion recognition engine, and if the analysis results in an emotion such as "stress," it recommends a prompt and courteous response.

[0652] Examples of prompt statements include the following:

[0653] "Please retrieve the contact person information corresponding to the URL 'https: / / example.com / page1'. Analyze the user's emotions based on their facial expression data and recommend an appropriate response. The user's facial expression data indicates 'stress'."

[0654] In this way, the system of the present invention can not only quickly obtain information about the person in charge of the web page viewed by the user, but also provide appropriate responses according to the user's emotional state.

[0655] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0656] Step 1:

[0657] The user clicks a button to request contact person information.

[0658] Input: User click action

[0659] Specific action: Click the "Request contact information" button on the webpage.

[0660] Output: URL of the webpage currently being viewed

[0661] Step 2:

[0662] The device automatically retrieves the URL of the web page it is currently viewing and sends the URL to the server.

[0663] Input: URL of the webpage you are currently viewing

[0664] Specific operation: Parses the DOM to obtain the URL and sends an HTTP GET request to the server.

[0665] Output: HTTP request (including URL information)

[0666] Step 3:

[0667] The server searches the database for the corresponding contact person information based on the URL.

[0668] Input: URL information

[0669] Specific operation: Send an SQL query to the database to retrieve information about the person in charge.

[0670] Output: Person in charge information (department name, name, contact information)

[0671] Step 4:

[0672] The server returns the contact person information obtained as a search result to the client in JSON format.

[0673] Input: Person in charge information

[0674] Specific operation: Convert the person in charge information into JSON format and send it to the client as an HTTP response.

[0675] Output: Person in charge information in JSON format

[0676] Step 5:

[0677] The terminal displays the contact person information it received as a pop-up.

[0678] Input: Contact person information in JSON format

[0679] Specific operation: Parse JSON data, generate a popup window, and display the person in charge's information.

[0680] Output: Person in charge information displayed in the pop-up window

[0681] Step 6:

[0682] The device sends the user's voice and facial expression data to an emotion recognition engine, which then analyzes their emotions.

[0683] Input: User voice and facial expression data

[0684] Specific operation: Data collected by the camera and microphone is sent to the emotion recognition engine.

[0685] Output: User's emotional state

[0686] Step 7:

[0687] The emotion recognition engine analyzes the user's emotional state and returns the analysis results to the server.

[0688] Input: User voice and facial expression data

[0689] Specific operation: Analyze emotions using a deep learning model.

[0690] Output: Emotion analysis results (stress, anger, joy, etc.)

[0691] Step 8:

[0692] The server provides responses tailored to the user's emotional state based on the emotion analysis results.

[0693] Input: Sentiment analysis results

[0694] Specific actions: Determine and present messages and responses to the user based on their emotional state.

[0695] Output: Appropriate response (e.g., "A prompt and courteous response is required.")

[0696] Through the steps described above, the system of the present invention can not only quickly obtain information about the person in charge of the web page viewed by the user, but also provide appropriate responses according to the user's emotional state.

[0697] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0698] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0699] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0700] [Third Embodiment]

[0701] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0702] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0703] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0704] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0705] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0706] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0707] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0708] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0709] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0710] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0711] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0712] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0713] As an embodiment of the present invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly retrieve that information. This system consists of a database, a user interface, a server-side program, and a client-side script.

[0714] First, the server builds a specific database to store information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[0715] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0716] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0717] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, this could be done by generating a pop-up window that displays the contact person's department name, name, and contact information.

[0718] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0719] As described above, through the embodiments of the present invention, users can quickly and easily obtain contact information for web pages, providing a system that improves the efficiency of inquiries and reduces errors.

[0720] The following describes the processing flow.

[0721] Step 1:

[0722] The server creates a database to store information about the person in charge of each web page. The database includes fields to store the web page's URL, the department responsible, the person in charge's name, and contact information.

[0723] Step 2:

[0724] When a user creates a new webpage or makes changes to an existing one, they enter the corresponding user information into the database. This saves both the webpage and the user information in the database.

[0725] Step 3:

[0726] If a user is browsing a specific webpage and wants to know the "contact person information" for that page, the user clicks the displayed "Contact Person Information" button.

[0727] Step 4:

[0728] The device captures a button click event and automatically retrieves the URL of the currently viewed webpage. It then generates an HTTP GET request to send the retrieved URL to the server.

[0729] Step 5:

[0730] The device sends an HTTP GET request to the server. The request includes the URL of the web page as a parameter.

[0731] Step 6:

[0732] The server parses the received request and searches the database based on the provided URL to retrieve the relevant personnel information. It uses SQL queries to select the necessary information from the database.

[0733] Step 7:

[0734] The server converts the acquired contact person information into JSON format and sends it to the terminal as an HTTP response. The JSON data includes the department, contact person's name, and contact information.

[0735] Step 8:

[0736] The terminal receives an HTTP response from the server and parses the JSON data. Based on the parsed data, it displays the person in charge's information on the user interface.

[0737] Step 9:

[0738] The device generates a pop-up window displaying the analyzed contact information (department name, name, and contact details). This allows the user to quickly find the necessary contact information.

[0739] (Example 1)

[0740] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0741] Traditional systems made it difficult to quickly and accurately retrieve contact information for web pages. Furthermore, manual management of contact information led to errors and delays in data updates. The challenge lies in improving user convenience, streamlining inquiries, and accelerating information retrieval.

[0742] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0743] In this invention, the server includes means for creating a database to store information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for searching the database for the corresponding person in charge information based on the URL of the requested web page; means for returning the person in charge information obtained as a search result to the user; means for managing the data entered into the database based on appropriate authentication; means for automatically obtaining the URL of the web page currently being viewed based on the user's request and sending a GET request including the obtained URL to the server; and means for parsing the JSON format data returned from the server and displaying the person in charge information. This makes it possible to search for and display person in charge information quickly and accurately. In addition, since the user can easily obtain the person in charge information corresponding to the page currently being viewed simply by clicking the "Person in Charge Information" button on the web page, the efficiency and convenience of inquiries are improved.

[0744] A "database" is a relational database management system used to store and manage information about the person in charge of each web page.

[0745] "Information on the person in charge" refers to data that includes the URL of the web page, the department in charge, the name of the person in charge, and contact information.

[0746] "A means of requesting contact person information for a web page a user is viewing" refers to a "Contact Person Information" button implemented on a part of the web page, where the user requests contact person information by clicking this button.

[0747] A "URL" refers to the address of a requested web page and is used as a parameter when creating an HTTP request.

[0748] A "GET request" is a request method based on the HTTP protocol used to retrieve specific information from a server.

[0749] "JSON format" is an abbreviation for JavaScript Object Notation, and it is a lightweight data exchange format for structurally representing data.

[0750] "Analysis" refers to the process of interpreting JSON-formatted data received from a server and extracting its contents.

[0751] A "pop-up window" is a window that appears on the user's screen and serves as a means of visually providing the user with information about the person in charge.

[0752] "Appropriate authentication" refers to the authentication process that ensures data entered into a database is managed accurately and securely.

[0753] As an embodiment of this invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly retrieve that information. This system consists of a database, a user interface, a server-side program, and a client-side script.

[0754] First, the server uses MySQL to build a database, storing information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[0755] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0756] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0757] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, this could be done by generating a pop-up window that displays the contact person's department name, name, and contact information.

[0758] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0759] Examples of prompt statements for a generative AI model are as follows:

[0760] "Please provide a detailed explanation of the system's process for returning contact person information corresponding to a specific URL. For example, please describe the specific steps involved in retrieving and displaying the contact person information for https: / / example.com / page1."

[0761] As described above, through the embodiments of the present invention, users can quickly and easily obtain contact information for web pages, providing a system that improves the efficiency of inquiries and reduces errors.

[0762] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0763] Step 1:

[0764] The server will build a new database using MySQL. The input will include the URL of each web page, the department responsible, the contact person's name, and contact information. The server will input this data into a relational database management system (RDBMS) and store each piece of information in the appropriate format. This will build the database.

[0765] Step 2:

[0766] The server manages the data entered into the database based on appropriate authentication. Specifically, this involves setting access permissions based on user login information to prevent unauthorized access. The input for this step is authentication information, and the output is the database with the access permissions set.

[0767] Step 3:

[0768] The user clicks the "Contact Person Information" button on the web page they are viewing. This causes the device to automatically retrieve the URL of the current web page. The input in this step is the user's action, and the output is the retrieved URL.

[0769] Step 4:

[0770] The device uses the acquired URL to request contact information corresponding to that URL from the server. This request is executed as a GET request based on the HTTP protocol. The input is a URL, and the output is an HTTP GET request. The device sends this request to the server.

[0771] Step 5:

[0772] The server processes the received GET request and retrieves the corresponding contact person information from the database based on the URL in the request. The input for this step is the URL included in the GET request, and the output is the corresponding contact person information. The server retrieves the data from the database and converts it to JSON format.

[0773] Step 6:

[0774] The server returns the person in charge information in JSON format to the client (user's terminal). The input for this step is the person in charge information and its conversion to JSON format, and the output is the JSON data sent as a response.

[0775] Step 7:

[0776] The terminal receives JSON data returned from the server. The input is JSON data, and the output is the personnel information to be parsed.

[0777] Step 8:

[0778] The terminal generates a pop-up window based on the analyzed contact person information and displays the information to the user. Specifically, the contact person's department name, name, and contact information are displayed. The input for this step is the analyzed contact person information, and the output is a pop-up window on the user interface.

[0779] By following these steps, users can quickly and easily obtain the contact person information for a web page.

[0780] (Application Example 1)

[0781] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0782] In electronic payment services, it is difficult for users to quickly obtain information about support personnel from specific payment pages, hindering the efficiency of inquiries. Furthermore, current systems make it cumbersome for users to access the information they need, resulting in longer support times. This can degrade the user experience and potentially reduce the willingness to use the service. Therefore, the present invention aims to solve these problems.

[0783] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0784] In this invention, the server includes means for creating a database that stores information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for searching the database for the corresponding person in charge information based on the URL of the requested web page; means for returning the person in charge information obtained as a search result to the user; means for quickly obtaining information on the support person for a specific web page while using the electronic payment service; and means for displaying the obtained person in charge information as a pop-up on the user interface of a smartphone. This makes it possible for users to quickly and easily obtain support person information from a specific payment page, improving the efficiency of inquiries and the ease of receiving support.

[0785] A "database" is an information management system used to store information about the person in charge of each web page.

[0786] A "user" is an individual or organization that browses web pages on the internet and requests information.

[0787] "URL" is an abbreviation for Unified Resource Locator, which indicates the address of a web page.

[0788] "Contact person information" refers to information such as the department responsible for a specific web page, the name of the person in charge, and contact information.

[0789] "Electronic payment services" refer to systems and services that support online payment processes.

[0790] A "support staff member" is responsible for handling inquiries and problems related to electronic payment services.

[0791] A "smartphone" is a portable device that has internet connectivity and application execution capabilities.

[0792] A "user interface" is an interface through which a user interacts with a system or application.

[0793] A "pop-up" is a small window that appears on top of an existing window or screen.

[0794] A "server" is a computer system that provides various services and data in response to requests from clients.

[0795] To implement this invention, it is necessary to construct a system using a combination of various hardware and software. This invention is a system for quickly obtaining information about support personnel based on the URL of a specific web page and displaying it to the user. The details are described below.

[0796] The server first builds a database to store information about the person in charge of each web page. This database will contain URLs, departments, contact information, etc. A relational database management system such as SQL is used to manage this database.

[0797] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This interface is implemented as a "Contact Information" button on a part of the web page, and a request is generated when the user clicks this button. The request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0798] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. The user's terminal parses the received JSON data and displays the contact person information as a pop-up window on the user interface.

[0799] Examples of hardware and software

[0800] Hardware: Servers, smartphones

[0801] Software: SQL (database management system), Flask (web framework), HTTP (communication protocol)

[0802] Specific example

[0803] For example, suppose there is a sample web page "https: / / example.com / payment". The person in charge of this page is "Taro Yamada (yamada@example.com) from the Support Department", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the user's device retrieves the URL "https: / / example.com / payment" and sends a request to the server. The server retrieves the information "Taro Yamada (yamada@example.com) from the Support Department" from the database and returns the result in JSON format. The user's device parses the received JSON data and displays this information to the user as a pop-up.

[0804] Example of a prompt

[0805] "Create a prompt message for when a user wants to retrieve contact information from a specific page of an electronic payment service. Specify the URL of that page, and the prompt should respond with the name and contact information of the corresponding support representative. URL: https: / / example.com / payment"

[0806] As described above, the present invention enables users to quickly and easily obtain support personnel information for a specific page while using an electronic payment service, thereby improving the efficiency of inquiries and making it easier to receive support.

[0807] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0808] Step 1:

[0809] The user clicks the "Contact Person Information" button while browsing a specific webpage for an electronic payment service. This action triggers the user interface to receive the user's request.

[0810] (Input): The user clicks the "Contact Person Information" button.

[0811] (Data processing): Get the URL of the currently viewed webpage.

[0812] (Output): Preparation for sending the acquired URL to the server

[0813] Step 2:

[0814] The device automatically retrieves the URL of the web page the user is currently viewing. This prevents user input errors and allows for the collection of accurate information.

[0815] (Input): URL of the webpage the user clicked

[0816] (Data processing): Passing URL information as parameters to send to the server.

[0817] (Output): Send URL information to the server in HTTP GET request format.

[0818] Step 3:

[0819] The server receives the URL information sent from the terminal and executes a query in the database to search for the corresponding contact person information.

[0820] (Input): Submitted URL information

[0821] (Data processing): Generate an SQL query and search the database for the relevant person's information.

[0822] (Output): Person in charge information obtained as search results

[0823] Step 4:

[0824] The server converts the personnel information retrieved from the database into JSON format and sends it back to the terminal.

[0825] (Input): Person in charge information obtained as search results

[0826] (Data processing): Convert to JSON format

[0827] (Output): Sends the person in charge information in JSON format back to the terminal.

[0828] Step 5:

[0829] The terminal receives the returned JSON-formatted contact person information and displays it as a pop-up window on the user interface. Here, the contact person's department name, name, and contact information are displayed.

[0830] (Input): Contact person information in JSON format

[0831] (Data Processing): Parse JSON data and convert it into a format that can be displayed in the user interface.

[0832] (Output): Display contact person information as a pop-up window.

[0833] Step 6:

[0834] Users can review the contact person information displayed in the pop-up window and contact the person if necessary. This process improves the efficiency of inquiries.

[0835] (Input): Confirmation of the displayed contact person information

[0836] (Data processing): Select contact method based on contact person information.

[0837] (Output): Contact support staff

[0838] In this way, a system is realized that collects the necessary information at each step and provides users with contact person information quickly and accurately. This improves user support while using electronic payment services and streamlines inquiries.

[0839] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0840] As an embodiment of the present invention, a system is described that manages information on the person in charge of each web page and allows users to quickly obtain this information, as well as a system that recognizes the user's emotions and recommends appropriate responses. This system consists of a database, a user interface, a server-side program, a client-side script, and an emotion engine.

[0841] First, the server builds a specific database to store information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[0842] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0843] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact person information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[0844] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, the display method may be to generate a pop-up window and display the contact person's department name, name, and contact information.

[0845] Furthermore, an emotion engine is incorporated to analyze user emotions. When a user requests contact information, the emotion engine analyzes the user's tone of voice, facial expressions, etc., to recognize their current emotional state. Based on this information, the system provides the most appropriate response to the user.

[0846] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0847] At this stage, the emotion engine recognizes the user's emotions. For example, if the user is exhibiting an unpleasant attitude or stress, the system takes this information into consideration and notifies the relevant personnel that a prompt and courteous response is required. It is also possible to display friendly messages to the user depending on their specific emotional state.

[0848] As described above, through the embodiments of the present invention, users can not only quickly and easily obtain information about the person in charge of a web page, but also receive suggestions and support that appropriately address their emotions at the time. This provides a system that improves the efficiency of inquiries and enhances user satisfaction.

[0849] The following describes the processing flow.

[0850] Step 1:

[0851] The server creates a database to store information about the person in charge of each web page. The database includes fields to store the web page's URL, the department responsible, the person in charge's name, and contact information.

[0852] Step 2:

[0853] When a user creates a new webpage or makes changes to an existing one, they enter the corresponding user information into the database. This saves both the webpage and the user information in the database.

[0854] Step 3:

[0855] If a user is browsing a specific webpage and wants to know the "contact person information" for that page, the user clicks the displayed "Contact Person Information" button.

[0856] Step 4:

[0857] The device captures a button click event and automatically retrieves the URL of the currently viewed webpage. It then generates an HTTP GET request to send the retrieved URL to the server.

[0858] Step 5:

[0859] The device sends an HTTP GET request to the server. The request includes the URL of the web page as a parameter.

[0860] Step 6:

[0861] The server parses the received request and searches the database based on the provided URL to retrieve the relevant personnel information. It uses SQL queries to select the necessary information from the database.

[0862] Step 7:

[0863] The server converts the acquired contact person information into JSON format and sends it to the terminal as an HTTP response. The JSON data includes the department, contact person's name, and contact information.

[0864] Step 8:

[0865] The terminal receives an HTTP response from the server and parses the JSON data. Based on the parsed data, it displays the person in charge's information on the user interface.

[0866] Step 9:

[0867] The emotion engine analyzes the user's tone of voice, facial expressions, or input content to recognize their current emotion. This is done, for example, using speech recognition or image analysis technologies.

[0868] Step 10:

[0869] Based on the user's emotions recognized by the emotion engine, the system determines the appropriate response. For example, if signs of anger or stress are detected, the system notifies the person in charge that a prompt and courteous response is required.

[0870] Step 11:

[0871] The device generates a pop-up window displaying the analyzed contact information (department name, name, and contact details). It may also display additional information or messages based on the user's sentiment.

[0872] Step 12:

[0873] Users can review the contact person information displayed in a pop-up window and contact them if necessary. The system can also provide additional support based on the user's emotions. For example, if a user is feeling dissatisfied, it may display an encouraging message.

[0874] (Example 2)

[0875] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0876] While systems exist that quickly provide information on who is in charge of a web page, they lack mechanisms for providing appropriate responses based on the user's emotions. As a result, responses when users experience unpleasant emotions may be insufficient, potentially leading to decreased user satisfaction. This invention aims to improve user satisfaction by enabling users to easily obtain information on who is in charge of a web page and by recommending responses that are appropriate to the user's emotional state.

[0877] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0878] In this invention, the server includes means for creating an information management device that stores information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for retrieving the corresponding person in charge information from the information management device based on the identifier of the requested web page; means for returning the person in charge information obtained as a search result to the user; and means including an emotion analysis device that analyzes the user's emotions and recommends an appropriate response based on the results. As a result, the user can quickly obtain person in charge information for web pages and receive an appropriate response that is in line with the user's emotions.

[0879] An "information management device" is a database system used to store and manage information about the person in charge of each web page.

[0880] A "user" is an end-user who views a web page and requests contact information.

[0881] An "identifier" is a unique string of characters, such as a URL, used to identify a web page.

[0882] "Searching" refers to the act of querying data within an information management device based on an identifier and obtaining the corresponding personnel information.

[0883] An "emotion analysis device" is a system that analyzes the user's voice tone, facial expressions, and other data to recognize and estimate their current emotional state.

[0884] A "window" is a display area that visualizes the contact person information obtained as a search result for the user.

[0885] As an embodiment of the present invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly obtain this information, as well as a system that recognizes the user's emotions and recommends appropriate responses. This system consists of an information management device, a user interface, a server-side program, a client-side script, and an emotion analysis device.

[0886] First, the server establishes a specific information management device that stores identifiers for each web page, responsible departments, contact persons, and contact information. This information management device is implemented using a relational database management system such as SQL. Furthermore, the data entered into the information management device is managed based on appropriate authentication.

[0887] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request obtains the identifier of the web page the user is currently viewing and requests the corresponding contact information from the server.

[0888] When a user clicks a button, the device automatically retrieves the identifier of the current web page and requests the server for the contact person information corresponding to this identifier. This request is executed as a GET request based on the HTTP protocol, and the identifier information is passed as a parameter.

[0889] The server processes the received request and retrieves the corresponding contact person information from the information management device. The contact person information obtained as a search result is returned to the client side (user's terminal) in data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, the display method may involve generating a pop-up window that displays the contact person's department name, name, and contact information.

[0890] Furthermore, the system incorporates an emotion analysis device to analyze the user's emotions. When a user requests information about a representative, the emotion analysis device analyzes the user's tone of voice, facial expressions, etc., to recognize their current emotional state. Based on this information, the system provides the most appropriate response to the user.

[0891] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Marketing Department Representative (tanaka@example.com)", and this information is pre-entered in the information management device. When a user clicks the button to request "Representative Information" while browsing this page, the device obtains the identifier "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Marketing Department Representative (tanaka@example.com)" from the information management device and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[0892] At this stage, the emotion analyzer recognizes the user's emotions. For example, if the user exhibits an unpleasant attitude or stress, the system takes this information into consideration and notifies the person in charge that a prompt and courteous response is required. It can also display friendly messages to the user depending on their specific emotional state.

[0893] In this way, through embodiments of the present invention, users can not only quickly and easily obtain information about the person in charge of a web page, but also receive suggestions and support that appropriately address their emotions at the time. This provides a system that improves the efficiency of inquiries and enhances user satisfaction.

[0894] Example of a prompt

[0895] A user visits the webpage "https: / / example.com / page1" and clicks the "Contact Person Information" button. The contact person for this page is "Marketing Department Staff," and this information is stored in the information management system. The system recommends an appropriate response based on the user's emotional state. Please describe the specific system operation and suggest how to make user support even more effective.

[0896] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0897] Program processing flow

[0898] Step 1: Building the Database

[0899] server

[0900] Input: Defines the database table structure based on configuration files or scripts.

[0901] Process: Use a relational database management system such as SQL to create tables to store the identifier (URL), department, contact person's name, and contact information for each web page.

[0902] Output: A database table is created.

[0903] Specific actions: For example, create a table called "Contact Person Information" with columns such as "url", "department", "contact_person", and "contact_info".

[0904] Step 2: Install the contact person information button.

[0905] terminal

[0906] Input: HTML code of a web page.

[0907] Process: Use JavaScript and CSS to place the "Contact Person Information" button on the web page.

[0908] Output: A button is displayed on the web page.

[0909] Specific action: For example, add the following code to your HTML.

[0910] html

[0911] <button id="contact-info-button"> Person in charge information< / button>

[0912] Step 3: Submit a request for contact person information.

[0913] User

[0914] Input: Click the "Contact Person Information" button on the web page.

[0915] Process: Use JavaScript to obtain the identifier (URL) of the current web page.

[0916] Output: The retrieved URL is sent to the server.

[0917] Specific operation: Capture the button click event, execute the following JavaScript code to obtain the URL, and send a request to the server.

[0918] JavaScript

[0919] document.getElementById('contact-info-button').addEventListener('click', function() {

[0920] const currentURL = window.location.href;

[0921] fetch(https: / / example-server.com / get-contact-info?url=${encodeURIComponent(currentURL)})

[0922] .then(response => response.json())

[0923] .then(data => displayContactInfo(data));

[0924] });

[0925] Step 4: Receive the request and query the database.

[0926] server

[0927] Input: HTTP GET request and its URL parameters.

[0928] Processing: Based on the received URL, the information management device (database) is searched, and the corresponding personnel information is retrieved.

[0929] Output: The responsible person information is returned to the client (user's terminal) in JSON format.

[0930] Specific operation: For example, construct an SQL statement using the received URL as a query parameter.

[0931] Python

[0932] @app.route(' / get-contact-info', methods=['GET'])

[0933] def get_contact_info():

[0934] url = request.args.get('url')

[0935] db_data = query_database(url) Execute the query and retrieve the data.

[0936] return jsonify(db_data)

[0937] Step 5: Displaying the person in charge information

[0938] terminal

[0939] Input: JSON data of contact person information received from the server.

[0940] Processing: The received JSON data is parsed, and the person in charge's information is displayed on the user interface.

[0941] Output: A pop-up window will appear displaying the department name, name, and contact information of the person in charge.

[0942] Specific actions: For example, execute the following JavaScript code to generate a popup and display information.

[0943] JavaScript

[0944] function displayContactInfo(data) {

[0945] const popup = window.open('', 'Contact Person Information', 'width=400,height=300');

[0946] popup.document.write( Department: ${data.department} );

[0947] popup.document.write( Contact person: ${data.contact_person} );

[0948] popup.document.write( Contact: ${data.contact_info} );

[0949] }

[0950] Step 6: Analyzing User Sentiment

[0951] terminal

[0952] Input: Real-time data such as the user's voice tone and facial expressions.

[0953] Processing: Data from the camera and microphone is acquired using WebRTC, etc., and transmitted to an emotion analysis device.

[0954] Output: Data regarding the user's emotional state is obtained.

[0955] Specific actions: For example, execute the following JavaScript code to obtain microphone and camera data.

[0956] JavaScript

[0957] navigator.mediaDevices.getUserMedia({ video: true, audio: true})

[0958] .then(stream => {

[0959] / / Uses microphone and camera stream data

[0960] });

[0961] Step 7: Recommendation of appropriate action

[0962] server

[0963] Input: Emotional data transmitted from the emotion analysis device.

[0964] Processing: Analyze the user's emotional state based on emotional data and recommend appropriate actions.

[0965] Output: Notifications and messages regarding the response policy are generated.

[0966] Specific actions: For example, if a user is showing signs of displeasure, a notification will be sent to the person in charge requesting prompt action.

[0967] JavaScript

[0968] if (detectedEmotion === 'angry') {

[0969] alert('The user is showing signs of distress. Please respond promptly.');

[0970] }

[0971] In this way, the entire system goes through a series of processing steps, allowing the user to quickly obtain contact information and receive appropriate responses tailored to their emotions at the time.

[0972] (Application Example 2)

[0973] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0974] Current web page browsing systems have problems with quickly obtaining information about the person in charge and providing appropriate responses that take into account the user's emotional state. In particular, in autonomous vehicles, prompt and courteous responses are required when passengers feel stressed or anxious, and conventional systems are insufficient to handle this.

[0975] The identification processing performed by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for creating a database that stores information on the person in charge of each web page, means for requesting person in charge information for the web page being viewed by the user, means for searching the database for the corresponding person in charge information based on the URL of the requested web page, and means for determining a response based on the user's emotions using an emotion recognition engine that analyzes the user's emotional state. This makes it possible not only to quickly obtain the person in charge information for the web page being viewed by the user, but also to provide an appropriate response according to the user's emotional state.

[0976] A "web page" is a document or information resource that can be accessed via the internet.

[0977] A "responsible department" is a department that is responsible for a specific task or project.

[0978] "Contact person information" refers to information about the person responsible for a specific task or project, as well as contact details.

[0979] A "database" is a system that organizes and stores data, and allows it to be searched and updated as needed.

[0980] "URL" stands for Uniform Resource Locator, and it is an address that indicates the location of a specific resource on the internet.

[0981] An "emotion recognition engine" is an algorithm or system that analyzes a user's facial expressions, tone of voice, etc., to recognize their emotional state.

[0982] A "pop-up" is a small window that suddenly appears on a user interface, used to display specific information.

[0983] An "autonomous vehicle" is a vehicle that uses artificial intelligence and sensor technology to drive autonomously without a human driver.

[0984] As an embodiment of the present invention, we will describe a system that manages information on the person in charge of a web page and allows users to quickly obtain that information, as well as a system that recognizes the user's emotions and recommends appropriate responses.

[0985] This system consists of a database, user interface, server-side programs, client-side scripts, and an emotion recognition engine. Specifically, the database stores information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. The database is implemented using a relational database management system such as PostgreSQL.

[0986] The server receives HTTP requests to retrieve contact information for specific web pages from a database and returns the results to the client in JSON format. It also automatically retrieves the URL of the currently viewed web page based on the user's request and searches for the contact information corresponding to that URL. Furthermore, it includes a mechanism for displaying the retrieved contact information as a pop-up.

[0987] In the system of the present invention, when a user clicks a button requesting "person in charge information" while browsing a specific web page, the URL is automatically retrieved, and an SQL query is executed against the database based on that information. The resulting person in charge information is displayed in a pop-up format on the user interface, allowing the user to easily check the person in charge information.

[0988] Next, the user's emotional state is analyzed using an emotion recognition engine. This engine utilizes models built with deep learning frameworks such as TensorFlow and PyTorch, recognizing the user's emotions by analyzing their voice and image data. Based on this analysis, the server can provide appropriate responses according to the user's emotional state.

[0989] As a concrete example, let's explain the system's operation inside an autonomous vehicle. Suppose a passenger requests customer support while browsing a specific webpage inside the autonomous vehicle. The system obtains the URL of that page and retrieves the contact person's information from the database. At the same time, it inputs the passenger's voice and facial expression data into an emotion recognition engine, and if the analysis results in an emotion such as "stress," it recommends a prompt and courteous response.

[0990] Examples of prompt statements include the following:

[0991] "Please retrieve the contact person information corresponding to the URL 'https: / / example.com / page1'. Analyze the user's emotions based on their facial expression data and recommend an appropriate response. The user's facial expression data indicates 'stress'."

[0992] In this way, the system of the present invention can not only quickly obtain information about the person in charge of the web page viewed by the user, but also provide appropriate responses according to the user's emotional state.

[0993] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0994] Step 1:

[0995] The user clicks a button to request contact person information.

[0996] Input: User click action

[0997] Specific action: Click the "Request contact information" button on the webpage.

[0998] Output: URL of the webpage currently being viewed

[0999] Step 2:

[1000] The device automatically retrieves the URL of the web page it is currently viewing and sends the URL to the server.

[1001] Input: URL of the webpage you are currently viewing

[1002] Specific operation: Parses the DOM to obtain the URL and sends an HTTP GET request to the server.

[1003] Output: HTTP request (including URL information)

[1004] Step 3:

[1005] The server searches the database for the corresponding contact person information based on the URL.

[1006] Input: URL information

[1007] Specific operation: Send an SQL query to the database to retrieve information about the person in charge.

[1008] Output: Person in charge information (department name, name, contact information)

[1009] Step 4:

[1010] The server returns the contact person information obtained as a search result to the client in JSON format.

[1011] Input: Person in charge information

[1012] Specific operation: Convert the person in charge information into JSON format and send it to the client as an HTTP response.

[1013] Output: Person in charge information in JSON format

[1014] Step 5:

[1015] The terminal displays the contact person information it received as a pop-up.

[1016] Input: Contact person information in JSON format

[1017] Specific operation: Parse JSON data, generate a popup window, and display the person in charge's information.

[1018] Output: Person in charge information displayed in the pop-up window

[1019] Step 6:

[1020] The device sends the user's voice and facial expression data to an emotion recognition engine, which then analyzes their emotions.

[1021] Input: User voice and facial expression data

[1022] Specific operation: Data collected by the camera and microphone is sent to the emotion recognition engine.

[1023] Output: User's emotional state

[1024] Step 7:

[1025] The emotion recognition engine analyzes the user's emotional state and returns the analysis results to the server.

[1026] Input: User voice and facial expression data

[1027] Specific operation: Analyze emotions using a deep learning model.

[1028] Output: Emotion analysis results (stress, anger, joy, etc.)

[1029] Step 8:

[1030] The server provides responses tailored to the user's emotional state based on the emotion analysis results.

[1031] Input: Sentiment analysis results

[1032] Specific actions: Determine and present messages and responses to the user based on their emotional state.

[1033] Output: Appropriate response (e.g., "A prompt and courteous response is required.")

[1034] Through the steps described above, the system of the present invention can not only quickly obtain information about the person in charge of the web page viewed by the user, but also provide appropriate responses according to the user's emotional state.

[1035] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1036] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1037] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1038] [Fourth Embodiment]

[1039] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1040] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1041] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1042] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1043] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1044] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1045] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1046] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1047] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1048] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1049] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1050] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1051] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1052] As an embodiment of the present invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly retrieve that information. This system consists of a database, a user interface, a server-side program, and a client-side script.

[1053] First, the server builds a specific database to store information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[1054] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[1055] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[1056] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, this could be done by generating a pop-up window that displays the contact person's department name, name, and contact information.

[1057] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[1058] As described above, through the embodiments of the present invention, users can quickly and easily obtain contact information for web pages, providing a system that improves the efficiency of inquiries and reduces errors.

[1059] The following describes the processing flow.

[1060] Step 1:

[1061] The server creates a database to store information about the person in charge of each web page. The database includes fields to store the web page's URL, the department responsible, the person in charge's name, and contact information.

[1062] Step 2:

[1063] When a user creates a new webpage or makes changes to an existing one, they enter the corresponding user information into the database. This saves both the webpage and the user information in the database.

[1064] Step 3:

[1065] If a user is browsing a specific webpage and wants to know the "contact person information" for that page, the user clicks the displayed "Contact Person Information" button.

[1066] Step 4:

[1067] The device captures a button click event and automatically retrieves the URL of the currently viewed webpage. It then generates an HTTP GET request to send the retrieved URL to the server.

[1068] Step 5:

[1069] The device sends an HTTP GET request to the server. The request includes the URL of the web page as a parameter.

[1070] Step 6:

[1071] The server parses the received request and searches the database based on the provided URL to retrieve the relevant personnel information. It uses SQL queries to select the necessary information from the database.

[1072] Step 7:

[1073] The server converts the acquired contact person information into JSON format and sends it to the terminal as an HTTP response. The JSON data includes the department, contact person's name, and contact information.

[1074] Step 8:

[1075] The terminal receives an HTTP response from the server and parses the JSON data. Based on the parsed data, it displays the person in charge's information on the user interface.

[1076] Step 9:

[1077] The device generates a pop-up window displaying the analyzed contact information (department name, name, and contact details). This allows the user to quickly find the necessary contact information.

[1078] (Example 1)

[1079] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1080] Traditional systems made it difficult to quickly and accurately retrieve contact information for web pages. Furthermore, manual management of contact information led to errors and delays in data updates. The challenge lies in improving user convenience, streamlining inquiries, and accelerating information retrieval.

[1081] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1082] In this invention, the server includes means for creating a database to store information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for searching the database for the corresponding person in charge information based on the URL of the requested web page; means for returning the person in charge information obtained as a search result to the user; means for managing the data entered into the database based on appropriate authentication; means for automatically obtaining the URL of the web page currently being viewed based on the user's request and sending a GET request including the obtained URL to the server; and means for parsing the JSON format data returned from the server and displaying the person in charge information. This makes it possible to search for and display person in charge information quickly and accurately. In addition, since the user can easily obtain the person in charge information corresponding to the page currently being viewed simply by clicking the "Person in Charge Information" button on the web page, the efficiency and convenience of inquiries are improved.

[1083] A "database" is a relational database management system used to store and manage information about the person in charge of each web page.

[1084] "Information on the person in charge" refers to data that includes the URL of the web page, the department in charge, the name of the person in charge, and contact information.

[1085] "A means of requesting contact person information for a web page a user is viewing" refers to a "Contact Person Information" button implemented on a part of the web page, where the user requests contact person information by clicking this button.

[1086] A "URL" refers to the address of a requested web page and is used as a parameter when creating an HTTP request.

[1087] A "GET request" is a request method based on the HTTP protocol used to retrieve specific information from a server.

[1088] "JSON format" is an abbreviation for JavaScript Object Notation, and it is a lightweight data exchange format for structurally representing data.

[1089] "Analysis" refers to the process of interpreting JSON-formatted data received from a server and extracting its contents.

[1090] A "pop-up window" is a window that appears on the user's screen and serves as a means of visually providing the user with information about the person in charge.

[1091] "Appropriate authentication" refers to the authentication process that ensures data entered into a database is managed accurately and securely.

[1092] As an embodiment of this invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly retrieve that information. This system consists of a database, a user interface, a server-side program, and a client-side script.

[1093] First, the server uses MySQL to build a database, storing information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[1094] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[1095] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[1096] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, this could be done by generating a pop-up window that displays the contact person's department name, name, and contact information.

[1097] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[1098] Examples of prompt statements for a generative AI model are as follows:

[1099] "Please provide a detailed explanation of the system's process for returning contact person information corresponding to a specific URL. For example, please describe the specific steps involved in retrieving and displaying the contact person information for https: / / example.com / page1."

[1100] As described above, through the embodiments of the present invention, users can quickly and easily obtain contact information for web pages, providing a system that improves the efficiency of inquiries and reduces errors.

[1101] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1102] Step 1:

[1103] The server will build a new database using MySQL. The input will include the URL of each web page, the department responsible, the contact person's name, and contact information. The server will input this data into a relational database management system (RDBMS) and store each piece of information in the appropriate format. This will build the database.

[1104] Step 2:

[1105] The server manages the data entered into the database based on appropriate authentication. Specifically, this involves setting access permissions based on user login information to prevent unauthorized access. The input for this step is authentication information, and the output is the database with the access permissions set.

[1106] Step 3:

[1107] The user clicks the "Contact Person Information" button on the web page they are viewing. This causes the device to automatically retrieve the URL of the current web page. The input in this step is the user's action, and the output is the retrieved URL.

[1108] Step 4:

[1109] The device uses the acquired URL to request contact information corresponding to that URL from the server. This request is executed as a GET request based on the HTTP protocol. The input is a URL, and the output is an HTTP GET request. The device sends this request to the server.

[1110] Step 5:

[1111] The server processes the received GET request and retrieves the corresponding contact person information from the database based on the URL in the request. The input for this step is the URL included in the GET request, and the output is the corresponding contact person information. The server retrieves the data from the database and converts it to JSON format.

[1112] Step 6:

[1113] The server returns the person in charge information in JSON format to the client (user's terminal). The input for this step is the person in charge information and its conversion to JSON format, and the output is the JSON data sent as a response.

[1114] Step 7:

[1115] The terminal receives JSON data returned from the server. The input is JSON data, and the output is the personnel information to be parsed.

[1116] Step 8:

[1117] The terminal generates a pop-up window based on the analyzed contact person information and displays the information to the user. Specifically, the contact person's department name, name, and contact information are displayed. The input for this step is the analyzed contact person information, and the output is a pop-up window on the user interface.

[1118] By following these steps, users can quickly and easily obtain the contact person information for a web page.

[1119] (Application Example 1)

[1120] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1121] In electronic payment services, it is difficult for users to quickly obtain information about support personnel from specific payment pages, hindering the efficiency of inquiries. Furthermore, current systems make it cumbersome for users to access the information they need, resulting in longer support times. This can degrade the user experience and potentially reduce the willingness to use the service. Therefore, the present invention aims to solve these problems.

[1122] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1123] In this invention, the server includes means for creating a database that stores information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for searching the database for the corresponding person in charge information based on the URL of the requested web page; means for returning the person in charge information obtained as a search result to the user; means for quickly obtaining information on the support person for a specific web page while using the electronic payment service; and means for displaying the obtained person in charge information as a pop-up on the user interface of a smartphone. This makes it possible for users to quickly and easily obtain support person information from a specific payment page, improving the efficiency of inquiries and the ease of receiving support.

[1124] A "database" is an information management system used to store information about the person in charge of each web page.

[1125] A "user" is an individual or organization that browses web pages on the internet and requests information.

[1126] "URL" is an abbreviation for Unified Resource Locator, which indicates the address of a web page.

[1127] "Contact person information" refers to information such as the department responsible for a specific web page, the name of the person in charge, and contact information.

[1128] "Electronic payment services" refer to systems and services that support online payment processes.

[1129] A "support staff member" is responsible for handling inquiries and problems related to electronic payment services.

[1130] A "smartphone" is a portable device that has internet connectivity and application execution capabilities.

[1131] A "user interface" is an interface through which a user interacts with a system or application.

[1132] A "pop-up" is a small window that appears on top of an existing window or screen.

[1133] A "server" is a computer system that provides various services and data in response to requests from clients.

[1134] To implement this invention, it is necessary to construct a system using a combination of various hardware and software. This invention is a system for quickly obtaining information about support personnel based on the URL of a specific web page and displaying it to the user. The details are described below.

[1135] The server first builds a database to store information about the person in charge of each web page. This database will contain URLs, departments, contact information, etc. A relational database management system such as SQL is used to manage this database.

[1136] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This interface is implemented as a "Contact Information" button on a part of the web page, and a request is generated when the user clicks this button. The request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[1137] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. The user's terminal parses the received JSON data and displays the contact person information as a pop-up window on the user interface.

[1138] Examples of hardware and software

[1139] Hardware: Servers, smartphones

[1140] Software: SQL (database management system), Flask (web framework), HTTP (communication protocol)

[1141] Specific example

[1142] For example, suppose there is a sample web page "https: / / example.com / payment". The person in charge of this page is "Taro Yamada (yamada@example.com) from the Support Department", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the user's device retrieves the URL "https: / / example.com / payment" and sends a request to the server. The server retrieves the information "Taro Yamada (yamada@example.com) from the Support Department" from the database and returns the result in JSON format. The user's device parses the received JSON data and displays this information to the user as a pop-up.

[1143] Example of a prompt

[1144] "Create a prompt message for when a user wants to retrieve contact information from a specific page of an electronic payment service. Specify the URL of that page, and the prompt should respond with the name and contact information of the corresponding support representative. URL: https: / / example.com / payment"

[1145] As described above, the present invention enables users to quickly and easily obtain support personnel information for a specific page while using an electronic payment service, thereby improving the efficiency of inquiries and making it easier to receive support.

[1146] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1147] Step 1:

[1148] The user clicks the "Contact Person Information" button while browsing a specific webpage for an electronic payment service. This action triggers the user interface to receive the user's request.

[1149] (Input): The user clicks the "Contact Person Information" button.

[1150] (Data processing): Get the URL of the currently viewed webpage.

[1151] (Output): Preparation for sending the acquired URL to the server

[1152] Step 2:

[1153] The device automatically retrieves the URL of the web page the user is currently viewing. This prevents user input errors and allows for the collection of accurate information.

[1154] (Input): URL of the webpage the user clicked

[1155] (Data processing): Passing URL information as parameters to send to the server.

[1156] (Output): Send URL information to the server in HTTP GET request format.

[1157] Step 3:

[1158] The server receives the URL information sent from the terminal and executes a query in the database to search for the corresponding contact person information.

[1159] (Input): Submitted URL information

[1160] (Data processing): Generate an SQL query and search the database for the relevant person's information.

[1161] (Output): Person in charge information obtained as search results

[1162] Step 4:

[1163] The server converts the personnel information retrieved from the database into JSON format and sends it back to the terminal.

[1164] (Input): Person in charge information obtained as search results

[1165] (Data processing): Convert to JSON format

[1166] (Output): Sends the person in charge information in JSON format back to the terminal.

[1167] Step 5:

[1168] The terminal receives the returned JSON-formatted contact person information and displays it as a pop-up window on the user interface. Here, the contact person's department name, name, and contact information are displayed.

[1169] (Input): Contact person information in JSON format

[1170] (Data Processing): Parse JSON data and convert it into a format that can be displayed in the user interface.

[1171] (Output): Display contact person information as a pop-up window.

[1172] Step 6:

[1173] Users can review the contact person information displayed in the pop-up window and contact the person if necessary. This process improves the efficiency of inquiries.

[1174] (Input): Confirmation of the displayed contact person information

[1175] (Data processing): Select contact method based on contact person information.

[1176] (Output): Contact support staff

[1177] In this way, a system is realized that collects the necessary information at each step and provides users with contact person information quickly and accurately. This improves user support while using electronic payment services and streamlines inquiries.

[1178] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1179] As an embodiment of the present invention, a system is described that manages information on the person in charge of each web page and allows users to quickly obtain this information, as well as a system that recognizes the user's emotions and recommends appropriate responses. This system consists of a database, a user interface, a server-side program, a client-side script, and an emotion engine.

[1180] First, the server builds a specific database to store information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. This database is implemented using a relational database management system such as SQL. Furthermore, the data entered into the database is managed based on appropriate authentication.

[1181] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request retrieves the URL of the web page the user is currently viewing and requests the corresponding contact information from the server.

[1182] When a user clicks a button, the device automatically retrieves the URL of the current webpage and requests the server for the contact person information corresponding to that URL. This request is executed as a GET request based on the HTTP protocol, and the URL information is passed as a parameter.

[1183] The server processes the received request and searches the database for the corresponding contact person information. The contact person information obtained as a search result is returned to the client side (user's terminal) in a data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, the display method may be to generate a pop-up window and display the contact person's department name, name, and contact information.

[1184] Furthermore, an emotion engine is incorporated to analyze user emotions. When a user requests contact information, the emotion engine analyzes the user's tone of voice, facial expressions, etc., to recognize their current emotional state. Based on this information, the system provides the most appropriate response to the user.

[1185] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Ichiro Tanaka of the Marketing Department (tanaka@example.com)", and this information is pre-entered in the database. When a user clicks the "Request Person Information" button while browsing this page, the device retrieves the URL "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Ichiro Tanaka of the Marketing Department (tanaka@example.com)" from the database and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[1186] At this stage, the emotion engine recognizes the user's emotions. For example, if the user is exhibiting an unpleasant attitude or stress, the system takes this information into consideration and notifies the relevant personnel that a prompt and courteous response is required. It is also possible to display friendly messages to the user depending on their specific emotional state.

[1187] As described above, through the embodiments of the present invention, users can not only quickly and easily obtain information about the person in charge of a web page, but also receive suggestions and support that appropriately address their emotions at the time. This provides a system that improves the efficiency of inquiries and enhances user satisfaction.

[1188] The following describes the processing flow.

[1189] Step 1:

[1190] The server creates a database to store information about the person in charge of each web page. The database includes fields to store the web page's URL, the department responsible, the person in charge's name, and contact information.

[1191] Step 2:

[1192] When a user creates a new webpage or makes changes to an existing one, they enter the corresponding user information into the database. This saves both the webpage and the user information in the database.

[1193] Step 3:

[1194] If a user is browsing a specific webpage and wants to know the "contact person information" for that page, the user clicks the displayed "Contact Person Information" button.

[1195] Step 4:

[1196] The device captures a button click event and automatically retrieves the URL of the currently viewed webpage. It then generates an HTTP GET request to send the retrieved URL to the server.

[1197] Step 5:

[1198] The device sends an HTTP GET request to the server. The request includes the URL of the web page as a parameter.

[1199] Step 6:

[1200] The server parses the received request and searches the database based on the provided URL to retrieve the relevant personnel information. It uses SQL queries to select the necessary information from the database.

[1201] Step 7:

[1202] The server converts the acquired contact person information into JSON format and sends it to the terminal as an HTTP response. The JSON data includes the department, contact person's name, and contact information.

[1203] Step 8:

[1204] The terminal receives an HTTP response from the server and parses the JSON data. Based on the parsed data, it displays the person in charge's information on the user interface.

[1205] Step 9:

[1206] The emotion engine analyzes the user's tone of voice, facial expressions, or input content to recognize their current emotion. This is done, for example, using speech recognition or image analysis technologies.

[1207] Step 10:

[1208] Based on the user's emotions recognized by the emotion engine, the system determines the appropriate response. For example, if signs of anger or stress are detected, the system notifies the person in charge that a prompt and courteous response is required.

[1209] Step 11:

[1210] The device generates a pop-up window displaying the analyzed contact information (department name, name, and contact details). It may also display additional information or messages based on the user's sentiment.

[1211] Step 12:

[1212] Users can review the contact person information displayed in a pop-up window and contact them if necessary. The system can also provide additional support based on the user's emotions. For example, if a user is feeling dissatisfied, it may display an encouraging message.

[1213] (Example 2)

[1214] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1215] While systems exist that quickly provide information on who is in charge of a web page, they lack mechanisms for providing appropriate responses based on the user's emotions. As a result, responses when users experience unpleasant emotions may be insufficient, potentially leading to decreased user satisfaction. This invention aims to improve user satisfaction by enabling users to easily obtain information on who is in charge of a web page and by recommending responses that are appropriate to the user's emotional state.

[1216] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1217] In this invention, the server includes means for creating an information management device that stores information on the person in charge of each web page; means for requesting person in charge information for the web page being viewed by the user; means for retrieving the corresponding person in charge information from the information management device based on the identifier of the requested web page; means for returning the person in charge information obtained as a search result to the user; and means including an emotion analysis device that analyzes the user's emotions and recommends an appropriate response based on the results. As a result, the user can quickly obtain person in charge information for web pages and receive an appropriate response that is in line with the user's emotions.

[1218] An "information management device" is a database system used to store and manage information about the person in charge of each web page.

[1219] A "user" is an end-user who views a web page and requests contact information.

[1220] An "identifier" is a unique string of characters, such as a URL, used to identify a web page.

[1221] "Searching" refers to the act of querying data within an information management device based on an identifier and obtaining the corresponding personnel information.

[1222] An "emotion analysis device" is a system that analyzes the user's voice tone, facial expressions, and other data to recognize and estimate their current emotional state.

[1223] A "window" is a display area that visualizes the contact person information obtained as a search result for the user.

[1224] As an embodiment of the present invention, a system is described that manages the information of the person in charge of each web page and allows users to quickly obtain this information, as well as a system that recognizes the user's emotions and recommends appropriate responses. This system consists of an information management device, a user interface, a server-side program, a client-side script, and an emotion analysis device.

[1225] First, the server establishes a specific information management device that stores identifiers for each web page, responsible departments, contact persons, and contact information. This information management device is implemented using a relational database management system such as SQL. Furthermore, the data entered into the information management device is managed based on appropriate authentication.

[1226] Next, an interface is provided for the user to request contact information for the web page they are currently viewing. This is implemented, for example, as a "Contact Information" button on a part of the web page, and the request is triggered when the user clicks this button. This request obtains the identifier of the web page the user is currently viewing and requests the corresponding contact information from the server.

[1227] When a user clicks a button, the device automatically retrieves the identifier of the current web page and requests the server for the contact person information corresponding to this identifier. This request is executed as a GET request based on the HTTP protocol, and the identifier information is passed as a parameter.

[1228] The server processes the received request and retrieves the corresponding contact person information from the information management device. The contact person information obtained as a search result is returned to the client side (user's terminal) in data format such as JSON. Based on this, the terminal displays the contact person information on the user interface. For example, the display method may involve generating a pop-up window that displays the contact person's department name, name, and contact information.

[1229] Furthermore, the system incorporates an emotion analysis device to analyze the user's emotions. When a user requests information about a representative, the emotion analysis device analyzes the user's tone of voice, facial expressions, etc., to recognize their current emotional state. Based on this information, the system provides the most appropriate response to the user.

[1230] As a concrete example, let's assume there is a sample web page "https: / / example.com / page1". The person in charge of this page is "Marketing Department Representative (tanaka@example.com)", and this information is pre-entered in the information management device. When a user clicks the button to request "Representative Information" while browsing this page, the device obtains the identifier "https: / / example.com / page1" and sends a request to the server. The server retrieves the information "Marketing Department Representative (tanaka@example.com)" from the information management device and returns the result in JSON format. The device parses the received JSON data and displays this information to the user as a pop-up.

[1231] At this stage, the emotion analyzer recognizes the user's emotions. For example, if the user exhibits an unpleasant attitude or stress, the system takes this information into consideration and notifies the person in charge that a prompt and courteous response is required. It can also display friendly messages to the user depending on their specific emotional state.

[1232] In this way, through embodiments of the present invention, users can not only quickly and easily obtain information about the person in charge of a web page, but also receive suggestions and support that appropriately address their emotions at the time. This provides a system that improves the efficiency of inquiries and enhances user satisfaction.

[1233] Example of a prompt

[1234] A user visits the webpage "https: / / example.com / page1" and clicks the "Contact Person Information" button. The contact person for this page is "Marketing Department Staff," and this information is stored in the information management system. The system recommends an appropriate response based on the user's emotional state. Please describe the specific system operation and suggest how to make user support even more effective.

[1235] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1236] Program processing flow

[1237] Step 1: Building the Database

[1238] server

[1239] Input: Defines the database table structure based on configuration files or scripts.

[1240] Process: Use a relational database management system such as SQL to create tables to store the identifier (URL), department, contact person's name, and contact information for each web page.

[1241] Output: A database table is created.

[1242] Specific actions: For example, create a table called "Contact Person Information" with columns such as "url", "department", "contact_person", and "contact_info".

[1243] Step 2: Install the contact person information button.

[1244] terminal

[1245] Input: HTML code of a web page.

[1246] Process: Use JavaScript and CSS to place the "Contact Person Information" button on the web page.

[1247] Output: A button is displayed on the web page.

[1248] Specific action: For example, add the following code to your HTML.

[1249] html

[1250] <button id="contact-info-button"> Person in charge information< / button>

[1251] Step 3: Submit a request for contact person information.

[1252] User

[1253] Input: Click the "Contact Person Information" button on the web page.

[1254] Process: Use JavaScript to obtain the identifier (URL) of the current web page.

[1255] Output: The retrieved URL is sent to the server.

[1256] Specific operation: Capture the button click event, execute the following JavaScript code to obtain the URL, and send a request to the server.

[1257] JavaScript

[1258] document.getElementById('contact-info-button').addEventListener('click', function() {

[1259] const currentURL = window.location.href;

[1260] fetch(https: / / example-server.com / get-contact-info?url=${encodeURIComponent(currentURL)})

[1261] .then(response => response.json())

[1262] .then(data => displayContactInfo(data));

[1263] });

[1264] Step 4: Receive the request and query the database.

[1265] server

[1266] Input: HTTP GET request and its URL parameters.

[1267] Processing: Based on the received URL, the information management device (database) is searched, and the corresponding personnel information is retrieved.

[1268] Output: The responsible person information is returned to the client (user's terminal) in JSON format.

[1269] Specific operation: For example, construct an SQL statement using the received URL as a query parameter.

[1270] python

[1271] @app.route(' / get-contact-info', methods=['GET'])

[1272] def get_contact_info():

[1273] url = request.args.get('url')

[1274] db_data = query_database(url) Execute the query and retrieve the data.

[1275] return jsonify(db_data)

[1276] Step 5: Displaying the person in charge information

[1277] terminal

[1278] Input: JSON data of contact person information received from the server.

[1279] Processing: The received JSON data is parsed, and the person in charge's information is displayed on the user interface.

[1280] Output: A pop-up window will appear displaying the department name, name, and contact information of the person in charge.

[1281] Specific actions: For example, execute the following JavaScript code to generate a popup and display information.

[1282] JavaScript

[1283] function displayContactInfo(data) {

[1284] const popup = window.open('', 'Contact Person Information', 'width=400,height=300');

[1285] popup.document.write( Department: ${data.department} );

[1286] popup.document.write( Contact person: ${data.contact_person} );

[1287] popup.document.write( Contact: ${data.contact_info} );

[1288] }

[1289] Step 6: Analyzing User Sentiment

[1290] terminal

[1291] Input: Real-time data such as the user's voice tone and facial expressions.

[1292] Processing: Data from the camera and microphone is acquired using WebRTC, etc., and transmitted to an emotion analysis device.

[1293] Output: Data regarding the user's emotional state is obtained.

[1294] Specific actions: For example, execute the following JavaScript code to obtain microphone and camera data.

[1295] JavaScript

[1296] navigator.mediaDevices.getUserMedia({ video: true, audio: true})

[1297] .then(stream => {

[1298] / / Uses microphone and camera stream data

[1299] });

[1300] Step 7: Recommendation of appropriate action

[1301] server

[1302] Input: Emotional data transmitted from the emotion analysis device.

[1303] Processing: Analyze the user's emotional state based on emotional data and recommend appropriate actions.

[1304] Output: Notifications and messages regarding the response policy are generated.

[1305] Specific actions: For example, if a user is showing signs of displeasure, a notification will be sent to the person in charge requesting prompt action.

[1306] JavaScript

[1307] if (detectedEmotion === 'angry') {

[1308] alert('The user is showing signs of distress. Please respond promptly.');

[1309] }

[1310] In this way, the entire system goes through a series of processing steps, allowing the user to quickly obtain contact information and receive appropriate responses tailored to their emotions at the time.

[1311] (Application Example 2)

[1312] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1313] Current web page browsing systems have problems with quickly obtaining information about the person in charge and providing appropriate responses that take into account the user's emotional state. In particular, in autonomous vehicles, prompt and courteous responses are required when passengers feel stressed or anxious, and conventional systems are insufficient to handle this.

[1314] The identification processing performed by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for creating a database that stores information on the person in charge of each web page, means for requesting person in charge information for the web page being viewed by the user, means for searching the database for the corresponding person in charge information based on the URL of the requested web page, and means for determining a response based on the user's emotions using an emotion recognition engine that analyzes the user's emotional state. This makes it possible not only to quickly obtain the person in charge information for the web page being viewed by the user, but also to provide an appropriate response according to the user's emotional state.

[1315] A "web page" is a document or information resource that can be accessed via the internet.

[1316] A "responsible department" is a department that is responsible for a specific task or project.

[1317] "Contact person information" refers to information about the person responsible for a specific task or project, as well as contact details.

[1318] A "database" is a system that organizes and stores data, and allows it to be searched and updated as needed.

[1319] "URL" stands for Uniform Resource Locator, and it is an address that indicates the location of a specific resource on the internet.

[1320] An "emotion recognition engine" is an algorithm or system that analyzes a user's facial expressions, tone of voice, etc., to recognize their emotional state.

[1321] A "pop-up" is a small window that suddenly appears on a user interface, used to display specific information.

[1322] An "autonomous vehicle" is a vehicle that uses artificial intelligence and sensor technology to drive autonomously without a human driver.

[1323] As an embodiment of the present invention, we will describe a system that manages information on the person in charge of a web page and allows users to quickly obtain that information, as well as a system that recognizes the user's emotions and recommends appropriate responses.

[1324] This system consists of a database, user interface, server-side programs, client-side scripts, and an emotion recognition engine. Specifically, the database stores information such as the URL of each web page, the department responsible, the name of the person in charge, and contact information. The database is implemented using a relational database management system such as PostgreSQL.

[1325] The server receives HTTP requests to retrieve contact information for specific web pages from a database and returns the results to the client in JSON format. It also automatically retrieves the URL of the currently viewed web page based on the user's request and searches for the contact information corresponding to that URL. Furthermore, it includes a mechanism for displaying the retrieved contact information as a pop-up.

[1326] In the system of the present invention, when a user clicks a button requesting "person in charge information" while browsing a specific web page, the URL is automatically retrieved, and an SQL query is executed against the database based on that information. The resulting person in charge information is displayed in a pop-up format on the user interface, allowing the user to easily check the person in charge information.

[1327] Next, the user's emotional state is analyzed using an emotion recognition engine. This engine utilizes models built with deep learning frameworks such as TensorFlow and PyTorch, recognizing the user's emotions by analyzing their voice and image data. Based on this analysis, the server can provide appropriate responses according to the user's emotional state.

[1328] As a concrete example, let's explain the system's operation inside an autonomous vehicle. Suppose a passenger requests customer support while browsing a specific webpage inside the autonomous vehicle. The system obtains the URL of that page and retrieves the contact person's information from the database. At the same time, it inputs the passenger's voice and facial expression data into an emotion recognition engine, and if the analysis results in an emotion such as "stress," it recommends a prompt and courteous response.

[1329] Examples of prompt statements include the following:

[1330] "Please retrieve the contact person information corresponding to the URL 'https: / / example.com / page1'. Analyze the user's emotions based on their facial expression data and recommend an appropriate response. The user's facial expression data indicates 'stress'."

[1331] In this way, the system of the present invention can not only quickly obtain information about the person in charge of the web page viewed by the user, but also provide appropriate responses according to the user's emotional state.

[1332] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1333] Step 1:

[1334] The user clicks a button to request contact person information.

[1335] Input: User click action

[1336] Specific action: Click the "Request contact information" button on the webpage.

[1337] Output: URL of the webpage currently being viewed

[1338] Step 2:

[1339] The device automatically retrieves the URL of the web page it is currently viewing and sends the URL to the server.

[1340] Input: URL of the webpage you are currently viewing

[1341] Specific operation: Parses the DOM to obtain the URL and sends an HTTP GET request to the server.

[1342] Output: HTTP request (including URL information)

[1343] Step 3:

[1344] The server searches the database for the corresponding contact person information based on the URL.

[1345] Input: URL information

[1346] Specific operation: Send an SQL query to the database to retrieve information about the person in charge.

[1347] Output: Person in charge information (department name, name, contact information)

[1348] Step 4:

[1349] The server returns the contact person information obtained as a search result to the client in JSON format.

[1350] Input: Person in charge information

[1351] Specific operation: Convert the person in charge information into JSON format and send it to the client as an HTTP response.

[1352] Output: Person in charge information in JSON format

[1353] Step 5:

[1354] The terminal displays the contact person information it received as a pop-up.

[1355] Input: Contact person information in JSON format

[1356] Specific operation: Parse JSON data, generate a popup window, and display the person in charge's information.

[1357] Output: Person in charge information displayed in the pop-up window

[1358] Step 6:

[1359] The device sends the user's voice and facial expression data to an emotion recognition engine, which then analyzes their emotions.

[1360] Input: User voice and facial expression data

[1361] Specific operation: Data collected by the camera and microphone is sent to the emotion recognition engine.

[1362] Output: User's emotional state

[1363] Step 7:

[1364] The emotion recognition engine analyzes the user's emotional state and returns the analysis results to the server.

[1365] Input: User voice and facial expression data

[1366] Specific operation: Analyze emotions using a deep learning model.

[1367] Output: Emotion analysis results (stress, anger, joy, etc.)

[1368] Step 8:

[1369] The server provides responses tailored to the user's emotional state based on the emotion analysis results.

[1370] Input: Sentiment analysis results

[1371] Specific actions: Determine and present messages and responses to the user based on their emotional state.

[1372] Output: Appropriate response (e.g., "A prompt and courteous response is required.")

[1373] Through the steps described above, the system of the present invention can not only quickly obtain information about the person in charge of the web page viewed by the user, but also provide appropriate responses according to the user's emotional state.

[1374] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1375] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1376] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1377] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1378] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1379] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1380] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1381] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1382] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1383] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1384] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1385] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1386] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1387] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1388] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1389] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1390] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1391] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1392] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1393] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1394] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[1395] The following is further disclosed regarding the embodiments described above.

[1396] (Claim 1)

[1397] A means of creating a database that stores information on the person in charge of each web page,

[1398] A means for a user to request contact person information for the web page they are viewing,

[1399] A means of retrieving the corresponding contact person information from a database based on the URL of the requested web page,

[1400] A means of returning the contact person information obtained as a search result to the user,

[1401] A system that includes this.

[1402] (Claim 2)

[1403] The system according to claim 1, further comprising means for automatically obtaining the URL of the currently viewed web page based on a user's request.

[1404] (Claim 3)

[1405] The system according to claim 1, further comprising means for generating a pop-up for displaying the person in charge information obtained as a search result.

[1406] "Example 1"

[1407] (Claim 1)

[1408] A means of creating a database that stores information on the person in charge of each web page,

[1409] A means for a user to request contact person information for the web page they are viewing,

[1410] A means of retrieving the corresponding contact person information from a database based on the URL of the requested web page,

[1411] A means of returning the contact person information obtained as a search result to the user,

[1412] A means of managing data entered into a database based on appropriate authentication,

[1413] A means for automatically obtaining the URL of the currently viewed web page based on the user's request and sending a GET request containing the obtained URL to the server,

[1414] A means of parsing the JSON data returned from the server and displaying the person in charge information,

[1415] A system that includes this.

[1416] (Claim 2)

[1417] The system according to claim 1, further comprising a means for displaying a "Contact Person Information" button on the currently viewed web page, and for the user to request contact person information by clicking the button.

[1418] (Claim 3)

[1419] The system according to claim 1, further comprising means for displaying the department name, name, and contact information of a person in charge to the user using a pop-up for displaying the person in charge information obtained as a search result.

[1420] "Application Example 1"

[1421] (Claim 1)

[1422] A means of creating a database that stores information on the person in charge of each web page,

[1423] A means for a user to request contact person information for the web page they are viewing,

[1424] A means of retrieving the corresponding contact person information from a database based on the URL of the requested web page,

[1425] A means of returning the contact person information obtained as a search result to the user,

[1426] A means of quickly obtaining information about the support person for a specific webpage while using an electronic payment service,

[1427] A means of displaying the acquired personnel information as a pop-up on the smartphone user interface,

[1428] A system that includes this.

[1429] (Claim 2)

[1430] The system according to claim 1, further comprising means for automatically obtaining the URL of the currently viewed web page based on a user's request.

[1431] (Claim 3)

[1432] The system according to claim 1, further comprising means for generating a pop-up for displaying the person in charge information obtained as a search result.

[1433] "Example 2 of combining an emotion engine"

[1434] (Claim 1)

[1435] A means for creating an information management device that stores information on the person in charge of each web page,

[1436] A means for a user to request contact person information for the web page they are viewing,

[1437] A means for retrieving the corresponding person in charge information from the information management device based on the identifier of the requested web page,

[1438] A means of returning the contact person information obtained as a search result to the user,

[1439] A means including an emotion analysis device that analyzes the user's emotions and recommends appropriate actions based on the results,

[1440] A system that includes this.

[1441] (Claim 2)

[1442] The system according to claim 1, further comprising means for automatically obtaining the identifier of the currently viewed web page based on a user request.

[1443] (Claim 3)

[1444] The system according to claim 1, further comprising means for generating a window for displaying the person in charge information obtained as a search result.

[1445] "Application example 2 when combining with an emotional engine"

[1446] (Claim 1)

[1447] A means of creating a database that stores information on the person in charge of each web page,

[1448] A means for a user to request contact person information for the web page they are viewing,

[1449] A means of retrieving the corresponding contact person information from a database based on the URL of the requested web page,

[1450] A means of returning the contact person information obtained as a search result to the user,

[1451] A means for determining a response based on the user's emotions, using an emotion recognition engine that analyzes the user's emotional state,

[1452] A system that includes this.

[1453] (Claim 2)

[1454] The system according to claim 1, further comprising means for automatically obtaining the URL of the currently viewed web page based on a user's request.

[1455] (Claim 3)

[1456] The system according to claim 1, further comprising means for generating a pop-up for displaying the person in charge information obtained as a search result. [Explanation of Symbols]

[1457] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of creating a database that stores information on the person in charge of each web page, A means for a user to request contact person information for the web page they are viewing, A means of retrieving the corresponding contact person information from a database based on the URL of the requested web page, A means of returning the contact person information obtained as a search result to the user, A system that includes this.

2. The system according to claim 1, further comprising means for automatically obtaining the URL of the currently viewed web page based on a user's request.

3. The system according to claim 1, further comprising means for generating a pop-up for displaying the person in charge information obtained as a search result.

Images