system

Abstract

We provide the system. [Solution] A means for automatically detecting updates to construction instructions and analyzing the updated information, A means of registering the analyzed information in a database and performing normalization, A means of searching a database based on a query entered by the user and ranking the relevant information, Methods for formatting search results to present them to users, A system that includes this.

Description

Technical Field

[0004] , , , ,

[0005] , , , , ,

[0003] , ,

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Since the construction instruction manual is updated irregularly, there is a problem that it takes a great deal of time and labor for the relevant parties to identify the latest construction method. Furthermore, there is also a risk that construction is carried out based on an incorrect method among a vast amount of information. In such a situation, it is necessary to improve the efficiency and reliability of information collection and analysis.

Means for Solving the Problems

[0005] To address the above challenges, the present invention provides a database system that automatically detects updates to construction instructions and analyzes and registers the latest information. Furthermore, it enables efficient retrieval of relevant information by searching the database based on queries entered by the user. This system reduces the risk of referring to misinformation by normalizing the analyzed information and eliminating duplicates. It also features a user interface for presenting search results to the user, enabling the presentation of information according to its importance.

[0006] A "construction instruction manual" is a document that details the necessary work procedures and precautions for construction and building projects.

[0007] "Analysis" refers to the process of breaking down information into its constituent elements and evaluating them in order to examine and understand them in detail.

[0008] A "database" is a collection of information organized in a way that allows for the efficient management and retrieval of large amounts of data.

[0009] A "query" refers to an instruction or command used to request a search or ask a question to a database.

[0010] "Normalization" is a method of structuring data to eliminate duplication and inconsistencies in information within a database and maintain consistency.

[0011] A "user interface" refers to an interactive screen or input device that allows a user to interact with and operate a system.

[0012] "Importance" is a measure that evaluates the relative value of information, indicating how valuable it is to the user. [Brief explanation of the drawing]

[0013] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2]It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying Out the Invention

[0014] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc.

[0017] In the following embodiments, the labeled RAM (Random Access Memory) is a memory where information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0019] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), etc.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] This invention provides a system that efficiently manages the updating of construction instructions and allows for the rapid retrieval of necessary information. The following describes specific embodiments for carrying out this invention.

[0035] This system includes a database, server, and terminals as its core components. First, the server has the function of automatically monitoring updates to construction instructions. When an update is made to a construction instruction, the server downloads the content and analyzes it using natural language processing technology. This analysis procedure divides the document into sections and extracts keywords and related metadata.

[0036] Next, the server registers the analysis results in the database. Here, data duplication is eliminated and the information is normalized. This creates a structure that minimizes the reference of misinformation and inconsistencies. After that, the data is indexed to improve search efficiency.

[0037] On the other hand, users access this system through a terminal. Users can enter queries to obtain the necessary information. The terminal sends this query to the server, and the server searches the database based on the received query. The server extracts relevant information and uses an algorithm to rank it based on importance.

[0038] Finally, the search results from the server are returned to the terminal. The terminal formats the results in a user-friendly format and presents them through the user interface. For example, if a user enters "latest antenna installation procedure" as a query, the terminal can display highly relevant information. This process allows the user to access accurate information with minimal effort.

[0039] In this way, the system of the present invention improves the efficiency of managing construction instructions and retrieving information.

[0040] The following describes the processing flow.

[0041] Step 1:

[0042] The server periodically checks for updates to the construction instructions. When there are new updates, the server downloads the files.

[0043] Step 2:

[0044] The server passes the downloaded construction instructions to a natural language processing engine for analysis. The analysis divides the document into sections and extracts keywords and related information.

[0045] Step 3:

[0046] The server registers the analyzed information in the database. During registration, duplicate information is removed and normalization is performed to maintain data integrity.

[0047] Step 4:

[0048] The user enters queries through the terminal's interface and instructs the system to search for the necessary information.

[0049] Step 5:

[0050] The terminal sends a query from the user to the server. The server receives the query and searches the database.

[0051] Step 6:

[0052] The server finds information related to the query and ranks the information based on its relevance. The server then formats the search results and sends them to the terminal.

[0053] Step 7:

[0054] The terminal displays search results received from the server in the user interface. The information is presented in order of importance, allowing the user to quickly find the information they are looking for.

[0055] Step 8:

[0056] Users can refer to the displayed information and, if necessary, view more detailed information to confirm the construction method.

[0057] (Example 1)

[0058] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0059] The high frequency of updates to construction instructions and the complexity of manual management make it difficult to ensure information consistency. Furthermore, while there is a need to quickly search for and accurately grasp information, traditional methods make it difficult to efficiently acquire relevant information. Therefore, there is a need for a system that automatically manages updates to construction instructions and provides necessary information quickly and accurately.

[0060] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0061] In this invention, the server includes means for automatically detecting update information and analyzing documents using natural language processing technology, means for registering the analyzed data in a database and performing data normalization and deduplication, and means for searching the database based on user input queries, evaluating relevance, and ranking the information. This enables efficient management of updates to construction instructions and allows users to quickly retrieve the information they need.

[0062] "Update information" refers to the latest data that has been changed or corrected in documents such as construction instructions.

[0063] "Natural language processing technology" refers to technologies that enable machines to understand, interpret, and generate human language.

[0064] "Document analysis" is the process of analyzing text data based on specific rules and algorithms to extract and organize information.

[0065] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[0066] "Normalization" is the process of converting information into a standardized format in order to maintain data consistency and integrity.

[0067] "Deduplication" is the process of removing redundant or duplicate information from a dataset to improve its efficiency.

[0068] A "query" is a request used to retrieve specific information from a database.

[0069] "Relevance" is a measure that indicates how important or relevant specific information is to a search query.

[0070] "Ranking" refers to organizing information or data in order of priority based on specific criteria.

[0071] This invention provides a system for the efficient management and retrieval of construction instructions. This system is primarily composed of a database, a server, and terminals.

[0072] The server functions as the core of this system, constantly monitoring updates to construction instructions. Specifically, the server checks the data source at regular intervals and immediately downloads any new updates. This process uses SpaCy, an open-source natural language processing library, and the downloaded data is analyzed using this library. During the analysis, the document is divided into sections, and keywords and metadata are extracted. When these analysis results are registered in the MySQL® database, the data undergoes deduplication and normalization. This operation ensures data integrity and consistency.

[0073] Users access this system through a terminal. They enter queries through the terminal's interface to search for the information they need. For example, a user might enter the query "latest antenna installation procedure." The terminal sends this query to the server, which searches the database. This search uses SQL queries and the TF-IDF algorithm to further clarify the relevant information. The server ranks the search results based on importance and returns the results to the terminal.

[0074] The device formats the search results obtained in a way that is easy for the user to understand visually and displays them through the user interface. HTML and CSS are used for the display, providing a highly visible layout that allows the user to intuitively obtain information.

[0075] In this way, the system of the present invention improves the efficiency of managing construction instructions and retrieving information. An example of a specific prompt message is, "Search for the latest information on construction instructions and check if it includes the specific installation procedure." By using this prompt, the user can easily obtain the desired information.

[0076] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0077] Step 1:

[0078] The server monitors updates to construction instructions. It checks the data source at regular intervals and downloads the information when a new update is detected. The input is data update notifications on the network, and the output is the updated construction instruction data file. Specific operational methods include using APIs and webhooks.

[0079] Step 2:

[0080] The server analyzes the downloaded construction instruction data using natural language processing technology. The input is the updated construction instruction data file, and the output is text divided into sections, along with extracted keywords and metadata. Specifically, the document is tokenized using an open-source library, and information is extracted.

[0081] Step 3:

[0082] The server registers the analyzed information in a database and performs normalization and deduplication. The input is the analysis result, and the output is a consistent database entry. Specifically, SQL is used to write data to the database, ensuring that no abnormal or duplicate information is included.

[0083] Step 4:

[0084] Users access this system through their terminals and enter queries to retrieve information. The input is a query string entered by the user, and the output is a query request sent to the server. This can be done using web browser forms or dedicated applications.

[0085] Step 5:

[0086] The server searches the database based on the received query, evaluates its relevance, and ranks the results. The input is the query content from the terminal, and the output is a ranked list of search results. Specifically, the TF-IDF algorithm is used to organize the relevant information in order of priority.

[0087] Step 6:

[0088] The terminal receives search results from the server and formats them in a user-friendly format. The input is the search result data from the server, and the output is visually organized information displayed in the user interface. Specifically, HTML and CSS are used to convert the results into a display format.

[0089] Step 7:

[0090] Users view results on their devices and perform further actions or searches as needed. Input is the results displayed on the device, and output is the user's new query or confirmation of information. Specifically, interactions such as clicking links or re-filling forms occur.

[0091] (Application Example 1)

[0092] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0093] In construction sites where work instructions and inventory information are frequently updated, manual verification and updating of information is time-consuming and labor-intensive, leading to the occurrence of misinformation and reduced search efficiency. Furthermore, the insufficient immediate sharing and presentation of information via smart devices made rapid and accurate information management and retrieval difficult.

[0094] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0095] In this invention, the server includes means for automatically detecting and analyzing updates to construction instructions and inventory information, means for registering and normalizing the analyzed information in a database, and means for performing searches and presentations based on queries entered by the user via a smart device. This enables rapid information updates, accurate data management, and immediate access via smart devices.

[0096] A "construction instruction sheet" is a document that outlines the specific work procedures and details involved in construction or engineering work.

[0097] "Inventory information" refers to data such as the quantity and location of goods and materials in logistics centers and warehouses.

[0098] "Automatic detection" refers to a function that allows the system to identify updated or changed information without human intervention.

[0099] "Analysis" refers to the process of dividing collected information into meaningful units and processing it into an understandable form.

[0100] A "database" is a collection of digital information that is systematically organized and stored in an easily accessible format.

[0101] "Normalization" is the process of organizing information within a database into a unified format, eliminating duplication and inconsistencies to maintain consistency.

[0102] A "query" is a statement of inquiry that a user enters to search for information within a database.

[0103] A "smart device" is a general term for portable devices equipped with communication and computer functions.

[0104] "Instant access" refers to a state where users can instantly access the information they need.

[0105] The system implementing this invention is designed to enable efficient management and retrieval of construction instructions and inventory information. The server automatically detects updates to construction instructions and inventory information and performs analysis using natural language processing technology. The analyzed information is registered in a database and normalized to eliminate duplicates and misinformation.

[0106] In this system, users can use smart devices to enter queries and search for information in the database. The server indexes relevant information based on the user's query and extracts the necessary information in an order of importance according to a ranking algorithm. This information is visually organized and presented to the user through the terminal's user interface.

[0107] The program uses the Python programming language and Flask to implement web server functionality. It also utilizes the spaCy library for natural language processing and ElasticSearch® for database search capabilities. The hardware used will include internet-connected smartphones, tablets, and personal computers.

[0108] A concrete example is in inventory management at a logistics center, where a staff member searching for "the latest location information for new product A" can quickly check the updated inventory information as soon as it becomes available. In this case, the information can be retrieved instantly using a prompt such as "location of new product A".

[0109] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0110] Step 1:

[0111] The server automatically detects updates to construction instructions and inventory information. When an update is detected, the information is entered into the server, and natural language processing is used to divide the document into sections and extract keywords. As a result of this process, structured data of the document is output.

[0112] Step 2:

[0113] The server registers the structured data obtained in step 1 into the database and performs normalization. This process removes duplicate information and converts the data into a consistent format. As a result of this process, unified data is stored in the database.

[0114] Step 3:

[0115] The user enters a query via a terminal, which is then sent to the server. The query is a search requirement provided by the user, and the server parses this query to retrieve relevant data. Based on the entered query, the server identifies matching information in the database and returns a list of it.

[0116] Step 4:

[0117] The server applies a ranking algorithm to the information obtained in step 3. The information is ranked based on its importance and relevance, and the results are output as a formatted list.

[0118] Step 5:

[0119] The terminal presents the user with formatted search results received from the server through a visual interface. At this stage, the user can immediately obtain the necessary information and use it in their work. This interface displays information in an easy-to-read format, enabling efficient information verification.

[0120] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0121] This invention is a system that combines a construction instruction update management system with an emotion engine that recognizes the user's emotions and presents search results based on those emotions. Specific embodiments of this invention are described below.

[0122] This system includes a server, terminals, and an emotion engine as its main components. First, the server automatically detects updates to construction instructions and analyzes the updated information using natural language processing technology. The analyzed information is registered in a database, where it is normalized to eliminate duplication and inconsistencies.

[0123] When a user enters a query using their device, the device sends this information to the server. The server searches the database, extracts relevant information, and ranks it. The sentiment engine plays a crucial role in this ranking process.

[0124] The emotion engine recognizes the user's current emotional state based on user input, operation history, and, in some cases, data obtained from biometric sensors. For example, if the engine detects that the user is stressed, it adjusts the display of search results to be more concise and intuitive. In this way, it provides a user experience that is adapted to the user's emotions.

[0125] Search results from the server are sent to the terminal in a format optimized by the emotion engine. The results are then displayed on the user interface via the terminal. Through this emotion-adjusted information display, users can access the necessary information more appropriately and efficiently.

[0126] Thus, the present invention combines an emotion engine with the update management and information suggestion of construction instructions, thereby realizing flexible information provision that takes into account the user's emotional state.

[0127] The following describes the processing flow.

[0128] Step 1:

[0129] The server periodically scans for updates to construction instructions and downloads new files as soon as they are found.

[0130] Step 2:

[0131] The server analyzes the downloaded construction instructions using a natural language processing engine, divides the information into sections, and extracts key keywords and related data.

[0132] Step 3:

[0133] The server registers the extracted information in the database. During this process, the information is normalized and duplicated, and indexing is performed while maintaining consistency.

[0134] Step 4:

[0135] Users enter queries about topics of interest or questions through the terminal's interface.

[0136] Step 5:

[0137] The terminal sends the user's query to the server. The server parses the query and searches for the relevant entries in the database.

[0138] Step 6:

[0139] The server temporarily stores the search results and passes the user's operation history and input information to the sentiment engine for sentiment analysis.

[0140] Step 7:

[0141] The emotion engine analyzes the user's emotional state and uses the results to optimize the ranking and display format of search results.

[0142] Step 8:

[0143] The server formats the search results, which have been adjusted by the sentiment engine, and sends them to the terminal in a viewable format.

[0144] Step 9:

[0145] The device will display search results in an emotionally conscious layout, making it easy for users to access and understand the information.

[0146] Step 10:

[0147] Users can refer to the displayed results and efficiently obtain the information they need.

[0148] (Example 2)

[0149] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0150] To provide the latest information on construction site instructions quickly and accurately, it is necessary to instantly detect updates and present information appropriately according to the user's emotional state. However, conventional systems had problems such as low efficiency in detecting information updates and failure to present information considering the user's state, resulting in a lot of time and effort being required to obtain the necessary information. In addition, redundant data in the data storage device hindered information retrieval.

[0151] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0152] In this invention, the server includes means for automatically detecting updates to construction instructions and analyzing the updated information, means for registering the analyzed information in a data storage device and performing normalization, and means for recognizing the client's state and optimizing the presentation of search results. This enables users to quickly and accurately obtain the latest information in an optimal form tailored to their emotions.

[0153] A "construction instruction sheet" is a document used at construction sites and other work sites that contains instructions, procedures, and precautions for the work to be done.

[0154] "Automatically detecting updates" refers to the process by which a system detects new information or changes without human intervention.

[0155] "Analysis" is the process of breaking down specific data or information into smaller parts and understanding their meaning and structure.

[0156] A "data storage device" is a system or equipment that permanently stores information so that it can be retrieved later.

[0157] "Normalization" is a process to eliminate duplication and inconsistencies in information and maintain data consistency and integrity.

[0158] A "client" refers to a user or device that accesses a system and requests information.

[0159] "Questions" refer to specific requests or inquiries regarding the information entered by the client.

[0160] "Exploration" refers to the process or activity of finding necessary information from accumulated data.

[0161] "Priorization" is the process of determining priorities based on the relevance and importance of the information that has been explored.

[0162] "Presentation" refers to the act of making information visible and displaying it in a way that is easy for users to understand.

[0163] "Emotional analysis" is a technology that evaluates a client's emotional state and adjusts the information and services provided by the system according to that state.

[0164] This invention relates to a system for updating and managing construction instructions that presents information while taking user emotions into consideration. This system includes a server, a terminal, and an emotion engine as its main components.

[0165] The server is equipped with hardware and software to automatically detect updates to construction instructions. Specifically, it checks for updates using techniques such as timestamp comparison and file hash values. Furthermore, if an update is detected, it analyzes the information using natural language processing techniques (e.g., Python's NLTK library). Our data storage device is normalized to eliminate duplicate and inconsistent information.

[0166] The terminal has a user interface for the user to enter queries. The query entered by the user, such as a prompt message like "Please provide the latest safety instructions," is processed by the terminal and sent to the server.

[0167] Based on the received query, the server uses the Elasticsearch engine to search the data storage. This search process extracts and prioritizes the most relevant information.

[0168] The emotion engine analyzes the user's operation history and, in some cases, data from biometric sensors to identify the user's emotional state. For example, if the user is feeling stressed, the emotion engine adjusts the search results to be concise and visually easy to understand.

[0169] Ultimately, the device displays these optimized search results in the user interface. This allows users to receive information tailored to their emotions and access the necessary data quickly and efficiently.

[0170] The aim of implementing this system is to streamline the management of construction site instructions and significantly improve the user's information retrieval experience.

[0171] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0172] Step 1:

[0173] The server periodically scans the data storage where construction instructions are stored and automatically detects updates. The input is the current instruction content and file metadata, and the output is a list of newly updated information. This includes operations such as timestamp comparison and file hash value calculation to identify which parts have been changed.

[0174] Step 2:

[0175] The server analyzes the detected update information using natural language processing techniques. The input is a list of updates, and the output is an extraction and classification of the components of the specific instruction content. The techniques used include, for example, Python's NLTK for text analysis. This clarifies how the content of the instruction has changed semantically.

[0176] Step 3:

[0177] The server registers the analyzed information in a data storage device and performs normalization processing. The input is the analyzed instructions, and the output is the normalized data stored in the database. Regular expressions and database scrutiny are performed to eliminate duplication and inconsistencies and maintain data integrity.

[0178] Step 4:

[0179] The user enters specific queries using a terminal. These inputs are questions or requests from the user, such as prompts like "Please provide the latest security instructions." The terminal sends this information to the server as a string.

[0180] Step 5:

[0181] The server searches the database based on the received query and ranks the relevant information. The input is the user's query, and the output is a list of information ranked in order of relevance. A search engine such as Elasticsearch is used to quickly extract relevant information.

[0182] Step 6:

[0183] The emotion engine recognizes the user's emotional state by analyzing user input, operation history, and biometric information acquired in some cases. The input is user operation data, and the output is the identified emotional state. An AI model, such as TENSORFLOW®, is used to estimate the emotional state, and the system's response is adjusted accordingly.

[0184] Step 7:

[0185] The server utilizes the analysis results from the emotion engine to adapt search results to the client's state. Inputs are the emotional state and search results, and output is a refined list of information. This includes formatting to simplify the information presented and make it visually easier to understand.

[0186] Step 8:

[0187] The terminal displays optimized search results sent from the server in its user interface. The input is an optimized information list, and the output is an organized information screen that the user can visually review. This enables the user to instantly access the necessary information in a way that is optimal to their emotions.

[0188] (Application Example 2)

[0189] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0190] Conventional information retrieval systems present information without considering the user's emotional state, which can result in inappropriate information being displayed to users experiencing stress. Furthermore, the system fails to provide effective information suggestions tailored to the user's emotions during the retrieval process, resulting in an inability to deliver an optimal user experience. This has led to challenges for users in quickly and efficiently accessing the information they need.

[0191] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0192] In this invention, the server includes means for automatically detecting updates to construction instructions and analyzing the updated information; means for registering the analyzed information in a database and normalizing it; means for searching the database based on queries entered by the user and ranking relevant information; means for analyzing the user's emotional state using an emotion recognition function and adjusting the ranking of search results based on the results; and means for formatting the search results to adjust and present them according to the user's emotions. This enables flexible information provision that adapts to the user's emotions, allowing the user to efficiently access the necessary information.

[0193] A "construction instruction sheet" is a document that specifies in detail the work content, procedures, and methods for construction or execution.

[0194] "Emotion recognition function" is a technology that analyzes the user's current emotional state based on input information and biometric data.

[0195] A "database" is an information aggregation system that structures and stores information, making it easy to search and use.

[0196] "Normalization" is the process of maintaining the integrity of information by removing duplicates from data within a database and standardizing its format.

[0197] "User experience" is a concept that refers to the feelings, satisfaction, and overall experience that users have when using a product or service.

[0198] "Ranking search results" is the process of sorting information found based on a user's query according to its relevance and importance.

[0199] "Optimizing information display" is the process of adjusting search results so that they are presented effectively according to the user's emotional state and needs.

[0200] To implement this application, a server, an emotion engine, a database, and a terminal equipped with a user interface are required. The server automatically detects updates to construction instructions and analyzes them using natural language processing technology. The analyzed information is registered in the database and normalized to eliminate data duplication and inconsistencies.

[0201] When a user enters a query via a terminal, the terminal sends it to the server. The server searches the database and ranks the relevant information using an emotion engine. The emotion engine analyzes the user's emotional state using the user's input information, operation history, and, if possible, data from biometric sensors. Based on this information, the search results are formatted to reflect the user's emotions.

[0202] For example, when a user searches in a virtual store, the emotion engine recognizes the user's emotions and, if they are stressed, makes the search results concise and easy to understand. On the other hand, if they are relaxed, it can present a variety of product options, offering a wider range of choices.

[0203] An example of a prompt message might be: "Please select a product that will be displayed when the user is feeling stressed. Please prioritize simple and easy-to-understand options such as 'relaxing chair' or 'ergonomic chair'."

[0204] In this way, the server can provide optimal information tailored to the user's emotional state and efficiently present search results that meet the user's needs through the user interface.

[0205] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0206] Step 1:

[0207] The server automatically detects updates to construction instructions and analyzes them using natural language processing technology. The input is the newly updated construction instructions, and the output is the analyzed information. This analysis converts the contents of the construction instructions into a structured data format. Furthermore, the data is normalized to mitigate potential inconsistencies and redundancies.

[0208] Step 2:

[0209] The user enters a query via a terminal. The input is a text query containing the information the user wants to search for, and the output is the search request sent to the server. The terminal sends this query information to the server, where it is formatted into the necessary data format for rapid processing.

[0210] Step 3:

[0211] The server searches the database based on the received query and extracts relevant information. The input is the user's query and database information, and the output is the extracted relevant information. The server uses an efficient search algorithm to identify highly relevant data and create a list of available information.

[0212] Step 4:

[0213] The server uses emotion recognition to analyze the user's emotional state and ranks search results based on the results. Inputs include user input information, operation history, and biometric information (if available), and output is a ranking result optimized for emotion. The server analyzes the user's emotions and makes adjustments, such as simplifying the display if the user is stressed and broadening the range of information if the user is relaxed.

[0214] Step 5:

[0215] The server optimizes search results based on sentiment before sending them to the user's device. The input is the sentiment-based ranked search results, and the output is the information displayed on the user's device. The user interface presents information in a user-friendly way, enabling flexible information delivery tailored to user needs.

[0216] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0217] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0218] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0219] [Second Embodiment]

[0220] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0221] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0222] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0223] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0224] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0225] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0226] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0227] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0228] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0229] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0230] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0231] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0232] This invention provides a system that efficiently manages the updating of construction instructions and allows for the rapid retrieval of necessary information. The following describes specific embodiments for carrying out this invention.

[0233] This system includes a database, server, and terminals as its core components. First, the server has the function of automatically monitoring updates to construction instructions. When an update is made to a construction instruction, the server downloads the content and analyzes it using natural language processing technology. This analysis procedure divides the document into sections and extracts keywords and related metadata.

[0234] Next, the server registers the analysis results in the database. Here, data duplication is eliminated and the information is normalized. This creates a structure that minimizes the reference of misinformation and inconsistencies. After that, the data is indexed to improve search efficiency.

[0235] On the other hand, users access this system through a terminal. Users can enter queries to obtain the necessary information. The terminal sends this query to the server, and the server searches the database based on the received query. The server extracts relevant information and uses an algorithm to rank it based on importance.

[0236] Finally, the search results from the server are returned to the terminal. The terminal formats the results in a user-friendly format and presents them through the user interface. For example, if a user enters "latest antenna installation procedure" as a query, the terminal can display highly relevant information. This process allows the user to access accurate information with minimal effort.

[0237] In this way, the system of the present invention improves the efficiency of managing construction instructions and retrieving information.

[0238] The following describes the processing flow.

[0239] Step 1:

[0240] The server periodically checks for updates to the construction instructions. When there are new updates, the server downloads the files.

[0241] Step 2:

[0242] The server passes the downloaded construction instructions to a natural language processing engine for analysis. The analysis divides the document into sections and extracts keywords and related information.

[0243] Step 3:

[0244] The server registers the analyzed information in the database. During registration, duplicate information is removed and normalization is performed to maintain data integrity.

[0245] Step 4:

[0246] The user enters queries through the terminal's interface and instructs the system to search for the necessary information.

[0247] Step 5:

[0248] The terminal sends a query from the user to the server. The server receives the query and searches the database.

[0249] Step 6:

[0250] The server finds information related to the query and ranks the information based on its relevance. The server then formats the search results and sends them to the terminal.

[0251] Step 7:

[0252] The terminal displays search results received from the server in the user interface. The information is presented in order of importance, allowing the user to quickly find the information they are looking for.

[0253] Step 8:

[0254] Users can refer to the displayed information and, if necessary, view more detailed information to confirm the construction method.

[0255] (Example 1)

[0256] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0257] The high frequency of updates to construction instructions and the complexity of manual management make it difficult to ensure information consistency. Furthermore, while there is a need to quickly search for and accurately grasp information, traditional methods make it difficult to efficiently acquire relevant information. Therefore, there is a need for a system that automatically manages updates to construction instructions and provides necessary information quickly and accurately.

[0258] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0259] In this invention, the server includes means for automatically detecting update information and analyzing documents using natural language processing technology, means for registering the analyzed data in a database and performing data normalization and deduplication, and means for searching the database based on user input queries, evaluating relevance, and ranking the information. This enables efficient management of updates to construction instructions and allows users to quickly retrieve the information they need.

[0260] "Update information" refers to the latest data that has been changed or corrected in documents such as construction instructions.

[0261] "Natural language processing technology" refers to technologies that enable machines to understand, interpret, and generate human language.

[0262] "Document analysis" is the process of analyzing text data based on specific rules and algorithms to extract and organize information.

[0263] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[0264] "Normalization" is the process of converting information into a standardized format in order to maintain data consistency and integrity.

[0265] "Deduplication" is the process of removing redundant or duplicate information from a dataset to improve its efficiency.

[0266] A "query" is a request used to retrieve specific information from a database.

[0267] "Relevance" is a measure that indicates how important or relevant specific information is to a search query.

[0268] "Ranking" refers to organizing information or data in order of priority based on specific criteria.

[0269] This invention provides a system for the efficient management and retrieval of construction instructions. This system is primarily composed of a database, a server, and terminals.

[0270] The server functions as the core of this system, constantly monitoring updates to construction instructions. Specifically, the server checks the data source at regular intervals and immediately downloads any new updates. This process uses SpaCy, an open-source natural language processing library, and the downloaded data is parsed using this library. During the parsing, the document is divided into sections, and keywords and metadata are extracted. When these parsing results are registered in the MySQL database, the data undergoes deduplication and normalization. This operation ensures data integrity and consistency.

[0271] Users access this system through a terminal. They enter queries through the terminal's interface to search for the information they need. For example, a user might enter the query "latest antenna installation procedure." The terminal sends this query to the server, which searches the database. This search uses SQL queries and the TF-IDF algorithm to further clarify the relevant information. The server ranks the search results based on importance and returns the results to the terminal.

[0272] The device formats the search results obtained in a way that is easy for the user to understand visually and displays them through the user interface. HTML and CSS are used for the display, providing a highly visible layout that allows the user to intuitively obtain information.

[0273] In this way, the system of the present invention improves the efficiency of managing construction instructions and retrieving information. An example of a specific prompt message is, "Search for the latest information on construction instructions and check if it includes the specific installation procedure." By using this prompt, the user can easily obtain the desired information.

[0274] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0275] Step 1:

[0276] The server monitors updates to construction instructions. It checks the data source at regular intervals and downloads the information when a new update is detected. The input is data update notifications on the network, and the output is the updated construction instruction data file. Specific operational methods include using APIs and webhooks.

[0277] Step 2:

[0278] The server analyzes the downloaded construction instruction data using natural language processing technology. The input is the updated construction instruction data file, and the output is text divided into sections, along with extracted keywords and metadata. Specifically, the document is tokenized using an open-source library, and information is extracted.

[0279] Step 3:

[0280] The server registers the analyzed information in the database and performs normalization and deduplication. The input is the analysis result, and the output is a database entry with maintained integrity. Specifically, SQL is used to write data into the database to ensure that there is no abnormality or duplicate information.

[0281] Step 4:

[0282] The user accesses this system through the terminal and inputs a query to obtain information. The input is the query string by the user, and the output is a query request to the server. As specific operations, forms on the web browser or dedicated applications are used.

[0283] Step 5:

[0284] The server searches the database based on the received query, evaluates the relevance, and ranks the results. The input is the query content from the terminal, and the output is a ranked list of search results. Specifically, the TF-IDF algorithm is used to sort the relevant information in order of priority. <000:0901> Step 6:

[0286] The terminal receives the search results from the server and formats them in an easy-to-understand form for the user. The input is the search result data from the server, and the output is visually organized information displayed on the user interface. As specific operations, HTML and CSS are used to convert the results into a display format.

[0287] Step 7:

[0288] The user browses the results on the terminal and performs further operations or re-searches as needed. The input is the results displayed on the terminal, and the output is a new query by the user or information confirmation. Specifically, interactions such as clicking on links or re-entering forms are performed. <00:0912>

[0289] ((Application Example 1)

[0290] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0291] In construction sites where work instructions and inventory information are frequently updated, manual verification and updating of information is time-consuming and labor-intensive, leading to the occurrence of misinformation and reduced search efficiency. Furthermore, the insufficient immediate sharing and presentation of information via smart devices made rapid and accurate information management and retrieval difficult.

[0292] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0293] In this invention, the server includes means for automatically detecting and analyzing updates to construction instructions and inventory information, means for registering and normalizing the analyzed information in a database, and means for performing searches and presentations based on queries entered by the user via a smart device. This enables rapid information updates, accurate data management, and immediate access via smart devices.

[0294] A "construction instruction sheet" is a document that outlines the specific work procedures and details involved in construction or engineering work.

[0295] "Inventory information" refers to data such as the quantity and location of goods and materials in logistics centers and warehouses.

[0296] "Automatic detection" refers to a function that allows the system to identify updated or changed information without human intervention.

[0297] "Analysis" refers to the process of dividing collected information into meaningful units and processing it into an understandable form.

[0298] A "database" is a collection of digital information that is systematically organized and stored in an easily accessible format.

[0299] "Normalization" is the process of organizing information within a database into a unified format, eliminating duplication and inconsistencies to maintain consistency.

[0300] A "query" is a statement of inquiry that a user enters to search for information within a database.

[0301] A "smart device" is a general term for portable devices equipped with communication and computer functions.

[0302] "Instant access" refers to a state where users can instantly access the information they need.

[0303] The system implementing this invention is designed to enable efficient management and retrieval of construction instructions and inventory information. The server automatically detects updates to construction instructions and inventory information and performs analysis using natural language processing technology. The analyzed information is registered in a database and normalized to eliminate duplicates and misinformation.

[0304] In this system, users can use smart devices to enter queries and search for information in the database. The server indexes relevant information based on the user's query and extracts the necessary information in an order of importance according to a ranking algorithm. This information is visually organized and presented to the user through the terminal's user interface.

[0305] The program will run using the Python programming language, with Flask used to implement web server functionality. The spaCy library will be used for natural language processing, and Elasticsearch will be used for the database search mechanism. The hardware will consist of internet-connected smartphones, tablets, and personal computers.

[0306] As a specific example, in the inventory management of a logistics center, there is a case where a staff member searching for "the latest placement information of new product A" can quickly check when new inventory information is updated. In this case, information can be immediately obtained with a prompt sentence such as "location of new product A".

[0307] The flow of the specific process in Application Example 1 will be described using FIG. 12.

[0308] Step 1:

[0309] The server automatically detects updates to the construction instruction and inventory information. When an update is detected, the information is input into the server, the document is split into sections using natural language processing, and keywords are extracted. As a result of this process, structured data of the document is output.

[0310] Step 2: [[ID=1८]]

[0311] The server registers the structured data obtained in Step 1 in the database and performs normalization processing. Here, duplicate information is deleted and converted into a consistent data format. As a result of this process, unified data is stored in the database.

[0312] Step 3:

[0313] The user inputs a query via the terminal, and it is sent to the server. The query is the search requirement provided by the user, and the server analyzes this query and searches for relevant data. Based on the input query, matching information in the database is identified and a list of it is returned.

[0314] Step 4:

[0315] The server applies a ranking algorithm to the information obtained in Step 3. Ranking is performed based on the importance and relevance of the information, and the result is output as a formatted list.

[0316] Step 5:

[0317] The terminal presents the user with formatted search results received from the server through a visual interface. At this stage, the user can immediately obtain the necessary information and use it in their work. This interface displays information in an easy-to-read format, enabling efficient information verification.

[0318] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0319] This invention is a system that combines a construction instruction update management system with an emotion engine that recognizes the user's emotions and presents search results based on those emotions. Specific embodiments of this invention are described below.

[0320] This system includes a server, terminals, and an emotion engine as its main components. First, the server automatically detects updates to construction instructions and analyzes the updated information using natural language processing technology. The analyzed information is registered in a database, where it is normalized to eliminate duplication and inconsistencies.

[0321] When a user enters a query using their device, the device sends this information to the server. The server searches the database, extracts relevant information, and ranks it. The sentiment engine plays a crucial role in this ranking process.

[0322] The emotion engine recognizes the user's current emotional state based on user input, operation history, and, in some cases, data obtained from biometric sensors. For example, if the engine detects that the user is stressed, it adjusts the display of search results to be more concise and intuitive. In this way, it provides a user experience that is adapted to the user's emotions.

[0323] Search results from the server are sent to the terminal in a format optimized by the emotion engine. The results are then displayed on the user interface via the terminal. Through this emotion-adjusted information display, users can access the necessary information more appropriately and efficiently.

[0324] Thus, the present invention combines an emotion engine with the update management and information suggestion of construction instructions, thereby realizing flexible information provision that takes into account the user's emotional state.

[0325] The following describes the processing flow.

[0326] Step 1:

[0327] The server periodically scans for updates to construction instructions and downloads new files as soon as they are found.

[0328] Step 2:

[0329] The server analyzes the downloaded construction instructions using a natural language processing engine, divides the information into sections, and extracts key keywords and related data.

[0330] Step 3:

[0331] The server registers the extracted information in the database. During this process, the information is normalized and duplicated, and indexing is performed while maintaining consistency.

[0332] Step 4:

[0333] Users enter queries about topics of interest or questions through the terminal's interface.

[0334] Step 5:

[0335] The terminal sends the user's query to the server. The server parses the query and searches for the relevant entries in the database.

[0336] Step 6:

[0337] The server temporarily stores the search results and passes the user's operation history and input information to the sentiment engine for sentiment analysis.

[0338] Step 7:

[0339] The emotion engine analyzes the user's emotional state and uses the results to optimize the ranking and display format of search results.

[0340] Step 8:

[0341] The server formats the search results, which have been adjusted by the sentiment engine, and sends them to the terminal in a viewable format.

[0342] Step 9:

[0343] The device will display search results in an emotionally conscious layout, making it easy for users to access and understand the information.

[0344] Step 10:

[0345] Users can refer to the displayed results and efficiently obtain the information they need.

[0346] (Example 2)

[0347] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0348] To provide the latest information on construction site instructions quickly and accurately, it is necessary to instantly detect updates and present information appropriately according to the user's emotional state. However, conventional systems had problems such as low efficiency in detecting information updates and failure to present information considering the user's state, resulting in a lot of time and effort being required to obtain the necessary information. In addition, redundant data in the data storage device hindered information retrieval.

[0349] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0350] In this invention, the server includes means for automatically detecting updates to construction instructions and analyzing the updated information, means for registering the analyzed information in a data storage device and performing normalization, and means for recognizing the client's state and optimizing the presentation of search results. This enables users to quickly and accurately obtain the latest information in an optimal form tailored to their emotions.

[0351] A "construction instruction sheet" is a document used at construction sites and other work sites that contains instructions, procedures, and precautions for the work to be done.

[0352] "Automatically detecting updates" refers to the process by which a system detects new information or changes without human intervention.

[0353] "Analysis" is the process of breaking down specific data or information into smaller parts and understanding their meaning and structure.

[0354] A "data storage device" is a system or equipment that permanently stores information so that it can be retrieved later.

[0355] "Normalization" is a process to eliminate duplication and inconsistencies in information and maintain data consistency and integrity.

[0356] A "client" refers to a user or device that accesses a system and requests information.

[0357] "Questions" refer to specific requests or inquiries regarding the information entered by the client.

[0358] "Exploration" refers to the process or activity of finding necessary information from accumulated data.

[0359] "Priorization" is the process of determining priorities based on the relevance and importance of the information that has been explored.

[0360] "Presentation" refers to the act of making information visible and displaying it in a way that is easy for users to understand.

[0361] "Emotional analysis" is a technology that evaluates a client's emotional state and adjusts the information and services provided by the system according to that state.

[0362] This invention relates to a system for updating and managing construction instructions that presents information while taking user emotions into consideration. This system includes a server, a terminal, and an emotion engine as its main components.

[0363] The server is equipped with hardware and software to automatically detect updates to construction instructions. Specifically, it checks for updates using techniques such as timestamp comparison and file hash values. Furthermore, if an update is detected, it analyzes the information using natural language processing techniques (e.g., Python's NLTK library). Our data storage device is normalized to eliminate duplicate and inconsistent information.

[0364] The terminal has a user interface for the user to enter queries. The query entered by the user, such as a prompt message like "Please provide the latest safety instructions," is processed by the terminal and sent to the server.

[0365] Based on the received query, the server uses the Elasticsearch engine to search the data storage. This search process extracts and prioritizes the most relevant information.

[0366] The emotion engine analyzes the user's operation history and, in some cases, data from biometric sensors to identify the user's emotional state. For example, if the user is feeling stressed, the emotion engine adjusts the search results to be concise and visually easy to understand.

[0367] Ultimately, the device displays these optimized search results in the user interface. This allows users to receive information tailored to their emotions and access the necessary data quickly and efficiently.

[0368] The aim of implementing this system is to streamline the management of construction site instructions and significantly improve the user's information retrieval experience.

[0369] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0370] Step 1:

[0371] The server periodically scans the data storage where construction instructions are stored and automatically detects updates. The input is the current instruction content and file metadata, and the output is a list of newly updated information. This includes operations such as timestamp comparison and file hash value calculation to identify which parts have been changed.

[0372] Step 2:

[0373] The server analyzes the detected update information using natural language processing techniques. The input is a list of updates, and the output is an extraction and classification of the components of the specific instruction content. The techniques used include, for example, Python's NLTK for text analysis. This clarifies how the content of the instruction has changed semantically.

[0374] Step 3:

[0375] The server registers the analyzed information in a data storage device and performs normalization processing. The input is the analyzed instructions, and the output is the normalized data stored in the database. Regular expressions and database scrutiny are performed to eliminate duplication and inconsistencies and maintain data integrity.

[0376] Step 4:

[0377] The user enters specific queries using a terminal. These inputs are questions or requests from the user, such as prompts like "Please provide the latest security instructions." The terminal sends this information to the server as a string.

[0378] Step 5:

[0379] The server searches the database based on the received query and ranks the relevant information. The input is the user's query, and the output is a list of information ranked in order of relevance. A search engine such as Elasticsearch is used to quickly extract relevant information.

[0380] Step 6:

[0381] The emotion engine analyzes user input, operation history, and biometric information acquired in some cases to recognize the user's emotional state. The input is user operation data, and the output is the identified emotional state. An AI model, such as TensorFlow, is used to estimate the emotional state, and the system's response is adjusted accordingly.

[0382] Step 7:

[0383] The server utilizes the analysis results from the emotion engine to adapt search results to the client's state. Inputs are the emotional state and search results, and output is a refined list of information. This includes formatting to simplify the information presented and make it visually easier to understand.

[0384] Step 8:

[0385] The terminal displays optimized search results sent from the server in its user interface. The input is an optimized information list, and the output is an organized information screen that the user can visually review. This enables the user to instantly access the necessary information in a way that is optimal to their emotions.

[0386] (Application Example 2)

[0387] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0388] Conventional information retrieval systems present information without considering the user's emotional state, which can result in inappropriate information being displayed to users experiencing stress. Furthermore, the system fails to provide effective information suggestions tailored to the user's emotions during the retrieval process, resulting in an inability to deliver an optimal user experience. This has led to challenges for users in quickly and efficiently accessing the information they need.

[0389] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0390] In this invention, the server includes means for automatically detecting updates to construction instructions and analyzing the updated information; means for registering the analyzed information in a database and normalizing it; means for searching the database based on queries entered by the user and ranking relevant information; means for analyzing the user's emotional state using an emotion recognition function and adjusting the ranking of search results based on the results; and means for formatting the search results to adjust and present them according to the user's emotions. This enables flexible information provision that adapts to the user's emotions, allowing the user to efficiently access the necessary information.

[0391] A "construction instruction sheet" is a document that specifies in detail the work content, procedures, and methods for construction or execution.

[0392] "Emotion recognition function" is a technology that analyzes the user's current emotional state based on input information and biometric data.

[0393] A "database" is an information aggregation system that structures and stores information, making it easy to search and use.

[0394] "Normalization" is the process of maintaining the integrity of information by removing duplicates from data within a database and standardizing its format.

[0395] "User experience" is a concept that refers to the feelings, satisfaction, and overall experience that users have when using a product or service.

[0396] "Ranking search results" is the process of sorting information found based on a user's query according to its relevance and importance.

[0397] "Optimizing information display" is the process of adjusting search results so that they are presented effectively according to the user's emotional state and needs.

[0398] To implement this application, a server, an emotion engine, a database, and a terminal equipped with a user interface are required. The server automatically detects updates to construction instructions and analyzes them using natural language processing technology. The analyzed information is registered in the database and normalized to eliminate data duplication and inconsistencies.

[0399] When a user enters a query via a terminal, the terminal sends it to the server. The server searches the database and ranks the relevant information using an emotion engine. The emotion engine analyzes the user's emotional state using the user's input information, operation history, and, if possible, data from biometric sensors. Based on this information, the search results are formatted to reflect the user's emotions.

[0400] For example, when a user searches in a virtual store, the emotion engine recognizes the user's emotions and, if they are stressed, makes the search results concise and easy to understand. On the other hand, if they are relaxed, it can present a variety of product options, offering a wider range of choices.

[0401] An example of a prompt message might be: "Please select a product that will be displayed when the user is feeling stressed. Please prioritize simple and easy-to-understand options such as 'relaxing chair' or 'ergonomic chair'."

[0402] In this way, the server can provide optimal information tailored to the user's emotional state and efficiently present search results that meet the user's needs through the user interface.

[0403] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0404] Step 1:

[0405] The server automatically detects updates to construction instructions and analyzes them using natural language processing technology. The input is the newly updated construction instructions, and the output is the analyzed information. This analysis converts the contents of the construction instructions into a structured data format. Furthermore, the data is normalized to mitigate potential inconsistencies and redundancies.

[0406] Step 2:

[0407] The user enters a query via a terminal. The input is a text query containing the information the user wants to search for, and the output is the search request sent to the server. The terminal sends this query information to the server, where it is formatted into the necessary data format for rapid processing.

[0408] Step 3:

[0409] The server searches the database based on the received query and extracts relevant information. The input is the user's query and database information, and the output is the extracted relevant information. The server uses an efficient search algorithm to identify highly relevant data and create a list of available information.

[0410] Step 4:

[0411] The server uses emotion recognition to analyze the user's emotional state and ranks search results based on the results. Inputs include user input information, operation history, and biometric information (if available), and output is a ranking result optimized for emotion. The server analyzes the user's emotions and makes adjustments, such as simplifying the display if the user is stressed and broadening the range of information if the user is relaxed.

[0412] Step 5:

[0413] The server optimizes search results based on sentiment before sending them to the user's device. The input is the sentiment-based ranked search results, and the output is the information displayed on the user's device. The user interface presents information in a user-friendly way, enabling flexible information delivery tailored to user needs.

[0414] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0415] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0416] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0417] [Third Embodiment]

[0418] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0419] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0420] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0421] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0422] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0423] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0424] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0425] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0426] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0427] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0428] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0429] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0430] This invention provides a system that efficiently manages the updating of construction instructions and allows for the rapid retrieval of necessary information. The following describes specific embodiments for carrying out this invention.

[0431] This system includes a database, server, and terminals as its core components. First, the server has the function of automatically monitoring updates to construction instructions. When an update is made to a construction instruction, the server downloads the content and analyzes it using natural language processing technology. This analysis procedure divides the document into sections and extracts keywords and related metadata.

[0432] Next, the server registers the analysis results in the database. Here, data duplication is eliminated and the information is normalized. This creates a structure that minimizes the reference of misinformation and inconsistencies. After that, the data is indexed to improve search efficiency.

[0433] On the other hand, users access this system through a terminal. Users can enter queries to obtain the necessary information. The terminal sends this query to the server, and the server searches the database based on the received query. The server extracts relevant information and uses an algorithm to rank it based on importance.

[0434] Finally, the search results from the server are returned to the terminal. The terminal formats the results in a user-friendly format and presents them through the user interface. For example, if a user enters "latest antenna installation procedure" as a query, the terminal can display highly relevant information. This process allows the user to access accurate information with minimal effort.

[0435] In this way, the system of the present invention improves the efficiency of managing construction instructions and retrieving information.

[0436] The following describes the processing flow.

[0437] Step 1:

[0438] The server periodically checks for updates to the construction instructions. When there are new updates, the server downloads the files.

[0439] Step 2:

[0440] The server passes the downloaded construction instructions to a natural language processing engine for analysis. The analysis divides the document into sections and extracts keywords and related information.

[0441] Step 3:

[0442] The server registers the analyzed information in the database. During registration, duplicate information is removed and normalization is performed to maintain data integrity.

[0443] Step 4:

[0444] The user enters queries through the terminal's interface and instructs the system to search for the necessary information.

[0445] Step 5:

[0446] The terminal sends a query from the user to the server. The server receives the query and searches the database.

[0447] Step 6:

[0448] The server finds information related to the query and ranks the information based on its relevance. The server then formats the search results and sends them to the terminal.

[0449] Step 7:

[0450] The terminal displays search results received from the server in the user interface. The information is presented in order of importance, allowing the user to quickly find the information they are looking for.

[0451] Step 8:

[0452] Users can refer to the displayed information and, if necessary, view more detailed information to confirm the construction method.

[0453] (Example 1)

[0454] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0455] The high frequency of updates to construction instructions and the complexity of manual management make it difficult to ensure information consistency. Furthermore, while there is a need to quickly search for and accurately grasp information, traditional methods make it difficult to efficiently acquire relevant information. Therefore, there is a need for a system that automatically manages updates to construction instructions and provides necessary information quickly and accurately.

[0456] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0457] In this invention, the server includes means for automatically detecting update information and analyzing documents using natural language processing technology, means for registering the analyzed data in a database and performing data normalization and deduplication, and means for searching the database based on user input queries, evaluating relevance, and ranking the information. This enables efficient management of updates to construction instructions and allows users to quickly retrieve the information they need.

[0458] "Update information" refers to the latest data that has been changed or corrected in documents such as construction instructions.

[0459] "Natural language processing technology" refers to technologies that enable machines to understand, interpret, and generate human language.

[0460] "Document analysis" is the process of analyzing text data based on specific rules and algorithms to extract and organize information.

[0461] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[0462] "Normalization" is the process of converting information into a standardized format in order to maintain data consistency and integrity.

[0463] "Deduplication" is the process of removing redundant or duplicate information from a dataset to improve its efficiency.

[0464] A "query" is a request used to retrieve specific information from a database.

[0465] "Relevance" is a measure that indicates how important or relevant specific information is to a search query.

[0466] "Ranking" refers to organizing information or data in order of priority based on specific criteria.

[0467] This invention provides a system for the efficient management and retrieval of construction instructions. This system is primarily composed of a database, a server, and terminals.

[0468] The server functions as the core of this system, constantly monitoring updates to construction instructions. Specifically, the server checks the data source at regular intervals and immediately downloads any new updates. This process uses SpaCy, an open-source natural language processing library, and the downloaded data is parsed using this library. During the parsing, the document is divided into sections, and keywords and metadata are extracted. When these parsing results are registered in the MySQL database, the data undergoes deduplication and normalization. This operation ensures data integrity and consistency.

[0469] Users access this system through a terminal. They enter queries through the terminal's interface to search for the information they need. For example, a user might enter the query "latest antenna installation procedure." The terminal sends this query to the server, which searches the database. This search uses SQL queries and the TF-IDF algorithm to further clarify the relevant information. The server ranks the search results based on importance and returns the results to the terminal.

[0470] The device formats the search results obtained in a way that is easy for the user to understand visually and displays them through the user interface. HTML and CSS are used for the display, providing a highly visible layout that allows the user to intuitively obtain information.

[0471] In this way, the system of the present invention improves the efficiency of managing construction instructions and retrieving information. An example of a specific prompt message is, "Search for the latest information on construction instructions and check if it includes the specific installation procedure." By using this prompt, the user can easily obtain the desired information.

[0472] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0473] Step 1:

[0474] The server monitors updates to construction instructions. It checks the data source at regular intervals and downloads the information when a new update is detected. The input is data update notifications on the network, and the output is the updated construction instruction data file. Specific operational methods include using APIs and webhooks.

[0475] Step 2:

[0476] The server analyzes the downloaded construction instruction data using natural language processing technology. The input is the updated construction instruction data file, and the output is text divided into sections, along with extracted keywords and metadata. Specifically, the document is tokenized using an open-source library, and information is extracted.

[0477] Step 3:

[0478] The server registers the analyzed information in a database and performs normalization and deduplication. The input is the analysis result, and the output is a consistent database entry. Specifically, SQL is used to write data to the database, ensuring that no abnormal or duplicate information is included.

[0479] Step 4:

[0480] Users access this system through their terminals and enter queries to retrieve information. The input is a query string entered by the user, and the output is a query request sent to the server. This can be done using web browser forms or dedicated applications.

[0481] Step 5:

[0482] The server searches the database based on the received query, evaluates its relevance, and ranks the results. The input is the query content from the terminal, and the output is a ranked list of search results. Specifically, the TF-IDF algorithm is used to organize the relevant information in order of priority.

[0483] Step 6:

[0484] The terminal receives search results from the server and formats them in a user-friendly format. The input is the search result data from the server, and the output is visually organized information displayed in the user interface. Specifically, HTML and CSS are used to convert the results into a display format.

[0485] Step 7:

[0486] Users view results on their devices and perform further actions or searches as needed. Input is the results displayed on the device, and output is the user's new query or confirmation of information. Specifically, interactions such as clicking links or re-filling forms occur.

[0487] (Application Example 1)

[0488] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0489] In construction sites where work instructions and inventory information are frequently updated, manual verification and updating of information is time-consuming and labor-intensive, leading to the occurrence of misinformation and reduced search efficiency. Furthermore, the insufficient immediate sharing and presentation of information via smart devices made rapid and accurate information management and retrieval difficult.

[0490] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0491] In this invention, the server includes means for automatically detecting and analyzing updates to construction instructions and inventory information, means for registering and normalizing the analyzed information in a database, and means for performing searches and presentations based on queries entered by the user via a smart device. This enables rapid information updates, accurate data management, and immediate access via smart devices.

[0492] A "construction instruction sheet" is a document that outlines the specific work procedures and details involved in construction or engineering work.

[0493] "Inventory information" refers to data such as the quantity and location of goods and materials in logistics centers and warehouses.

[0494] "Automatic detection" refers to a function that allows the system to identify updated or changed information without human intervention.

[0495] "Analysis" refers to the process of dividing collected information into meaningful units and processing it into an understandable form.

[0496] A "database" is a collection of digital information that is systematically organized and stored in an easily accessible format.

[0497] "Normalization" is the process of organizing information within a database into a unified format, eliminating duplication and inconsistencies to maintain consistency.

[0498] A "query" is a statement of inquiry that a user enters to search for information within a database.

[0499] A "smart device" is a general term for portable devices equipped with communication and computer functions.

[0500] "Instant access" refers to a state where users can instantly access the information they need.

[0501] The system implementing this invention is designed to enable efficient management and retrieval of construction instructions and inventory information. The server automatically detects updates to construction instructions and inventory information and performs analysis using natural language processing technology. The analyzed information is registered in a database and normalized to eliminate duplicates and misinformation.

[0502] In this system, users can use smart devices to enter queries and search for information in the database. The server indexes relevant information based on the user's query and extracts the necessary information in an order of importance according to a ranking algorithm. This information is visually organized and presented to the user through the terminal's user interface.

[0503] The program will run using the Python programming language, with Flask used to implement web server functionality. The spaCy library will be used for natural language processing, and Elasticsearch will be used for the database search mechanism. The hardware will consist of internet-connected smartphones, tablets, and personal computers.

[0504] A concrete example is in inventory management at a logistics center, where a staff member searching for "the latest location information for new product A" can quickly check the updated inventory information as soon as it becomes available. In this case, the information can be retrieved instantly using a prompt such as "location of new product A".

[0505] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0506] Step 1:

[0507] The server automatically detects updates to construction instructions and inventory information. When an update is detected, the information is entered into the server, and natural language processing is used to divide the document into sections and extract keywords. As a result of this process, structured data of the document is output.

[0508] Step 2:

[0509] The server registers the structured data obtained in step 1 into the database and performs normalization. This process removes duplicate information and converts the data into a consistent format. As a result of this process, unified data is stored in the database.

[0510] Step 3:

[0511] The user enters a query via a terminal, which is then sent to the server. The query is a search requirement provided by the user, and the server parses this query to retrieve relevant data. Based on the entered query, the server identifies matching information in the database and returns a list of it.

[0512] Step 4:

[0513] The server applies a ranking algorithm to the information obtained in step 3. The information is ranked based on its importance and relevance, and the results are output as a formatted list.

[0514] Step 5:

[0515] The terminal presents the user with formatted search results received from the server through a visual interface. At this stage, the user can immediately obtain the necessary information and use it in their work. This interface displays information in an easy-to-read format, enabling efficient information verification.

[0516] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0517] This invention is a system that combines a construction instruction update management system with an emotion engine that recognizes the user's emotions and presents search results based on those emotions. Specific embodiments of this invention are described below.

[0518] This system includes a server, terminals, and an emotion engine as its main components. First, the server automatically detects updates to construction instructions and analyzes the updated information using natural language processing technology. The analyzed information is registered in a database, where it is normalized to eliminate duplication and inconsistencies.

[0519] When a user enters a query using their device, the device sends this information to the server. The server searches the database, extracts relevant information, and ranks it. The sentiment engine plays a crucial role in this ranking process.

[0520] The emotion engine recognizes the user's current emotional state based on user input, operation history, and, in some cases, data obtained from biometric sensors. For example, if the engine detects that the user is stressed, it adjusts the display of search results to be more concise and intuitive. In this way, it provides a user experience that is adapted to the user's emotions.

[0521] Search results from the server are sent to the terminal in a format optimized by the emotion engine. The results are then displayed on the user interface via the terminal. Through this emotion-adjusted information display, users can access the necessary information more appropriately and efficiently.

[0522] Thus, the present invention combines an emotion engine with the update management and information suggestion of construction instructions, thereby realizing flexible information provision that takes into account the user's emotional state.

[0523] The following describes the processing flow.

[0524] Step 1:

[0525] The server periodically scans for updates to construction instructions and downloads new files as soon as they are found.

[0526] Step 2:

[0527] The server analyzes the downloaded construction instructions using a natural language processing engine, divides the information into sections, and extracts key keywords and related data.

[0528] Step 3:

[0529] The server registers the extracted information in the database. During this process, the information is normalized and duplicated, and indexing is performed while maintaining consistency.

[0530] Step 4:

[0531] Users enter queries about topics of interest or questions through the terminal's interface.

[0532] Step 5:

[0533] The terminal sends the user's query to the server. The server parses the query and searches for the relevant entries in the database.

[0534] Step 6:

[0535] The server temporarily stores the search results and passes the user's operation history and input information to the sentiment engine for sentiment analysis.

[0536] Step 7:

[0537] The emotion engine analyzes the user's emotional state and uses the results to optimize the ranking and display format of search results.

[0538] Step 8:

[0539] The server formats the search results, which have been adjusted by the sentiment engine, and sends them to the terminal in a viewable format.

[0540] Step 9:

[0541] The device will display search results in an emotionally conscious layout, making it easy for users to access and understand the information.

[0542] Step 10:

[0543] Users can refer to the displayed results and efficiently obtain the information they need.

[0544] (Example 2)

[0545] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0546] To provide the latest information on construction site instructions quickly and accurately, it is necessary to instantly detect updates and present information appropriately according to the user's emotional state. However, conventional systems had problems such as low efficiency in detecting information updates and failure to present information considering the user's state, resulting in a lot of time and effort being required to obtain the necessary information. In addition, redundant data in the data storage device hindered information retrieval.

[0547] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0548] In this invention, the server includes means for automatically detecting updates to construction instructions and analyzing the updated information, means for registering the analyzed information in a data storage device and performing normalization, and means for recognizing the client's state and optimizing the presentation of search results. This enables users to quickly and accurately obtain the latest information in an optimal form tailored to their emotions.

[0549] A "construction instruction sheet" is a document used at construction sites and other work sites that contains instructions, procedures, and precautions for the work to be done.

[0550] "Automatically detecting updates" refers to the process by which a system detects new information or changes without human intervention.

[0551] "Analysis" is the process of breaking down specific data or information into smaller parts and understanding their meaning and structure.

[0552] A "data storage device" is a system or equipment that permanently stores information so that it can be retrieved later.

[0553] "Normalization" is a process to eliminate duplication and inconsistencies in information and maintain data consistency and integrity.

[0554] A "client" refers to a user or device that accesses a system and requests information.

[0555] "Questions" refer to specific requests or inquiries regarding the information entered by the client.

[0556] "Exploration" refers to the process or activity of finding necessary information from accumulated data.

[0557] "Priorization" is the process of determining priorities based on the relevance and importance of the information that has been explored.

[0558] "Presentation" refers to the act of making information visible and displaying it in a way that is easy for users to understand.

[0559] "Emotional analysis" is a technology that evaluates a client's emotional state and adjusts the information and services provided by the system according to that state.

[0560] This invention relates to a system for updating and managing construction instructions that presents information while taking user emotions into consideration. This system includes a server, a terminal, and an emotion engine as its main components.

[0561] The server is equipped with hardware and software to automatically detect updates to construction instructions. Specifically, it checks for updates using techniques such as timestamp comparison and file hash values. Furthermore, if an update is detected, it analyzes the information using natural language processing techniques (e.g., Python's NLTK library). Our data storage device is normalized to eliminate duplicate and inconsistent information.

[0562] The terminal has a user interface for the user to enter queries. The query entered by the user, such as a prompt message like "Please provide the latest safety instructions," is processed by the terminal and sent to the server.

[0563] Based on the received query, the server uses the Elasticsearch engine to search the data storage. This search process extracts and prioritizes the most relevant information.

[0564] The emotion engine analyzes the user's operation history and, in some cases, data from biometric sensors to identify the user's emotional state. For example, if the user is feeling stressed, the emotion engine adjusts the search results to be concise and visually easy to understand.

[0565] Ultimately, the device displays these optimized search results in the user interface. This allows users to receive information tailored to their emotions and access the necessary data quickly and efficiently.

[0566] The aim of implementing this system is to streamline the management of construction site instructions and significantly improve the user's information retrieval experience.

[0567] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0568] Step 1:

[0569] The server periodically scans the data storage where construction instructions are stored and automatically detects updates. The input is the current instruction content and file metadata, and the output is a list of newly updated information. This includes operations such as timestamp comparison and file hash value calculation to identify which parts have been changed.

[0570] Step 2:

[0571] The server analyzes the detected update information using natural language processing techniques. The input is a list of updates, and the output is an extraction and classification of the components of the specific instruction content. The techniques used include, for example, Python's NLTK for text analysis. This clarifies how the content of the instruction has changed semantically.

[0572] Step 3:

[0573] The server registers the analyzed information in a data storage device and performs normalization processing. The input is the analyzed instructions, and the output is the normalized data stored in the database. Regular expressions and database scrutiny are performed to eliminate duplication and inconsistencies and maintain data integrity.

[0574] Step 4:

[0575] The user enters specific queries using a terminal. These inputs are questions or requests from the user, such as prompts like "Please provide the latest security instructions." The terminal sends this information to the server as a string.

[0576] Step 5:

[0577] The server searches the database based on the received query and ranks the relevant information. The input is the user's query, and the output is a list of information ranked in order of relevance. A search engine such as Elasticsearch is used to quickly extract relevant information.

[0578] Step 6:

[0579] The emotion engine analyzes user input, operation history, and biometric information acquired in some cases to recognize the user's emotional state. The input is user operation data, and the output is the identified emotional state. An AI model, such as TensorFlow, is used to estimate the emotional state, and the system's response is adjusted accordingly.

[0580] Step 7:

[0581] The server utilizes the analysis results from the emotion engine to adapt search results to the client's state. Inputs are the emotional state and search results, and output is a refined list of information. This includes formatting to simplify the information presented and make it visually easier to understand.

[0582] Step 8:

[0583] The terminal displays optimized search results sent from the server in its user interface. The input is an optimized information list, and the output is an organized information screen that the user can visually review. This enables the user to instantly access the necessary information in a way that is optimal to their emotions.

[0584] (Application Example 2)

[0585] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0586] Conventional information retrieval systems present information without considering the user's emotional state, which can result in inappropriate information being displayed to users experiencing stress. Furthermore, the system fails to provide effective information suggestions tailored to the user's emotions during the retrieval process, resulting in an inability to deliver an optimal user experience. This has led to challenges for users in quickly and efficiently accessing the information they need.

[0587] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0588] In this invention, the server includes means for automatically detecting updates to construction instructions and analyzing the updated information; means for registering the analyzed information in a database and normalizing it; means for searching the database based on queries entered by the user and ranking relevant information; means for analyzing the user's emotional state using an emotion recognition function and adjusting the ranking of search results based on the results; and means for formatting the search results to adjust and present them according to the user's emotions. This enables flexible information provision that adapts to the user's emotions, allowing the user to efficiently access the necessary information.

[0589] A "construction instruction sheet" is a document that specifies in detail the work content, procedures, and methods for construction or execution.

[0590] "Emotion recognition function" is a technology that analyzes the user's current emotional state based on input information and biometric data.

[0591] A "database" is an information aggregation system that structures and stores information, making it easy to search and use.

[0592] "Normalization" is the process of maintaining the integrity of information by removing duplicates from data within a database and standardizing its format.

[0593] "User experience" is a concept that refers to the feelings, satisfaction, and overall experience that users have when using a product or service.

[0594] "Ranking search results" is the process of sorting information found based on a user's query according to its relevance and importance.

[0595] "Optimizing information display" is the process of adjusting search results so that they are presented effectively according to the user's emotional state and needs.

[0596] To implement this application, a server, an emotion engine, a database, and a terminal equipped with a user interface are required. The server automatically detects updates to construction instructions and analyzes them using natural language processing technology. The analyzed information is registered in the database and normalized to eliminate data duplication and inconsistencies.

[0597] When a user enters a query via a terminal, the terminal sends it to the server. The server searches the database and ranks the relevant information using an emotion engine. The emotion engine analyzes the user's emotional state using the user's input information, operation history, and, if possible, data from biometric sensors. Based on this information, the search results are formatted to reflect the user's emotions.

[0598] For example, when a user searches in a virtual store, the emotion engine recognizes the user's emotions and, if they are stressed, makes the search results concise and easy to understand. On the other hand, if they are relaxed, it can present a variety of product options, offering a wider range of choices.

[0599] An example of a prompt message might be: "Please select a product that will be displayed when the user is feeling stressed. Please prioritize simple and easy-to-understand options such as 'relaxing chair' or 'ergonomic chair'."

[0600] In this way, the server can provide optimal information tailored to the user's emotional state and efficiently present search results that meet the user's needs through the user interface.

[0601] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0602] Step 1:

[0603] The server automatically detects updates to construction instructions and analyzes them using natural language processing technology. The input is the newly updated construction instructions, and the output is the analyzed information. This analysis converts the contents of the construction instructions into a structured data format. Furthermore, the data is normalized to mitigate potential inconsistencies and redundancies.

[0604] Step 2:

[0605] The user enters a query via a terminal. The input is a text query containing the information the user wants to search for, and the output is the search request sent to the server. The terminal sends this query information to the server, where it is formatted into the necessary data format for rapid processing.

[0606] Step 3:

[0607] The server searches the database based on the received query and extracts relevant information. The input is the user's query and database information, and the output is the extracted relevant information. The server uses an efficient search algorithm to identify highly relevant data and create a list of available information.

[0608] Step 4:

[0609] The server uses emotion recognition to analyze the user's emotional state and ranks search results based on the results. Inputs include user input information, operation history, and biometric information (if available), and output is a ranking result optimized for emotion. The server analyzes the user's emotions and makes adjustments, such as simplifying the display if the user is stressed and broadening the range of information if the user is relaxed.

[0610] Step 5:

[0611] The server optimizes search results based on sentiment before sending them to the user's device. The input is the sentiment-based ranked search results, and the output is the information displayed on the user's device. The user interface presents information in a user-friendly way, enabling flexible information delivery tailored to user needs.

[0612] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0613] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0614] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0615] [Fourth Embodiment]

[0616] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0617] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0618] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0619] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0620] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0621] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0622] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0623] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0624] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0625] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0626] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0627] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0628] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0629] This invention provides a system that efficiently manages the updating of construction instructions and allows for the rapid retrieval of necessary information. The following describes specific embodiments for carrying out this invention.

[0630] This system includes a database, server, and terminals as its core components. First, the server has the function of automatically monitoring updates to construction instructions. When an update is made to a construction instruction, the server downloads the content and analyzes it using natural language processing technology. This analysis procedure divides the document into sections and extracts keywords and related metadata.

[0631] Next, the server registers the analysis results in the database. Here, data duplication is eliminated and the information is normalized. This creates a structure that minimizes the reference of misinformation and inconsistencies. After that, the data is indexed to improve search efficiency.

[0632] On the other hand, users access this system through a terminal. Users can enter queries to obtain the necessary information. The terminal sends this query to the server, and the server searches the database based on the received query. The server extracts relevant information and uses an algorithm to rank it based on importance.

[0633] Finally, the search results from the server are returned to the terminal. The terminal formats the results in a user-friendly format and presents them through the user interface. For example, if a user enters "latest antenna installation procedure" as a query, the terminal can display highly relevant information. This process allows the user to access accurate information with minimal effort.

[0634] In this way, the system of the present invention improves the efficiency of managing construction instructions and retrieving information.

[0635] The following describes the processing flow.

[0636] Step 1:

[0637] The server periodically checks for updates to the construction instructions. When there are new updates, the server downloads the files.

[0638] Step 2:

[0639] The server passes the downloaded construction instructions to a natural language processing engine for analysis. The analysis divides the document into sections and extracts keywords and related information.

[0640] Step 3:

[0641] The server registers the analyzed information in the database. During registration, duplicate information is removed and normalization is performed to maintain data integrity.

[0642] Step 4:

[0643] The user enters queries through the terminal's interface and instructs the system to search for the necessary information.

[0644] Step 5:

[0645] The terminal sends a query from the user to the server. The server receives the query and searches the database.

[0646] Step 6:

[0647] The server finds information related to the query and ranks the information based on its relevance. The server then formats the search results and sends them to the terminal.

[0648] Step 7:

[0649] The terminal displays search results received from the server in the user interface. The information is presented in order of importance, allowing the user to quickly find the information they are looking for.

[0650] Step 8:

[0651] Users can refer to the displayed information and, if necessary, view more detailed information to confirm the construction method.

[0652] (Example 1)

[0653] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0654] The high frequency of updates to construction instructions and the complexity of manual management make it difficult to ensure information consistency. Furthermore, while there is a need to quickly search for and accurately grasp information, traditional methods make it difficult to efficiently acquire relevant information. Therefore, there is a need for a system that automatically manages updates to construction instructions and provides necessary information quickly and accurately.

[0655] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0656] In this invention, the server includes means for automatically detecting update information and analyzing documents using natural language processing technology, means for registering the analyzed data in a database and performing data normalization and deduplication, and means for searching the database based on user input queries, evaluating relevance, and ranking the information. This enables efficient management of updates to construction instructions and allows users to quickly retrieve the information they need.

[0657] "Update information" refers to the latest data that has been changed or corrected in documents such as construction instructions.

[0658] "Natural language processing technology" refers to technologies that enable machines to understand, interpret, and generate human language.

[0659] "Document analysis" is the process of analyzing text data based on specific rules and algorithms to extract and organize information.

[0660] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[0661] "Normalization" is the process of converting information into a standardized format in order to maintain data consistency and integrity.

[0662] "Deduplication" is the process of removing redundant or duplicate information from a dataset to improve its efficiency.

[0663] A "query" is a request used to retrieve specific information from a database.

[0664] "Relevance" is a measure that indicates how important or relevant specific information is to a search query.

[0665] "Ranking" refers to organizing information or data in order of priority based on specific criteria.

[0666] This invention provides a system for the efficient management and retrieval of construction instructions. This system is primarily composed of a database, a server, and terminals.

[0667] The server functions as the core of this system, constantly monitoring updates to construction instructions. Specifically, the server checks the data source at regular intervals and immediately downloads any new updates. This process uses SpaCy, an open-source natural language processing library, and the downloaded data is parsed using this library. During the parsing, the document is divided into sections, and keywords and metadata are extracted. When these parsing results are registered in the MySQL database, the data undergoes deduplication and normalization. This operation ensures data integrity and consistency.

[0668] Users access this system through a terminal. They enter queries through the terminal's interface to search for the information they need. For example, a user might enter the query "latest antenna installation procedure." The terminal sends this query to the server, which searches the database. This search uses SQL queries and the TF-IDF algorithm to further clarify the relevant information. The server ranks the search results based on importance and returns the results to the terminal.

[0669] The device formats the search results obtained in a way that is easy for the user to understand visually and displays them through the user interface. HTML and CSS are used for the display, providing a highly visible layout that allows the user to intuitively obtain information.

[0670] In this way, the system of the present invention improves the efficiency of managing construction instructions and retrieving information. An example of a specific prompt message is, "Search for the latest information on construction instructions and check if it includes the specific installation procedure." By using this prompt, the user can easily obtain the desired information.

[0671] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0672] Step 1:

[0673] The server monitors updates to construction instructions. It checks the data source at regular intervals and downloads the information when a new update is detected. The input is data update notifications on the network, and the output is the updated construction instruction data file. Specific operational methods include using APIs and webhooks.

[0674] Step 2:

[0675] The server analyzes the downloaded construction instruction data using natural language processing technology. The input is the updated construction instruction data file, and the output is text divided into sections, along with extracted keywords and metadata. Specifically, the document is tokenized using an open-source library, and information is extracted.

[0676] Step 3:

[0677] The server registers the analyzed information in a database and performs normalization and deduplication. The input is the analysis result, and the output is a consistent database entry. Specifically, SQL is used to write data to the database, ensuring that no abnormal or duplicate information is included.

[0678] Step 4:

[0679] Users access this system through their terminals and enter queries to retrieve information. The input is a query string entered by the user, and the output is a query request sent to the server. This can be done using web browser forms or dedicated applications.

[0680] Step 5:

[0681] The server searches the database based on the received query, evaluates its relevance, and ranks the results. The input is the query content from the terminal, and the output is a ranked list of search results. Specifically, the TF-IDF algorithm is used to organize the relevant information in order of priority.

[0682] Step 6:

[0683] The terminal receives search results from the server and formats them in a user-friendly format. The input is the search result data from the server, and the output is visually organized information displayed in the user interface. Specifically, HTML and CSS are used to convert the results into a display format.

[0684] Step 7:

[0685] Users view results on their devices and perform further actions or searches as needed. Input is the results displayed on the device, and output is the user's new query or confirmation of information. Specifically, interactions such as clicking links or re-filling forms occur.

[0686] (Application Example 1)

[0687] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0688] In construction sites where work instructions and inventory information are frequently updated, manual verification and updating of information is time-consuming and labor-intensive, leading to the occurrence of misinformation and reduced search efficiency. Furthermore, the insufficient immediate sharing and presentation of information via smart devices made rapid and accurate information management and retrieval difficult.

[0689] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0690] In this invention, the server includes means for automatically detecting and analyzing updates to construction instructions and inventory information, means for registering and normalizing the analyzed information in a database, and means for performing searches and presentations based on queries entered by the user via a smart device. This enables rapid information updates, accurate data management, and immediate access via smart devices.

[0691] A "construction instruction sheet" is a document that outlines the specific work procedures and details involved in construction or engineering work.

[0692] "Inventory information" refers to data such as the quantity and location of goods and materials in logistics centers and warehouses.

[0693] "Automatic detection" refers to a function that allows the system to identify updated or changed information without human intervention.

[0694] "Analysis" refers to the process of dividing collected information into meaningful units and processing it into an understandable form.

[0695] A "database" is a collection of digital information that is systematically organized and stored in an easily accessible format.

[0696] "Normalization" is the process of organizing information within a database into a unified format, eliminating duplication and inconsistencies to maintain consistency.

[0697] A "query" is a statement of inquiry that a user enters to search for information within a database.

[0698] A "smart device" is a general term for portable devices equipped with communication and computer functions.

[0699] "Instant access" refers to a state where users can instantly access the information they need.

[0700] The system implementing this invention is designed to enable efficient management and retrieval of construction instructions and inventory information. The server automatically detects updates to construction instructions and inventory information and performs analysis using natural language processing technology. The analyzed information is registered in a database and normalized to eliminate duplicates and misinformation.

[0701] In this system, users can use smart devices to enter queries and search for information in the database. The server indexes relevant information based on the user's query and extracts the necessary information in an order of importance according to a ranking algorithm. This information is visually organized and presented to the user through the terminal's user interface.

[0702] The program will run using the Python programming language, with Flask used to implement web server functionality. The spaCy library will be used for natural language processing, and Elasticsearch will be used for the database search mechanism. The hardware will consist of internet-connected smartphones, tablets, and personal computers.

[0703] A concrete example is in inventory management at a logistics center, where a staff member searching for "the latest location information for new product A" can quickly check the updated inventory information as soon as it becomes available. In this case, the information can be retrieved instantly using a prompt such as "location of new product A".

[0704] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0705] Step 1:

[0706] The server automatically detects updates to construction instructions and inventory information. When an update is detected, the information is entered into the server, and natural language processing is used to divide the document into sections and extract keywords. As a result of this process, structured data of the document is output.

[0707] Step 2:

[0708] The server registers the structured data obtained in step 1 into the database and performs normalization. This process removes duplicate information and converts the data into a consistent format. As a result of this process, unified data is stored in the database.

[0709] Step 3:

[0710] The user enters a query via a terminal, which is then sent to the server. The query is a search requirement provided by the user, and the server parses this query to retrieve relevant data. Based on the entered query, the server identifies matching information in the database and returns a list of it.

[0711] Step 4:

[0712] The server applies a ranking algorithm to the information obtained in step 3. The information is ranked based on its importance and relevance, and the results are output as a formatted list.

[0713] Step 5:

[0714] The terminal presents the user with formatted search results received from the server through a visual interface. At this stage, the user can immediately obtain the necessary information and use it in their work. This interface displays information in an easy-to-read format, enabling efficient information verification.

[0715] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0716] This invention is a system that combines a construction instruction update management system with an emotion engine that recognizes the user's emotions and presents search results based on those emotions. Specific embodiments of this invention are described below.

[0717] This system includes a server, terminals, and an emotion engine as its main components. First, the server automatically detects updates to construction instructions and analyzes the updated information using natural language processing technology. The analyzed information is registered in a database, where it is normalized to eliminate duplication and inconsistencies.

[0718] When a user enters a query using their device, the device sends this information to the server. The server searches the database, extracts relevant information, and ranks it. The sentiment engine plays a crucial role in this ranking process.

[0719] The emotion engine recognizes the user's current emotional state based on user input, operation history, and, in some cases, data obtained from biometric sensors. For example, if the engine detects that the user is stressed, it adjusts the display of search results to be more concise and intuitive. In this way, it provides a user experience that is adapted to the user's emotions.

[0720] Search results from the server are sent to the terminal in a format optimized by the emotion engine. The results are then displayed on the user interface via the terminal. Through this emotion-adjusted information display, users can access the necessary information more appropriately and efficiently.

[0721] Thus, the present invention combines an emotion engine with the update management and information suggestion of construction instructions, thereby realizing flexible information provision that takes into account the user's emotional state.

[0722] The following describes the processing flow.

[0723] Step 1:

[0724] The server periodically scans for updates to construction instructions and downloads new files as soon as they are found.

[0725] Step 2:

[0726] The server analyzes the downloaded construction instructions using a natural language processing engine, divides the information into sections, and extracts key keywords and related data.

[0727] Step 3:

[0728] The server registers the extracted information in the database. During this process, the information is normalized and duplicated, and indexing is performed while maintaining consistency.

[0729] Step 4:

[0730] Users enter queries about topics of interest or questions through the terminal's interface.

[0731] Step 5:

[0732] The terminal sends the user's query to the server. The server parses the query and searches for the relevant entries in the database.

[0733] Step 6:

[0734] The server temporarily stores the search results and passes the user's operation history and input information to the sentiment engine for sentiment analysis.

[0735] Step 7:

[0736] The emotion engine analyzes the user's emotional state and uses the results to optimize the ranking and display format of search results.

[0737] Step 8:

[0738] The server formats the search results, which have been adjusted by the sentiment engine, and sends them to the terminal in a viewable format.

[0739] Step 9:

[0740] The device will display search results in an emotionally conscious layout, making it easy for users to access and understand the information.

[0741] Step 10:

[0742] Users can refer to the displayed results and efficiently obtain the information they need.

[0743] (Example 2)

[0744] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0745] To provide the latest information on construction site instructions quickly and accurately, it is necessary to instantly detect updates and present information appropriately according to the user's emotional state. However, conventional systems had problems such as low efficiency in detecting information updates and failure to present information considering the user's state, resulting in a lot of time and effort being required to obtain the necessary information. In addition, redundant data in the data storage device hindered information retrieval.

[0746] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0747] In this invention, the server includes means for automatically detecting updates to construction instructions and analyzing the updated information, means for registering the analyzed information in a data storage device and performing normalization, and means for recognizing the client's state and optimizing the presentation of search results. This enables users to quickly and accurately obtain the latest information in an optimal form tailored to their emotions.

[0748] A "construction instruction sheet" is a document used at construction sites and other work sites that contains instructions, procedures, and precautions for the work to be done.

[0749] "Automatically detecting updates" refers to the process by which a system detects new information or changes without human intervention.

[0750] "Analysis" is the process of breaking down specific data or information into smaller parts and understanding their meaning and structure.

[0751] A "data storage device" is a system or equipment that permanently stores information so that it can be retrieved later.

[0752] "Normalization" is a process to eliminate duplication and inconsistencies in information and maintain data consistency and integrity.

[0753] A "client" refers to a user or device that accesses a system and requests information.

[0754] "Questions" refer to specific requests or inquiries regarding the information entered by the client.

[0755] "Exploration" refers to the process or activity of finding necessary information from accumulated data.

[0756] "Priorization" is the process of determining priorities based on the relevance and importance of the information that has been explored.

[0757] "Presentation" refers to the act of making information visible and displaying it in a way that is easy for users to understand.

[0758] "Emotional analysis" is a technology that evaluates a client's emotional state and adjusts the information and services provided by the system according to that state.

[0759] This invention relates to a system for updating and managing construction instructions that presents information while taking user emotions into consideration. This system includes a server, a terminal, and an emotion engine as its main components.

[0760] The server is equipped with hardware and software to automatically detect updates to construction instructions. Specifically, it checks for updates using techniques such as timestamp comparison and file hash values. Furthermore, if an update is detected, it analyzes the information using natural language processing techniques (e.g., Python's NLTK library). Our data storage device is normalized to eliminate duplicate and inconsistent information.

[0761] The terminal has a user interface for the user to enter queries. The query entered by the user, such as a prompt message like "Please provide the latest safety instructions," is processed by the terminal and sent to the server.

[0762] Based on the received query, the server uses the Elasticsearch engine to search the data storage. This search process extracts and prioritizes the most relevant information.

[0763] The emotion engine analyzes the user's operation history and, in some cases, data from biometric sensors to identify the user's emotional state. For example, if the user is feeling stressed, the emotion engine adjusts the search results to be concise and visually easy to understand.

[0764] Ultimately, the device displays these optimized search results in the user interface. This allows users to receive information tailored to their emotions and access the necessary data quickly and efficiently.

[0765] The aim of implementing this system is to streamline the management of construction site instructions and significantly improve the user's information retrieval experience.

[0766] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0767] Step 1:

[0768] The server periodically scans the data storage where construction instructions are stored and automatically detects updates. The input is the current instruction content and file metadata, and the output is a list of newly updated information. This includes operations such as timestamp comparison and file hash value calculation to identify which parts have been changed.

[0769] Step 2:

[0770] The server analyzes the detected update information using natural language processing techniques. The input is a list of updates, and the output is an extraction and classification of the components of the specific instruction content. The techniques used include, for example, Python's NLTK for text analysis. This clarifies how the content of the instruction has changed semantically.

[0771] Step 3:

[0772] The server registers the analyzed information in a data storage device and performs normalization processing. The input is the analyzed instructions, and the output is the normalized data stored in the database. Regular expressions and database scrutiny are performed to eliminate duplication and inconsistencies and maintain data integrity.

[0773] Step 4:

[0774] The user enters specific queries using a terminal. These inputs are questions or requests from the user, such as prompts like "Please provide the latest security instructions." The terminal sends this information to the server as a string.

[0775] Step 5:

[0776] The server searches the database based on the received query and ranks the relevant information. The input is the user's query, and the output is a list of information ranked in order of relevance. A search engine such as Elasticsearch is used to quickly extract relevant information.

[0777] Step 6:

[0778] The emotion engine analyzes user input, operation history, and biometric information acquired in some cases to recognize the user's emotional state. The input is user operation data, and the output is the identified emotional state. An AI model, such as TensorFlow, is used to estimate the emotional state, and the system's response is adjusted accordingly.

[0779] Step 7:

[0780] The server utilizes the analysis results from the emotion engine to adapt search results to the client's state. Inputs are the emotional state and search results, and output is a refined list of information. This includes formatting to simplify the information presented and make it visually easier to understand.

[0781] Step 8:

[0782] The terminal displays optimized search results sent from the server in its user interface. The input is an optimized information list, and the output is an organized information screen that the user can visually review. This enables the user to instantly access the necessary information in a way that is optimal to their emotions.

[0783] (Application Example 2)

[0784] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0785] Conventional information retrieval systems present information without considering the user's emotional state, which can result in inappropriate information being displayed to users experiencing stress. Furthermore, the system fails to provide effective information suggestions tailored to the user's emotions during the retrieval process, resulting in an inability to deliver an optimal user experience. This has led to challenges for users in quickly and efficiently accessing the information they need.

[0786] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0787] In this invention, the server includes means for automatically detecting updates to construction instructions and analyzing the updated information; means for registering the analyzed information in a database and normalizing it; means for searching the database based on queries entered by the user and ranking relevant information; means for analyzing the user's emotional state using an emotion recognition function and adjusting the ranking of search results based on the results; and means for formatting the search results to adjust and present them according to the user's emotions. This enables flexible information provision that adapts to the user's emotions, allowing the user to efficiently access the necessary information.

[0788] A "construction instruction sheet" is a document that specifies in detail the work content, procedures, and methods for construction or execution.

[0789] "Emotion recognition function" is a technology that analyzes the user's current emotional state based on input information and biometric data.

[0790] A "database" is an information aggregation system that structures and stores information, making it easy to search and use.

[0791] "Normalization" is the process of maintaining the integrity of information by removing duplicates from data within a database and standardizing its format.

[0792] "User experience" is a concept that refers to the feelings, satisfaction, and overall experience that users have when using a product or service.

[0793] "Ranking search results" is the process of sorting information found based on a user's query according to its relevance and importance.

[0794] "Optimizing information display" is the process of adjusting search results so that they are presented effectively according to the user's emotional state and needs.

[0795] To implement this application, a server, an emotion engine, a database, and a terminal equipped with a user interface are required. The server automatically detects updates to construction instructions and analyzes them using natural language processing technology. The analyzed information is registered in the database and normalized to eliminate data duplication and inconsistencies.

[0796] When a user enters a query via a terminal, the terminal sends it to the server. The server searches the database and ranks the relevant information using an emotion engine. The emotion engine analyzes the user's emotional state using the user's input information, operation history, and, if possible, data from biometric sensors. Based on this information, the search results are formatted to reflect the user's emotions.

[0797] For example, when a user searches in a virtual store, the emotion engine recognizes the user's emotions and, if they are stressed, makes the search results concise and easy to understand. On the other hand, if they are relaxed, it can present a variety of product options, offering a wider range of choices.

[0798] An example of a prompt message might be: "Please select a product that will be displayed when the user is feeling stressed. Please prioritize simple and easy-to-understand options such as 'relaxing chair' or 'ergonomic chair'."

[0799] In this way, the server can provide optimal information tailored to the user's emotional state and efficiently present search results that meet the user's needs through the user interface.

[0800] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0801] Step 1:

[0802] The server automatically detects updates to construction instructions and analyzes them using natural language processing technology. The input is the newly updated construction instructions, and the output is the analyzed information. This analysis converts the contents of the construction instructions into a structured data format. Furthermore, the data is normalized to mitigate potential inconsistencies and redundancies.

[0803] Step 2:

[0804] The user enters a query via a terminal. The input is a text query containing the information the user wants to search for, and the output is the search request sent to the server. The terminal sends this query information to the server, where it is formatted into the necessary data format for rapid processing.

[0805] Step 3:

[0806] The server searches the database based on the received query and extracts relevant information. The input is the user's query and database information, and the output is the extracted relevant information. The server uses an efficient search algorithm to identify highly relevant data and create a list of available information.

[0807] Step 4:

[0808] The server uses emotion recognition to analyze the user's emotional state and ranks search results based on the results. Inputs include user input information, operation history, and biometric information (if available), and output is a ranking result optimized for emotion. The server analyzes the user's emotions and makes adjustments, such as simplifying the display if the user is stressed and broadening the range of information if the user is relaxed.

[0809] Step 5:

[0810] The server optimizes search results based on sentiment before sending them to the user's device. The input is the sentiment-based ranked search results, and the output is the information displayed on the user's device. The user interface presents information in a user-friendly way, enabling flexible information delivery tailored to user needs.

[0811] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0812] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0813] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0814] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0815] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0816] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0817] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0818] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0819] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0820] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0821] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0822] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0823] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0824] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0825] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0826] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0827] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0828] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0829] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0830] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0831] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0832] The following is further disclosed regarding the embodiments described above.

[0833] (Claim 1)

[0834] A means for automatically detecting updates to construction instructions and analyzing the updated information,

[0835] A means of registering the analyzed information in a database and performing normalization,

[0836] A means of searching a database based on a query entered by the user and ranking the relevant information,

[0837] Methods for formatting search results to present them to users,

[0838] A system that includes this.

[0839] (Claim 2)

[0840] The system according to claim 1, which has a user interface for displaying information on a terminal that receives search results, and organizes and presents the information based on its importance.

[0841] (Claim 3)

[0842] The system according to claim 1, further comprising a process of removing duplicates and normalizing information in a database in order to prevent inaccurate data references in the database.

[0843] "Example 1"

[0844] (Claim 1)

[0845] A means for automatically detecting update information and analyzing documents using natural language processing technology,

[0846] A means for registering the analyzed data in a database and performing data normalization and deduplication,

[0847] A means of searching a database based on user-input queries, evaluating relevance, and ranking the information,

[0848] A means of formatting search results into a user-friendly format on the receiving device,

[0849] A system that includes this.

[0850] (Claim 2)

[0851] The system according to claim 1, wherein the receiving terminal has a visual user interface for displaying information and organizes the presented information based on its importance.

[0852] (Claim 3)

[0853] The system according to claim 1, comprising a process of eliminating and normalizing data in order to prevent inaccurate references of information within the database.

[0854] "Application Example 1"

[0855] (Claim 1)

[0856] A means to automatically detect updates to construction instructions and inventory information, and to analyze the updated information,

[0857] A means of registering the analyzed information in a database and performing normalization,

[0858] A means of searching a database based on a query entered by the user and ranking the relevant information,

[0859] A means of formatting information for display on smart devices and presenting it to the user,

[0860] A system that includes this.

[0861] (Claim 2)

[0862] The system according to claim 1, which has a user interface for displaying information on a terminal that receives search results, and organizes and presents logistics-related information based on importance.

[0863] (Claim 3)

[0864] The system according to claim 1, further comprising a process of removing duplicates and normalizing information in a database in order to prevent inaccurate data references in the database.

[0865] "Example 2 of combining an emotion engine"

[0866] (Claim 1)

[0867] A means for automatically detecting updates to construction instructions and analyzing the updated information,

[0868] A means for registering the analyzed information in a data storage device and performing normalization,

[0869] A means for searching for data storage devices based on a query entered by the client and ranking relevant information,

[0870] A method for formatting the search results to present them to the client,

[0871] A sentiment analysis tool that recognizes the client's state and optimizes the presentation of search results,

[0872] A system that includes this.

[0873] (Claim 2)

[0874] The system according to claim 1, wherein the display terminal that receives the search results has a user interface for displaying the information, organizes the information based on importance, and presents it based on the client's status.

[0875] (Claim 3)

[0876] The system according to claim 1, further comprising a process of removing duplicates and normalizing information within a data storage device in order to prevent inaccurate data referencing of the data storage device.

[0877] "Application example 2 when combining with an emotional engine"

[0878] (Claim 1)

[0879] A means for automatically detecting updates to construction instructions and analyzing the updated information,

[0880] A means of registering the analyzed information in a database and performing normalization,

[0881] A means of searching a database based on a query entered by the user and ranking the relevant information,

[0882] A means for analyzing the user's emotional state using emotion recognition functionality and adjusting the ranking of search results based on the results,

[0883] A method for formatting search results to adjust and present them according to the user's emotions,

[0884] A system that includes this.

[0885] (Claim 2)

[0886] The system according to claim 1, wherein the terminal that receives the search results has a user interface for displaying the information, and organizes and presents the information based on the user's emotional state.

[0887] (Claim 3)

[0888] The system according to claim 1, which includes a process of removing duplicates and normalizing information in a database to prevent inaccurate data references in the database, and optimizes the display of information using user sentiment data. [Explanation of Symbols]

[0889] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for automatically detecting updates to construction instructions and analyzing the updated information, A means of registering the analyzed information in a database and performing normalization, A means of searching a database based on a query entered by the user and ranking the relevant information, Methods for formatting search results to present them to users, A system that includes this.

2. The system according to claim 1, wherein the terminal that receives the search results has a user interface for displaying the information, and organizes and presents the information based on its importance.

3. The system according to claim 1, further comprising a process of removing duplicates and normalizing information in a database in order to prevent inaccurate data references in the database.

Images