System

Abstract

A system is provided.SOLUTION: A system comprising means for a user to upload a digital file to the system, means for interactively asking the user for metadata input for the uploaded file, means for temporarily storing the metadata and sending it to cloud storage, means for analyzing file content using a natural language processing engine to generate additional metadata, and means for identifying and recommending relevant files based on the user's past behavior history.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional file management systems have a problem in that businesspeople spend a lot of time searching for files in their daily work. This is a problem that needs to be solved. The time it takes to search for files reduces work efficiency and increases stress at work, as it disrupts concentration while working. This leads to reduced productivity and a stressful environment, negatively impacting individual work performance. [Means for solving the problem]

[0005] In order to solve the above problems, the present invention provides an advanced file management system using AI. The system includes the following means.

[0006] 1. Provide a means for users to upload digital files to the system and interactively prompt users to enter metadata for the uploaded files.

[0007] 2. Provide a means to temporarily store and send metadata to cloud storage.

[0008] 3. Includes means for analyzing file content and generating additional metadata using a natural language processing engine.

[0009] 4. Provide a means to identify and recommend related files based on the user's past behavioral history.

[0010] This allows users to instantly find the files they need, significantly reducing the time spent searching for files and minimizing distractions, resulting in an efficient and stress-free work environment. The system also improves the overall file management experience by suggesting related files based on the search query entered by the user and including a means to display a recommended file list.

[0011] "User" refers to a person who accesses the system and uploads or retrieves files.

[0012] "Digital files" refer to data files handled on a computer, including documents, images, videos, and audio files.

[0013] "System" refers to a mechanism consisting of multiple hardware and software components that provides functions such as file upload, metadata management, search, and recommendations.

[0014] "Metadata" means additional information associated with a file, such as its content, purpose, audience, keywords, etc.

[0015] A "natural language processing engine" refers to algorithms and technologies that understand, analyze, and generate human language, analyzing file content and generating metadata.

[0016] "Cloud storage" refers to an online storage service that allows you to store and access files and data over the Internet.

[0017] "Behavioral history" refers to the operation records and usage history when a user uses the system.

[0018] "Dialogue" refers to an interactive communication method between the system and the user, in which information is collected through questions and answers.

[0019] "Recommendation" refers to suggesting highly relevant files and information based on a user's behavioral history and metadata.

[0020] A "search query" refers to a keyword or phrase that a user enters into a system to search for specific information. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0022] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0023] First, the terms used in the following description will be explained.

[0024] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0025] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0026] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0027] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0028] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0029] [First embodiment]

[0030] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0031] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0032] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0033] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0034] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0035] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0036] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0037] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0038] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0039] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0040] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0041] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0042] The AI ​​file management system of the present invention has various functions designed to enable users to efficiently manage and quickly search for files. The system begins with a process in which a user uploads a file and enters metadata, after which the AI ​​automatically completes the metadata and recommends related files. Specific embodiments of the system are described in detail below.

[0043] User Interface

[0044] 1. A user logs into the system.

[0045] Example: A user accesses a cloud-based file management system and logs in by entering their account information.

[0046] 2. The terminal displays the file upload screen to the logged-in user.

[0047] Example: The user clicks the "Upload" button and selects "Report2023.docx" from the local disk.

[0048] Metadata Input

[0049] 3. The device confirms the file upload and interactively prompts the user to enter metadata.

[0050] Example: The terminal displays "Please briefly describe the contents of this file," and the user types "Sales Report 2023."

[0051] 4. The user enters metadata such as the file's content, audience, and keywords.

[0052] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[0053] Sending and completing metadata

[0054] 5. The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[0055] Example: The device temporarily saves "Report2023.docx" and its metadata.

[0056] 6. The server stores the received files and metadata in cloud storage and uses a natural language processing engine to complete any missing metadata.

[0057] Example: The server analyzes the content of "Sales Report 2023" and adds metadata about "Annual Report," "Sales," and "Finance."

[0058] Activity history and related file recommendations

[0059] 7. The server identifies related files based on the user's past behavior history and recommends them to the user.

[0060] Example: The server recommends "Sales Report 2022.pdf" based on the user's search history for "Sales Report."

[0061] File search and presentation

[0062] 8. When a user searches for a specific file, they enter a search query.

[0063] Example: A user types, "Find the sales report file for management."

[0064] 9. The server analyzes the search query and presents the most suitable files based on relevant metadata and past behavior.

[0065] Example: The server presents "Report 2023.docx" and "2022 Sales Report.pdf" in order of relevance.

[0066] 10. The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0067] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[0068] In this way, the specific operations at each step provide an environment in which users can efficiently manage and search for files. The system of the present invention realizes automation and efficiency of file management, and can improve business productivity, making it extremely useful for users.

[0069] The processing flow will be explained below.

[0070] Step 1:

[0071] A user logs into the system, selects a file, and uploads it.

[0072] Example: A user accesses the system homepage, enters their account information, and logs in. Then, they click the "Upload" button, select "Report 2023.docx" from their local disk, and begin uploading.

[0073] Step 2:

[0074] The device confirms the file upload and interactively prompts the user to enter metadata.

[0075] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[0076] Step 3:

[0077] The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[0078] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[0079] Step 4:

[0080] The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[0081] Example: The device temporarily saves "Report2023.docx" and its metadata.

[0082] Step 5:

[0083] The server stores the files and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[0084] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[0085] Step 6:

[0086] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history.

[0087] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[0088] Step 7:

[0089] When a user searches for a particular file on the system, they enter a search query.

[0090] Example: A user types "Find management's sales report file" into a search box.

[0091] Step 8:

[0092] The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[0093] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[0094] Step 9:

[0095] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0096] Example: The device displays a file list, and the user clicks on "Report 2023.docx" to open it.

[0097] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency.

[0098] Example 1

[0099] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0100] Conventional file management systems require users to manually manage large volumes of files, resulting in inefficient file uploads, metadata entry, and related file searches, which reduces work productivity. Furthermore, it is difficult for users to quickly find specific files, preventing them from efficiently using related information.

[0101] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0102] In this invention, the server includes means for a user to upload digital files to the system, means for interactively prompting the user to input metadata for the uploaded files, means for temporarily saving the metadata and sending it to cloud storage, means for analyzing file content using a natural language processing device and generating additional metadata, means for identifying and recommending related files based on the user's past behavior history, means for a user to input a search query when searching for a specific file, means for presenting related files based on the search query and metadata, and means for displaying a list of recommended files to the user, thereby enabling users to efficiently manage their files and quickly search for and obtain required files.

[0103] "User" means any person or entity that accesses and operates the System.

[0104] "Digital file" refers to any type of data file used on a computer.

[0105] "System" is a general term for the series of hardware and software that constitute the AI ​​file management system of the present invention.

[0106] "Upload" refers to the act of transferring a file from a local device to cloud storage or a server.

[0107] "Interactive" refers to a method in which a user and a system communicate interactively, exchanging information through questions and answers.

[0108] "Metadata" refers to data that describes information about a digital file, including the file's content, audience, keywords, etc.

[0109] "Temporarily storing" refers to the operation of temporarily holding files or data in memory or storage.

[0110] "Cloud storage" refers to online storage services accessible via the Internet.

[0111] "Natural language processing device" refers to software or hardware for understanding and analyzing natural language.

[0112] "Additional metadata" refers to complementary information that is added to the original metadata.

[0113] "Behavioral history" refers to historical information such as the operations and search queries a user performs within the system.

[0114] "Related files" refer to files that are relevant to a user based on specified metadata and behavioral history.

[0115] A "search query" refers to a string or phrase that a user enters to search for specific information.

[0116] "Presenting" refers to the operation of displaying files or information to the user as search results.

[0117] "Recommended file list" refers to a list of highly relevant files that the system suggests to the user.

[0118] The AI ​​file management system of the present invention includes a series of processes and functions designed to enable users to efficiently manage and quickly search for files. The system begins with a process in which a user uploads a digital file and inputs related metadata, and then uses a natural language processing device to complement the metadata and recommend related files.

[0119] User Interface

[0120] When a user logs in to the system, they open a browser, enter the URL of the cloud-based file management system, and enter their user ID and password. After successful login, the device will display a file upload screen for the user. The user can click the "Upload" button on this screen to select and upload files from their local disk.

[0121] Metadata Input

[0122] For uploaded files, the device interactively prompts the user to enter metadata. For example, a prompt may appear saying, "Please briefly describe the contents of this file." The user then enters specific details. In addition, the user may enter additional metadata such as the file's content, target audience, and keywords.

[0123] Sending and completing metadata

[0124] Once the metadata is entered, the device temporarily stores it and prepares it for transmission to cloud storage. The transmitted file and metadata are then stored in cloud storage by the server. The server then uses a natural language processing system to analyze the file content and automatically complete any missing metadata. Specifically, the server analyzes the content of "2023 sales report" and adds metadata such as "annual report," "sales," and "finance."

[0125] Activity history and related file recommendations

[0126] Furthermore, the server identifies related files based on the user's past behavior history and recommends them to the user. For example, the server recommends "Sales Report 2022.pdf" based on the user's search history for "Sales Report."

[0127] File search and presentation

[0128] When a user searches for a specific file, they enter a search query, such as "Find sales report files for management," into the search bar. The server analyzes this search query and suggests the most suitable files based on associated metadata and past activity. The suggested file list is then displayed to the user on their device, allowing them to instantly find the file they are looking for.

[0129] Examples of prompt statements

[0130] Here are some example prompts to input to a generative AI model:

[0131] "Please explain the process of how a user logs into a file management system, uploads a file, and enters metadata. The system then automatically completes the metadata and recommends related files to the user."

[0132] By using this prompt, the generative AI model can be made to describe the system's sequence of operations in natural language.

[0133] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0134] Step 1:

[0135] A user logs in to the system.

[0136] Specific operation: Open a browser, enter the URL of the cloud-based file management system, and the login screen will appear. Enter your user ID and password and click the "Login" button.

[0137] Input: User ID, Password

[0138] Output: The user is logged in.

[0139] Step 2:

[0140] The terminal displays a file upload screen to the logged-in user.

[0141] What happens: User navigates to the dashboard and sees the "File Upload" section. User clicks the "Upload" button, which opens a file selection dialog. User selects a file from their local disk and clicks "Open".

[0142] Input: User clicks, selected files

[0143] Output: The path of the file to be uploaded

[0144] Step 3:

[0145] For uploaded files, the terminal interactively prompts the user to input metadata.

[0146] What it does: Once the file upload is confirmed, the device will prompt you to "Please briefly describe the contents of this file."

[0147] Input: Uploaded file path, user answer

[0148] Output: Initial metadata entered by the user

[0149] Step 4:

[0150] The user enters metadata such as the file's content, target audience, and keywords.

[0151] Specific operation: The user enters information such as the file content, target audience, and keywords into the text box and clicks the "Save" button.

[0152] Input: User-entered metadata (e.g., file content, audience, keywords)

[0153] Output: Metadata input completion signal

[0154] Step 5:

[0155] The device temporarily stores the entered metadata and prepares it for transmission to cloud storage.

[0156] Specific operation: The device temporarily stores metadata and file information in local memory and formats the data for sending to cloud storage.

[0157] Input: Entered metadata, uploaded file path

[0158] Output: Temporarily saved metadata and file information

[0159] Step 6:

[0160] The server stores the received files and metadata in cloud storage and uses a natural language processing device to complete any missing metadata.

[0161] How it works: The server stores files and metadata in cloud storage, analyzes the files using a natural language processing system, and automatically generates missing metadata based on the analysis results and adds it to the original metadata.

[0162] Input: File, initial metadata

[0163] Output: Completed metadata

[0164] Step 7:

[0165] The server identifies related files based on the user's past behavior history and recommends them to the user.

[0166] How it works: The server analyzes the user's past search history and access logs to identify relevant files, and then recommends the most suitable files to the user.

[0167] Input: User behavior history

[0168] Output: Recommended file list

[0169] Step 8:

[0170] When a user searches for a particular file, they enter a search query.

[0171] What happens: Enter a query in the search bar and click the "Search" button.

[0172] Input: Search query

[0173] Output: Search request based on the search query

[0174] Step 9:

[0175] The server analyzes the search query and presents the most suitable files based on associated metadata and past behavior.

[0176] What it does: It uses a natural language processor to analyze your search query, match it with relevant metadata and historical behavior, score the best files, and sort them by relevance.

[0177] Input: Search query, metadata, behavioral history

[0178] Output: Related file list

[0179] Step 10:

[0180] The terminal displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0181] Specific operation: The device displays a list of search results, and the user clicks on the desired file to open it.

[0182] Input: Related file list

[0183] Output: Displayed file list and selected file

[0184] (Application example 1)

[0185] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0186] In conventional logistics centers, file management has been challenging due to the difficulty of efficiently and quickly handling large volumes of digital documents and reports. Searching for files and recommending related files takes time, reducing work efficiency. Manually entering metadata often requires time and introduces errors, further reducing efficiency. To solve these issues, a file management system using AI is needed.

[0187] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0188] In this invention, the server includes: a means for a user to upload digital files to the system; a means for interactively prompting the user to input metadata for the uploaded files; a means for temporarily storing the metadata and sending it to cloud storage; a means for analyzing file content using a natural language processing engine and generating additional metadata; a means for identifying and recommending related files based on the user's past behavioral history; a means for automatically completing missing metadata using a generative AI model; a means for managing files and their metadata on the cloud and recommending highly similar files; and a means for uploading and searching files using a smartphone. This enables efficient and rapid management and search of large volumes of digital documents and reports at logistics centers.

[0189] "User" means a person who accesses the system to upload and retrieve digital files.

[0190] A "digital file" is a digital data file, such as a document, image, or audio file, that is handled on a computer.

[0191] A "system" is a collection of hardware and software designed to enable users to efficiently manage and retrieve digital files.

[0192] "Uploading" refers to the act of a user sending and saving a digital file from their own device to a server.

[0193] "Dialogue format" refers to a method in which the system asks the user to input information in the form of questions.

[0194] "Metadata" refers to auxiliary information such as the file's content, target audience, keywords, etc.

[0195] "Storage" refers to the act of a system temporarily or permanently storing input data or files in a storage device.

[0196] "Cloud storage" refers to remote servers that store and share data over the internet.

[0197] A "natural language processing engine" is an artificial intelligence technology for analyzing and understanding human language.

[0198] "Analysis" is the process by which a system examines the contents of data and finds the information it needs.

[0199] "Additional metadata" refers to supplemental information automatically generated by a natural language processing engine.

[0200] "Behavioral history" refers to the operations and search records performed by a user on the system.

[0201] "Recommendation" means that the system presents highly relevant files based on the user's behavioral history, etc.

[0202] A "generative AI model" is a machine learning algorithm used to generate data or fill in missing information.

[0203] "Similarity" is an index that indicates the degree of similarity between different data or objects.

[0204] A "smartphone" is a portable information terminal that can connect to the Internet and run applications.

[0205] The present invention is a system for efficiently managing and searching large volumes of digital documents and reports in a logistics center. This system consists of the following main components:

[0206] System Configuration

[0207] 1. Device:

[0208] The terminals are smartphones used by employees at the logistics center, which they use to upload and retrieve files.

[0209] 2. Server:

[0210] The server is equipped with cloud storage, a natural language processing engine, and a generative AI model that automatically analyzes file content, completes metadata, and recommends related files.

[0211] Program processing

[0212] 1. Uploading files via terminal:

[0213] Users upload files to the system using their smartphones. For example, if an employee wants to upload an annual sales report, they select the file from their local disk and send it to the server through a dedicated app.

[0214] 2. Metadata entry support:

[0215] The device interactively prompts the user to enter metadata for the uploaded file. For example, the device prompts the user to "Please briefly describe the contents of this file," and the user enters "Annual Sales Report."

[0216] 3. Metadata Completion:

[0217] The server uses a generative AI model based on the input metadata to fill in any missing metadata. The generative AI model used here could be OpenAI's GPT-3 (registered trademark). For example, from the file description "Sales Report by Year," the AI ​​could automatically add metadata such as "Financial Report," "2023," and "Annual Sales."

[0218] 4. Save to cloud storage:

[0219] The file is then stored together with the completed metadata in cloud storage, such as Amazon S3 or Google Cloud Storage.

[0220] 5. Related file recommendations:

[0221] The server identifies and recommends related files based on the user's past behavior. For example, if a user has searched for sales reports, the server may recommend files such as "previous year's sales report."

[0222] 6. File search function:

[0223] When a user searches for a specific file, they enter a search query into their device. The server analyzes the search query and metadata and automatically presents highly relevant files. For example, by entering "Search for sales report files for management," a list of appropriate files will be displayed.

[0224] Examples of concrete examples and prompts

[0225] For example, suppose a logistics center manager uploads an annual report and describes it as a "sales report by year." The server automatically generates additional metadata such as "financial report," "year 2023," and "annual sales."

[0226] An example prompt is:

[0227] "Please briefly describe the contents of the file: Annual sales report"

[0228] This enables logistics centers to efficiently and quickly manage and search large volumes of digital documents and reports.

[0229] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0230] Step 1:

[0231] A user uses a smartphone to select a digital file and upload it to the system.

[0232] Input: A digital file selected by the user (e.g., annual sales report).

[0233] Specific operation: The user opens the app on their smartphone, clicks the "File Upload" button, and selects "Annual Sales Report.docx" from their local disk.

[0234] Output: The digital file that is sent to the server.

[0235] Step 2:

[0236] The terminal interactively prompts the user to input metadata for the uploaded file.

[0237] Input: Uploaded digital files.

[0238] Specific operation: The terminal displays the prompt "Please briefly describe the contents of this file," and the user enters "Annual sales report."

[0239] Output: User-entered metadata.

[0240] Step 3:

[0241] The device temporarily stores the entered metadata and sends it to cloud storage.

[0242] Input: User-entered metadata and uploaded digital files.

[0243] Specific operation: The device temporarily stores the "Annual Sales Report" and its metadata and sends it to cloud storage.

[0244] Output: Digital files and metadata stored in cloud storage.

[0245] Step 4:

[0246] The server uses a natural language processing engine to analyze the file content and generate additional metadata.

[0247] Input: Files and metadata stored in cloud storage.

[0248] How it works: The server uses a generative AI model (e.g., OpenAI® GPT-3) to automatically generate additional metadata such as "Financial Report," "2023," and "Annual Revenue" from the description "Sales Report by Year."

[0249] Output: Digital files with additional metadata.

[0250] Step 5:

[0251] The server identifies and recommends related files based on the user's past behavioral history.

[0252] Input: A digital file with a user's past behavior and additional metadata.

[0253] What it does: The server analyzes the user's search history and identifies related files, such as "last year's sales report."

[0254] Output: A list of recommended related files.

[0255] Step 6:

[0256] When a user searches for a particular file, they enter a search query into their device.

[0257] Input: The search query entered by the user (e.g., "Find sales report files for management").

[0258] What happens: A user types a query into the search bar on their smartphone.

[0259] Output: The search query is sent to the server.

[0260] Step 7:

[0261] The server analyzes the search query and metadata and automatically presents highly relevant files.

[0262] Input: Search query and file metadata.

[0263] How it works: The server uses a natural language processing engine to analyze the search query and lists "Report 2023.docx" and "Last year's sales report" in order of relevance.

[0264] Output: A list of highly relevant files.

[0265] Step 8:

[0266] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0267] Input: A list of highly relevant files.

[0268] Specific operation: The terminal displays a file list to the user, and the user clicks "Annual Sales Report.docx" from the list to open it.

[0269] Output: The file list and selected files as displayed to the user.

[0270] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0271] The AI ​​file management system of the present invention has various functions designed to enable users to efficiently manage and quickly search files. The system combines a metadata input function, a natural language processing engine, and an emotion engine to significantly improve the user experience. A detailed description of specific embodiments of the present invention is provided below.

[0272] User Interface

[0273] 1. A user logs into the system.

[0274] Example: A user accesses a cloud-based file management system and logs in by entering their account information.

[0275] 2. The terminal displays the file upload screen to the logged-in user.

[0276] Example: The user clicks the "Upload" button and selects "Report2023.docx" from the local disk.

[0277] Metadata Input

[0278] 3. The device confirms the file upload and interactively prompts the user to enter metadata.

[0279] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[0280] 4. The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[0281] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[0282] Sending and completing metadata

[0283] 5. The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[0284] Example: The device temporarily saves "Report2023.docx" and its metadata.

[0285] 6. The server stores the file and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[0286] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[0287] Activity history and related file recommendations

[0288] 7. The server-generated metadata is integrated with existing metadata to identify related files based on user behavior history.

[0289] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[0290] Implementing the Emotion Engine

[0291] 8. The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes that information.

[0292] Example: While a user is accessing the system, a camera analyzes facial expressions and a microphone analyzes the tone of voice.

[0293] 9. The server customizes the files and information it recommends based on the emotional state of the user based on the analysis results of the emotion engine.

[0294] Example: If the server detects that the user is feeling stressed, it will recommend "relaxation techniques" or "simple task guides."

[0295] 10. The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine, providing feedback according to the user's emotions.

[0296] Example: If the user is excited, the system changes the color to a calmer one and displays user guidance and tips.

[0297] File search and presentation

[0298] 11. When a user searches for a specific file, they enter a search query.

[0299] Example: A user types "Find management's sales report file" into a search box.

[0300] 12. The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[0301] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[0302] 13. The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0303] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[0304] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency. Furthermore, the implementation of an emotion engine enables flexible responses according to the user's emotional state, further improving the user experience.

[0305] The processing flow will be explained below.

[0306] Step 1:

[0307] A user logs into the system, selects a file, and uploads it.

[0308] Example: A user accesses a cloud-based file management system, enters their account information, logs in, clicks the "Upload" button, selects "Report 2023.docx" from their local disk, and begins uploading.

[0309] Step 2:

[0310] The device confirms the file upload and interactively prompts the user to enter metadata.

[0311] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[0312] Step 3:

[0313] The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[0314] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[0315] Step 4:

[0316] The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[0317] Example: The device temporarily saves "Report2023.docx" and its metadata.

[0318] Step 5:

[0319] The server stores the files and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[0320] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[0321] Step 6:

[0322] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history.

[0323] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[0324] Step 7:

[0325] The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes that information.

[0326] Example: While a user is accessing the system, the camera analyzes their facial expressions and the microphone analyzes their tone of voice. The emotion engine uses this data to analyze whether the user is feeling stressed.

[0327] Step 8:

[0328] The server customizes recommended files and information according to the user's emotional state based on the analysis results of the emotion engine.

[0329] Example: If the server detects that the user is feeling stressed, it will recommend "relaxation techniques" or "simple task guides."

[0330] Step 9:

[0331] The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine, and provides feedback according to the user's emotions.

[0332] Example: If the user is agitated, the server changes the interface color to a calmer one and displays user guides and tips.

[0333] Step 10:

[0334] When a user searches for a particular file, they enter a search query.

[0335] Example: A user types "Find management's sales report file" into a search box.

[0336] Step 11:

[0337] The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[0338] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[0339] Step 12:

[0340] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0341] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[0342] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency.In addition, the implementation of an emotion engine enables flexible response according to the user's emotional state, further improving the user experience.

[0343] Example 2

[0344] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0345] Existing file management systems often require manual file search and management, resulting in inefficiencies. Additionally, they lack the ability to respond flexibly to the user's emotional state, preventing an improved user experience.

[0346] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for collecting image and audio information to recognize the user's emotions and analyzing it using an emotion engine, means for dynamically changing the user interface based on the analysis results of the emotion engine and recommending files and information according to the user's emotions, and means for analyzing file contents using a natural language processing engine and generating additional metadata. This allows the user to efficiently search and manage files and flexibly respond to their emotional state.

[0347] A "digital file" is a means of storing and representing data or information in electronic form for use by computers and other electronic devices.

[0348] A "system" is a mechanism in which multiple pieces of hardware and software work together to achieve a specific function.

[0349] A "user" is a user of this system who uploads digital files and inputs metadata.

[0350] The "interactive format" is an interface that emphasizes communication with the user and allows operations to proceed while sequentially exchanging information.

[0351] "Metadata" is data that provides additional information about a digital file, such as its content, audience, keywords, etc.

[0352] "Temporary storage" is the act of storing data for a short period of time and then preparing it for further processing.

[0353] "Cloud storage" is a data storage service available over the Internet.

[0354] A "natural language processing engine" is a program that allows a computer to analyze and understand human language.

[0355] "Additional metadata" is metadata that is newly generated based on the analysis results of the natural language processing engine.

[0356] "Behavioral history" is a record of the operations and searches performed by a user within the system.

[0357] "Related files" are other files that are related to the current operation or search.

[0358] "Recommendation" means that the system presents specific files or information to the user based on the user's behavioral history and metadata.

[0359] An "emotion engine" is a program that analyzes the user's emotional state and responds based on that.

[0360] A "user interface" refers to the screen and operation method used by the user to exchange information with the system.

[0361] The AI ​​file management system of the present invention has various functions to enable users to efficiently manage and quickly search digital files. The system combines a metadata input function, a natural language processing engine, and an emotion engine to significantly improve the user experience.

[0362] Specifically, the system operates as follows.

[0363] User Interface

[0364] A user accesses a cloud-based file management system and enters their account information to log in. After logging in, the device displays a file upload screen for the user. For example, the user clicks the "Upload" button and selects "Report 2023.docx" from their local disk.

[0365] Metadata Input

[0366] The device confirms the file upload and interactively prompts the user to enter metadata. For example, it might prompt the user to "Please briefly describe the contents of this file," and the user might enter "Sales report for 2023." The user might also enter additional information, such as audience and keywords. For example, the user might enter "Audience: Management" and "Keywords: Sales, 2023, Report."

[0367] Sending and completing metadata

[0368] The device temporarily stores the entered metadata and prepares it for transmission to cloud storage. Next, the server stores the file and metadata in cloud storage and uses a natural language processing engine (e.g., natural language processing API) to analyze the file content and generate additional metadata. For example, metadata related to "annual report," "sales," and "finance" can be automatically generated based on the content analysis of "2023 sales report."

[0369] Activity history and related file recommendations

[0370] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history. For example, based on the user's past search history for "sales report," the system identifies "2022 sales report.pdf" and "Q2 sales analysis.xlsx" as related files.

[0371] Implementing the Emotion Engine

[0372] The device uses the camera and microphone to recognize the user's emotions, and the emotion engine (e.g., emotion analysis API) analyzes that information. For example, while the user is accessing the system, the camera analyzes facial expressions and the microphone analyzes the tone of voice. The server customizes the files and information it recommends according to the user's emotional state based on the emotion engine's analysis results. For example, if the user is recognized as feeling stressed, the server will recommend "relaxation methods" or "simple task guides."

[0373] File search and presentation

[0374] When a user searches for a specific file, they enter a search query. For example, they might type "Find a sales report file for management" into the search box. The server analyzes the received search query and suggests the most suitable files based on associated metadata and the user's behavioral history. For example, it might suggest "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance. The device then displays a list of recommended files to the user, allowing them to instantly find the file they are looking for. For example, the user might click "Report 2023.docx" from the suggested file list to open it.

[0375] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency. Furthermore, the implementation of an emotion engine enables flexible responses according to the user's emotional state, further improving the user experience.

[0376] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0377] Step 1:

[0378] A user accesses a cloud-based file management system and logs in by entering their account information on the login screen. At this time, a username and password are entered, which the system receives as authentication information. The system compares the entered information with the database, and if authentication is successful, the user moves to the next screen. The output is the authentication result, and if successful, the file upload screen is displayed.

[0379] Step 2:

[0380] After the terminal logs in, it displays a file upload screen to the user. The user clicks the "Upload" button and selects a file (e.g., "Report 2023.docx") from the local disk. The input is the path of the file selected by the user, and the terminal receives this and starts uploading the file. The output is the temporary storage location of the selected file.

[0381] Step 3:

[0382] The terminal confirms the file upload and interactively prompts the user to enter metadata. The input is confirmation of the existence of the uploaded file and a prompt to the user to enter metadata, with the message "Please briefly describe the contents of this file." The user enters "Sales report for 2023." The output is the entered metadata.

[0383] Step 4:

[0384] The user follows interactive prompts to input metadata such as the file contents, target audience, and keywords. The input is specific information such as "target audience: management" and "keywords: sales, 2023, report," and the terminal receives this information. The output is this metadata information.

[0385] Step 5:

[0386] The device temporarily stores the input metadata and prepares it for sending to cloud storage. The input is the file and metadata to be saved, which the device temporarily saves in local storage. The output is the file and metadata ready to be sent to cloud storage.

[0387] Step 6:

[0388] The server stores the files and metadata in cloud storage, analyzes the file contents using a natural language processing engine, and generates additional metadata. The input is the files stored in cloud storage and the initial metadata, and the server performs analysis based on this. The output is additional metadata (e.g., "Annual Report," "Sales," "Finance") generated based on the analysis results.

[0389] Step 7:

[0390] The server merges the generated metadata with existing metadata and identifies related files based on the user's behavioral history. The input is new and existing metadata and the user's behavioral history, and the server uses this to identify related files (e.g., "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx"). The output is a list of identified related files.

[0391] Step 8:

[0392] The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes the information. The input is the user's facial expression data and tone of voice, and the device sends this information to the emotion engine. The output is the analyzed emotional state.

[0393] Step 9:

[0394] The server customizes the files and information it recommends based on the user's emotional state, based on the analysis results of the emotion engine. The input is the analysis results of the emotion engine, and the server selects recommended information (e.g., "How to relax" or "Simple task guide") based on this. The output is customized recommended information.

[0395] Step 10:

[0396] The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine and provides feedback according to the user's emotions. The input is the analysis results of the emotion engine and the current interface information, and the server optimizes the user interface to suit the user's emotions. The output is a dynamically changed interface.

[0397] Step 11:

[0398] When a user searches for a specific file, they enter a search query. The input is the keywords entered into the search box, say the user types "Find sales report files for management." The output is the search query.

[0399] Step 12:

[0400] The server analyzes the received search query and presents the most appropriate files based on the associated metadata and user behavior history. The input is the search query, associated metadata, and behavior history, and the server generates search results (e.g., "Report 2023.docx," "2022 Sales Report.pdf," "Q2 Sales Analysis.xlsx") based on this. The output is the presented search results.

[0401] Step 13:

[0402] The terminal displays a recommended file list to the user, allowing the user to instantly find the file they are looking for. The input is a file list sent from the server, which the terminal displays to the user. The output is a file list for the user to access.

[0403] The above are the specific processing steps of the program of this system.

[0404] (Application example 2)

[0405] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0406] Efficient management and search of operation manuals and various documents is important on factory floors. However, manual metadata entry and file search are laborious and time-consuming, reducing efficiency. Furthermore, appropriate support based on the emotional state of workers is often not provided, leading to stress and errors. A system that can solve these problems and improve work efficiency and user experience is needed.

[0407] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to upload digital files to the system; means for interactively prompting the user to input metadata for the uploaded files; means for temporarily saving the metadata and sending it to cloud storage; means for analyzing file content using a natural language processing engine and generating additional metadata; means for identifying and recommending related files based on the user's past behavioral history; means for using a camera or microphone to recognize the user's emotions and analyzing the information with an emotion engine; and means for customizing recommended files and information according to the user's emotional state based on the analysis results of the emotion engine. This enables efficient file management and search, and further improves work efficiency and user experience by providing appropriate support according to the user's emotions.

[0408] "User" refers to any individual or entity that uses the System.

[0409] "Digital file" refers to a data file, such as a document, image, audio, or video, stored in electronic form.

[0410] "Uploading" refers to the act of transferring data from your local environment to the cloud or another system.

[0411] "System" refers to a collection of hardware and software configured to achieve a specific function or purpose.

[0412] "Metadata" refers to auxiliary information that describes the content and characteristics of data.

[0413] "Interactive" refers to an interface in which the user and the system interact continuously.

[0414] "Storage" refers to the act of retaining data.

[0415] "Cloud storage" refers to a service that stores data on remote servers available over the Internet.

[0416] A "natural language processing engine" refers to an algorithm or program that analyzes and understands text written in natural language.

[0417] "Associated Files" refers to data or documents related to a particular file.

[0418] An "emotion engine" refers to a module that analyzes the user's emotions and uses the results to adjust the system's behavior.

[0419] "Customization" refers to the act of adjusting or modifying a system or service to suit the needs or circumstances of a particular user.

[0420] "Camera" refers to a device that captures and records images.

[0421] "Microphone" refers to a device for capturing sound.

[0422] "Analysis" refers to the act of breaking down and interpreting data and information to extract meaning and patterns.

[0423] "Behavioral history" refers to the record of operations and searches performed by a user using the system.

[0424] "Recommendation" refers to the act of presenting useful or highly relevant information or files to a user.

[0425] This invention is a system for efficiently managing and searching operation manuals and related documents on factory floors. The invention aims to improve work efficiency and user experience, particularly through an interface using smart glasses.

[0426] Hardware and Software Configuration

[0427] Hardware

[0428] Smart glasses: A device worn by the user to display information and perform voice interaction.

[0429] Camera: Built into the smart glasses and used to capture the user's facial expressions.

[0430] Microphone: Built into the smart glasses and used to capture the user's voice.

[0431] Server: A remote computing resource located in the cloud for data storage and analysis.

[0432] software

[0433] Natural language processing engine: Algorithms for analyzing user-entered metadata and search queries, for example, using the Python transformers library.

[0434] Emotion Engine: A module that analyzes the user's emotions and adjusts the system's behavior based on that information. It uses the OpenCV library.

[0435] Cloud storage service: A service that stores and manages files and metadata, such as AWS (registered trademark) S3.

[0436] System Operation

[0437] User Operation

[0438] A user puts on the smart glasses and logs in to the system. After logging in, a file upload screen is displayed on the smart glasses, allowing the user to upload operation manuals and various documents. For the uploaded files, the smart glasses interactively prompt the user to enter metadata.

[0439] For example, when a user uploads "Operation Manual for New Robot 2023," the smart glasses will prompt the user, "Please briefly explain the contents of this file," to which the user can respond verbally, "Operation Manual for New Robot 2023."

[0440] Natural Language Processing and Sentiment Analysis

[0441] The server temporarily stores the metadata sent by the user and sends it to cloud storage. Using a natural language processing engine, the server analyzes the file content and generates additional metadata. The emotion engine also analyzes the user's facial expressions and tone of voice captured by the camera and microphone to recognize their emotional state.

[0442] For example, if the user is recognized as feeling stressed, the server can recommend a "quick operation guide" or a "document on how to relax" in the "related files" section.

[0443] File Management and Search

[0444] When a user enters a search query, the server analyzes the received search query and presents related files based on past behavioral history and metadata. For example, if a user voice-inputs "operation guide for new robot," the server will present "operation manual for new robot 2023.pdf" and "assembly procedure for new robot.xlsx."

[0445] Examples of concrete examples and prompts

[0446] Here are some examples of prompts for generative AI models:

[0447] "This operating manual is a guide to the new 2023 robot model. Key keywords: robot, operating guide, new model, 2023."

[0448] instructions

[0449] Please briefly explain the contents of this operation manual.

[0450] Please list related keywords.

[0451] "Recommend relevant documents based on keywords entered by the user"

[0452] This system will streamline document management and search on the factory floor, and will also provide flexible support based on user emotions, significantly improving the user experience.

[0453] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0454] Step 1:

[0455] The user puts on the smart glasses and logs in to the application. The user accesses the login screen of the smart glasses and enters their account information. The account information as input data is sent to the server, and the authentication process is executed. If the authentication is successful, the user sees a success message and an upload screen.

[0456] Step 2:

[0457] The user uploads an operation manual or document. Using the smart glasses interface, the user clicks the "Upload" button and selects a local file. The uploaded file is temporarily stored by the terminal. The file data and file name as input by the user are sent to the terminal for further processing.

[0458] Step 3:

[0459] The device interactively prompts the user to enter metadata for the uploaded file. The device interface displays a prompt such as "Please briefly describe the contents of this file," and the user enters the metadata by voice. The entered voice data is captured via the microphone and temporarily saved by the device.

[0460] Step 4:

[0461] The server receives the audio data and converts it to text using a natural language processing engine. The server then analyzes the converted text and generates additional metadata based on the file's content. The audio file is converted into text and analyzed to generate keywords and descriptions associated with the file.

[0462] Step 5:

[0463] The generated metadata is sent to the cloud storage. The server compresses the metadata to avoid data delays and sends it to the cloud storage. The generated metadata as input is stored on the cloud, allowing it to be accessed quickly when needed.

[0464] Step 6:

[0465] The server retrieves files and metadata from cloud storage and analyzes the user's past behavior history. Based on the user's previous search queries and file access history, it identifies and recommends relevant files. The past behavior history data is taken as input and an algorithm is run to identify highly relevant files.

[0466] Step 7:

[0467] When a user searches for a file using the smart glasses, the device prompts the user to enter a search query. For example, the user can say, "I'm looking for an operation guide for a new robot," and the device sends a search request to the server.

[0468] Step 8:

[0469] The server analyzes the received search query and suggests the most suitable files based on relevant metadata and past behavior. The analyzed search query is matched with the metadata, and a list of suitable files is generated and sent back to the device.

[0470] Step 9:

[0471] The device displays the recommended file list to the user. The related files are displayed in order on the smart glasses display, and the user can select and view them. The generated file list is displayed as input, and specific file contents are displayed according to the user's selection.

[0472] Step 10:

[0473] The device uses a camera and microphone to analyze the user's emotional state. The camera captures the user's facial expressions and the microphone records their tone of voice. This data is sent to the server and analyzed by the emotion engine.

[0474] Step 11:

[0475] The server then provides customized information based on the user's emotional state based on the analysis results of the emotion engine. For example, if the server detects that the user is feeling stressed, it will recommend information on relaxation methods or simple task guides. The server analyzes the emotional state data as input, generates appropriate recommendations, and sends them to the device.

[0476] As described above, by clarifying the specific operations performed in each step and the flow of input and output data, it is possible to explain specific embodiments of the present invention.

[0477] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0478] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0479] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0480] [Second embodiment]

[0481] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0482] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0483] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0484] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0485] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0486] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0487] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0488] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0489] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0490] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0491] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0492] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0493] The AI ​​file management system of the present invention has various functions designed to enable users to efficiently manage and quickly search for files. The system begins with a process in which a user uploads a file and enters metadata, after which the AI ​​automatically completes the metadata and recommends related files. Specific embodiments of the system are described in detail below.

[0494] User Interface

[0495] 1. A user logs into the system.

[0496] Example: A user accesses a cloud-based file management system and logs in by entering their account information.

[0497] 2. The terminal displays the file upload screen to the logged-in user.

[0498] Example: The user clicks the "Upload" button and selects "Report2023.docx" from the local disk.

[0499] Metadata Input

[0500] 3. The device confirms the file upload and interactively prompts the user to enter metadata.

[0501] Example: The terminal displays "Please briefly describe the contents of this file," and the user types "Sales Report 2023."

[0502] 4. The user enters metadata such as the file's content, audience, and keywords.

[0503] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[0504] Sending and completing metadata

[0505] 5. The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[0506] Example: The device temporarily saves "Report2023.docx" and its metadata.

[0507] 6. The server stores the received files and metadata in cloud storage and uses a natural language processing engine to complete any missing metadata.

[0508] Example: The server analyzes the content of "Sales Report 2023" and adds metadata about "Annual Report," "Sales," and "Finance."

[0509] Activity history and related file recommendations

[0510] 7. The server identifies related files based on the user's past behavior history and recommends them to the user.

[0511] Example: The server recommends "Sales Report 2022.pdf" based on the user's search history for "Sales Report."

[0512] File search and presentation

[0513] 8. When a user searches for a specific file, they enter a search query.

[0514] Example: A user types, "Find the sales report file for management."

[0515] 9. The server analyzes the search query and presents the most suitable files based on relevant metadata and past behavior.

[0516] Example: The server presents "Report 2023.docx" and "2022 Sales Report.pdf" in order of relevance.

[0517] 10. The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0518] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[0519] In this way, the specific operations at each step provide an environment in which users can efficiently manage and search for files. The system of the present invention realizes automation and efficiency of file management, and can improve business productivity, making it extremely useful for users.

[0520] The processing flow will be explained below.

[0521] Step 1:

[0522] A user logs into the system, selects a file, and uploads it.

[0523] Example: A user accesses the system homepage, enters their account information, and logs in. Then, they click the "Upload" button, select "Report 2023.docx" from their local disk, and begin uploading.

[0524] Step 2:

[0525] The device confirms the file upload and interactively prompts the user to enter metadata.

[0526] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[0527] Step 3:

[0528] The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[0529] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[0530] Step 4:

[0531] The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[0532] Example: The device temporarily saves "Report2023.docx" and its metadata.

[0533] Step 5:

[0534] The server stores the files and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[0535] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[0536] Step 6:

[0537] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history.

[0538] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[0539] Step 7:

[0540] When a user searches for a particular file on the system, they enter a search query.

[0541] Example: A user types "Find management's sales report file" into a search box.

[0542] Step 8:

[0543] The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[0544] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[0545] Step 9:

[0546] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0547] Example: The device displays a file list, and the user clicks on "Report 2023.docx" to open it.

[0548] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency.

[0549] Example 1

[0550] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0551] Conventional file management systems require users to manually manage large volumes of files, resulting in inefficient file uploads, metadata entry, and related file searches, which reduces work productivity. Furthermore, it is difficult for users to quickly find specific files, preventing them from efficiently using related information.

[0552] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0553] In this invention, the server includes means for a user to upload digital files to the system, means for interactively prompting the user to input metadata for the uploaded files, means for temporarily saving the metadata and sending it to cloud storage, means for analyzing file content using a natural language processing device and generating additional metadata, means for identifying and recommending related files based on the user's past behavior history, means for a user to input a search query when searching for a specific file, means for presenting related files based on the search query and metadata, and means for displaying a list of recommended files to the user, thereby enabling users to efficiently manage their files and quickly search for and obtain required files.

[0554] "User" means any person or entity that accesses and operates the System.

[0555] "Digital file" refers to any type of data file used on a computer.

[0556] "System" is a general term for the series of hardware and software that constitute the AI ​​file management system of the present invention.

[0557] "Upload" refers to the act of transferring a file from a local device to cloud storage or a server.

[0558] "Interactive" refers to a method in which a user and a system communicate interactively, exchanging information through questions and answers.

[0559] "Metadata" refers to data that describes information about a digital file, including the file's content, audience, keywords, etc.

[0560] "Temporarily storing" refers to the operation of temporarily holding files or data in memory or storage.

[0561] "Cloud storage" refers to online storage services accessible via the Internet.

[0562] "Natural language processing device" refers to software or hardware for understanding and analyzing natural language.

[0563] "Additional metadata" refers to complementary information that is added to the original metadata.

[0564] "Behavioral history" refers to historical information such as the operations and search queries a user performs within the system.

[0565] "Related files" refer to files that are relevant to a user based on specified metadata and behavioral history.

[0566] A "search query" refers to a string or phrase that a user enters to search for specific information.

[0567] "Presenting" refers to the operation of displaying files or information to the user as search results.

[0568] "Recommended file list" refers to a list of highly relevant files that the system suggests to the user.

[0569] The AI ​​file management system of the present invention includes a series of processes and functions designed to enable users to efficiently manage and quickly search for files. The system begins with a process in which a user uploads a digital file and inputs related metadata, and then uses a natural language processing device to complement the metadata and recommend related files.

[0570] User Interface

[0571] When a user logs in to the system, they open a browser, enter the URL of the cloud-based file management system, and enter their user ID and password. After successful login, the device will display a file upload screen for the user. The user can click the "Upload" button on this screen to select and upload files from their local disk.

[0572] Metadata Input

[0573] For uploaded files, the device interactively prompts the user to enter metadata. For example, a prompt may appear saying, "Please briefly describe the contents of this file." The user then enters specific details. In addition, the user may enter additional metadata such as the file's content, target audience, and keywords.

[0574] Sending and completing metadata

[0575] Once the metadata is entered, the device temporarily stores it and prepares it for transmission to cloud storage. The transmitted file and metadata are then stored in cloud storage by the server. The server then uses a natural language processing system to analyze the file content and automatically complete any missing metadata. Specifically, the server analyzes the content of "2023 sales report" and adds metadata such as "annual report," "sales," and "finance."

[0576] Activity history and related file recommendations

[0577] Furthermore, the server identifies related files based on the user's past behavior history and recommends them to the user. For example, the server recommends "Sales Report 2022.pdf" based on the user's search history for "Sales Report."

[0578] File search and presentation

[0579] When a user searches for a specific file, they enter a search query, such as "Find sales report files for management," into the search bar. The server analyzes this search query and suggests the most suitable files based on associated metadata and past activity. The suggested file list is then displayed to the user on their device, allowing them to instantly find the file they are looking for.

[0580] Examples of prompt statements

[0581] Here are some example prompts to input to a generative AI model:

[0582] "Please explain the process of how a user logs into a file management system, uploads a file, and enters metadata. The system then automatically completes the metadata and recommends related files to the user."

[0583] By using this prompt, the generative AI model can be made to describe the system's sequence of operations in natural language.

[0584] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0585] Step 1:

[0586] A user logs in to the system.

[0587] Specific operation: Open a browser, enter the URL of the cloud-based file management system, and the login screen will appear. Enter your user ID and password and click the "Login" button.

[0588] Input: User ID, Password

[0589] Output: The user is logged in.

[0590] Step 2:

[0591] The terminal displays a file upload screen to the logged-in user.

[0592] What happens: User navigates to the dashboard and sees the "File Upload" section. User clicks the "Upload" button, which opens a file selection dialog. User selects a file from their local disk and clicks "Open".

[0593] Input: User clicks, selected files

[0594] Output: The path of the file to be uploaded

[0595] Step 3:

[0596] For uploaded files, the terminal interactively prompts the user to input metadata.

[0597] What it does: Once the file upload is confirmed, the device will prompt you to "Please briefly describe the contents of this file."

[0598] Input: Uploaded file path, user answer

[0599] Output: Initial metadata entered by the user

[0600] Step 4:

[0601] The user enters metadata such as the file's content, target audience, and keywords.

[0602] Specific operation: The user enters information such as the file content, target audience, and keywords into the text box and clicks the "Save" button.

[0603] Input: User-entered metadata (e.g., file content, audience, keywords)

[0604] Output: Metadata input completion signal

[0605] Step 5:

[0606] The device temporarily stores the entered metadata and prepares it for transmission to cloud storage.

[0607] Specific operation: The device temporarily stores metadata and file information in local memory and formats the data for sending to cloud storage.

[0608] Input: Entered metadata, uploaded file path

[0609] Output: Temporarily saved metadata and file information

[0610] Step 6:

[0611] The server stores the received files and metadata in cloud storage and uses a natural language processing device to complete any missing metadata.

[0612] How it works: The server stores files and metadata in cloud storage, analyzes the files using a natural language processing system, and automatically generates missing metadata based on the analysis results and adds it to the original metadata.

[0613] Input: File, initial metadata

[0614] Output: Completed metadata

[0615] Step 7:

[0616] The server identifies related files based on the user's past behavior history and recommends them to the user.

[0617] How it works: The server analyzes the user's past search history and access logs to identify relevant files, and then recommends the most suitable files to the user.

[0618] Input: User behavior history

[0619] Output: Recommended file list

[0620] Step 8:

[0621] When a user searches for a particular file, they enter a search query.

[0622] What happens: Enter a query in the search bar and click the "Search" button.

[0623] Input: Search query

[0624] Output: Search request based on the search query

[0625] Step 9:

[0626] The server analyzes the search query and presents the most suitable files based on associated metadata and past behavior.

[0627] What it does: It uses a natural language processor to analyze your search query, match it with relevant metadata and historical behavior, score the best files, and sort them by relevance.

[0628] Input: Search query, metadata, behavioral history

[0629] Output: Related file list

[0630] Step 10:

[0631] The terminal displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0632] Specific operation: The device displays a list of search results, and the user clicks on the desired file to open it.

[0633] Input: Related file list

[0634] Output: Displayed file list and selected file

[0635] (Application example 1)

[0636] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0637] In conventional logistics centers, file management has been challenging due to the difficulty of efficiently and quickly handling large volumes of digital documents and reports. Searching for files and recommending related files takes time, reducing work efficiency. Manually entering metadata often requires time and introduces errors, further reducing efficiency. To solve these issues, a file management system using AI is needed.

[0638] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0639] In this invention, the server includes: a means for a user to upload digital files to the system; a means for interactively prompting the user to input metadata for the uploaded files; a means for temporarily storing the metadata and sending it to cloud storage; a means for analyzing file content using a natural language processing engine and generating additional metadata; a means for identifying and recommending related files based on the user's past behavioral history; a means for automatically completing missing metadata using a generative AI model; a means for managing files and their metadata on the cloud and recommending highly similar files; and a means for uploading and searching files using a smartphone. This enables efficient and rapid management and search of large volumes of digital documents and reports at logistics centers.

[0640] "User" means a person who accesses the system to upload and retrieve digital files.

[0641] A "digital file" is a digital data file, such as a document, image, or audio file, that is handled on a computer.

[0642] A "system" is a collection of hardware and software designed to enable users to efficiently manage and retrieve digital files.

[0643] "Uploading" refers to the act of a user sending and saving a digital file from their own device to a server.

[0644] "Dialogue format" refers to a method in which the system asks the user to input information in the form of questions.

[0645] "Metadata" refers to auxiliary information such as the file's content, target audience, keywords, etc.

[0646] "Storage" refers to the act of a system temporarily or permanently storing input data or files in a storage device.

[0647] "Cloud storage" refers to remote servers that store and share data over the internet.

[0648] A "natural language processing engine" is an artificial intelligence technology for analyzing and understanding human language.

[0649] "Analysis" is the process by which a system examines the contents of data and finds the information it needs.

[0650] "Additional metadata" refers to supplemental information automatically generated by a natural language processing engine.

[0651] "Behavioral history" refers to the operations and search records performed by a user on the system.

[0652] "Recommendation" means that the system presents highly relevant files based on the user's behavioral history, etc.

[0653] A "generative AI model" is a machine learning algorithm used to generate data or fill in missing information.

[0654] "Similarity" is an index that indicates the degree of similarity between different data or objects.

[0655] A "smartphone" is a portable information terminal that can connect to the Internet and run applications.

[0656] The present invention is a system for efficiently managing and searching large volumes of digital documents and reports in a logistics center. This system consists of the following main components:

[0657] System Configuration

[0658] 1. Device:

[0659] The terminals are smartphones used by employees at the logistics center, which they use to upload and retrieve files.

[0660] 2. Server:

[0661] The server is equipped with cloud storage, a natural language processing engine, and a generative AI model that automatically analyzes file content, completes metadata, and recommends related files.

[0662] Program processing

[0663] 1. Uploading files via terminal:

[0664] Users upload files to the system using their smartphones. For example, if an employee wants to upload an annual sales report, they select the file from their local disk and send it to the server through a dedicated app.

[0665] 2. Metadata entry support:

[0666] The device interactively prompts the user to enter metadata for the uploaded file. For example, the device prompts the user to "Please briefly describe the contents of this file," and the user enters "Annual Sales Report."

[0667] 3. Metadata Completion:

[0668] The server uses a generative AI model based on the input metadata to fill in any missing metadata. A possible generative AI model would be OpenAI's GPT-3. For example, from a file description of "Annual Sales Report," the AI ​​could automatically add metadata such as "Financial Report," "2023," and "Annual Sales."

[0669] 4. Save to cloud storage:

[0670] The files are then stored with the completed metadata in cloud storage, such as Amazon S3 or Google Cloud Storage.

[0671] 5. Related file recommendations:

[0672] The server identifies and recommends related files based on the user's past behavior. For example, if a user has searched for sales reports, the server may recommend files such as "previous year's sales report."

[0673] 6. File search function:

[0674] When a user searches for a specific file, they enter a search query into their device. The server analyzes the search query and metadata and automatically presents highly relevant files. For example, by entering "Search for sales report files for management," a list of appropriate files will be displayed.

[0675] Examples of concrete examples and prompts

[0676] For example, suppose a logistics center manager uploads an annual report and describes it as a "sales report by year." The server automatically generates additional metadata such as "financial report," "year 2023," and "annual sales."

[0677] An example prompt is:

[0678] "Please briefly describe the contents of the file: Annual sales report"

[0679] This enables logistics centers to efficiently and quickly manage and search large volumes of digital documents and reports.

[0680] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0681] Step 1:

[0682] A user uses a smartphone to select a digital file and upload it to the system.

[0683] Input: A digital file selected by the user (e.g., annual sales report).

[0684] Specific operation: The user opens the app on their smartphone, clicks the "File Upload" button, and selects "Annual Sales Report.docx" from their local disk.

[0685] Output: The digital file that is sent to the server.

[0686] Step 2:

[0687] The terminal interactively prompts the user to input metadata for the uploaded file.

[0688] Input: Uploaded digital files.

[0689] Specific operation: The terminal displays the prompt "Please briefly describe the contents of this file," and the user enters "Annual sales report."

[0690] Output: User-entered metadata.

[0691] Step 3:

[0692] The device temporarily stores the entered metadata and sends it to cloud storage.

[0693] Input: User-entered metadata and uploaded digital files.

[0694] Specific operation: The device temporarily stores the "Annual Sales Report" and its metadata and sends it to cloud storage.

[0695] Output: Digital files and metadata stored in cloud storage.

[0696] Step 4:

[0697] The server uses a natural language processing engine to analyze the file content and generate additional metadata.

[0698] Input: Files and metadata stored in cloud storage.

[0699] How it works: The server uses a generative AI model (e.g., OpenAI GPT-3) to automatically generate additional metadata such as "Financial Report," "2023," and "Annual Sales" from the description "Sales Report by Year."

[0700] Output: Digital files with additional metadata.

[0701] Step 5:

[0702] The server identifies and recommends related files based on the user's past behavioral history.

[0703] Input: A digital file with a user's past behavior and additional metadata.

[0704] What it does: The server analyzes the user's search history and identifies related files, such as "last year's sales report."

[0705] Output: A list of recommended related files.

[0706] Step 6:

[0707] When a user searches for a particular file, they enter a search query into their device.

[0708] Input: The search query entered by the user (e.g., "Find sales report files for management").

[0709] What happens: A user types a query into the search bar on their smartphone.

[0710] Output: The search query is sent to the server.

[0711] Step 7:

[0712] The server analyzes the search query and metadata and automatically presents highly relevant files.

[0713] Input: Search query and file metadata.

[0714] How it works: The server uses a natural language processing engine to analyze the search query and lists "Report 2023.docx" and "Last year's sales report" in order of relevance.

[0715] Output: A list of highly relevant files.

[0716] Step 8:

[0717] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0718] Input: A list of highly relevant files.

[0719] Specific operation: The terminal displays a file list to the user, and the user clicks "Annual Sales Report.docx" from the list to open it.

[0720] Output: The file list and selected files as displayed to the user.

[0721] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0722] The AI ​​file management system of the present invention has various functions designed to enable users to efficiently manage and quickly search files. The system combines a metadata input function, a natural language processing engine, and an emotion engine to significantly improve the user experience. A detailed description of specific embodiments of the present invention is provided below.

[0723] User Interface

[0724] 1. A user logs into the system.

[0725] Example: A user accesses a cloud-based file management system and logs in by entering their account information.

[0726] 2. The terminal displays the file upload screen to the logged-in user.

[0727] Example: The user clicks the "Upload" button and selects "Report2023.docx" from the local disk.

[0728] Metadata Input

[0729] 3. The device confirms the file upload and interactively prompts the user to enter metadata.

[0730] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[0731] 4. The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[0732] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[0733] Sending and completing metadata

[0734] 5. The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[0735] Example: The device temporarily saves "Report2023.docx" and its metadata.

[0736] 6. The server stores the file and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[0737] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[0738] Activity history and related file recommendations

[0739] 7. The server-generated metadata is integrated with existing metadata to identify related files based on user behavior history.

[0740] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[0741] Implementing the Emotion Engine

[0742] 8. The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes that information.

[0743] Example: While a user is accessing the system, a camera analyzes facial expressions and a microphone analyzes the tone of voice.

[0744] 9. The server customizes the files and information it recommends based on the emotional state of the user based on the analysis results of the emotion engine.

[0745] Example: If the server detects that the user is feeling stressed, it will recommend "relaxation techniques" or "simple task guides."

[0746] 10. The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine, providing feedback according to the user's emotions.

[0747] Example: If the user is excited, the system changes the color to a calmer one and displays user guidance and tips.

[0748] File search and presentation

[0749] 11. When a user searches for a specific file, they enter a search query.

[0750] Example: A user types "Find management's sales report file" into a search box.

[0751] 12. The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[0752] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[0753] 13. The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0754] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[0755] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency. Furthermore, the implementation of an emotion engine enables flexible responses according to the user's emotional state, further improving the user experience.

[0756] The processing flow will be explained below.

[0757] Step 1:

[0758] A user logs into the system, selects a file, and uploads it.

[0759] Example: A user accesses a cloud-based file management system, enters their account information, logs in, clicks the "Upload" button, selects "Report 2023.docx" from their local disk, and begins uploading.

[0760] Step 2:

[0761] The device confirms the file upload and interactively prompts the user to enter metadata.

[0762] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[0763] Step 3:

[0764] The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[0765] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[0766] Step 4:

[0767] The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[0768] Example: The device temporarily saves "Report2023.docx" and its metadata.

[0769] Step 5:

[0770] The server stores the files and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[0771] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[0772] Step 6:

[0773] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history.

[0774] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[0775] Step 7:

[0776] The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes that information.

[0777] Example: While a user is accessing the system, the camera analyzes their facial expressions and the microphone analyzes their tone of voice. The emotion engine uses this data to analyze whether the user is feeling stressed.

[0778] Step 8:

[0779] The server customizes recommended files and information according to the user's emotional state based on the analysis results of the emotion engine.

[0780] Example: If the server detects that the user is feeling stressed, it will recommend "relaxation techniques" or "simple task guides."

[0781] Step 9:

[0782] The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine, and provides feedback according to the user's emotions.

[0783] Example: If the user is agitated, the server changes the interface color to a calmer one and displays user guides and tips.

[0784] Step 10:

[0785] When a user searches for a particular file, they enter a search query.

[0786] Example: A user types "Find management's sales report file" into a search box.

[0787] Step 11:

[0788] The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[0789] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[0790] Step 12:

[0791] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0792] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[0793] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency.In addition, the implementation of an emotion engine enables flexible response according to the user's emotional state, further improving the user experience.

[0794] Example 2

[0795] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0796] Existing file management systems often require manual file search and management, resulting in inefficiencies. Additionally, they lack the ability to respond flexibly to the user's emotional state, preventing an improved user experience.

[0797] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for collecting image and audio information to recognize the user's emotions and analyzing it using an emotion engine, means for dynamically changing the user interface based on the analysis results of the emotion engine and recommending files and information according to the user's emotions, and means for analyzing file contents using a natural language processing engine and generating additional metadata. This allows the user to efficiently search and manage files and flexibly respond to their emotional state.

[0798] A "digital file" is a means of storing and representing data or information in electronic form for use by computers and other electronic devices.

[0799] A "system" is a mechanism in which multiple pieces of hardware and software work together to achieve a specific function.

[0800] A "user" is a user of this system who uploads digital files and inputs metadata.

[0801] The "interactive format" is an interface that emphasizes communication with the user and allows operations to proceed while sequentially exchanging information.

[0802] "Metadata" is data that provides additional information about a digital file, such as its content, audience, keywords, etc.

[0803] "Temporary storage" is the act of storing data for a short period of time and then preparing it for further processing.

[0804] "Cloud storage" is a data storage service available over the Internet.

[0805] A "natural language processing engine" is a program that allows a computer to analyze and understand human language.

[0806] "Additional metadata" is metadata that is newly generated based on the analysis results of the natural language processing engine.

[0807] "Behavioral history" is a record of the operations and searches performed by a user within the system.

[0808] "Related files" are other files that are related to the current operation or search.

[0809] "Recommendation" means that the system presents specific files or information to the user based on the user's behavioral history and metadata.

[0810] An "emotion engine" is a program that analyzes the user's emotional state and responds based on that.

[0811] A "user interface" refers to the screen and operation method used by the user to exchange information with the system.

[0812] The AI ​​file management system of the present invention has various functions to enable users to efficiently manage and quickly search digital files. The system combines a metadata input function, a natural language processing engine, and an emotion engine to significantly improve the user experience.

[0813] Specifically, the system operates as follows.

[0814] User Interface

[0815] A user accesses a cloud-based file management system and enters their account information to log in. After logging in, the device displays a file upload screen for the user. For example, the user clicks the "Upload" button and selects "Report 2023.docx" from their local disk.

[0816] Metadata Input

[0817] The device confirms the file upload and interactively prompts the user to enter metadata. For example, it might prompt the user to "Please briefly describe the contents of this file," and the user might enter "Sales report for 2023." The user might also enter additional information, such as audience and keywords. For example, the user might enter "Audience: Management" and "Keywords: Sales, 2023, Report."

[0818] Sending and completing metadata

[0819] The device temporarily stores the entered metadata and prepares it for transmission to cloud storage. Next, the server stores the file and metadata in cloud storage and uses a natural language processing engine (e.g., natural language processing API) to analyze the file content and generate additional metadata. For example, metadata related to "annual report," "sales," and "finance" can be automatically generated based on the content analysis of "2023 sales report."

[0820] Activity history and related file recommendations

[0821] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history. For example, based on the user's past search history for "sales report," the system identifies "2022 sales report.pdf" and "Q2 sales analysis.xlsx" as related files.

[0822] Implementing the Emotion Engine

[0823] The device uses the camera and microphone to recognize the user's emotions, and the emotion engine (e.g., emotion analysis API) analyzes that information. For example, while the user is accessing the system, the camera analyzes facial expressions and the microphone analyzes the tone of voice. The server customizes the files and information it recommends according to the user's emotional state based on the emotion engine's analysis results. For example, if the user is recognized as feeling stressed, the server will recommend "relaxation methods" or "simple task guides."

[0824] File search and presentation

[0825] When a user searches for a specific file, they enter a search query. For example, they might type "Find a sales report file for management" into the search box. The server analyzes the received search query and suggests the most suitable files based on associated metadata and the user's behavioral history. For example, it might suggest "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance. The device then displays a list of recommended files to the user, allowing them to instantly find the file they are looking for. For example, the user might click "Report 2023.docx" from the suggested file list to open it.

[0826] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency. Furthermore, the implementation of an emotion engine enables flexible responses according to the user's emotional state, further improving the user experience.

[0827] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0828] Step 1:

[0829] A user accesses a cloud-based file management system and logs in by entering their account information on the login screen. At this time, a username and password are entered, which the system receives as authentication information. The system compares the entered information with the database, and if authentication is successful, the user moves to the next screen. The output is the authentication result, and if successful, the file upload screen is displayed.

[0830] Step 2:

[0831] After the terminal logs in, it displays a file upload screen to the user. The user clicks the "Upload" button and selects a file (e.g., "Report 2023.docx") from the local disk. The input is the path of the file selected by the user, and the terminal receives this and starts uploading the file. The output is the temporary storage location of the selected file.

[0832] Step 3:

[0833] The terminal confirms the file upload and interactively prompts the user to enter metadata. The input is confirmation of the existence of the uploaded file and a prompt to the user to enter metadata, with the message "Please briefly describe the contents of this file." The user enters "Sales report for 2023." The output is the entered metadata.

[0834] Step 4:

[0835] The user follows interactive prompts to input metadata such as the file contents, target audience, and keywords. The input is specific information such as "target audience: management" and "keywords: sales, 2023, report," and the terminal receives this information. The output is this metadata information.

[0836] Step 5:

[0837] The device temporarily stores the input metadata and prepares it for sending to cloud storage. The input is the file and metadata to be saved, which the device temporarily saves in local storage. The output is the file and metadata ready to be sent to cloud storage.

[0838] Step 6:

[0839] The server stores the files and metadata in cloud storage, analyzes the file contents using a natural language processing engine, and generates additional metadata. The input is the files stored in cloud storage and the initial metadata, and the server performs analysis based on this. The output is additional metadata (e.g., "Annual Report," "Sales," "Finance") generated based on the analysis results.

[0840] Step 7:

[0841] The server merges the generated metadata with existing metadata and identifies related files based on the user's behavioral history. The input is new and existing metadata and the user's behavioral history, and the server uses this to identify related files (e.g., "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx"). The output is a list of identified related files.

[0842] Step 8:

[0843] The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes the information. The input is the user's facial expression data and tone of voice, and the device sends this information to the emotion engine. The output is the analyzed emotional state.

[0844] Step 9:

[0845] The server customizes the files and information it recommends based on the user's emotional state, based on the analysis results of the emotion engine. The input is the analysis results of the emotion engine, and the server selects recommended information (e.g., "How to relax" or "Simple task guide") based on this. The output is customized recommended information.

[0846] Step 10:

[0847] The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine and provides feedback according to the user's emotions. The input is the analysis results of the emotion engine and the current interface information, and the server optimizes the user interface to suit the user's emotions. The output is a dynamically changed interface.

[0848] Step 11:

[0849] When a user searches for a specific file, they enter a search query. The input is the keywords entered into the search box, say the user types "Find sales report files for management." The output is the search query.

[0850] Step 12:

[0851] The server analyzes the received search query and presents the most appropriate files based on the associated metadata and user behavior history. The input is the search query, associated metadata, and behavior history, and the server generates search results (e.g., "Report 2023.docx," "2022 Sales Report.pdf," "Q2 Sales Analysis.xlsx") based on this. The output is the presented search results.

[0852] Step 13:

[0853] The terminal displays a recommended file list to the user, allowing the user to instantly find the file they are looking for. The input is a file list sent from the server, which the terminal displays to the user. The output is a file list for the user to access.

[0854] The above are the specific processing steps of the program of this system.

[0855] (Application example 2)

[0856] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0857] Efficient management and search of operation manuals and various documents is important on factory floors. However, manual metadata entry and file search are laborious and time-consuming, reducing efficiency. Furthermore, appropriate support based on the emotional state of workers is often not provided, leading to stress and errors. A system that can solve these problems and improve work efficiency and user experience is needed.

[0858] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to upload digital files to the system; means for interactively prompting the user to input metadata for the uploaded files; means for temporarily saving the metadata and sending it to cloud storage; means for analyzing file content using a natural language processing engine and generating additional metadata; means for identifying and recommending related files based on the user's past behavioral history; means for using a camera or microphone to recognize the user's emotions and analyzing the information with an emotion engine; and means for customizing recommended files and information according to the user's emotional state based on the analysis results of the emotion engine. This enables efficient file management and search, and further improves work efficiency and user experience by providing appropriate support according to the user's emotions.

[0859] "User" refers to any individual or entity that uses the System.

[0860] "Digital file" refers to a data file, such as a document, image, audio, or video, stored in electronic form.

[0861] "Uploading" refers to the act of transferring data from your local environment to the cloud or another system.

[0862] "System" refers to a collection of hardware and software configured to achieve a specific function or purpose.

[0863] "Metadata" refers to auxiliary information that describes the content and characteristics of data.

[0864] "Interactive" refers to an interface in which the user and the system interact continuously.

[0865] "Storage" refers to the act of retaining data.

[0866] "Cloud storage" refers to a service that stores data on remote servers available over the Internet.

[0867] A "natural language processing engine" refers to an algorithm or program that analyzes and understands text written in natural language.

[0868] "Associated Files" refers to data or documents related to a particular file.

[0869] An "emotion engine" refers to a module that analyzes the user's emotions and uses the results to adjust the system's behavior.

[0870] "Customization" refers to the act of adjusting or modifying a system or service to suit the needs or circumstances of a particular user.

[0871] "Camera" refers to a device that captures and records images.

[0872] "Microphone" refers to a device for capturing sound.

[0873] "Analysis" refers to the act of breaking down and interpreting data and information to extract meaning and patterns.

[0874] "Behavioral history" refers to the record of operations and searches performed by a user using the system.

[0875] "Recommendation" refers to the act of presenting useful or highly relevant information or files to a user.

[0876] This invention is a system for efficiently managing and searching operation manuals and related documents on factory floors. The invention aims to improve work efficiency and user experience, particularly through an interface using smart glasses.

[0877] Hardware and Software Configuration

[0878] Hardware

[0879] Smart glasses: A device worn by the user to display information and perform voice interaction.

[0880] Camera: Built into the smart glasses and used to capture the user's facial expressions.

[0881] Microphone: Built into the smart glasses and used to capture the user's voice.

[0882] Server: A remote computing resource located in the cloud for data storage and analysis.

[0883] software

[0884] Natural language processing engine: Algorithms for analyzing user-entered metadata and search queries, for example, using the Python transformers library.

[0885] Emotion Engine: A module that analyzes the user's emotions and adjusts the system's behavior based on that information. It uses the OpenCV library.

[0886] Cloud storage service: A service that stores and manages files and metadata, such as AWS S3.

[0887] System Operation

[0888] User Operation

[0889] A user puts on the smart glasses and logs in to the system. After logging in, a file upload screen is displayed on the smart glasses, allowing the user to upload operation manuals and various documents. For the uploaded files, the smart glasses interactively prompt the user to enter metadata.

[0890] For example, when a user uploads "Operation Manual for New Robot 2023," the smart glasses will prompt the user, "Please briefly explain the contents of this file," to which the user can respond verbally, "Operation Manual for New Robot 2023."

[0891] Natural Language Processing and Sentiment Analysis

[0892] The server temporarily stores the metadata sent by the user and sends it to cloud storage. Using a natural language processing engine, the server analyzes the file content and generates additional metadata. The emotion engine also analyzes the user's facial expressions and tone of voice captured by the camera and microphone to recognize their emotional state.

[0893] For example, if the user is recognized as feeling stressed, the server can recommend a "quick operation guide" or a "document on how to relax" in the "related files" section.

[0894] File Management and Search

[0895] When a user enters a search query, the server analyzes the received search query and presents related files based on past behavioral history and metadata. For example, if a user voice-inputs "operation guide for new robot," the server will present "operation manual for new robot 2023.pdf" and "assembly procedure for new robot.xlsx."

[0896] Examples of concrete examples and prompts

[0897] Here are some examples of prompts for generative AI models:

[0898] "This operating manual is a guide to the new 2023 robot model. Key keywords: robot, operating guide, new model, 2023."

[0899] instructions

[0900] Please briefly explain the contents of this operation manual.

[0901] Please list related keywords.

[0902] "Recommend relevant documents based on keywords entered by the user"

[0903] This system will streamline document management and search on the factory floor, and will also provide flexible support based on user emotions, significantly improving the user experience.

[0904] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0905] Step 1:

[0906] The user puts on the smart glasses and logs in to the application. The user accesses the login screen of the smart glasses and enters their account information. The account information as input data is sent to the server, and the authentication process is executed. If the authentication is successful, the user sees a success message and an upload screen.

[0907] Step 2:

[0908] The user uploads an operation manual or document. Using the smart glasses interface, the user clicks the "Upload" button and selects a local file. The uploaded file is temporarily stored by the terminal. The file data and file name as input by the user are sent to the terminal for further processing.

[0909] Step 3:

[0910] The device interactively prompts the user to enter metadata for the uploaded file. The device interface displays a prompt such as "Please briefly describe the contents of this file," and the user enters the metadata by voice. The entered voice data is captured via the microphone and temporarily saved by the device.

[0911] Step 4:

[0912] The server receives the audio data and converts it to text using a natural language processing engine. The server then analyzes the converted text and generates additional metadata based on the file's content. The audio file is converted into text and analyzed to generate keywords and descriptions associated with the file.

[0913] Step 5:

[0914] The generated metadata is sent to the cloud storage. The server compresses the metadata to avoid data delays and sends it to the cloud storage. The generated metadata as input is stored on the cloud, allowing it to be accessed quickly when needed.

[0915] Step 6:

[0916] The server retrieves files and metadata from cloud storage and analyzes the user's past behavior history. Based on the user's previous search queries and file access history, it identifies and recommends relevant files. The past behavior history data is taken as input and an algorithm is run to identify highly relevant files.

[0917] Step 7:

[0918] When a user searches for a file using the smart glasses, the device prompts the user to enter a search query. For example, the user can say, "I'm looking for an operation guide for a new robot," and the device sends a search request to the server.

[0919] Step 8:

[0920] The server analyzes the received search query and suggests the most suitable files based on relevant metadata and past behavior. The analyzed search query is matched with the metadata, and a list of suitable files is generated and sent back to the device.

[0921] Step 9:

[0922] The device displays the recommended file list to the user. The related files are displayed in order on the smart glasses display, and the user can select and view them. The generated file list is displayed as input, and specific file contents are displayed according to the user's selection.

[0923] Step 10:

[0924] The device uses a camera and microphone to analyze the user's emotional state. The camera captures the user's facial expressions and the microphone records their tone of voice. This data is sent to the server and analyzed by the emotion engine.

[0925] Step 11:

[0926] The server then provides customized information based on the user's emotional state based on the analysis results of the emotion engine. For example, if the server detects that the user is feeling stressed, it will recommend information on relaxation methods or simple task guides. The server analyzes the emotional state data as input, generates appropriate recommendations, and sends them to the device.

[0927] As described above, by clarifying the specific operations performed in each step and the flow of input and output data, it is possible to explain specific embodiments of the present invention.

[0928] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0929] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0930] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0931] [Third embodiment]

[0932] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0933] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0934] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0935] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0936] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0937] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0938] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0939] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0940] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0941] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0942] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0943] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0944] The AI ​​file management system of the present invention has various functions designed to enable users to efficiently manage and quickly search for files. The system begins with a process in which a user uploads a file and enters metadata, after which the AI ​​automatically completes the metadata and recommends related files. Specific embodiments of the system are described in detail below.

[0945] User Interface

[0946] 1. A user logs into the system.

[0947] Example: A user accesses a cloud-based file management system and logs in by entering their account information.

[0948] 2. The terminal displays the file upload screen to the logged-in user.

[0949] Example: The user clicks the "Upload" button and selects "Report2023.docx" from the local disk.

[0950] Metadata Input

[0951] 3. The device confirms the file upload and interactively prompts the user to enter metadata.

[0952] Example: The terminal displays "Please briefly describe the contents of this file," and the user types "Sales Report 2023."

[0953] 4. The user enters metadata such as the file's content, audience, and keywords.

[0954] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[0955] Sending and completing metadata

[0956] 5. The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[0957] Example: The device temporarily saves "Report2023.docx" and its metadata.

[0958] 6. The server stores the received files and metadata in cloud storage and uses a natural language processing engine to complete any missing metadata.

[0959] Example: The server analyzes the content of "Sales Report 2023" and adds metadata about "Annual Report," "Sales," and "Finance."

[0960] Activity history and related file recommendations

[0961] 7. The server identifies related files based on the user's past behavior history and recommends them to the user.

[0962] Example: The server recommends "Sales Report 2022.pdf" based on the user's search history for "Sales Report."

[0963] File search and presentation

[0964] 8. When a user searches for a specific file, they enter a search query.

[0965] Example: A user types, "Find the sales report file for management."

[0966] 9. The server analyzes the search query and presents the most suitable files based on relevant metadata and past behavior.

[0967] Example: The server presents "Report 2023.docx" and "2022 Sales Report.pdf" in order of relevance.

[0968] 10. The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0969] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[0970] In this way, the specific operations at each step provide an environment in which users can efficiently manage and search for files. The system of the present invention realizes automation and efficiency of file management, and can improve business productivity, making it extremely useful for users.

[0971] The processing flow will be explained below.

[0972] Step 1:

[0973] A user logs into the system, selects a file, and uploads it.

[0974] Example: A user accesses the system homepage, enters their account information, and logs in. Then, they click the "Upload" button, select "Report 2023.docx" from their local disk, and begin uploading.

[0975] Step 2:

[0976] The device confirms the file upload and interactively prompts the user to enter metadata.

[0977] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[0978] Step 3:

[0979] The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[0980] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[0981] Step 4:

[0982] The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[0983] Example: The device temporarily saves "Report2023.docx" and its metadata.

[0984] Step 5:

[0985] The server stores the files and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[0986] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[0987] Step 6:

[0988] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history.

[0989] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[0990] Step 7:

[0991] When a user searches for a particular file on the system, they enter a search query.

[0992] Example: A user types "Find management's sales report file" into a search box.

[0993] Step 8:

[0994] The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[0995] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[0996] Step 9:

[0997] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[0998] Example: The device displays a file list, and the user clicks on "Report 2023.docx" to open it.

[0999] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency.

[1000] Example 1

[1001] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1002] Conventional file management systems require users to manually manage large volumes of files, resulting in inefficient file uploads, metadata entry, and related file searches, which reduces work productivity. Furthermore, it is difficult for users to quickly find specific files, preventing them from efficiently using related information.

[1003] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1004] In this invention, the server includes means for a user to upload digital files to the system, means for interactively prompting the user to input metadata for the uploaded files, means for temporarily saving the metadata and sending it to cloud storage, means for analyzing file content using a natural language processing device and generating additional metadata, means for identifying and recommending related files based on the user's past behavior history, means for a user to input a search query when searching for a specific file, means for presenting related files based on the search query and metadata, and means for displaying a list of recommended files to the user, thereby enabling users to efficiently manage their files and quickly search for and obtain required files.

[1005] "User" means any person or entity that accesses and operates the System.

[1006] "Digital file" refers to any type of data file used on a computer.

[1007] "System" is a general term for the series of hardware and software that constitute the AI ​​file management system of the present invention.

[1008] "Upload" refers to the act of transferring a file from a local device to cloud storage or a server.

[1009] "Interactive" refers to a method in which a user and a system communicate interactively, exchanging information through questions and answers.

[1010] "Metadata" refers to data that describes information about a digital file, including the file's content, audience, keywords, etc.

[1011] "Temporarily storing" refers to the operation of temporarily holding files or data in memory or storage.

[1012] "Cloud storage" refers to online storage services accessible via the Internet.

[1013] "Natural language processing device" refers to software or hardware for understanding and analyzing natural language.

[1014] "Additional metadata" refers to complementary information that is added to the original metadata.

[1015] "Behavioral history" refers to historical information such as the operations and search queries a user performs within the system.

[1016] "Related files" refer to files that are relevant to a user based on specified metadata and behavioral history.

[1017] A "search query" refers to a string or phrase that a user enters to search for specific information.

[1018] "Presenting" refers to the operation of displaying files or information to the user as search results.

[1019] "Recommended file list" refers to a list of highly relevant files that the system suggests to the user.

[1020] The AI ​​file management system of the present invention includes a series of processes and functions designed to enable users to efficiently manage and quickly search for files. The system begins with a process in which a user uploads a digital file and inputs related metadata, and then uses a natural language processing device to complement the metadata and recommend related files.

[1021] User Interface

[1022] When a user logs in to the system, they open a browser, enter the URL of the cloud-based file management system, and enter their user ID and password. After successful login, the device will display a file upload screen for the user. The user can click the "Upload" button on this screen to select and upload files from their local disk.

[1023] Metadata Input

[1024] For uploaded files, the device interactively prompts the user to enter metadata. For example, a prompt may appear saying, "Please briefly describe the contents of this file." The user then enters specific details. In addition, the user may enter additional metadata such as the file's content, target audience, and keywords.

[1025] Sending and completing metadata

[1026] Once the metadata is entered, the device temporarily stores it and prepares it for transmission to cloud storage. The transmitted file and metadata are then stored in cloud storage by the server. The server then uses a natural language processing system to analyze the file content and automatically complete any missing metadata. Specifically, the server analyzes the content of "2023 sales report" and adds metadata such as "annual report," "sales," and "finance."

[1027] Activity history and related file recommendations

[1028] Furthermore, the server identifies related files based on the user's past behavior history and recommends them to the user. For example, the server recommends "Sales Report 2022.pdf" based on the user's search history for "Sales Report."

[1029] File search and presentation

[1030] When a user searches for a specific file, they enter a search query, such as "Find sales report files for management," into the search bar. The server analyzes this search query and suggests the most suitable files based on associated metadata and past activity. The suggested file list is then displayed to the user on their device, allowing them to instantly find the file they are looking for.

[1031] Examples of prompt statements

[1032] Here are some example prompts to input to a generative AI model:

[1033] "Please explain the process of how a user logs into a file management system, uploads a file, and enters metadata. The system then automatically completes the metadata and recommends related files to the user."

[1034] By using this prompt, the generative AI model can be made to describe the system's sequence of operations in natural language.

[1035] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1036] Step 1:

[1037] A user logs in to the system.

[1038] Specific operation: Open a browser, enter the URL of the cloud-based file management system, and the login screen will appear. Enter your user ID and password and click the "Login" button.

[1039] Input: User ID, Password

[1040] Output: The user is logged in.

[1041] Step 2:

[1042] The terminal displays a file upload screen to the logged-in user.

[1043] What happens: User navigates to the dashboard and sees the "File Upload" section. User clicks the "Upload" button, which opens a file selection dialog. User selects a file from their local disk and clicks "Open".

[1044] Input: User clicks, selected files

[1045] Output: The path of the file to be uploaded

[1046] Step 3:

[1047] For uploaded files, the terminal interactively prompts the user to input metadata.

[1048] What it does: Once the file upload is confirmed, the device will prompt you to "Please briefly describe the contents of this file."

[1049] Input: Uploaded file path, user answer

[1050] Output: Initial metadata entered by the user

[1051] Step 4:

[1052] The user enters metadata such as the file's content, target audience, and keywords.

[1053] Specific operation: The user enters information such as the file content, target audience, and keywords into the text box and clicks the "Save" button.

[1054] Input: User-entered metadata (e.g., file content, audience, keywords)

[1055] Output: Metadata input completion signal

[1056] Step 5:

[1057] The device temporarily stores the entered metadata and prepares it for transmission to cloud storage.

[1058] Specific operation: The device temporarily stores metadata and file information in local memory and formats the data for sending to cloud storage.

[1059] Input: Entered metadata, uploaded file path

[1060] Output: Temporarily saved metadata and file information

[1061] Step 6:

[1062] The server stores the received files and metadata in cloud storage and uses a natural language processing device to complete any missing metadata.

[1063] How it works: The server stores files and metadata in cloud storage, analyzes the files using a natural language processing system, and automatically generates missing metadata based on the analysis results and adds it to the original metadata.

[1064] Input: File, initial metadata

[1065] Output: Completed metadata

[1066] Step 7:

[1067] The server identifies related files based on the user's past behavior history and recommends them to the user.

[1068] How it works: The server analyzes the user's past search history and access logs to identify relevant files, and then recommends the most suitable files to the user.

[1069] Input: User behavior history

[1070] Output: Recommended file list

[1071] Step 8:

[1072] When a user searches for a particular file, they enter a search query.

[1073] What happens: Enter a query in the search bar and click the "Search" button.

[1074] Input: Search query

[1075] Output: Search request based on the search query

[1076] Step 9:

[1077] The server analyzes the search query and presents the most suitable files based on associated metadata and past behavior.

[1078] What it does: It uses a natural language processor to analyze your search query, match it with relevant metadata and historical behavior, score the best files, and sort them by relevance.

[1079] Input: Search query, metadata, behavioral history

[1080] Output: Related file list

[1081] Step 10:

[1082] The terminal displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[1083] Specific operation: The device displays a list of search results, and the user clicks on the desired file to open it.

[1084] Input: Related file list

[1085] Output: Displayed file list and selected file

[1086] (Application example 1)

[1087] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1088] In conventional logistics centers, file management has been challenging due to the difficulty of efficiently and quickly handling large volumes of digital documents and reports. Searching for files and recommending related files takes time, reducing work efficiency. Manually entering metadata often requires time and introduces errors, further reducing efficiency. To solve these issues, a file management system using AI is needed.

[1089] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1090] In this invention, the server includes: a means for a user to upload digital files to the system; a means for interactively prompting the user to input metadata for the uploaded files; a means for temporarily storing the metadata and sending it to cloud storage; a means for analyzing file content using a natural language processing engine and generating additional metadata; a means for identifying and recommending related files based on the user's past behavioral history; a means for automatically completing missing metadata using a generative AI model; a means for managing files and their metadata on the cloud and recommending highly similar files; and a means for uploading and searching files using a smartphone. This enables efficient and rapid management and search of large volumes of digital documents and reports at logistics centers.

[1091] "User" means a person who accesses the system to upload and retrieve digital files.

[1092] A "digital file" is a digital data file, such as a document, image, or audio file, that is handled on a computer.

[1093] A "system" is a collection of hardware and software designed to enable users to efficiently manage and retrieve digital files.

[1094] "Uploading" refers to the act of a user sending and saving a digital file from their own device to a server.

[1095] "Dialogue format" refers to a method in which the system asks the user to input information in the form of questions.

[1096] "Metadata" refers to auxiliary information such as the file's content, target audience, keywords, etc.

[1097] "Storage" refers to the act of a system temporarily or permanently storing input data or files in a storage device.

[1098] "Cloud storage" refers to remote servers that store and share data over the internet.

[1099] A "natural language processing engine" is an artificial intelligence technology for analyzing and understanding human language.

[1100] "Analysis" is the process by which a system examines the contents of data and finds the information it needs.

[1101] "Additional metadata" refers to supplemental information automatically generated by a natural language processing engine.

[1102] "Behavioral history" refers to the operations and search records performed by a user on the system.

[1103] "Recommendation" means that the system presents highly relevant files based on the user's behavioral history, etc.

[1104] A "generative AI model" is a machine learning algorithm used to generate data or fill in missing information.

[1105] "Similarity" is an index that indicates the degree of similarity between different data or objects.

[1106] A "smartphone" is a portable information terminal that can connect to the Internet and run applications.

[1107] The present invention is a system for efficiently managing and searching large volumes of digital documents and reports in a logistics center. This system consists of the following main components:

[1108] System Configuration

[1109] 1. Device:

[1110] The terminals are smartphones used by employees at the logistics center, which they use to upload and retrieve files.

[1111] 2. Server:

[1112] The server is equipped with cloud storage, a natural language processing engine, and a generative AI model that automatically analyzes file content, completes metadata, and recommends related files.

[1113] Program processing

[1114] 1. Uploading files via terminal:

[1115] Users upload files to the system using their smartphones. For example, if an employee wants to upload an annual sales report, they select the file from their local disk and send it to the server through a dedicated app.

[1116] 2. Metadata entry support:

[1117] The device interactively prompts the user to enter metadata for the uploaded file. For example, the device prompts the user to "Please briefly describe the contents of this file," and the user enters "Annual Sales Report."

[1118] 3. Metadata Completion:

[1119] The server uses a generative AI model based on the input metadata to fill in any missing metadata. A possible generative AI model would be OpenAI's GPT-3. For example, from a file description of "Annual Sales Report," the AI ​​could automatically add metadata such as "Financial Report," "2023," and "Annual Sales."

[1120] 4. Save to cloud storage:

[1121] The files are then stored with the completed metadata in cloud storage, such as Amazon S3 or Google Cloud Storage.

[1122] 5. Related file recommendations:

[1123] The server identifies and recommends related files based on the user's past behavior. For example, if a user has searched for sales reports, the server may recommend files such as "previous year's sales report."

[1124] 6. File search function:

[1125] When a user searches for a specific file, they enter a search query into their device. The server analyzes the search query and metadata and automatically presents highly relevant files. For example, by entering "Search for sales report files for management," a list of appropriate files will be displayed.

[1126] Examples of concrete examples and prompts

[1127] For example, suppose a logistics center manager uploads an annual report and describes it as a "sales report by year." The server automatically generates additional metadata such as "financial report," "year 2023," and "annual sales."

[1128] An example prompt is:

[1129] "Please briefly describe the contents of the file: Annual sales report"

[1130] This enables logistics centers to efficiently and quickly manage and search large volumes of digital documents and reports.

[1131] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1132] Step 1:

[1133] A user uses a smartphone to select a digital file and upload it to the system.

[1134] Input: A digital file selected by the user (e.g., annual sales report).

[1135] Specific operation: The user opens the app on their smartphone, clicks the "File Upload" button, and selects "Annual Sales Report.docx" from their local disk.

[1136] Output: The digital file that is sent to the server.

[1137] Step 2:

[1138] The terminal interactively prompts the user to input metadata for the uploaded file.

[1139] Input: Uploaded digital files.

[1140] Specific operation: The terminal displays the prompt "Please briefly describe the contents of this file," and the user enters "Annual sales report."

[1141] Output: User-entered metadata.

[1142] Step 3:

[1143] The device temporarily stores the entered metadata and sends it to cloud storage.

[1144] Input: User-entered metadata and uploaded digital files.

[1145] Specific operation: The device temporarily stores the "Annual Sales Report" and its metadata and sends it to cloud storage.

[1146] Output: Digital files and metadata stored in cloud storage.

[1147] Step 4:

[1148] The server uses a natural language processing engine to analyze the file content and generate additional metadata.

[1149] Input: Files and metadata stored in cloud storage.

[1150] How it works: The server uses a generative AI model (e.g., OpenAI GPT-3) to automatically generate additional metadata such as "Financial Report," "2023," and "Annual Sales" from the description "Sales Report by Year."

[1151] Output: Digital files with additional metadata.

[1152] Step 5:

[1153] The server identifies and recommends related files based on the user's past behavioral history.

[1154] Input: A digital file with a user's past behavior and additional metadata.

[1155] What it does: The server analyzes the user's search history and identifies related files, such as "last year's sales report."

[1156] Output: A list of recommended related files.

[1157] Step 6:

[1158] When a user searches for a particular file, they enter a search query into their device.

[1159] Input: The search query entered by the user (e.g., "Find sales report files for management").

[1160] What happens: A user types a query into the search bar on their smartphone.

[1161] Output: The search query is sent to the server.

[1162] Step 7:

[1163] The server analyzes the search query and metadata and automatically presents highly relevant files.

[1164] Input: Search query and file metadata.

[1165] How it works: The server uses a natural language processing engine to analyze the search query and lists "Report 2023.docx" and "Last year's sales report" in order of relevance.

[1166] Output: A list of highly relevant files.

[1167] Step 8:

[1168] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[1169] Input: A list of highly relevant files.

[1170] Specific operation: The terminal displays a file list to the user, and the user clicks "Annual Sales Report.docx" from the list to open it.

[1171] Output: The file list and selected files as displayed to the user.

[1172] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1173] The AI ​​file management system of the present invention has various functions designed to enable users to efficiently manage and quickly search files. The system combines a metadata input function, a natural language processing engine, and an emotion engine to significantly improve the user experience. A detailed description of specific embodiments of the present invention is provided below.

[1174] User Interface

[1175] 1. A user logs into the system.

[1176] Example: A user accesses a cloud-based file management system and logs in by entering their account information.

[1177] 2. The terminal displays the file upload screen to the logged-in user.

[1178] Example: The user clicks the "Upload" button and selects "Report2023.docx" from the local disk.

[1179] Metadata Input

[1180] 3. The device confirms the file upload and interactively prompts the user to enter metadata.

[1181] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[1182] 4. The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[1183] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[1184] Sending and completing metadata

[1185] 5. The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[1186] Example: The device temporarily saves "Report2023.docx" and its metadata.

[1187] 6. The server stores the file and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[1188] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[1189] Activity history and related file recommendations

[1190] 7. The server-generated metadata is integrated with existing metadata to identify related files based on user behavior history.

[1191] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[1192] Implementing the Emotion Engine

[1193] 8. The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes that information.

[1194] Example: While a user is accessing the system, a camera analyzes facial expressions and a microphone analyzes the tone of voice.

[1195] 9. The server customizes the files and information it recommends based on the emotional state of the user based on the analysis results of the emotion engine.

[1196] Example: If the server detects that the user is feeling stressed, it will recommend "relaxation techniques" or "simple task guides."

[1197] 10. The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine, providing feedback according to the user's emotions.

[1198] Example: If the user is excited, the system changes the color to a calmer one and displays user guidance and tips.

[1199] File search and presentation

[1200] 11. When a user searches for a specific file, they enter a search query.

[1201] Example: A user types "Find management's sales report file" into a search box.

[1202] 12. The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[1203] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[1204] 13. The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[1205] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[1206] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency. Furthermore, the implementation of an emotion engine enables flexible responses according to the user's emotional state, further improving the user experience.

[1207] The processing flow will be explained below.

[1208] Step 1:

[1209] A user logs into the system, selects a file, and uploads it.

[1210] Example: A user accesses a cloud-based file management system, enters their account information, logs in, clicks the "Upload" button, selects "Report 2023.docx" from their local disk, and begins uploading.

[1211] Step 2:

[1212] The device confirms the file upload and interactively prompts the user to enter metadata.

[1213] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[1214] Step 3:

[1215] The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[1216] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[1217] Step 4:

[1218] The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[1219] Example: The device temporarily saves "Report2023.docx" and its metadata.

[1220] Step 5:

[1221] The server stores the files and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[1222] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[1223] Step 6:

[1224] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history.

[1225] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[1226] Step 7:

[1227] The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes that information.

[1228] Example: While a user is accessing the system, the camera analyzes their facial expressions and the microphone analyzes their tone of voice. The emotion engine uses this data to analyze whether the user is feeling stressed.

[1229] Step 8:

[1230] The server customizes recommended files and information according to the user's emotional state based on the analysis results of the emotion engine.

[1231] Example: If the server detects that the user is feeling stressed, it will recommend "relaxation techniques" or "simple task guides."

[1232] Step 9:

[1233] The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine, and provides feedback according to the user's emotions.

[1234] Example: If the user is agitated, the server changes the interface color to a calmer one and displays user guides and tips.

[1235] Step 10:

[1236] When a user searches for a particular file, they enter a search query.

[1237] Example: A user types "Find management's sales report file" into a search box.

[1238] Step 11:

[1239] The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[1240] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[1241] Step 12:

[1242] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[1243] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[1244] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency.In addition, the implementation of an emotion engine enables flexible response according to the user's emotional state, further improving the user experience.

[1245] Example 2

[1246] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1247] Existing file management systems often require manual file search and management, resulting in inefficiencies. Additionally, they lack the ability to respond flexibly to the user's emotional state, preventing an improved user experience.

[1248] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for collecting image and audio information to recognize the user's emotions and analyzing it using an emotion engine, means for dynamically changing the user interface based on the analysis results of the emotion engine and recommending files and information according to the user's emotions, and means for analyzing file contents using a natural language processing engine and generating additional metadata. This allows the user to efficiently search and manage files and flexibly respond to their emotional state.

[1249] A "digital file" is a means of storing and representing data or information in electronic form for use by computers and other electronic devices.

[1250] A "system" is a mechanism in which multiple pieces of hardware and software work together to achieve a specific function.

[1251] A "user" is a user of this system who uploads digital files and inputs metadata.

[1252] The "interactive format" is an interface that emphasizes communication with the user and allows operations to proceed while sequentially exchanging information.

[1253] "Metadata" is data that provides additional information about a digital file, such as its content, audience, keywords, etc.

[1254] "Temporary storage" is the act of storing data for a short period of time and then preparing it for further processing.

[1255] "Cloud storage" is a data storage service available over the Internet.

[1256] A "natural language processing engine" is a program that allows a computer to analyze and understand human language.

[1257] "Additional metadata" is metadata that is newly generated based on the analysis results of the natural language processing engine.

[1258] "Behavioral history" is a record of the operations and searches performed by a user within the system.

[1259] "Related files" are other files that are related to the current operation or search.

[1260] "Recommendation" means that the system presents specific files or information to the user based on the user's behavioral history and metadata.

[1261] An "emotion engine" is a program that analyzes the user's emotional state and responds based on that.

[1262] A "user interface" refers to the screen and operation method used by the user to exchange information with the system.

[1263] The AI ​​file management system of the present invention has various functions to enable users to efficiently manage and quickly search digital files. The system combines a metadata input function, a natural language processing engine, and an emotion engine to significantly improve the user experience.

[1264] Specifically, the system operates as follows.

[1265] User Interface

[1266] A user accesses a cloud-based file management system and enters their account information to log in. After logging in, the device displays a file upload screen for the user. For example, the user clicks the "Upload" button and selects "Report 2023.docx" from their local disk.

[1267] Metadata Input

[1268] The device confirms the file upload and interactively prompts the user to enter metadata. For example, it might prompt the user to "Please briefly describe the contents of this file," and the user might enter "Sales report for 2023." The user might also enter additional information, such as audience and keywords. For example, the user might enter "Audience: Management" and "Keywords: Sales, 2023, Report."

[1269] Sending and completing metadata

[1270] The device temporarily stores the entered metadata and prepares it for transmission to cloud storage. Next, the server stores the file and metadata in cloud storage and uses a natural language processing engine (e.g., natural language processing API) to analyze the file content and generate additional metadata. For example, metadata related to "annual report," "sales," and "finance" can be automatically generated based on the content analysis of "2023 sales report."

[1271] Activity history and related file recommendations

[1272] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history. For example, based on the user's past search history for "sales report," the system identifies "2022 sales report.pdf" and "Q2 sales analysis.xlsx" as related files.

[1273] Implementing the Emotion Engine

[1274] The device uses the camera and microphone to recognize the user's emotions, and the emotion engine (e.g., emotion analysis API) analyzes that information. For example, while the user is accessing the system, the camera analyzes facial expressions and the microphone analyzes the tone of voice. The server customizes the files and information it recommends according to the user's emotional state based on the emotion engine's analysis results. For example, if the user is recognized as feeling stressed, the server will recommend "relaxation methods" or "simple task guides."

[1275] File search and presentation

[1276] When a user searches for a specific file, they enter a search query. For example, they might type "Find a sales report file for management" into the search box. The server analyzes the received search query and suggests the most suitable files based on associated metadata and the user's behavioral history. For example, it might suggest "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance. The device then displays a list of recommended files to the user, allowing them to instantly find the file they are looking for. For example, the user might click "Report 2023.docx" from the suggested file list to open it.

[1277] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency. Furthermore, the implementation of an emotion engine enables flexible responses according to the user's emotional state, further improving the user experience.

[1278] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1279] Step 1:

[1280] A user accesses a cloud-based file management system and logs in by entering their account information on the login screen. At this time, a username and password are entered, which the system receives as authentication information. The system compares the entered information with the database, and if authentication is successful, the user moves to the next screen. The output is the authentication result, and if successful, the file upload screen is displayed.

[1281] Step 2:

[1282] After the terminal logs in, it displays a file upload screen to the user. The user clicks the "Upload" button and selects a file (e.g., "Report 2023.docx") from the local disk. The input is the path of the file selected by the user, and the terminal receives this and starts uploading the file. The output is the temporary storage location of the selected file.

[1283] Step 3:

[1284] The terminal confirms the file upload and interactively prompts the user to enter metadata. The input is confirmation of the existence of the uploaded file and a prompt to the user to enter metadata, with the message "Please briefly describe the contents of this file." The user enters "Sales report for 2023." The output is the entered metadata.

[1285] Step 4:

[1286] The user follows interactive prompts to input metadata such as the file contents, target audience, and keywords. The input is specific information such as "target audience: management" and "keywords: sales, 2023, report," and the terminal receives this information. The output is this metadata information.

[1287] Step 5:

[1288] The device temporarily stores the input metadata and prepares it for sending to cloud storage. The input is the file and metadata to be saved, which the device temporarily saves in local storage. The output is the file and metadata ready to be sent to cloud storage.

[1289] Step 6:

[1290] The server stores the files and metadata in cloud storage, analyzes the file contents using a natural language processing engine, and generates additional metadata. The input is the files stored in cloud storage and the initial metadata, and the server performs analysis based on this. The output is additional metadata (e.g., "Annual Report," "Sales," "Finance") generated based on the analysis results.

[1291] Step 7:

[1292] The server merges the generated metadata with existing metadata and identifies related files based on the user's behavioral history. The input is new and existing metadata and the user's behavioral history, and the server uses this to identify related files (e.g., "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx"). The output is a list of identified related files.

[1293] Step 8:

[1294] The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes the information. The input is the user's facial expression data and tone of voice, and the device sends this information to the emotion engine. The output is the analyzed emotional state.

[1295] Step 9:

[1296] The server customizes the files and information it recommends based on the user's emotional state, based on the analysis results of the emotion engine. The input is the analysis results of the emotion engine, and the server selects recommended information (e.g., "How to relax" or "Simple task guide") based on this. The output is customized recommended information.

[1297] Step 10:

[1298] The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine and provides feedback according to the user's emotions. The input is the analysis results of the emotion engine and the current interface information, and the server optimizes the user interface to suit the user's emotions. The output is a dynamically changed interface.

[1299] Step 11:

[1300] When a user searches for a specific file, they enter a search query. The input is the keywords entered into the search box, say the user types "Find sales report files for management." The output is the search query.

[1301] Step 12:

[1302] The server analyzes the received search query and presents the most appropriate files based on the associated metadata and user behavior history. The input is the search query, associated metadata, and behavior history, and the server generates search results (e.g., "Report 2023.docx," "2022 Sales Report.pdf," "Q2 Sales Analysis.xlsx") based on this. The output is the presented search results.

[1303] Step 13:

[1304] The terminal displays a recommended file list to the user, allowing the user to instantly find the file they are looking for. The input is a file list sent from the server, which the terminal displays to the user. The output is a file list for the user to access.

[1305] The above are the specific processing steps of the program of this system.

[1306] (Application example 2)

[1307] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1308] Efficient management and search of operation manuals and various documents is important on factory floors. However, manual metadata entry and file search are laborious and time-consuming, reducing efficiency. Furthermore, appropriate support based on the emotional state of workers is often not provided, leading to stress and errors. A system that can solve these problems and improve work efficiency and user experience is needed.

[1309] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to upload digital files to the system; means for interactively prompting the user to input metadata for the uploaded files; means for temporarily saving the metadata and sending it to cloud storage; means for analyzing file content using a natural language processing engine and generating additional metadata; means for identifying and recommending related files based on the user's past behavioral history; means for using a camera or microphone to recognize the user's emotions and analyzing the information with an emotion engine; and means for customizing recommended files and information according to the user's emotional state based on the analysis results of the emotion engine. This enables efficient file management and search, and further improves work efficiency and user experience by providing appropriate support according to the user's emotions.

[1310] "User" refers to any individual or entity that uses the System.

[1311] "Digital file" refers to a data file, such as a document, image, audio, or video, stored in electronic form.

[1312] "Uploading" refers to the act of transferring data from your local environment to the cloud or another system.

[1313] "System" refers to a collection of hardware and software configured to achieve a specific function or purpose.

[1314] "Metadata" refers to auxiliary information that describes the content and characteristics of data.

[1315] "Interactive" refers to an interface in which the user and the system interact continuously.

[1316] "Storage" refers to the act of retaining data.

[1317] "Cloud storage" refers to a service that stores data on remote servers available over the Internet.

[1318] A "natural language processing engine" refers to an algorithm or program that analyzes and understands text written in natural language.

[1319] "Associated Files" refers to data or documents related to a particular file.

[1320] An "emotion engine" refers to a module that analyzes the user's emotions and uses the results to adjust the system's behavior.

[1321] "Customization" refers to the act of adjusting or modifying a system or service to suit the needs or circumstances of a particular user.

[1322] "Camera" refers to a device that captures and records images.

[1323] "Microphone" refers to a device for capturing sound.

[1324] "Analysis" refers to the act of breaking down and interpreting data and information to extract meaning and patterns.

[1325] "Behavioral history" refers to the record of operations and searches performed by a user using the system.

[1326] "Recommendation" refers to the act of presenting useful or highly relevant information or files to a user.

[1327] This invention is a system for efficiently managing and searching operation manuals and related documents on factory floors. The invention aims to improve work efficiency and user experience, particularly through an interface using smart glasses.

[1328] Hardware and Software Configuration

[1329] Hardware

[1330] Smart glasses: A device worn by the user to display information and perform voice interaction.

[1331] Camera: Built into the smart glasses and used to capture the user's facial expressions.

[1332] Microphone: Built into the smart glasses and used to capture the user's voice.

[1333] Server: A remote computing resource located in the cloud for data storage and analysis.

[1334] software

[1335] Natural language processing engine: Algorithms for analyzing user-entered metadata and search queries, for example, using the Python transformers library.

[1336] Emotion Engine: A module that analyzes the user's emotions and adjusts the system's behavior based on that information. It uses the OpenCV library.

[1337] Cloud storage service: A service that stores and manages files and metadata, such as AWS S3.

[1338] System Operation

[1339] User Operation

[1340] A user puts on the smart glasses and logs in to the system. After logging in, a file upload screen is displayed on the smart glasses, allowing the user to upload operation manuals and various documents. For the uploaded files, the smart glasses interactively prompt the user to enter metadata.

[1341] For example, when a user uploads "Operation Manual for New Robot 2023," the smart glasses will prompt the user, "Please briefly explain the contents of this file," to which the user can respond verbally, "Operation Manual for New Robot 2023."

[1342] Natural Language Processing and Sentiment Analysis

[1343] The server temporarily stores the metadata sent by the user and sends it to cloud storage. Using a natural language processing engine, the server analyzes the file content and generates additional metadata. The emotion engine also analyzes the user's facial expressions and tone of voice captured by the camera and microphone to recognize their emotional state.

[1344] For example, if the user is recognized as feeling stressed, the server can recommend a "quick operation guide" or a "document on how to relax" in the "related files" section.

[1345] File Management and Search

[1346] When a user enters a search query, the server analyzes the received search query and presents related files based on past behavioral history and metadata. For example, if a user voice-inputs "operation guide for new robot," the server will present "operation manual for new robot 2023.pdf" and "assembly procedure for new robot.xlsx."

[1347] Examples of concrete examples and prompts

[1348] Here are some examples of prompts for generative AI models:

[1349] "This operating manual is a guide to the new 2023 robot model. Key keywords: robot, operating guide, new model, 2023."

[1350] instructions

[1351] Please briefly explain the contents of this operation manual.

[1352] Please list related keywords.

[1353] "Recommend relevant documents based on keywords entered by the user"

[1354] This system will streamline document management and search on the factory floor, and will also provide flexible support based on user emotions, significantly improving the user experience.

[1355] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1356] Step 1:

[1357] The user puts on the smart glasses and logs in to the application. The user accesses the login screen of the smart glasses and enters their account information. The account information as input data is sent to the server, and the authentication process is executed. If the authentication is successful, the user sees a success message and an upload screen.

[1358] Step 2:

[1359] The user uploads an operation manual or document. Using the smart glasses interface, the user clicks the "Upload" button and selects a local file. The uploaded file is temporarily stored by the terminal. The file data and file name as input by the user are sent to the terminal for further processing.

[1360] Step 3:

[1361] The device interactively prompts the user to enter metadata for the uploaded file. The device interface displays a prompt such as "Please briefly describe the contents of this file," and the user enters the metadata by voice. The entered voice data is captured via the microphone and temporarily saved by the device.

[1362] Step 4:

[1363] The server receives the audio data and converts it to text using a natural language processing engine. The server then analyzes the converted text and generates additional metadata based on the file's content. The audio file is converted into text and analyzed to generate keywords and descriptions associated with the file.

[1364] Step 5:

[1365] The generated metadata is sent to the cloud storage. The server compresses the metadata to avoid data delays and sends it to the cloud storage. The generated metadata as input is stored on the cloud, allowing it to be accessed quickly when needed.

[1366] Step 6:

[1367] The server retrieves files and metadata from cloud storage and analyzes the user's past behavior history. Based on the user's previous search queries and file access history, it identifies and recommends relevant files. The past behavior history data is taken as input and an algorithm is run to identify highly relevant files.

[1368] Step 7:

[1369] When a user searches for a file using the smart glasses, the device prompts the user to enter a search query. For example, the user can say, "I'm looking for an operation guide for a new robot," and the device sends a search request to the server.

[1370] Step 8:

[1371] The server analyzes the received search query and suggests the most suitable files based on relevant metadata and past behavior. The analyzed search query is matched with the metadata, and a list of suitable files is generated and sent back to the device.

[1372] Step 9:

[1373] The device displays the recommended file list to the user. The related files are displayed in order on the smart glasses display, and the user can select and view them. The generated file list is displayed as input, and specific file contents are displayed according to the user's selection.

[1374] Step 10:

[1375] The device uses a camera and microphone to analyze the user's emotional state. The camera captures the user's facial expressions and the microphone records their tone of voice. This data is sent to the server and analyzed by the emotion engine.

[1376] Step 11:

[1377] The server then provides customized information based on the user's emotional state based on the analysis results of the emotion engine. For example, if the server detects that the user is feeling stressed, it will recommend information on relaxation methods or simple task guides. The server analyzes the emotional state data as input, generates appropriate recommendations, and sends them to the device.

[1378] As described above, by clarifying the specific operations performed in each step and the flow of input and output data, it is possible to explain specific embodiments of the present invention.

[1379] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1380] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1381] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1382] [Fourth embodiment]

[1383] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1384] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1385] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1386] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1387] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1388] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1389] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1390] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1391] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1392] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1393] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1394] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1395] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1396] The AI ​​file management system of the present invention has various functions designed to enable users to efficiently manage and quickly search for files. The system begins with a process in which a user uploads a file and enters metadata, after which the AI ​​automatically completes the metadata and recommends related files. Specific embodiments of the system are described in detail below.

[1397] User Interface

[1398] 1. A user logs into the system.

[1399] Example: A user accesses a cloud-based file management system and logs in by entering their account information.

[1400] 2. The terminal displays the file upload screen to the logged-in user.

[1401] Example: The user clicks the "Upload" button and selects "Report2023.docx" from the local disk.

[1402] Metadata Input

[1403] 3. The device confirms the file upload and interactively prompts the user to enter metadata.

[1404] Example: The terminal displays "Please briefly describe the contents of this file," and the user types "Sales Report 2023."

[1405] 4. The user enters metadata such as the file's content, audience, and keywords.

[1406] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[1407] Sending and completing metadata

[1408] 5. The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[1409] Example: The device temporarily saves "Report2023.docx" and its metadata.

[1410] 6. The server stores the received files and metadata in cloud storage and uses a natural language processing engine to complete any missing metadata.

[1411] Example: The server analyzes the content of "Sales Report 2023" and adds metadata about "Annual Report," "Sales," and "Finance."

[1412] Activity history and related file recommendations

[1413] 7. The server identifies related files based on the user's past behavior history and recommends them to the user.

[1414] Example: The server recommends "Sales Report 2022.pdf" based on the user's search history for "Sales Report."

[1415] File search and presentation

[1416] 8. When a user searches for a specific file, they enter a search query.

[1417] Example: A user types, "Find the sales report file for management."

[1418] 9. The server analyzes the search query and presents the most suitable files based on relevant metadata and past behavior.

[1419] Example: The server presents "Report 2023.docx" and "2022 Sales Report.pdf" in order of relevance.

[1420] 10. The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[1421] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[1422] In this way, the specific operations at each step provide an environment in which users can efficiently manage and search for files. The system of the present invention realizes automation and efficiency of file management, and can improve business productivity, making it extremely useful for users.

[1423] The processing flow will be explained below.

[1424] Step 1:

[1425] A user logs into the system, selects a file, and uploads it.

[1426] Example: A user accesses the system homepage, enters their account information, and logs in. Then, they click the "Upload" button, select "Report 2023.docx" from their local disk, and begin uploading.

[1427] Step 2:

[1428] The device confirms the file upload and interactively prompts the user to enter metadata.

[1429] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[1430] Step 3:

[1431] The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[1432] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[1433] Step 4:

[1434] The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[1435] Example: The device temporarily saves "Report2023.docx" and its metadata.

[1436] Step 5:

[1437] The server stores the files and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[1438] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[1439] Step 6:

[1440] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history.

[1441] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[1442] Step 7:

[1443] When a user searches for a particular file on the system, they enter a search query.

[1444] Example: A user types "Find management's sales report file" into a search box.

[1445] Step 8:

[1446] The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[1447] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[1448] Step 9:

[1449] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[1450] Example: The device displays a file list, and the user clicks on "Report 2023.docx" to open it.

[1451] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency.

[1452] Example 1

[1453] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1454] Conventional file management systems require users to manually manage large volumes of files, resulting in inefficient file uploads, metadata entry, and related file searches, which reduces work productivity. Furthermore, it is difficult for users to quickly find specific files, preventing them from efficiently using related information.

[1455] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1456] In this invention, the server includes means for a user to upload digital files to the system, means for interactively prompting the user to input metadata for the uploaded files, means for temporarily saving the metadata and sending it to cloud storage, means for analyzing file content using a natural language processing device and generating additional metadata, means for identifying and recommending related files based on the user's past behavior history, means for a user to input a search query when searching for a specific file, means for presenting related files based on the search query and metadata, and means for displaying a list of recommended files to the user, thereby enabling users to efficiently manage their files and quickly search for and obtain required files.

[1457] "User" means any person or entity that accesses and operates the System.

[1458] "Digital file" refers to any type of data file used on a computer.

[1459] "System" is a general term for the series of hardware and software that constitute the AI ​​file management system of the present invention.

[1460] "Upload" refers to the act of transferring a file from a local device to cloud storage or a server.

[1461] "Interactive" refers to a method in which a user and a system communicate interactively, exchanging information through questions and answers.

[1462] "Metadata" refers to data that describes information about a digital file, including the file's content, audience, keywords, etc.

[1463] "Temporarily storing" refers to the operation of temporarily holding files or data in memory or storage.

[1464] "Cloud storage" refers to online storage services accessible via the Internet.

[1465] "Natural language processing device" refers to software or hardware for understanding and analyzing natural language.

[1466] "Additional metadata" refers to complementary information that is added to the original metadata.

[1467] "Behavioral history" refers to historical information such as the operations and search queries a user performs within the system.

[1468] "Related files" refer to files that are relevant to a user based on specified metadata and behavioral history.

[1469] A "search query" refers to a string or phrase that a user enters to search for specific information.

[1470] "Presenting" refers to the operation of displaying files or information to the user as search results.

[1471] "Recommended file list" refers to a list of highly relevant files that the system suggests to the user.

[1472] The AI ​​file management system of the present invention includes a series of processes and functions designed to enable users to efficiently manage and quickly search for files. The system begins with a process in which a user uploads a digital file and inputs related metadata, and then uses a natural language processing device to complement the metadata and recommend related files.

[1473] User Interface

[1474] When a user logs in to the system, they open a browser, enter the URL of the cloud-based file management system, and enter their user ID and password. After successful login, the device will display a file upload screen for the user. The user can click the "Upload" button on this screen to select and upload files from their local disk.

[1475] Metadata Input

[1476] For uploaded files, the device interactively prompts the user to enter metadata. For example, a prompt may appear saying, "Please briefly describe the contents of this file." The user then enters specific details. In addition, the user may enter additional metadata such as the file's content, target audience, and keywords.

[1477] Sending and completing metadata

[1478] Once the metadata is entered, the device temporarily stores it and prepares it for transmission to cloud storage. The transmitted file and metadata are then stored in cloud storage by the server. The server then uses a natural language processing system to analyze the file content and automatically complete any missing metadata. Specifically, the server analyzes the content of "2023 sales report" and adds metadata such as "annual report," "sales," and "finance."

[1479] Activity history and related file recommendations

[1480] Furthermore, the server identifies related files based on the user's past behavior history and recommends them to the user. For example, the server recommends "Sales Report 2022.pdf" based on the user's search history for "Sales Report."

[1481] File search and presentation

[1482] When a user searches for a specific file, they enter a search query, such as "Find sales report files for management," into the search bar. The server analyzes this search query and suggests the most suitable files based on associated metadata and past activity. The suggested file list is then displayed to the user on their device, allowing them to instantly find the file they are looking for.

[1483] Examples of prompt statements

[1484] Here are some example prompts to input to a generative AI model:

[1485] "Please explain the process of how a user logs into a file management system, uploads a file, and enters metadata. The system then automatically completes the metadata and recommends related files to the user."

[1486] By using this prompt, the generative AI model can be made to describe the system's sequence of operations in natural language.

[1487] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1488] Step 1:

[1489] A user logs in to the system.

[1490] Specific operation: Open a browser, enter the URL of the cloud-based file management system, and the login screen will appear. Enter your user ID and password and click the "Login" button.

[1491] Input: User ID, Password

[1492] Output: The user is logged in.

[1493] Step 2:

[1494] The terminal displays a file upload screen to the logged-in user.

[1495] What happens: User navigates to the dashboard and sees the "File Upload" section. User clicks the "Upload" button, which opens a file selection dialog. User selects a file from their local disk and clicks "Open".

[1496] Input: User clicks, selected files

[1497] Output: The path of the file to be uploaded

[1498] Step 3:

[1499] For uploaded files, the terminal interactively prompts the user to input metadata.

[1500] What it does: Once the file upload is confirmed, the device will prompt you to "Please briefly describe the contents of this file."

[1501] Input: Uploaded file path, user answer

[1502] Output: Initial metadata entered by the user

[1503] Step 4:

[1504] The user enters metadata such as the file's content, target audience, and keywords.

[1505] Specific operation: The user enters information such as the file content, target audience, and keywords into the text box and clicks the "Save" button.

[1506] Input: User-entered metadata (e.g., file content, audience, keywords)

[1507] Output: Metadata input completion signal

[1508] Step 5:

[1509] The device temporarily stores the entered metadata and prepares it for transmission to cloud storage.

[1510] Specific operation: The device temporarily stores metadata and file information in local memory and formats the data for sending to cloud storage.

[1511] Input: Entered metadata, uploaded file path

[1512] Output: Temporarily saved metadata and file information

[1513] Step 6:

[1514] The server stores the received files and metadata in cloud storage and uses a natural language processing device to complete any missing metadata.

[1515] How it works: The server stores files and metadata in cloud storage, analyzes the files using a natural language processing system, and automatically generates missing metadata based on the analysis results and adds it to the original metadata.

[1516] Input: File, initial metadata

[1517] Output: Completed metadata

[1518] Step 7:

[1519] The server identifies related files based on the user's past behavior history and recommends them to the user.

[1520] How it works: The server analyzes the user's past search history and access logs to identify relevant files, and then recommends the most suitable files to the user.

[1521] Input: User behavior history

[1522] Output: Recommended file list

[1523] Step 8:

[1524] When a user searches for a particular file, they enter a search query.

[1525] What happens: Enter a query in the search bar and click the "Search" button.

[1526] Input: Search query

[1527] Output: Search request based on the search query

[1528] Step 9:

[1529] The server analyzes the search query and presents the most suitable files based on associated metadata and past behavior.

[1530] What it does: It uses a natural language processor to analyze your search query, match it with relevant metadata and historical behavior, score the best files, and sort them by relevance.

[1531] Input: Search query, metadata, behavioral history

[1532] Output: Related file list

[1533] Step 10:

[1534] The terminal displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[1535] Specific operation: The device displays a list of search results, and the user clicks on the desired file to open it.

[1536] Input: Related file list

[1537] Output: Displayed file list and selected file

[1538] (Application example 1)

[1539] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1540] In conventional logistics centers, file management has been challenging due to the difficulty of efficiently and quickly handling large volumes of digital documents and reports. Searching for files and recommending related files takes time, reducing work efficiency. Manually entering metadata often requires time and introduces errors, further reducing efficiency. To solve these issues, a file management system using AI is needed.

[1541] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1542] In this invention, the server includes: a means for a user to upload digital files to the system; a means for interactively prompting the user to input metadata for the uploaded files; a means for temporarily storing the metadata and sending it to cloud storage; a means for analyzing file content using a natural language processing engine and generating additional metadata; a means for identifying and recommending related files based on the user's past behavioral history; a means for automatically completing missing metadata using a generative AI model; a means for managing files and their metadata on the cloud and recommending highly similar files; and a means for uploading and searching files using a smartphone. This enables efficient and rapid management and search of large volumes of digital documents and reports at logistics centers.

[1543] "User" means a person who accesses the system to upload and retrieve digital files.

[1544] A "digital file" is a digital data file, such as a document, image, or audio file, that is handled on a computer.

[1545] A "system" is a collection of hardware and software designed to enable users to efficiently manage and retrieve digital files.

[1546] "Uploading" refers to the act of a user sending and saving a digital file from their own device to a server.

[1547] "Dialogue format" refers to a method in which the system asks the user to input information in the form of questions.

[1548] "Metadata" refers to auxiliary information such as the file's content, target audience, keywords, etc.

[1549] "Storage" refers to the act of a system temporarily or permanently storing input data or files in a storage device.

[1550] "Cloud storage" refers to remote servers that store and share data over the internet.

[1551] A "natural language processing engine" is an artificial intelligence technology for analyzing and understanding human language.

[1552] "Analysis" is the process by which a system examines the contents of data and finds the information it needs.

[1553] "Additional metadata" refers to supplemental information automatically generated by a natural language processing engine.

[1554] "Behavioral history" refers to the operations and search records performed by a user on the system.

[1555] "Recommendation" means that the system presents highly relevant files based on the user's behavioral history, etc.

[1556] A "generative AI model" is a machine learning algorithm used to generate data or fill in missing information.

[1557] "Similarity" is an index that indicates the degree of similarity between different data or objects.

[1558] A "smartphone" is a portable information terminal that can connect to the Internet and run applications.

[1559] The present invention is a system for efficiently managing and searching large volumes of digital documents and reports in a logistics center. This system consists of the following main components:

[1560] System Configuration

[1561] 1. Device:

[1562] The terminals are smartphones used by employees at the logistics center, which they use to upload and retrieve files.

[1563] 2. Server:

[1564] The server is equipped with cloud storage, a natural language processing engine, and a generative AI model that automatically analyzes file content, completes metadata, and recommends related files.

[1565] Program processing

[1566] 1. Uploading files via terminal:

[1567] Users upload files to the system using their smartphones. For example, if an employee wants to upload an annual sales report, they select the file from their local disk and send it to the server through a dedicated app.

[1568] 2. Metadata entry support:

[1569] The device interactively prompts the user to enter metadata for the uploaded file. For example, the device prompts the user to "Please briefly describe the contents of this file," and the user enters "Annual Sales Report."

[1570] 3. Metadata Completion:

[1571] The server uses a generative AI model based on the input metadata to fill in any missing metadata. A possible generative AI model would be OpenAI's GPT-3. For example, from a file description of "Annual Sales Report," the AI ​​could automatically add metadata such as "Financial Report," "2023," and "Annual Sales."

[1572] 4. Save to cloud storage:

[1573] The files are then stored with the completed metadata in cloud storage, such as Amazon S3 or Google Cloud Storage.

[1574] 5. Related file recommendations:

[1575] The server identifies and recommends related files based on the user's past behavior. For example, if a user has searched for sales reports, the server may recommend files such as "previous year's sales report."

[1576] 6. File search function:

[1577] When a user searches for a specific file, they enter a search query into their device. The server analyzes the search query and metadata and automatically presents highly relevant files. For example, by entering "Search for sales report files for management," a list of appropriate files will be displayed.

[1578] Examples of concrete examples and prompts

[1579] For example, suppose a logistics center manager uploads an annual report and describes it as a "sales report by year." The server automatically generates additional metadata such as "financial report," "year 2023," and "annual sales."

[1580] An example prompt is:

[1581] "Please briefly describe the contents of the file: Annual sales report"

[1582] This enables logistics centers to efficiently and quickly manage and search large volumes of digital documents and reports.

[1583] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1584] Step 1:

[1585] A user uses a smartphone to select a digital file and upload it to the system.

[1586] Input: A digital file selected by the user (e.g., annual sales report).

[1587] Specific operation: The user opens the app on their smartphone, clicks the "File Upload" button, and selects "Annual Sales Report.docx" from their local disk.

[1588] Output: The digital file that is sent to the server.

[1589] Step 2:

[1590] The terminal interactively prompts the user to input metadata for the uploaded file.

[1591] Input: Uploaded digital files.

[1592] Specific operation: The terminal displays the prompt "Please briefly describe the contents of this file," and the user enters "Annual sales report."

[1593] Output: User-entered metadata.

[1594] Step 3:

[1595] The device temporarily stores the entered metadata and sends it to cloud storage.

[1596] Input: User-entered metadata and uploaded digital files.

[1597] Specific operation: The device temporarily stores the "Annual Sales Report" and its metadata and sends it to cloud storage.

[1598] Output: Digital files and metadata stored in cloud storage.

[1599] Step 4:

[1600] The server uses a natural language processing engine to analyze the file content and generate additional metadata.

[1601] Input: Files and metadata stored in cloud storage.

[1602] How it works: The server uses a generative AI model (e.g., OpenAI GPT-3) to automatically generate additional metadata such as "Financial Report," "2023," and "Annual Sales" from the description "Sales Report by Year."

[1603] Output: Digital files with additional metadata.

[1604] Step 5:

[1605] The server identifies and recommends related files based on the user's past behavioral history.

[1606] Input: A digital file with a user's past behavior and additional metadata.

[1607] What it does: The server analyzes the user's search history and identifies related files, such as "last year's sales report."

[1608] Output: A list of recommended related files.

[1609] Step 6:

[1610] When a user searches for a particular file, they enter a search query into their device.

[1611] Input: The search query entered by the user (e.g., "Find sales report files for management").

[1612] What happens: A user types a query into the search bar on their smartphone.

[1613] Output: The search query is sent to the server.

[1614] Step 7:

[1615] The server analyzes the search query and metadata and automatically presents highly relevant files.

[1616] Input: Search query and file metadata.

[1617] How it works: The server uses a natural language processing engine to analyze the search query and lists "Report 2023.docx" and "Last year's sales report" in order of relevance.

[1618] Output: A list of highly relevant files.

[1619] Step 8:

[1620] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[1621] Input: A list of highly relevant files.

[1622] Specific operation: The terminal displays a file list to the user, and the user clicks "Annual Sales Report.docx" from the list to open it.

[1623] Output: The file list and selected files as displayed to the user.

[1624] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1625] The AI ​​file management system of the present invention has various functions designed to enable users to efficiently manage and quickly search files. The system combines a metadata input function, a natural language processing engine, and an emotion engine to significantly improve the user experience. A detailed description of specific embodiments of the present invention is provided below.

[1626] User Interface

[1627] 1. A user logs into the system.

[1628] Example: A user accesses a cloud-based file management system and logs in by entering their account information.

[1629] 2. The terminal displays the file upload screen to the logged-in user.

[1630] Example: The user clicks the "Upload" button and selects "Report2023.docx" from the local disk.

[1631] Metadata Input

[1632] 3. The device confirms the file upload and interactively prompts the user to enter metadata.

[1633] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[1634] 4. The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[1635] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[1636] Sending and completing metadata

[1637] 5. The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[1638] Example: The device temporarily saves "Report2023.docx" and its metadata.

[1639] 6. The server stores the file and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[1640] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[1641] Activity history and related file recommendations

[1642] 7. The server-generated metadata is integrated with existing metadata to identify related files based on user behavior history.

[1643] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[1644] Implementing the Emotion Engine

[1645] 8. The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes that information.

[1646] Example: While a user is accessing the system, a camera analyzes facial expressions and a microphone analyzes the tone of voice.

[1647] 9. The server customizes the files and information it recommends based on the emotional state of the user based on the analysis results of the emotion engine.

[1648] Example: If the server detects that the user is feeling stressed, it will recommend "relaxation techniques" or "simple task guides."

[1649] 10. The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine, providing feedback according to the user's emotions.

[1650] Example: If the user is excited, the system changes the color to a calmer one and displays user guidance and tips.

[1651] File search and presentation

[1652] 11. When a user searches for a specific file, they enter a search query.

[1653] Example: A user types "Find management's sales report file" into a search box.

[1654] 12. The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[1655] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[1656] 13. The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[1657] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[1658] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency. Furthermore, the implementation of an emotion engine enables flexible responses according to the user's emotional state, further improving the user experience.

[1659] The processing flow will be explained below.

[1660] Step 1:

[1661] A user logs into the system, selects a file, and uploads it.

[1662] Example: A user accesses a cloud-based file management system, enters their account information, logs in, clicks the "Upload" button, selects "Report 2023.docx" from their local disk, and begins uploading.

[1663] Step 2:

[1664] The device confirms the file upload and interactively prompts the user to enter metadata.

[1665] Example: The terminal displays the prompt "Please briefly describe what this file contains," and the user types "Sales Report 2023."

[1666] Step 3:

[1667] The user follows interactive prompts to enter metadata such as file content, audience, and keywords.

[1668] Example: A user enters "Audience: Management" and "Keywords: Sales, 2023, Report."

[1669] Step 4:

[1670] The device temporarily stores the entered metadata and prepares to send it to cloud storage.

[1671] Example: The device temporarily saves "Report2023.docx" and its metadata.

[1672] Step 5:

[1673] The server stores the files and metadata in cloud storage and uses a natural language processing engine to analyze the file content and generate additional metadata.

[1674] Example: The server automatically generates metadata about "Annual Report," "Sales," and "Finance" based on content analysis of "Sales Report for 2023."

[1675] Step 6:

[1676] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history.

[1677] Example: The server identifies "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx" as related files based on the user's past search history for "Sales Report."

[1678] Step 7:

[1679] The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes that information.

[1680] Example: While a user is accessing the system, the camera analyzes their facial expressions and the microphone analyzes their tone of voice. The emotion engine uses this data to analyze whether the user is feeling stressed.

[1681] Step 8:

[1682] The server customizes recommended files and information according to the user's emotional state based on the analysis results of the emotion engine.

[1683] Example: If the server detects that the user is feeling stressed, it will recommend "relaxation techniques" or "simple task guides."

[1684] Step 9:

[1685] The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine, and provides feedback according to the user's emotions.

[1686] Example: If the user is agitated, the server changes the interface color to a calmer one and displays user guides and tips.

[1687] Step 10:

[1688] When a user searches for a particular file, they enter a search query.

[1689] Example: A user types "Find management's sales report file" into a search box.

[1690] Step 11:

[1691] The server analyzes the received search query and presents the most suitable files based on the associated metadata and user behavior history.

[1692] Example: The server presents "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance.

[1693] Step 12:

[1694] The device displays a list of recommended files to the user, allowing the user to instantly find the file they are looking for.

[1695] Example: A user clicks on "Report 2023.docx" from a presented file list to open it.

[1696] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency.In addition, the implementation of an emotion engine enables flexible response according to the user's emotional state, further improving the user experience.

[1697] Example 2

[1698] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1699] Existing file management systems often require manual file search and management, resulting in inefficiencies. Additionally, they lack the ability to respond flexibly to the user's emotional state, preventing an improved user experience.

[1700] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for collecting image and audio information to recognize the user's emotions and analyzing it using an emotion engine, means for dynamically changing the user interface based on the analysis results of the emotion engine and recommending files and information according to the user's emotions, and means for analyzing file contents using a natural language processing engine and generating additional metadata. This allows the user to efficiently search and manage files and flexibly respond to their emotional state.

[1701] A "digital file" is a means of storing and representing data or information in electronic form for use by computers and other electronic devices.

[1702] A "system" is a mechanism in which multiple pieces of hardware and software work together to achieve a specific function.

[1703] A "user" is a user of this system who uploads digital files and inputs metadata.

[1704] The "interactive format" is an interface that emphasizes communication with the user and allows operations to proceed while sequentially exchanging information.

[1705] "Metadata" is data that provides additional information about a digital file, such as its content, audience, keywords, etc.

[1706] "Temporary storage" is the act of storing data for a short period of time and then preparing it for further processing.

[1707] "Cloud storage" is a data storage service available over the Internet.

[1708] A "natural language processing engine" is a program that allows a computer to analyze and understand human language.

[1709] "Additional metadata" is metadata that is newly generated based on the analysis results of the natural language processing engine.

[1710] "Behavioral history" is a record of the operations and searches performed by a user within the system.

[1711] "Related files" are other files that are related to the current operation or search.

[1712] "Recommendation" means that the system presents specific files or information to the user based on the user's behavioral history and metadata.

[1713] An "emotion engine" is a program that analyzes the user's emotional state and responds based on that.

[1714] A "user interface" refers to the screen and operation method used by the user to exchange information with the system.

[1715] The AI ​​file management system of the present invention has various functions to enable users to efficiently manage and quickly search digital files. The system combines a metadata input function, a natural language processing engine, and an emotion engine to significantly improve the user experience.

[1716] Specifically, the system operates as follows.

[1717] User Interface

[1718] A user accesses a cloud-based file management system and enters their account information to log in. After logging in, the device displays a file upload screen for the user. For example, the user clicks the "Upload" button and selects "Report 2023.docx" from their local disk.

[1719] Metadata Input

[1720] The device confirms the file upload and interactively prompts the user to enter metadata. For example, it might prompt the user to "Please briefly describe the contents of this file," and the user might enter "Sales report for 2023." The user might also enter additional information, such as audience and keywords. For example, the user might enter "Audience: Management" and "Keywords: Sales, 2023, Report."

[1721] Sending and completing metadata

[1722] The device temporarily stores the entered metadata and prepares it for transmission to cloud storage. Next, the server stores the file and metadata in cloud storage and uses a natural language processing engine (e.g., natural language processing API) to analyze the file content and generate additional metadata. For example, metadata related to "annual report," "sales," and "finance" can be automatically generated based on the content analysis of "2023 sales report."

[1723] Activity history and related file recommendations

[1724] The server-generated metadata is integrated with existing metadata to identify related files based on the user's behavioral history. For example, based on the user's past search history for "sales report," the system identifies "2022 sales report.pdf" and "Q2 sales analysis.xlsx" as related files.

[1725] Implementing the Emotion Engine

[1726] The device uses the camera and microphone to recognize the user's emotions, and the emotion engine (e.g., emotion analysis API) analyzes that information. For example, while the user is accessing the system, the camera analyzes facial expressions and the microphone analyzes the tone of voice. The server customizes the files and information it recommends according to the user's emotional state based on the emotion engine's analysis results. For example, if the user is recognized as feeling stressed, the server will recommend "relaxation methods" or "simple task guides."

[1727] File search and presentation

[1728] When a user searches for a specific file, they enter a search query. For example, they might type "Find a sales report file for management" into the search box. The server analyzes the received search query and suggests the most suitable files based on associated metadata and the user's behavioral history. For example, it might suggest "Report 2023.docx," "2022 Sales Report.pdf," and "Q2 Sales Analysis.xlsx" in order of relevance. The device then displays a list of recommended files to the user, allowing them to instantly find the file they are looking for. For example, the user might click "Report 2023.docx" from the suggested file list to open it.

[1729] This specific processing flow helps the system efficiently manage and search for the files users need, greatly improving work efficiency. Furthermore, the implementation of an emotion engine enables flexible responses according to the user's emotional state, further improving the user experience.

[1730] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1731] Step 1:

[1732] A user accesses a cloud-based file management system and logs in by entering their account information on the login screen. At this time, a username and password are entered, which the system receives as authentication information. The system compares the entered information with the database, and if authentication is successful, the user moves to the next screen. The output is the authentication result, and if successful, the file upload screen is displayed.

[1733] Step 2:

[1734] After the terminal logs in, it displays a file upload screen to the user. The user clicks the "Upload" button and selects a file (e.g., "Report 2023.docx") from the local disk. The input is the path of the file selected by the user, and the terminal receives this and starts uploading the file. The output is the temporary storage location of the selected file.

[1735] Step 3:

[1736] The terminal confirms the file upload and interactively prompts the user to enter metadata. The input is confirmation of the existence of the uploaded file and a prompt to the user to enter metadata, with the message "Please briefly describe the contents of this file." The user enters "Sales report for 2023." The output is the entered metadata.

[1737] Step 4:

[1738] The user follows interactive prompts to input metadata such as the file contents, target audience, and keywords. The input is specific information such as "target audience: management" and "keywords: sales, 2023, report," and the terminal receives this information. The output is this metadata information.

[1739] Step 5:

[1740] The device temporarily stores the input metadata and prepares it for sending to cloud storage. The input is the file and metadata to be saved, which the device temporarily saves in local storage. The output is the file and metadata ready to be sent to cloud storage.

[1741] Step 6:

[1742] The server stores the files and metadata in cloud storage, analyzes the file contents using a natural language processing engine, and generates additional metadata. The input is the files stored in cloud storage and the initial metadata, and the server performs analysis based on this. The output is additional metadata (e.g., "Annual Report," "Sales," "Finance") generated based on the analysis results.

[1743] Step 7:

[1744] The server merges the generated metadata with existing metadata and identifies related files based on the user's behavioral history. The input is new and existing metadata and the user's behavioral history, and the server uses this to identify related files (e.g., "2022 Sales Report.pdf" and "Q2 Sales Analysis.xlsx"). The output is a list of identified related files.

[1745] Step 8:

[1746] The device uses a camera and microphone to recognize the user's emotions, and the emotion engine analyzes the information. The input is the user's facial expression data and tone of voice, and the device sends this information to the emotion engine. The output is the analyzed emotional state.

[1747] Step 9:

[1748] The server customizes the files and information it recommends based on the user's emotional state, based on the analysis results of the emotion engine. The input is the analysis results of the emotion engine, and the server selects recommended information (e.g., "How to relax" or "Simple task guide") based on this. The output is customized recommended information.

[1749] Step 10:

[1750] The server dynamically changes the display content of the user interface based on the analysis results of the emotion engine and provides feedback according to the user's emotions. The input is the analysis results of the emotion engine and the current interface information, and the server optimizes the user interface to suit the user's emotions. The output is a dynamically changed interface.

[1751] Step 11:

[1752] When a user searches for a specific file, they enter a search query. The input is the keywords entered into the search box, say the user types "Find sales report files for management." The output is the search query.

[1753] Step 12:

[1754] The server analyzes the received search query and presents the most appropriate files based on the associated metadata and user behavior history. The input is the search query, associated metadata, and behavior history, and the server generates search results (e.g., "Report 2023.docx," "2022 Sales Report.pdf," "Q2 Sales Analysis.xlsx") based on this. The output is the presented search results.

[1755] Step 13:

[1756] The terminal displays a recommended file list to the user, allowing the user to instantly find the file they are looking for. The input is a file list sent from the server, which the terminal displays to the user. The output is a file list for the user to access.

[1757] The above are the specific processing steps of the program of this system.

[1758] (Application example 2)

[1759] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1760] Efficient management and search of operation manuals and various documents is important on factory floors. However, manual metadata entry and file search are laborious and time-consuming, reducing efficiency. Furthermore, appropriate support based on the emotional state of workers is often not provided, leading to stress and errors. A system that can solve these problems and improve work efficiency and user experience is needed.

[1761] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to upload digital files to the system; means for interactively prompting the user to input metadata for the uploaded files; means for temporarily saving the metadata and sending it to cloud storage; means for analyzing file content using a natural language processing engine and generating additional metadata; means for identifying and recommending related files based on the user's past behavioral history; means for using a camera or microphone to recognize the user's emotions and analyzing the information with an emotion engine; and means for customizing recommended files and information according to the user's emotional state based on the analysis results of the emotion engine. This enables efficient file management and search, and further improves work efficiency and user experience by providing appropriate support according to the user's emotions.

[1762] "User" refers to any individual or entity that uses the System.

[1763] "Digital file" refers to a data file, such as a document, image, audio, or video, stored in electronic form.

[1764] "Uploading" refers to the act of transferring data from your local environment to the cloud or another system.

[1765] "System" refers to a collection of hardware and software configured to achieve a specific function or purpose.

[1766] "Metadata" refers to auxiliary information that describes the content and characteristics of data.

[1767] "Interactive" refers to an interface in which the user and the system interact continuously.

[1768] "Storage" refers to the act of retaining data.

[1769] "Cloud storage" refers to a service that stores data on remote servers available over the Internet.

[1770] A "natural language processing engine" refers to an algorithm or program that analyzes and understands text written in natural language.

[1771] "Associated Files" refers to data or documents related to a particular file.

[1772] An "emotion engine" refers to a module that analyzes the user's emotions and uses the results to adjust the system's behavior.

[1773] "Customization" refers to the act of adjusting or modifying a system or service to suit the needs or circumstances of a particular user.

[1774] "Camera" refers to a device that captures and records images.

[1775] "Microphone" refers to a device for capturing sound.

[1776] "Analysis" refers to the act of breaking down and interpreting data and information to extract meaning and patterns.

[1777] "Behavioral history" refers to the record of operations and searches performed by a user using the system.

[1778] "Recommendation" refers to the act of presenting useful or highly relevant information or files to a user.

[1779] This invention is a system for efficiently managing and searching operation manuals and related documents on factory floors. The invention aims to improve work efficiency and user experience, particularly through an interface using smart glasses.

[1780] Hardware and Software Configuration

[1781] Hardware

[1782] Smart glasses: A device worn by the user to display information and perform voice interaction.

[1783] Camera: Built into the smart glasses and used to capture the user's facial expressions.

[1784] Microphone: Built into the smart glasses and used to capture the user's voice.

[1785] Server: A remote computing resource located in the cloud for data storage and analysis.

[1786] software

[1787] Natural language processing engine: Algorithms for analyzing user-entered metadata and search queries, for example, using the Python transformers library.

[1788] Emotion Engine: A module that analyzes the user's emotions and adjusts the system's behavior based on that information. It uses the OpenCV library.

[1789] Cloud storage service: A service that stores and manages files and metadata, such as AWS S3.

[1790] System Operation

[1791] User Operation

[1792] A user puts on the smart glasses and logs in to the system. After logging in, a file upload screen is displayed on the smart glasses, allowing the user to upload operation manuals and various documents. For the uploaded files, the smart glasses interactively prompt the user to enter metadata.

[1793] For example, when a user uploads "Operation Manual for New Robot 2023," the smart glasses will prompt the user, "Please briefly explain the contents of this file," to which the user can respond verbally, "Operation Manual for New Robot 2023."

[1794] Natural Language Processing and Sentiment Analysis

[1795] The server temporarily stores the metadata sent by the user and sends it to cloud storage. Using a natural language processing engine, the server analyzes the file content and generates additional metadata. The emotion engine also analyzes the user's facial expressions and tone of voice captured by the camera and microphone to recognize their emotional state.

[1796] For example, if the user is recognized as feeling stressed, the server can recommend a "quick operation guide" or a "document on how to relax" in the "related files" section.

[1797] File Management and Search

[1798] When a user enters a search query, the server analyzes the received search query and presents related files based on past behavioral history and metadata. For example, if a user voice-inputs "operation guide for new robot," the server will present "operation manual for new robot 2023.pdf" and "assembly procedure for new robot.xlsx."

[1799] Examples of concrete examples and prompts

[1800] Here are some examples of prompts for generative AI models:

[1801] "This operating manual is a guide to the new 2023 robot model. Key keywords: robot, operating guide, new model, 2023."

[1802] instructions

[1803] Please briefly explain the contents of this operation manual.

[1804] Please list related keywords.

[1805] "Recommend relevant documents based on keywords entered by the user"

[1806] This system will streamline document management and search on the factory floor, and will also provide flexible support based on user emotions, significantly improving the user experience.

[1807] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1808] Step 1:

[1809] The user puts on the smart glasses and logs in to the application. The user accesses the login screen of the smart glasses and enters their account information. The account information as input data is sent to the server, and the authentication process is executed. If the authentication is successful, the user sees a success message and an upload screen.

[1810] Step 2:

[1811] The user uploads an operation manual or document. Using the smart glasses interface, the user clicks the "Upload" button and selects a local file. The uploaded file is temporarily stored by the terminal. The file data and file name as input by the user are sent to the terminal for further processing.

[1812] Step 3:

[1813] The device interactively prompts the user to enter metadata for the uploaded file. The device interface displays a prompt such as "Please briefly describe the contents of this file," and the user enters the metadata by voice. The entered voice data is captured via the microphone and temporarily saved by the device.

[1814] Step 4:

[1815] The server receives the audio data and converts it to text using a natural language processing engine. The server then analyzes the converted text and generates additional metadata based on the file's content. The audio file is converted into text and analyzed to generate keywords and descriptions associated with the file.

[1816] Step 5:

[1817] The generated metadata is sent to the cloud storage. The server compresses the metadata to avoid data delays and sends it to the cloud storage. The generated metadata as input is stored on the cloud, allowing it to be accessed quickly when needed.

[1818] Step 6:

[1819] The server retrieves files and metadata from cloud storage and analyzes the user's past behavior history. Based on the user's previous search queries and file access history, it identifies and recommends relevant files. The past behavior history data is taken as input and an algorithm is run to identify highly relevant files.

[1820] Step 7:

[1821] When a user searches for a file using the smart glasses, the device prompts the user to enter a search query. For example, the user can say, "I'm looking for an operation guide for a new robot," and the device sends a search request to the server.

[1822] Step 8:

[1823] The server analyzes the received search query and suggests the most suitable files based on relevant metadata and past behavior. The analyzed search query is matched with the metadata, and a list of suitable files is generated and sent back to the device.

[1824] Step 9:

[1825] The device displays the recommended file list to the user. The related files are displayed in order on the smart glasses display, and the user can select and view them. The generated file list is displayed as input, and specific file contents are displayed according to the user's selection.

[1826] Step 10:

[1827] The device uses a camera and microphone to analyze the user's emotional state. The camera captures the user's facial expressions and the microphone records their tone of voice. This data is sent to the server and analyzed by the emotion engine.

[1828] Step 11:

[1829] The server then provides customized information based on the user's emotional state based on the analysis results of the emotion engine. For example, if the server detects that the user is feeling stressed, it will recommend information on relaxation methods or simple task guides. The server analyzes the emotional state data as input, generates appropriate recommendations, and sends them to the device.

[1830] As described above, by clarifying the specific operations performed in each step and the flow of input and output data, it is possible to explain specific embodiments of the present invention.

[1831] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1832] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1833] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1834] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1835] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1836] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1837] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1838] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1839] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1840] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1841] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1842] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1843] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1844] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1845] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1846] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1847] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1848] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1849] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1850] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1851] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1852] The following is further disclosed regarding the above embodiment.

[1853] (Claim 1)

[1854] a means for users to upload digital files to the system;

[1855] a means for interactively prompting a user to input metadata for an uploaded file;

[1856] a means for temporarily storing and transmitting the metadata to cloud storage;

[1857] means for analyzing file content using a natural language processing engine to generate additional metadata;

[1858] A system that includes a means for identifying and recommending related files based on a user's past behavioral history.

[1859] (Claim 2)

[1860] a means for a user to input a search query;

[1861] 10. The system of claim 1, further comprising means for suggesting related files based on the search query and the metadata.

[1862] (Claim 3)

[1863] 10. The system of claim 1, further comprising: means for displaying a list of recommended files to the user.

[1864] "Example 1"

[1865] (Claim 1)

[1866] a means for users to upload digital files to the system;

[1867] a means for interactively prompting a user to input metadata for an uploaded file;

[1868] a means for temporarily storing and transmitting the metadata to cloud storage;

[1869] means for analyzing the file content using a natural language processing device to generate additional metadata;

[1870] A means for identifying and recommending related files based on a user's past behavior history;

[1871] a means for a user to input a search query when searching for a particular file;

[1872] means for suggesting related files based on the search query and metadata;

[1873] A system including means for displaying a list of recommended files to a user.

[1874] (Claim 2)

[1875] 10. The system of claim 1, further comprising means for a user to search for a specified file.

[1876] (Claim 3)

[1877] 10. The system according to claim 1, further comprising an automatic metadata completion means for the purpose of improving the efficiency of file management.

[1878] "Application Example 1"

[1879] (Claim 1)

[1880] a means for users to upload digital files to the system;

[1881] a means for interactively prompting a user to input metadata for an uploaded file;

[1882] a means for temporarily storing and transmitting the metadata to cloud storage;

[1883] means for analyzing file content using a natural language processing engine to generate additional metadata;

[1884] A means for identifying and recommending related files based on a user's past behavior history;

[1885] A means to automatically complete missing metadata using generative AI models;

[1886] A method for managing files and their metadata on the cloud and recommending similar files.

[1887] A means for uploading and searching files using a smartphone;

[1888] A system including:

[1889] (Claim 2)

[1890] a means for a user to input a search query;

[1891] means for suggesting related files based on the search query and metadata;

[1892] It also includes a means to analyze search queries with a natural language processing engine and automatically suggest the most suitable files.

[1893] 10. The system of claim 1.

[1894] (Claim 3)

[1895] means for displaying a list of recommended files to a user;

[1896] Also includes a way to click and open the recommended file list on the smartphone screen.

[1897] 10. The system of claim 1.

[1898] "Example 2: Combining Emotion Engines"

[1899] (Claim 1)

[1900] a means for users to upload digital files to the system;

[1901] a means for interactively prompting a user to input metadata for an uploaded file;

[1902] A means for temporarily storing the input metadata and sending it to cloud storage;

[1903] means for analyzing file content using a natural language processing engine to generate additional metadata;

[1904] A means for identifying and recommending related files based on a user's past behavior history;

[1905] means for collecting and analyzing image and audio information using an emotion engine to recognize the user's emotions;

[1906] A system including a means for dynamically changing the user interface based on the analysis results of the emotion engine and recommending files and information according to the user's emotions.

[1907] (Claim 2)

[1908] a means for a user to input a search query;

[1909] 10. The system of claim 1, further comprising means for presenting related files based on the received search query and additional metadata.

[1910] (Claim 3)

[1911] 10. The system of claim 1, further comprising: means for displaying the presented related file list to a user.

[1912] "Application example 2 when combining emotion engines"

[1913] (Claim 1)

[1914] a means for users to upload digital files to the system;

[1915] a means for interactively prompting a user to input metadata for an uploaded file;

[1916] a means for temporarily storing and transmitting the metadata to cloud storage;

[1917] means for analyzing file content using a natural language processing engine to generate additional metadata;

[1918] A means for identifying and recommending related files based on a user's past behavior history;

[1919] A means of using a camera or microphone to recognize the user's emotions and for the emotion engine to analyze that information;

[1920] A system including a means for customizing recommended files and information according to the user's emotional state based on the analysis results of the emotion engine.

[1921] (Claim 2)

[1922] a means for a user to input a search query;

[1923] 10. The system of claim 1, further comprising means for suggesting related files based on the search query and the metadata.

[1924] (Claim 3)

[1925] 10. The system of claim 1, further comprising: means for displaying the identified file list. [Explanation of symbols]

[1926] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for users to upload digital files to the system; a means for interactively prompting a user to input metadata for an uploaded file; a means for temporarily storing and transmitting the metadata to cloud storage; means for analyzing file content using a natural language processing engine to generate additional metadata; A system that includes a means for identifying and recommending related files based on a user's past behavioral history.

2. a means for a user to input a search query; The system of claim 1 , further comprising means for presenting related files based on the search query and the metadata.

3. 10. The system of claim 1, further comprising: means for displaying a list of recommended files to the user.

Images