System
The system addresses inefficiencies in manual file management by automatically detecting, renaming, and converting files, enhancing office efficiency and accuracy.
Patent Information
- Application Number
- JP2024123931
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-30
- Publication Date
- 2026-02-12
AI Technical Summary
Manual file management in offices, including storing electronic files in appropriate locations, renaming, and converting formats, is time-consuming and prone to errors, reducing efficiency and accuracy.
A system that automatically detects new files, extracts metadata, determines storage locations, renames files based on predefined rules, and converts formats, allowing users to simply place files in a designated folder for efficient and accurate management.
The system significantly improves file management efficiency and accuracy by automating the process of storing, renaming, and converting file formats, reducing user burden and minimizing operational errors.
Smart Images

Figure 2026022414000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] In modern office work, manually storing numerous electronic files in the appropriate location and editing file names is time-consuming and labor-intensive. Furthermore, it's easy to store files in the wrong folder or forget to change the file name, reducing the efficiency of file management. Furthermore, if file formats need to be standardized, the conversion process becomes an additional burden. There is a strong demand for solutions to these issues and improve the efficiency and accuracy of office work. [Means for solving the problem]
[0005] The present invention provides a system that solves the above problems by using the following means. First, it provides a means for detecting that a new file has been added to a specified folder. Next, it includes a means for extracting metadata from the new file, determining a storage location for the new file based on the metadata, and moving the new file to that storage location. It also provides a means for changing the file name of the new file based on pre-defined rules. Furthermore, the system is configured to include a means for converting the new file into a specified format. This allows a user to simply place a file in a specified folder, and the file will automatically be stored in the appropriate folder, renamed to an appropriate file name, and converted into the specified format as necessary, significantly improving the efficiency of file management.
[0006] A "new file" refers to a file that has been newly added to a specified folder.
[0007] "Predetermined folder" refers to a specific folder into which a user inputs files.
[0008] "Means for detecting" refers to a function for detecting that a new file has been added to a specified folder.
[0009] "Metadata" is data that includes file attributes and related information, such as file name, creation date, and creator.
[0010] "Means for extracting" refers to the ability to extract metadata from a file.
[0011] "Storage location" refers to the folder or directory where the file should be saved.
[0012] "Means for determining" refers to the ability to select an appropriate storage location based on metadata.
[0013] "Means to move" refers to the ability to move files from one folder to another.
[0014] "Means for changing" refers to the function for changing a file name to another name based on pre-set rules.
[0015] "Configured Rules" refers to predefined rules or formats used in renaming files.
[0016] "Predetermined format" refers to the particular file format to which the file requires conversion.
[0017] "Means for converting" refers to the ability to convert a file from one format to a given format.
[0018] "System" refers to a set of hardware and software configurations that realize these functions. [Brief explanation of the drawings]
[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0021] First, the terms used in the following description will be explained.
[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0027] [First embodiment]
[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0040] This system allows users to simply place electronic files in a specific folder, and the server automatically stores the files in the appropriate folder, renames them to a specific file name, and converts the file format as needed. This system frees users from the burden of manual work and allows for efficient and accurate file management.
[0041] System Program Overview
[0042] The system performs the following main processes on the server:
[0043] 1. New file detection:
[0044] The server constantly monitors a specific folder and immediately detects when a new file is added.
[0045] 2. Extracting Metadata:
[0046] The server extracts file type and related information (metadata) from the name and content of newly detected files, such as file type, company name, creation date, etc.
[0047] 3. Store the file:
[0048] Based on the extracted metadata, the server determines the folder where the file should be saved. If the folder does not exist, the server automatically creates it.
[0049] 4. Change the file name:
[0050] The server renames the new file based on predefined rules, for example, the file name might be changed to "Invoice_Company_Date.pdf".
[0051] 5. File format conversion:
[0052] If the new file is not in a particular format, the server converts the file into a predetermined format, for example, PDF format.
[0053] System operation explanation in natural language
[0054] File submission and detection
[0055] A user places a file called "invoice_123.txt" into a specific monitored folder. The server, using monitoring software, monitors the folder and detects that a new file has been added.
[0056] Metadata extraction
[0057] The server extracts metadata from the detected "invoice_123.txt", including the file type "invoice", the company name "ExampleCorp", and the date "20231001".
[0058] File storage
[0059] Based on the extracted metadata, the server determines the appropriate folder " / path / to / invoices" and moves the file to that folder. If the folder does not exist, the server automatically creates it.
[0060] Renaming files
[0061] The server changes the file name to "Invoice_ExampleCorp_20231001.pdf" based on the pre-defined rules. Therefore, the server renames "invoice_123.txt" to "Invoice_ExampleCorp_20231001.pdf".
[0062] File format conversion
[0063] The server verifies that the renamed file is not in a specific format (PDF in this case), and if necessary, converts the file to PDF and deletes the original file.
[0064] Specific examples
[0065] If a user drops a new report file called "report_456.txt" into a specific folder, the server detects the file and extracts that the file type is "report." It also obtains the author ("AuthorName") and the date ("20231001") as metadata. Based on the metadata, the server moves the file to the " / path / to / reports" folder and renames it to "Report_AuthorName_20231001.pdf." Finally, the server converts the file to PDF format and deletes the original text file.
[0066] In this way, the system of the present invention allows the user to simply place files in a designated folder, and the server automatically manages the files, thereby improving work efficiency and accuracy.
[0067] The processing flow will be explained below.
[0068] Step 1:
[0069] A user submits a file called "invoice_123.txt" to a specific monitored folder.
[0070] Step 2:
[0071] The server uses monitoring software to monitor a specific folder. The server detects when a new file is added. This detection is done by a file system event handler.
[0072] Step 3:
[0073] The server obtains the path of the newly detected file "invoice_123.txt" and uses this file path to extract metadata from the file contents and file name.
[0074] Step 4:
[0075] The server parses the extracted metadata and determines that the file type is "invoice", the company name is "ExampleCorp", and the creation date is "20231001".
[0076] Step 5:
[0077] Based on the extracted metadata, the server determines the folder where the file should be saved. In this case, the folder " / path / to / invoices" is determined as the storage location. If the folder does not exist, the server will automatically create it.
[0078] Step 6:
[0079] The server moves the file "invoice_123.txt" to the determined folder by changing the file path.
[0080] Step 7:
[0081] The server then renames the file to a new format based on predefined rules. In this case, the file name is changed to "Delivery Note_ExampleCorp_20231001.pdf". This is done by changing the string in the file name.
[0082] Step 8:
[0083] The server verifies that the file to which the new filename is applied is not of a specific format (in this case, PDF format).
[0084] Step 9:
[0085] If the file format is not PDF, the server converts it to PDF format by reading the file contents and saving it as a new PDF file. Once this process is complete, the original text file is deleted.
[0086] Step 10:
[0087] The server checks that all operations are complete and returns to the next monitoring cycle.
[0088] In this way, the system of the present invention realizes improved efficiency and accuracy of work by allowing the server to automatically manage files simply by having the user input the files.
[0089] Example 1
[0090] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0091] In conventional file management systems, users had to manually determine where to store files, rename files, and convert file formats as needed, which resulted in low work efficiency and a high risk of operational errors. This not only consumed a lot of time and effort, but also created the problem of not guaranteeing the accuracy of file management.
[0092] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0093] In this invention, the server includes means for detecting that a new file has been added to a predetermined directory, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for changing the file name of the new file based on a preset rule, means for converting the new file into a predetermined format, and means for recording a log each time each processing step is completed, thereby enabling improved efficiency and accuracy of file management.
[0094] A "new file" refers to a file that has been newly added to a specific directory.
[0095] "Predetermined directory" refers to a directory that is designated as a specific location for the server to monitor.
[0096] "Metadata" refers to additional information extracted from the file name and file contents, including, for example, the file type, identifier, company name, creation date, and the like.
[0097] "Storage location" refers to a directory for saving files that is determined based on metadata.
[0098] "File renaming method" refers to a process or algorithm for renaming new files based on pre-established rules.
[0099] "Means for converting to a format" refers to tools or software that convert the new file into a specified predetermined format, such as PDF format.
[0100] "Means for recording logs" refers to a system or software that records the process as each processing step is completed.
[0101] This system allows users to simply place electronic files in a specific directory, and the server automatically stores the files in the appropriate location, renames them to a specific file name, and converts the file format as needed. This system frees users from the burden of manual work and allows for efficient and accurate file management.
[0102] System Program Overview
[0103] The system performs the following main processes on the server:
[0104] 1. Configuring a Watched Folder
[0105] The server is configured to monitor the directory specified by the user, using monitoring software such as inotify-tools.
[0106] Examples:
[0107] When a user specifies a directory called " / upload", the server will configure this directory and start monitoring it.
[0108] 2. New file detection
[0109] The server detects when a new file is added to a specified directory. Monitoring software such as inotifywait can be used.
[0110] Examples:
[0111] When a user uploads a file called "invoice_123.txt", the server immediately detects its presence and begins processing it.
[0112] 3. Metadata extraction
[0113] The server uses a Python script to extract metadata from the name and content of newly detected files, for example, the type "invoice" and the identifier "123" from the file name "invoice_123.txt."
[0114] Examples:
[0115] The server extracts the type "invoice" and the identifier "123" from "invoice_123.txt".
[0116] 4. Determine the destination folder
[0117] The server determines the appropriate destination directory based on the extracted metadata. If the specified folder does not exist, the server automatically creates it. File operations are performed using the os and shutil modules.
[0118] Examples:
[0119] If the type is "invoice", the server will decide to save the file in " / path / to / invoices" and will create the folder if it does not exist.
[0120] 5. Renaming the file
[0121] The server renames the file based on pre-defined rules, for example, renaming "invoice_123.txt" to "Delivery Note_ExampleCorp_20231001.pdf".
[0122] Examples:
[0123] The server renames "invoice_123.txt" to "Delivery Note_ExampleCorp_20231001.pdf".
[0124] 6. File Format Conversion
[0125] The server checks that the renamed file is not in a certain format (e.g. PDF) and converts it if necessary, using LibreOffice or pdftools.
[0126] Examples:
[0127] The server runs libreoffice --headless --convert-to pdf / path / to / invoices / DeliveryNote_ExampleCorp_20231001.pdf.
[0128] 7. Logging
[0129] The server logs each processing step it completes, allowing you to track which files have been processed and how. Use the logging module to write the logs to a file.
[0130] Examples:
[0131] The server writes the log message logging.info("File processed: Invoice_ExampleCorp_20231001.pdf") to the file.
[0132] Example input to a generative AI model
[0133] "Describe a system where a user can drop a file into a designated directory, and the server will detect the file, extract its metadata, move it to the appropriate directory, rename it, and convert its format as needed."
[0134] In this way, with this system, the user simply puts files into the directory, and the server automatically manages all files, improving work efficiency and accuracy.
[0135] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0136] Step 1: Configuring a Watched Folder
[0137] The server is configured to monitor the directory specified by the user. Since the server monitors the directory using monitoring software such as inotify-tools, it can immediately detect when a new file is added to the configured directory.
[0138] Input: The path of the directory specified by the user (e.g. " / upload").
[0139] Output: Set a specific directory to be monitored.
[0140] What it does: The server runs the command inotifywait -m / upload in the background, waiting for new files to be added.
[0141] Step 2: Detecting new files
[0142] The server detects when a new file is added to a monitored directory, which triggers the next processing step.
[0143] Input: The new file to be added to the watched directory (e.g. "invoice_123.txt").
[0144] Output: Notification of new file detection.
[0145] Specific behavior: The server receives the event of a new file being added and proceeds to the next step of metadata extraction.
[0146] Step 3: Extracting Metadata
[0147] The server uses a Python script to extract metadata from the name and content of newly detected files, including file type, identifier, company name, creation date, etc.
[0148] Input: Name and content of the new file (e.g. "invoice_123.txt").
[0149] Output: Extracted metadata (e.g. file type "invoice", identifier "123", company name "Unknown", creation date "Unknown").
[0150] Specific operation: The server runs a Python script to parse filename="invoice_123.txt" and retrieves the metadata in dictionary format.
[0151] Step 4: Determine the destination folder
[0152] The server determines the appropriate destination directory based on the extracted metadata. If the specified folder does not exist, the server automatically creates it and moves the new file into it.
[0153] Input: Extracted metadata (e.g. file type "invoice").
[0154] Output: The determined destination directory (e.g. " / path / to / invoices").
[0155] Specific operation: The server checks whether the folder exists using os.path.exists(" / path / to / invoices"), and if it does not exist, it creates a new one using os.makedirs(" / path / to / invoices"). Next, it moves the file using shutil.move(" / upload / invoice_123.txt", " / path / to / invoices / ").
[0156] Step 5: Renaming the file
[0157] The server renames the file based on predefined rules, for example, renaming "invoice_123.txt" to "Delivery Note_Company Name_Date.pdf".
[0158] Input: A new file (e.g., "invoice_123.txt") and extracted metadata (e.g., company name "Unknown", creation date "Unknown").
[0159] Output: The renamed file name (e.g. "Delivery Note_Unknown_Unknown.pdf").
[0160] Specific behavior: The server executes os.rename(" / path / to / invoices / invoice_123.txt", " / path / to / invoices / DeliveryNote_Unknown_Unknown.pdf").
[0161] Step 6: Convert the file format
[0162] The server checks that the renamed file is not in a specific format (e.g. PDF) and converts it if necessary, using LibreOffice or pdftools.
[0163] Input: The renamed file name (e.g. "Delivery Note_Unknown_Unknown.pdf").
[0164] Output: A file in the specified format (e.g. PDF format file).
[0165] Specific operation: The server runs libreoffice --headless --convert-to pdf / path / to / invoices / DeliveryNote_Unknown_Unknown.pdf and deletes the file in the original format.
[0166] Step 7: Logging
[0167] The server logs each processing step it completes, allowing you to track which files have been processed and how.
[0168] Input: The results of each processing step.
[0169] Output: Processing history recorded in a log file.
[0170] Specific operation: The server uses the logging module to record a log message to a file, for example logging.info("File processed: Delivery note_Unknown_Unknown.pdf").
[0171] (Application example 1)
[0172] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0173] At logistics centers, the management of newly added delivery slips and related files requires a lot of manual work, which can lead to human error and time-consuming problems. Furthermore, the different formats and inconsistencies in storage locations for each file make efficient file management difficult, resulting in a decline in overall operational efficiency. A system that can solve these issues is needed.
[0174] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0175] In this invention, the server includes means for detecting that new digital information has been added to a predetermined area, means for extracting attribute information from the new digital information, means for determining a storage location for the new digital information based on the attribute information and for moving the new digital information to the storage location, means for renaming the new digital information based on preset rules, means for converting the new digital information into a predetermined format, means for determining a desired storage location and automatically creating the location if it does not exist, means for converting the new digital information into a predetermined format if it is detected and the information is not in a specific format, and means for dynamically determining a storage location and deleting files converted into the specified format. This dramatically improves the efficiency of file management in logistics centers, reducing human error and shortening work hours.
[0176] "New electronic information" refers to files or data that have been newly added to a specified area.
[0177] A "predetermined area" refers to a specific folder or directory that is to be monitored.
[0178] "Attribute information" refers to information about a file, such as the file type, shipping destination, shipping origin, and date.
[0179] A "storage location" is a folder or directory to which a file is moved, determined based on attribute information.
[0180] "Name" refers to the file name.
[0181] A "rule" is a pre-defined rule for renaming a file.
[0182] "Format" refers to the digital format of the file (e.g. PDF, TXT, etc.).
[0183] "Dynamic" means that it changes automatically depending on the situation or conditions.
[0184] System Overview
[0185] The system of this invention is designed to efficiently manage newly added delivery slips and related files at a logistics center. The server detects when new digital information is added to a specified area, extracts attribute information, and determines an appropriate storage location based on that information. The server then moves the new digital information to the storage location, renames the file according to predefined rules, and converts it into a specified format as needed.
[0186] Hardware and software used
[0187] The system utilizes the following hardware and software:
[0188] Hardware: Smartphones, smart glasses, head-mounted displays (HMDs)
[0189] Software: Python, monitoring software (watchdog), PDF file manipulation library (PyPDF2)
[0190] Processing flow
[0191] Smart devices constantly monitor monitoring folders in the logistics center, and when a newly added file is detected, the server extracts attribute information from the file. The extracted attribute information includes the file type, shipping destination, shipping origin, and date. The server determines the file storage location based on this attribute information, and automatically creates it if the storage location does not exist. The server then renames the file based on pre-defined rules and converts the file format to a specified format (mainly PDF) as needed. After the file has been converted to a specific format, the original file is finally deleted.
[0192] Specific examples
[0193] For example, if a new shipping slip "shipment_567.txt" is added to the logistics center, the server immediately detects the slip and extracts the shipping destination "Tokyo," the shipping origin "Osaka," and the date "20231001." Next, it moves the file to the " / path / to / shipments / Tokyo" folder and renames it "Shipping Slip_Tokyo_Osaka_20231001.pdf." If the file is in text format, it is then converted to PDF format.
[0194] Example prompts for generative AI models
[0195] Please explain what happens when a new shipping slip "shipment_567.txt" is added to the monitored folder. The shipping destination is "Tokyo", the shipping origin is "Osaka", and the date is "20231001", and the file name is changed to "Shipping slip_Tokyo_Osaka_20231001.pdf". Furthermore, if the file format is not PDF, it is converted to PDF.
[0196] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0197] Step 1:
[0198] The server constantly monitors a specific folder using monitoring software. When new digital information is added to this folder, the monitoring software immediately notifies the user. The input is the monitored folder and the newly added file, and the output is an event indicating that a new file has been added.
[0199] Step 2:
[0200] The server extracts attribute information from newly detected digital information. For example, if the file name is "shipment_567.txt," "shipment" is the file type and "567" is the identifier. It also analyzes metadata (shipping destination, origin, date, etc.) according to specific rules. The input is the new file name, and the output is the extracted attribute information.
[0201] Step 3:
[0202] The server determines the storage location for the new electronic information based on the extracted attribute information. For example, the " / path / to / shipments / Tokyo" folder is determined based on the shipping destination "Tokyo." If this storage location does not exist, the server automatically creates a new folder. The input is the attribute information, and the output is the determined storage location.
[0203] Step 4:
[0204] The server moves the new electronic information to the determined storage location. This action means transferring the file from the original folder to the new folder. The input is the new electronic information and the determined storage location, and the output is the new electronic information in the moved location.
[0205] Step 5:
[0206] The server renames the new electronic information based on predefined rules. For example, it renames "shipment_567.txt" to "Shipping slip_Tokyo_Osaka_20231001.pdf." The input is the current name and rules of the new electronic information, and the output is the electronic information with the new name.
[0207] Step 6:
[0208] The server checks whether the new electronic information is in a specific format and converts it to the required format (e.g. PDF) if necessary. After conversion, it deletes the original format file. The input is the current format of the new electronic information, and the output is the electronic information converted to the required format.
[0209] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0210] This invention combines a system in which a user simply places an electronic file in a specific folder, and the server automatically stores the file in the appropriate folder, renames the file as specified, and converts the file format as necessary, with an emotion engine that recognizes the user's emotions and adjusts operations based on those emotions. This system not only relieves the user from the burden of manual work, but also enables flexible responses according to the user's mental state, allowing for more comfortable and efficient file management.
[0211] System Program Overview
[0212] The system performs the following main processes on the server:
[0213] 1. Emotion recognition with emotion engine:
[0214] It is equipped with an emotion engine that analyzes emotions based on the user's facial expressions, tone of voice, speed of operation, etc.
[0215] If a user feels anxious or stressed about the system, this information is detected.
[0216] 2. New file detection:
[0217] The server constantly monitors a specific folder and immediately detects when a new file is added.
[0218] 3. Extracting Metadata:
[0219] The server extracts file type and related information (metadata) from the name and content of newly detected files.
[0220] 4. Store the file:
[0221] Based on the extracted metadata, the server determines the folder in which the file should be saved and moves the file to that folder.
[0222] 5. Change the file name:
[0223] The server renames the new file based on pre-defined rules.
[0224] 6. File format conversion:
[0225] If the new file is not in a particular format, the server converts the file to the predetermined format.
[0226] 7. Emotion-based processing changes:
[0227] If the user's emotions are recognized as being stressed, the server delays file processing operations to reduce the burden on the user.
[0228] If the user is expressing positive sentiment, the server will proactively suppress notifications to avoid disrupting the user's workflow.
[0229] System operation explanation in natural language
[0230] File input and emotion recognition
[0231] The user places a file called "invoice_123.txt" into a specific monitoring folder. At the same time, the emotion engine analyzes the user's facial expressions, operation speed, tone of voice, etc. to recognize the user's emotions. For example, if the user is feeling stressed, the emotion engine sends that information to the server.
[0232] Detecting new files and extracting metadata
[0233] The server uses monitoring software to monitor the folder and detect when a new file is added, then extracts metadata from the file name and contents, such as file type "invoice", company name "ExampleCorp", and creation date "20231001".
[0234] Storing files and renaming files
[0235] The server determines the appropriate folder (e.g., " / path / to / invoices") based on the extracted metadata, moves the file to that folder, and then renames the file to "Invoice_ExampleCorp_20231001.pdf" based on the configured rules.
[0236] File format conversion and emotion-based behavior adjustment
[0237] The server converts new files to PDF format if they are not already in PDF format. On the other hand, if the user is stressed, the server delays file processing until the user is emotionally stable. If the user is expressing positive emotions, the server suppresses notifications to avoid interrupting the user's work.
[0238] Specific examples
[0239] If a user drops a new report file called "report_456.txt" into a specific folder and the emotion engine recognizes that the user is in a stressed state, the server detects the file and extracts the metadata that the file type is "report," the author is "AuthorName," and the date is "20231001." However, because the user is stressed, the server temporarily delays processing the file and resumes processing once the user's condition improves. It then moves the file to the " / path / to / reports" folder, renames it to "report_AuthorName_20231001.pdf," and converts it to PDF format.
[0240] In this way, the system of the present invention manages files efficiently and appropriately while taking into consideration the user's feelings, thereby improving work efficiency and reducing the psychological burden on the user.
[0241] The processing flow will be explained below.
[0242] Step 1:
[0243] A user submits a file called "invoice_123.txt" to a specific monitored folder.
[0244] Step 2:
[0245] The server uses monitoring software to constantly monitor a specific folder, and the server detects when a new file is added by using a file system event handler.
[0246] Step 3:
[0247] The emotion engine analyzes the user's facial expressions, tone of voice, and speed of operation to recognize the user's emotions.
[0248] Step 4:
[0249] The server obtains the file path of the detected "invoice_123.txt" and uses this file path to extract metadata from the file name and content.
[0250] Step 5:
[0251] The server parses the extracted metadata and determines that the file type is "invoice", the company name is "ExampleCorp", and the date is "20231001".
[0252] Step 6:
[0253] The server determines the folder where the file should be saved based on the metadata. In this case, the folder " / path / to / invoices" is determined as the storage location. If the folder does not exist, the server will automatically create it.
[0254] Step 7:
[0255] The server moves "invoice_123.txt" to the determined folder by changing the file path.
[0256] Step 8:
[0257] The server changes the file name to "Delivery Note_ExampleCorp_20231001.pdf" based on a predefined rule. This operation is performed by changing the string in the file name.
[0258] Step 9:
[0259] The server verifies that the file to which the new filename is applied is not of a specific format (in this case, PDF format).
[0260] Step 10:
[0261] If the file format is not PDF, the server converts it to PDF format by reading the file contents and saving it as a new PDF file. Once this process is complete, the original file is deleted.
[0262] Step 11:
[0263] The emotion engine continuously monitors the user's emotional state. If the user is feeling stressed, the server will delay file processing operations to reduce the user's stress.
[0264] Step 12:
[0265] If the user is expressing positive emotions, the server will proactively suppress notifications to avoid disrupting their work.
[0266] Step 13:
[0267] The server checks that all operations are complete and returns to the next monitoring cycle.
[0268] Example 2
[0269] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0270] Conventional file management systems require users to manually store files in the appropriate folders, rename them, and convert their formats as needed. This tedious manual process not only reduces work efficiency but also increases the psychological burden on users. Furthermore, the lack of flexible response to the user's emotional state limits the user experience.
[0271] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0272] In this invention, the server includes means for detecting that a new file has been added to a predetermined folder, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for renaming the new file based on preset rules, means for converting the new file into a predetermined format, and means for recognizing a user's emotions and adjusting file processing based on the emotions. This reduces the manual burden on the user, enables flexible responses according to the user's mental state, and enables more comfortable and efficient file management.
[0273] A "new file" refers to electronic data that has been newly added to a specified folder.
[0274] The term "detection means" refers to a technology or device for monitoring file additions in a specific folder and detecting that a new file has been added.
[0275] "Metadata" refers to data that includes file content, attributes, and related information, such as file type, creator, and creation date.
[0276] "Means for extracting" refers to a technique or device for extracting metadata from the new file.
[0277] "Storage location" refers to a folder or directory designated for storing new files.
[0278] "Means for determining" refers to a technology or device that selects a storage location for a file based on pre-defined rules or extracted metadata.
[0279] "Means for moving" refers to the technique or device that moves the new file to the determined storage location.
[0280] "File name" refers to the name used to identify a file.
[0281] "Modifying means" refers to a technique or device that renames files based on pre-established rules.
[0282] "Format" refers to the data structure of the file and its storage format.
[0283] "Means for converting" refers to a technique or device for changing a file from one format to another.
[0284] "User" refers to a person who uses the system.
[0285] "Emotion" refers to the user's psychological state or mood, and includes states such as stress, joy, and anxiety.
[0286] "Means for recognition" refers to technology or devices that identify emotions by analyzing the user's facial expressions, tone of voice, operation speed, etc.
[0287] "Adjusting" refers to changing the system's behavior based on the perceived user's emotions.
[0288] This invention combines a system in which a user simply places an electronic file in a specific folder, and the server automatically stores the file in the appropriate folder, renames the file as specified, and converts the file format as necessary, with an emotion engine that recognizes the user's emotions and adjusts its behavior based on those emotions. This system not only relieves the user from the burden of manual work, but also enables flexible responses according to the user's mental state, allowing for more comfortable and efficient file management.
[0289] To implement this system, the following hardware and software are used.
[0290] 1. Emotion recognition using an emotion engine
[0291] The server is equipped with an emotion engine that analyzes emotions based on the user's facial expressions, tone of voice, and speed of operation. This emotion engine uses software called "EmotionAI." The device uses a webcam and microphone to capture the user's facial expressions and voice in real time and transmits the data to the server.
[0292] 2. New file detection
[0293] The server constantly monitors a specific folder using monitoring software called "FolderWatch." When a user places a file called "invoice_123.txt" into the monitored folder, the server immediately detects the change.
[0294] 3. Metadata extraction
[0295] The server uses a tool called "Apache Tika" to extract file types and related information (metadata) from the names and contents of newly detected files, such as file type "invoice," company name "ExampleCorp," and creation date "20231001."
[0296] 4. Storing Files
[0297] Based on the extracted metadata, the server uses a rules engine called RuleEngine to determine the appropriate folder location, for example, moving the file to the " / path / to / invoices" folder.
[0298] 5. Renaming the file
[0299] The server uses the "RenameHandler" script to rename the file based on the configured rules. For example, it renames the file to "Delivery Note_ExampleCorp_20231001.pdf."
[0300] 6. File Format Conversion
[0301] If the newly added file is not in a specific format, the server uses LibreOffice or FFmpeg to convert the file into a specified format, such as PDF.
[0302] 7. Emotion-based processing changes
[0303] The server uses "DelayProcessor" to temporarily delay file processing if the user is perceived as being stressed, and suppresses notifications if the user is showing positive emotions, so as not to disrupt the user's workflow.
[0304] Specific examples
[0305] If a user drops a new report file called "report_456.txt" into a specific folder and the emotion engine recognizes that the user is in a stressed state, the server detects the file and extracts the metadata that the file type is "report," the author is "AuthorName," and the date is "20231001." However, because the user is stressed, the server temporarily delays processing the file and resumes processing once the user's condition improves. It then moves the file to the " / path / to / reports" folder, renames it to "report_AuthorName_20231001.pdf," and converts it to PDF format.
[0306] Example prompts for generative AI models
[0307] "When a user submits a new file to a particular folder, explain how the server processes the file. Include details on how the server renames the file, converts the file format, and adjusts the processing based on emotion."
[0308] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0309] Program processing steps
[0310] Step 1: Collecting and Recognizing Emotional Data
[0311] When a user logs in or starts an operation, the device uses a webcam and microphone to capture the user's facial expressions and voice in real time. This data is sent to the server. The server then uses "Emotion AI" to analyze the received data and recognize the user's emotional state. This emotional information is temporarily stored in the server's database. The specific input is real-time data obtained from the webcam and microphone, and the output is the recognized emotional state.
[0312] Step 2: Detecting new files
[0313] A user drops a file called "invoice_123.txt" into a specific folder. The server uses "FolderWatch" to monitor the folder and immediately detects that a new file has been added. The input to this step is the addition of a new file, and the output is the path and name of the file. The server logs this information.
[0314] Step 3: Extracting Metadata
[0315] The server uses Apache Tika to parse the contents of "invoice_123.txt" and extract the file type and related information (metadata). For example, the file type is "invoice", the company name is "ExampleCorp", and the creation date is "20231001". The input for this step is the file path and file contents, and the output is the extracted metadata.
[0316] Step 4: Determine the appropriate storage folder
[0317] The server uses the RuleEngine to determine the appropriate storage folder based on the extracted metadata. For example, it may determine that the file should be stored in a folder called / path / to / invoices. The input to this step is the metadata, and the output is the determined folder path.
[0318] Step 5: Moving Files
[0319] The server moves the new file "invoice_123.txt" to " / path / to / invoices". The path information of the moved file is recorded in the server's database. The input of this step is the original file path and the determined folder path, and the output is the updated file path after the move.
[0320] Step 6: Renaming the file
[0321] The server uses the "RenameHandler" script to rename the file to "Invoice_ExampleCorp_20231001.pdf" based on the configured rules. The renamed file name is recorded in the server's database. The input for this step is the original file name and metadata, and the output is the new renamed file name.
[0322] Step 7: Convert the file format
[0323] If the newly added file is not in a specific format (e.g., PDF), the server uses LibreOffice or FFmpeg to convert the file to the required format. For example, converting a text file (.txt) to PDF. The inputs to this step are the original file format and the required file format, and the output is the converted file.
[0324] Step 8: Regulating Emotion-Based Processing
[0325] The server adjusts processing based on the user's emotions recognized by the emotion engine. For example, if the user is feeling stressed, it uses "DelayProcessor" to temporarily delay file processing. If the user is showing positive emotions, it suppresses notifications so as not to disrupt the user's workflow. The input of this step is the user's emotional state, and the output is adjusted processing timing and notification settings.
[0326] (Application example 2)
[0327] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0328] Manufacturing sites handle a large number of electronic files, and they need to be properly classified and managed. However, employees are always busy and find it difficult to allocate sufficient time to file management. Furthermore, when employees experience stress or anxiety, their work efficiency decreases. For this reason, there is a need for a system that can efficiently and appropriately manage files while taking into account the user's mental state.
[0329] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0330] In this invention, the server includes means for detecting that a new file has been added to a predetermined folder, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for renaming the new file based on preset rules, means for converting the new file into a predetermined format, and means for recognizing a user's emotion and adjusting the timing of file processing based on the emotion. This enables automatic file management at the manufacturing site, realizes flexible responses according to the mental state of employees, and enables work efficiency to be improved and the psychological burden on users to be reduced.
[0331] "Means for detecting when a new file is added to a specified folder" refers to a system that uses monitoring software or sensors to detect in real time when a new file is added to a specific folder.
[0332] "Metadata extraction means" refers to a mechanism for reading and analyzing relevant information such as file name, content, creation date, and creator from newly detected files.
[0333] The "means for determining a storage location and moving the file to that storage location" is a mechanism for automatically moving new files to appropriate folders or directories based on the extracted metadata.
[0334] "Means for renaming files according to predefined rules" refers to a mechanism for renaming files according to predefined rules, such as renaming files to include the date or the creator's name.
[0335] "Means for converting to a specified format" refers to a mechanism that automatically converts a new file into a pre-specified format if the file is not in a specific format. For example, converting a text file into PDF format.
[0336] "Means for recognizing the user's emotions and adjusting the timing of file processing based on those emotions" refers to a mechanism that uses a camera or microphone to analyze the user's facial expressions and tone of voice, and adjusts the timing of file processing according to the user's psychological state. For example, if the user is feeling stressed, the processing may be temporarily delayed.
[0337] The system embodying the present invention combines file management and processing based on the user's emotions. A specific embodiment of the system will be described below.
[0338] System Overview
[0339] The system consists of a server, a terminal (e.g., smart glasses or a robot), and a user. The server constantly monitors a specific folder and processes new files when they are added. The terminal is equipped with an emotion engine that analyzes the user's facial expressions and tone of voice to recognize emotions and transmits that information to the server.
[0340] Emotion recognition with emotion engine
[0341] The device uses a camera (e.g., OpenCV) and microphone (e.g., PyDub) to analyze the user's facial expressions and tone of voice. The analysis results are then used to recognize the user's emotional state using a generative AI model. For example, if the user is in a stressful state, that information is sent to the server.
[0342] File monitoring and processing
[0343] The server monitors the specified folder in real time using monitoring software (e.g., the watchdog library). When a new file is added, it immediately detects the file and extracts metadata from the file name and content.
[0344] Metadata-based file storage
[0345] The server determines where to store new files based on the extracted metadata. For example, if the file contains the keyword "blueprint," it moves the file to the blueprints folder. It also renames the file based on predefined rules, for example, changing the file name to "blueprint_date_author."
[0346] File format conversion
[0347] If the new file is not in a specific format (e.g. PDF), the server will automatically convert it to the specified format, for example using a PDF library.
[0348] Adjusting file handling based on sentiment
[0349] If the user is in a stressful state, the server temporarily delays file processing until the user's emotional state improves. On the other hand, if the user is in a positive state, the server suppresses notifications to avoid interrupting the user's work.
[0350] Specific examples
[0351] For example, suppose a user places a file called "Blueprint_123.dwg" into a specific folder. If the emotion engine simultaneously recognizes the user's stress level, the server will detect the file and temporarily delay processing. It will then rename the file to "Blueprint_20231001_Person in Charge.dwg," automatically move it to the appropriate folder, and convert it to PDF format if necessary.
[0352] Prompt Sentence Examples
[0353] For example, consider the following prompt:
[0354] An extremely stressed employee has dropped a file called "Blueprint_789.dwg" into a designated folder. After detecting this file, temporarily delay the process to reduce the employee's stress, then move the file to the appropriate folder as "Blueprint_Employee_20231001.pdf" and convert it to PDF format.
[0355] In this way, the system of the present invention manages files efficiently and appropriately while taking into consideration the user's feelings, thereby improving work efficiency and reducing the psychological burden on the user.
[0356] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0357] Step 1: Recognize emotions
[0358] The device uses a camera and microphone to capture the user's facial expressions and tone of voice. Image data captured using OpenCV and audio data recorded using PyDub are input. The emotion engine inputs this data into a generative AI model to analyze the user's emotions. The resulting emotional state (e.g., stress, joy) is output.
[0359] Step 2: Detecting new files
[0360] The server uses the watchdog library to monitor the specified folder in real time and detects when a new file is added to the folder. In this step, a new file added to the folder is provided as input and an event is output to detect that it has been added to the folder.
[0361] Step 3: Extracting Metadata
[0362] The server analyzes the filename and contents of the detected new file and extracts metadata. For example, information such as "blueprint," "123," and "dwg" is extracted from the filename "blueprint_123.dwg." In this step, the file name and file contents are provided as input, and the analysis results are output as metadata.
[0363] Step 4: Decide on a storage location and change the file name
[0364] The server determines the appropriate storage location based on the extracted metadata and renames the file based on predefined rules. For example, "Design_123.dwg" is renamed to "Design_20231001_Designer.dwg." In this step, the storage location is input based on the metadata, and the new file name and the determined storage location are output.
[0365] Step 5: Moving Files
[0366] The server moves the file with the changed file name to the determined storage location. In this step, the new file name and storage location are input, and the state where the file has been moved to the specified folder is output.
[0367] Step 6: Convert the file format
[0368] If the new file is not in a specific format, the server automatically converts it to the required format. For example, if "Design_123.dwg" is not in PDF format, it will be converted to "Design_123.pdf." This step takes the modified file as input and outputs the converted file in the required format.
[0369] Step 7: Regulating Emotion-Based Processing
[0370] The server adjusts the timing of file processing based on the emotional state from the emotion engine. For example, if the user is feeling stressed, the processing may be temporarily delayed. In this step, the emotion analysis result is input and the output is to delay or speed up the processing.
[0371] Through the above steps, a system is realized in which new files entered by the user are properly managed and flexible responses are made according to the user's emotional state.
[0372] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0373] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0374] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0375] [Second embodiment]
[0376] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0377] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0378] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0379] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0380] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0381] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0382] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0383] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0384] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0385] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0386] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0387] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0388] This system allows users to simply place electronic files in a specific folder, and the server automatically stores the files in the appropriate folder, renames them to a specific file name, and converts the file format as needed. This system frees users from the burden of manual work and allows for efficient and accurate file management.
[0389] System Program Overview
[0390] The system performs the following main processes on the server:
[0391] 1. New file detection:
[0392] The server constantly monitors a specific folder and immediately detects when a new file is added.
[0393] 2. Extracting Metadata:
[0394] The server extracts file type and related information (metadata) from the name and content of newly detected files, such as file type, company name, creation date, etc.
[0395] 3. Store the file:
[0396] Based on the extracted metadata, the server determines the folder where the file should be saved. If the folder does not exist, the server automatically creates it.
[0397] 4. Change the file name:
[0398] The server renames the new file based on predefined rules, for example, the file name might be changed to "Invoice_Company_Date.pdf".
[0399] 5. File format conversion:
[0400] If the new file is not in a particular format, the server converts the file into a predetermined format, for example, PDF format.
[0401] System operation explanation in natural language
[0402] File submission and detection
[0403] A user places a file called "invoice_123.txt" into a specific monitored folder. The server, using monitoring software, monitors the folder and detects that a new file has been added.
[0404] Metadata extraction
[0405] The server extracts metadata from the detected "invoice_123.txt", including the file type "invoice", the company name "ExampleCorp", and the date "20231001".
[0406] File storage
[0407] Based on the extracted metadata, the server determines the appropriate folder " / path / to / invoices" and moves the file to that folder. If the folder does not exist, the server automatically creates it.
[0408] Renaming files
[0409] The server changes the file name to "Invoice_ExampleCorp_20231001.pdf" based on the pre-defined rules. Therefore, the server renames "invoice_123.txt" to "Invoice_ExampleCorp_20231001.pdf".
[0410] File format conversion
[0411] The server verifies that the renamed file is not in a specific format (PDF in this case), and if necessary, converts the file to PDF and deletes the original file.
[0412] Specific examples
[0413] If a user drops a new report file called "report_456.txt" into a specific folder, the server detects the file and extracts that the file type is "report." It also obtains the author ("AuthorName") and the date ("20231001") as metadata. Based on the metadata, the server moves the file to the " / path / to / reports" folder and renames it to "Report_AuthorName_20231001.pdf." Finally, the server converts the file to PDF format and deletes the original text file.
[0414] In this way, the system of the present invention allows the user to simply place files in a designated folder, and the server automatically manages the files, thereby improving work efficiency and accuracy.
[0415] The processing flow will be explained below.
[0416] Step 1:
[0417] A user submits a file called "invoice_123.txt" to a specific monitored folder.
[0418] Step 2:
[0419] The server uses monitoring software to monitor a specific folder. The server detects when a new file is added. This detection is done by a file system event handler.
[0420] Step 3:
[0421] The server obtains the path of the newly detected file "invoice_123.txt" and uses this file path to extract metadata from the file contents and file name.
[0422] Step 4:
[0423] The server parses the extracted metadata and determines that the file type is "invoice", the company name is "ExampleCorp", and the creation date is "20231001".
[0424] Step 5:
[0425] Based on the extracted metadata, the server determines the folder where the file should be saved. In this case, the folder " / path / to / invoices" is determined as the storage location. If the folder does not exist, the server will automatically create it.
[0426] Step 6:
[0427] The server moves the file "invoice_123.txt" to the determined folder by changing the file path.
[0428] Step 7:
[0429] The server then renames the file to a new format based on predefined rules. In this case, the file name is changed to "Delivery Note_ExampleCorp_20231001.pdf". This is done by changing the string in the file name.
[0430] Step 8:
[0431] The server verifies that the file to which the new filename is applied is not of a specific format (in this case, PDF format).
[0432] Step 9:
[0433] If the file format is not PDF, the server converts it to PDF format by reading the file contents and saving it as a new PDF file. Once this process is complete, the original text file is deleted.
[0434] Step 10:
[0435] The server checks that all operations are complete and returns to the next monitoring cycle.
[0436] In this way, the system of the present invention realizes improved efficiency and accuracy of work by allowing the server to automatically manage files simply by having the user input the files.
[0437] Example 1
[0438] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0439] In conventional file management systems, users had to manually determine where to store files, rename files, and convert file formats as needed, which resulted in low work efficiency and a high risk of operational errors. This not only consumed a lot of time and effort, but also created the problem of not guaranteeing the accuracy of file management.
[0440] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0441] In this invention, the server includes means for detecting that a new file has been added to a predetermined directory, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for changing the file name of the new file based on a preset rule, means for converting the new file into a predetermined format, and means for recording a log each time each processing step is completed, thereby enabling improved efficiency and accuracy of file management.
[0442] A "new file" refers to a file that has been newly added to a specific directory.
[0443] "Predetermined directory" refers to a directory that is designated as a specific location for the server to monitor.
[0444] "Metadata" refers to additional information extracted from the file name and file contents, including, for example, the file type, identifier, company name, creation date, and the like.
[0445] "Storage location" refers to a directory for saving files that is determined based on metadata.
[0446] "File renaming method" refers to a process or algorithm for renaming new files based on pre-established rules.
[0447] "Means for converting to a format" refers to tools or software that convert the new file into a specified predetermined format, such as PDF format.
[0448] "Means for recording logs" refers to a system or software that records the process as each processing step is completed.
[0449] This system allows users to simply place electronic files in a specific directory, and the server automatically stores the files in the appropriate location, renames them to a specific file name, and converts the file format as needed. This system frees users from the burden of manual work and allows for efficient and accurate file management.
[0450] System Program Overview
[0451] The system performs the following main processes on the server:
[0452] 1. Configuring a Watched Folder
[0453] The server is configured to monitor the directory specified by the user, using monitoring software such as inotify-tools.
[0454] Examples:
[0455] When a user specifies a directory called " / upload", the server will configure this directory and start monitoring it.
[0456] 2. New file detection
[0457] The server detects when a new file is added to a specified directory. Monitoring software such as inotifywait can be used.
[0458] Examples:
[0459] When a user uploads a file called "invoice_123.txt", the server immediately detects its presence and begins processing it.
[0460] 3. Metadata extraction
[0461] The server uses a Python script to extract metadata from the name and content of newly detected files, for example, the type "invoice" and the identifier "123" from the file name "invoice_123.txt."
[0462] Examples:
[0463] The server extracts the type "invoice" and the identifier "123" from "invoice_123.txt".
[0464] 4. Determine the destination folder
[0465] The server determines the appropriate destination directory based on the extracted metadata. If the specified folder does not exist, the server automatically creates it. File operations are performed using the os and shutil modules.
[0466] Examples:
[0467] If the type is "invoice", the server will decide to save the file in " / path / to / invoices" and will create the folder if it does not exist.
[0468] 5. Renaming the file
[0469] The server renames the file based on pre-defined rules, for example, renaming "invoice_123.txt" to "Delivery Note_ExampleCorp_20231001.pdf".
[0470] Examples:
[0471] The server renames "invoice_123.txt" to "Delivery Note_ExampleCorp_20231001.pdf".
[0472] 6. File Format Conversion
[0473] The server checks that the renamed file is not in a certain format (e.g. PDF) and converts it if necessary, using LibreOffice or pdftools.
[0474] Examples:
[0475] The server runs libreoffice --headless --convert-to pdf / path / to / invoices / DeliveryNote_ExampleCorp_20231001.pdf.
[0476] 7. Logging
[0477] The server logs each processing step it completes, allowing you to track which files have been processed and how. Use the logging module to write the logs to a file.
[0478] Examples:
[0479] The server writes the log message logging.info("File processed: Invoice_ExampleCorp_20231001.pdf") to the file.
[0480] Example input to a generative AI model
[0481] "Describe a system where a user can drop a file into a designated directory, and the server will detect the file, extract its metadata, move it to the appropriate directory, rename it, and convert its format as needed."
[0482] In this way, with this system, the user simply puts files into the directory, and the server automatically manages all files, improving work efficiency and accuracy.
[0483] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0484] Step 1: Configuring a Watched Folder
[0485] The server is configured to monitor the directory specified by the user. Since the server monitors the directory using monitoring software such as inotify-tools, it can immediately detect when a new file is added to the configured directory.
[0486] Input: The path of the directory specified by the user (e.g. " / upload").
[0487] Output: Set a specific directory to be monitored.
[0488] What it does: The server runs the command inotifywait -m / upload in the background, waiting for new files to be added.
[0489] Step 2: Detecting new files
[0490] The server detects when a new file is added to a monitored directory, which triggers the next processing step.
[0491] Input: The new file to be added to the watched directory (e.g. "invoice_123.txt").
[0492] Output: Notification of new file detection.
[0493] Specific behavior: The server receives the event of a new file being added and proceeds to the next step of metadata extraction.
[0494] Step 3: Extracting Metadata
[0495] The server uses a Python script to extract metadata from the name and content of newly detected files, including file type, identifier, company name, creation date, etc.
[0496] Input: Name and content of the new file (e.g. "invoice_123.txt").
[0497] Output: Extracted metadata (e.g. file type "invoice", identifier "123", company name "Unknown", creation date "Unknown").
[0498] Specific operation: The server runs a Python script to parse filename="invoice_123.txt" and retrieves the metadata in dictionary format.
[0499] Step 4: Determine the destination folder
[0500] The server determines the appropriate destination directory based on the extracted metadata. If the specified folder does not exist, the server automatically creates it and moves the new file into it.
[0501] Input: Extracted metadata (e.g. file type "invoice").
[0502] Output: The determined destination directory (e.g. " / path / to / invoices").
[0503] Specific operation: The server checks whether the folder exists using os.path.exists(" / path / to / invoices"), and if it does not exist, it creates a new one using os.makedirs(" / path / to / invoices"). Next, it moves the file using shutil.move(" / upload / invoice_123.txt", " / path / to / invoices / ").
[0504] Step 5: Renaming the file
[0505] The server renames the file based on predefined rules, for example, renaming "invoice_123.txt" to "Delivery Note_Company Name_Date.pdf".
[0506] Input: A new file (e.g., "invoice_123.txt") and extracted metadata (e.g., company name "Unknown", creation date "Unknown").
[0507] Output: The renamed file name (e.g. "Delivery Note_Unknown_Unknown.pdf").
[0508] Specific behavior: The server executes os.rename(" / path / to / invoices / invoice_123.txt", " / path / to / invoices / DeliveryNote_Unknown_Unknown.pdf").
[0509] Step 6: Convert the file format
[0510] The server checks that the renamed file is not in a specific format (e.g. PDF) and converts it if necessary, using LibreOffice or pdftools.
[0511] Input: The renamed file name (e.g. "Delivery Note_Unknown_Unknown.pdf").
[0512] Output: A file in the specified format (e.g. PDF format file).
[0513] Specific operation: The server runs libreoffice --headless --convert-to pdf / path / to / invoices / DeliveryNote_Unknown_Unknown.pdf and deletes the file in the original format.
[0514] Step 7: Logging
[0515] The server logs each processing step it completes, allowing you to track which files have been processed and how.
[0516] Input: The results of each processing step.
[0517] Output: Processing history recorded in a log file.
[0518] Specific operation: The server uses the logging module to record a log message to a file, for example logging.info("File processed: Delivery note_Unknown_Unknown.pdf").
[0519] (Application example 1)
[0520] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0521] At logistics centers, the management of newly added delivery slips and related files requires a lot of manual work, which can lead to human error and time-consuming problems. Furthermore, the different formats and inconsistencies in storage locations for each file make efficient file management difficult, resulting in a decline in overall operational efficiency. A system that can solve these issues is needed.
[0522] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0523] In this invention, the server includes means for detecting that new digital information has been added to a predetermined area, means for extracting attribute information from the new digital information, means for determining a storage location for the new digital information based on the attribute information and for moving the new digital information to the storage location, means for renaming the new digital information based on preset rules, means for converting the new digital information into a predetermined format, means for determining a desired storage location and automatically creating the location if it does not exist, means for converting the new digital information into a predetermined format if it is detected and the information is not in a specific format, and means for dynamically determining a storage location and deleting files converted into the specified format. This dramatically improves the efficiency of file management in logistics centers, reducing human error and shortening work hours.
[0524] "New electronic information" refers to files or data that have been newly added to a specified area.
[0525] A "predetermined area" refers to a specific folder or directory that is to be monitored.
[0526] "Attribute information" refers to information about a file, such as the file type, shipping destination, shipping origin, and date.
[0527] A "storage location" is a folder or directory to which a file is moved, determined based on attribute information.
[0528] "Name" refers to the file name.
[0529] A "rule" is a pre-defined rule for renaming a file.
[0530] "Format" refers to the digital format of the file (e.g. PDF, TXT, etc.).
[0531] "Dynamic" means that it changes automatically depending on the situation or conditions.
[0532] System Overview
[0533] The system of this invention is designed to efficiently manage newly added delivery slips and related files at a logistics center. The server detects when new digital information is added to a specified area, extracts attribute information, and determines an appropriate storage location based on that information. The server then moves the new digital information to the storage location, renames the file according to predefined rules, and converts it into a specified format as needed.
[0534] Hardware and software used
[0535] The system utilizes the following hardware and software:
[0536] Hardware: Smartphones, smart glasses, head-mounted displays (HMDs)
[0537] Software: Python, monitoring software (watchdog), PDF file manipulation library (PyPDF2)
[0538] Processing flow
[0539] Smart devices constantly monitor monitoring folders in the logistics center, and when a newly added file is detected, the server extracts attribute information from the file. The extracted attribute information includes the file type, shipping destination, shipping origin, and date. The server determines the file storage location based on this attribute information, and automatically creates it if the storage location does not exist. The server then renames the file based on pre-defined rules and converts the file format to a specified format (mainly PDF) as needed. After the file has been converted to a specific format, the original file is finally deleted.
[0540] Specific examples
[0541] For example, if a new shipping slip "shipment_567.txt" is added to the logistics center, the server immediately detects the slip and extracts the shipping destination "Tokyo," the shipping origin "Osaka," and the date "20231001." Next, it moves the file to the " / path / to / shipments / Tokyo" folder and renames it "Shipping Slip_Tokyo_Osaka_20231001.pdf." If the file is in text format, it is then converted to PDF format.
[0542] Example prompts for generative AI models
[0543] Please explain what happens when a new shipping slip "shipment_567.txt" is added to the monitored folder. The shipping destination is "Tokyo", the shipping origin is "Osaka", and the date is "20231001", and the file name is changed to "Shipping slip_Tokyo_Osaka_20231001.pdf". Furthermore, if the file format is not PDF, it is converted to PDF.
[0544] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0545] Step 1:
[0546] The server constantly monitors a specific folder using monitoring software. When new digital information is added to this folder, the monitoring software immediately notifies the user. The input is the monitored folder and the newly added file, and the output is an event indicating that a new file has been added.
[0547] Step 2:
[0548] The server extracts attribute information from newly detected digital information. For example, if the file name is "shipment_567.txt," "shipment" is the file type and "567" is the identifier. It also analyzes metadata (shipping destination, origin, date, etc.) according to specific rules. The input is the new file name, and the output is the extracted attribute information.
[0549] Step 3:
[0550] The server determines the storage location for the new electronic information based on the extracted attribute information. For example, the " / path / to / shipments / Tokyo" folder is determined based on the shipping destination "Tokyo." If this storage location does not exist, the server automatically creates a new folder. The input is the attribute information, and the output is the determined storage location.
[0551] Step 4:
[0552] The server moves the new electronic information to the determined storage location. This action means transferring the file from the original folder to the new folder. The input is the new electronic information and the determined storage location, and the output is the new electronic information in the moved location.
[0553] Step 5:
[0554] The server renames the new electronic information based on predefined rules. For example, it renames "shipment_567.txt" to "Shipping slip_Tokyo_Osaka_20231001.pdf." The input is the current name and rules of the new electronic information, and the output is the electronic information with the new name.
[0555] Step 6:
[0556] The server checks whether the new electronic information is in a specific format and converts it to the required format (e.g. PDF) if necessary. After conversion, it deletes the original format file. The input is the current format of the new electronic information, and the output is the electronic information converted to the required format.
[0557] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0558] This invention combines a system in which a user simply places an electronic file in a specific folder, and the server automatically stores the file in the appropriate folder, renames the file as specified, and converts the file format as necessary, with an emotion engine that recognizes the user's emotions and adjusts operations based on those emotions. This system not only relieves the user from the burden of manual work, but also enables flexible responses according to the user's mental state, allowing for more comfortable and efficient file management.
[0559] System Program Overview
[0560] The system performs the following main processes on the server:
[0561] 1. Emotion recognition with emotion engine:
[0562] It is equipped with an emotion engine that analyzes emotions based on the user's facial expressions, tone of voice, speed of operation, etc.
[0563] If a user feels anxious or stressed about the system, this information is detected.
[0564] 2. New file detection:
[0565] The server constantly monitors a specific folder and immediately detects when a new file is added.
[0566] 3. Extracting Metadata:
[0567] The server extracts file type and related information (metadata) from the name and content of newly detected files.
[0568] 4. Store the file:
[0569] Based on the extracted metadata, the server determines the folder in which the file should be saved and moves the file to that folder.
[0570] 5. Change the file name:
[0571] The server renames the new file based on pre-defined rules.
[0572] 6. File format conversion:
[0573] If the new file is not in a particular format, the server converts the file to the predetermined format.
[0574] 7. Emotion-based processing changes:
[0575] If the user's emotions are recognized as being stressed, the server delays file processing operations to reduce the burden on the user.
[0576] If the user is expressing positive sentiment, the server will proactively suppress notifications to avoid disrupting the user's workflow.
[0577] System operation explanation in natural language
[0578] File input and emotion recognition
[0579] The user places a file called "invoice_123.txt" into a specific monitoring folder. At the same time, the emotion engine analyzes the user's facial expressions, operation speed, tone of voice, etc. to recognize the user's emotions. For example, if the user is feeling stressed, the emotion engine sends that information to the server.
[0580] Detecting new files and extracting metadata
[0581] The server uses monitoring software to monitor the folder and detect when a new file is added, then extracts metadata from the file name and contents, such as file type "invoice", company name "ExampleCorp", and creation date "20231001".
[0582] Storing files and renaming files
[0583] The server determines the appropriate folder (e.g., " / path / to / invoices") based on the extracted metadata, moves the file to that folder, and then renames the file to "Invoice_ExampleCorp_20231001.pdf" based on the configured rules.
[0584] File format conversion and emotion-based behavior adjustment
[0585] The server converts new files to PDF format if they are not already in PDF format. On the other hand, if the user is stressed, the server delays file processing until the user is emotionally stable. If the user is expressing positive emotions, the server suppresses notifications to avoid interrupting the user's work.
[0586] Specific examples
[0587] If a user drops a new report file called "report_456.txt" into a specific folder and the emotion engine recognizes that the user is in a stressed state, the server detects the file and extracts the metadata that the file type is "report," the author is "AuthorName," and the date is "20231001." However, because the user is stressed, the server temporarily delays processing the file and resumes processing once the user's condition improves. It then moves the file to the " / path / to / reports" folder, renames it to "report_AuthorName_20231001.pdf," and converts it to PDF format.
[0588] In this way, the system of the present invention manages files efficiently and appropriately while taking into consideration the user's feelings, thereby improving work efficiency and reducing the psychological burden on the user.
[0589] The processing flow will be explained below.
[0590] Step 1:
[0591] A user submits a file called "invoice_123.txt" to a specific monitored folder.
[0592] Step 2:
[0593] The server uses monitoring software to constantly monitor a specific folder, and the server detects when a new file is added by using a file system event handler.
[0594] Step 3:
[0595] The emotion engine analyzes the user's facial expressions, tone of voice, and speed of operation to recognize the user's emotions.
[0596] Step 4:
[0597] The server obtains the file path of the detected "invoice_123.txt" and uses this file path to extract metadata from the file name and content.
[0598] Step 5:
[0599] The server parses the extracted metadata and determines that the file type is "invoice", the company name is "ExampleCorp", and the date is "20231001".
[0600] Step 6:
[0601] The server determines the folder where the file should be saved based on the metadata. In this case, the folder " / path / to / invoices" is determined as the storage location. If the folder does not exist, the server will automatically create it.
[0602] Step 7:
[0603] The server moves "invoice_123.txt" to the determined folder by changing the file path.
[0604] Step 8:
[0605] The server changes the file name to "Delivery Note_ExampleCorp_20231001.pdf" based on a predefined rule. This operation is performed by changing the string in the file name.
[0606] Step 9:
[0607] The server verifies that the file to which the new filename is applied is not of a specific format (in this case, PDF format).
[0608] Step 10:
[0609] If the file format is not PDF, the server converts it to PDF format by reading the file contents and saving it as a new PDF file. Once this process is complete, the original file is deleted.
[0610] Step 11:
[0611] The emotion engine continuously monitors the user's emotional state. If the user is feeling stressed, the server will delay file processing operations to reduce the user's stress.
[0612] Step 12:
[0613] If the user is expressing positive emotions, the server will proactively suppress notifications to avoid disrupting their work.
[0614] Step 13:
[0615] The server checks that all operations are complete and returns to the next monitoring cycle.
[0616] Example 2
[0617] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0618] Conventional file management systems require users to manually store files in the appropriate folders, rename them, and convert their formats as needed. This tedious manual process not only reduces work efficiency but also increases the psychological burden on users. Furthermore, the lack of flexible response to the user's emotional state limits the user experience.
[0619] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0620] In this invention, the server includes means for detecting that a new file has been added to a predetermined folder, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for renaming the new file based on preset rules, means for converting the new file into a predetermined format, and means for recognizing a user's emotions and adjusting file processing based on the emotions. This reduces the manual burden on the user, enables flexible responses according to the user's mental state, and enables more comfortable and efficient file management.
[0621] A "new file" refers to electronic data that has been newly added to a specified folder.
[0622] The term "detection means" refers to a technology or device for monitoring file additions in a specific folder and detecting that a new file has been added.
[0623] "Metadata" refers to data that includes file content, attributes, and related information, such as file type, creator, and creation date.
[0624] "Means for extracting" refers to a technique or device for extracting metadata from the new file.
[0625] "Storage location" refers to a folder or directory designated for storing new files.
[0626] "Means for determining" refers to a technology or device that selects a storage location for a file based on pre-defined rules or extracted metadata.
[0627] "Means for moving" refers to the technique or device that moves the new file to the determined storage location.
[0628] "File name" refers to the name used to identify a file.
[0629] "Modifying means" refers to a technique or device that renames files based on pre-established rules.
[0630] "Format" refers to the data structure of the file and its storage format.
[0631] "Means for converting" refers to a technique or device for changing a file from one format to another.
[0632] "User" refers to a person who uses the system.
[0633] "Emotion" refers to the user's psychological state or mood, and includes states such as stress, joy, and anxiety.
[0634] "Means for recognition" refers to technology or devices that identify emotions by analyzing the user's facial expressions, tone of voice, operation speed, etc.
[0635] "Adjusting" refers to changing the system's behavior based on the perceived user's emotions.
[0636] This invention combines a system in which a user simply places an electronic file in a specific folder, and the server automatically stores the file in the appropriate folder, renames the file as specified, and converts the file format as necessary, with an emotion engine that recognizes the user's emotions and adjusts its behavior based on those emotions. This system not only relieves the user from the burden of manual work, but also enables flexible responses according to the user's mental state, allowing for more comfortable and efficient file management.
[0637] To implement this system, the following hardware and software are used.
[0638] 1. Emotion recognition using an emotion engine
[0639] The server is equipped with an emotion engine that analyzes emotions based on the user's facial expressions, tone of voice, and speed of operation. This emotion engine uses software called "EmotionAI." The device uses a webcam and microphone to capture the user's facial expressions and voice in real time and transmits the data to the server.
[0640] 2. New file detection
[0641] The server constantly monitors a specific folder using monitoring software called "FolderWatch." When a user places a file called "invoice_123.txt" into the monitored folder, the server immediately detects the change.
[0642] 3. Metadata extraction
[0643] The server uses a tool called "Apache Tika" to extract file types and related information (metadata) from the names and contents of newly detected files, such as file type "invoice," company name "ExampleCorp," and creation date "20231001."
[0644] 4. Storing Files
[0645] Based on the extracted metadata, the server uses a rules engine called RuleEngine to determine the appropriate folder location, for example, moving the file to the " / path / to / invoices" folder.
[0646] 5. Renaming the file
[0647] The server uses the "RenameHandler" script to rename the file based on the configured rules. For example, it renames the file to "Delivery Note_ExampleCorp_20231001.pdf."
[0648] 6. File Format Conversion
[0649] If the newly added file is not in a specific format, the server uses LibreOffice or FFmpeg to convert the file into a specified format, such as PDF.
[0650] 7. Emotion-based processing changes
[0651] The server uses "DelayProcessor" to temporarily delay file processing if the user is perceived as being stressed, and suppresses notifications if the user is showing positive emotions, so as not to disrupt the user's workflow.
[0652] Specific examples
[0653] If a user drops a new report file called "report_456.txt" into a specific folder and the emotion engine recognizes that the user is in a stressed state, the server detects the file and extracts the metadata that the file type is "report," the author is "AuthorName," and the date is "20231001." However, because the user is stressed, the server temporarily delays processing the file and resumes processing once the user's condition improves. It then moves the file to the " / path / to / reports" folder, renames it to "report_AuthorName_20231001.pdf," and converts it to PDF format.
[0654] Example prompts for generative AI models
[0655] "When a user submits a new file to a particular folder, explain how the server processes the file. Include details on how the server renames the file, converts the file format, and adjusts the processing based on emotion."
[0656] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0657] Program processing steps
[0658] Step 1: Collecting and Recognizing Emotional Data
[0659] When a user logs in or starts an operation, the device uses a webcam and microphone to capture the user's facial expressions and voice in real time. This data is sent to the server. The server then uses "Emotion AI" to analyze the received data and recognize the user's emotional state. This emotional information is temporarily stored in the server's database. The specific input is real-time data obtained from the webcam and microphone, and the output is the recognized emotional state.
[0660] Step 2: Detecting new files
[0661] A user drops a file called "invoice_123.txt" into a specific folder. The server uses "FolderWatch" to monitor the folder and immediately detects that a new file has been added. The input to this step is the addition of a new file, and the output is the path and name of the file. The server logs this information.
[0662] Step 3: Extracting Metadata
[0663] The server uses Apache Tika to parse the contents of "invoice_123.txt" and extract the file type and related information (metadata). For example, the file type is "invoice", the company name is "ExampleCorp", and the creation date is "20231001". The input for this step is the file path and file contents, and the output is the extracted metadata.
[0664] Step 4: Determine the appropriate storage folder
[0665] The server uses the RuleEngine to determine the appropriate storage folder based on the extracted metadata. For example, it may determine that the file should be stored in a folder called / path / to / invoices. The input to this step is the metadata, and the output is the determined folder path.
[0666] Step 5: Moving Files
[0667] The server moves the new file "invoice_123.txt" to " / path / to / invoices". The path information of the moved file is recorded in the server's database. The input of this step is the original file path and the determined folder path, and the output is the updated file path after the move.
[0668] Step 6: Renaming the file
[0669] The server uses the "RenameHandler" script to rename the file to "Invoice_ExampleCorp_20231001.pdf" based on the configured rules. The renamed file name is recorded in the server's database. The input for this step is the original file name and metadata, and the output is the new renamed file name.
[0670] Step 7: Convert the file format
[0671] If the newly added file is not in a specific format (e.g., PDF), the server uses LibreOffice or FFmpeg to convert the file to the required format. For example, converting a text file (.txt) to PDF. The inputs to this step are the original file format and the required file format, and the output is the converted file.
[0672] Step 8: Regulating Emotion-Based Processing
[0673] The server adjusts processing based on the user's emotions recognized by the emotion engine. For example, if the user is feeling stressed, it uses "DelayProcessor" to temporarily delay file processing. If the user is showing positive emotions, it suppresses notifications so as not to disrupt the user's workflow. The input of this step is the user's emotional state, and the output is adjusted processing timing and notification settings.
[0674] (Application example 2)
[0675] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0676] Manufacturing sites handle a large number of electronic files, and they need to be properly classified and managed. However, employees are always busy and find it difficult to allocate sufficient time to file management. Furthermore, when employees experience stress or anxiety, their work efficiency decreases. For this reason, there is a need for a system that can efficiently and appropriately manage files while taking into account the user's mental state.
[0677] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0678] In this invention, the server includes means for detecting that a new file has been added to a predetermined folder, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for renaming the new file based on preset rules, means for converting the new file into a predetermined format, and means for recognizing a user's emotion and adjusting the timing of file processing based on the emotion. This enables automatic file management at the manufacturing site, realizes flexible responses according to the mental state of employees, and enables work efficiency to be improved and the psychological burden on users to be reduced.
[0679] "Means for detecting when a new file is added to a specified folder" refers to a system that uses monitoring software or sensors to detect in real time when a new file is added to a specific folder.
[0680] "Metadata extraction means" refers to a mechanism for reading and analyzing relevant information such as file name, content, creation date, and creator from newly detected files.
[0681] The "means for determining a storage location and moving the file to that storage location" is a mechanism for automatically moving new files to appropriate folders or directories based on the extracted metadata.
[0682] "Means for renaming files according to predefined rules" refers to a mechanism for renaming files according to predefined rules, such as renaming files to include the date or the creator's name.
[0683] "Means for converting to a specified format" refers to a mechanism that automatically converts a new file into a pre-specified format if the file is not in a specific format. For example, converting a text file into PDF format.
[0684] "Means for recognizing the user's emotions and adjusting the timing of file processing based on those emotions" refers to a mechanism that uses a camera or microphone to analyze the user's facial expressions and tone of voice, and adjusts the timing of file processing according to the user's psychological state. For example, if the user is feeling stressed, the processing may be temporarily delayed.
[0685] The system embodying the present invention combines file management and processing based on the user's emotions. A specific embodiment of the system will be described below.
[0686] System Overview
[0687] The system consists of a server, a terminal (e.g., smart glasses or a robot), and a user. The server constantly monitors a specific folder and processes new files when they are added. The terminal is equipped with an emotion engine that analyzes the user's facial expressions and tone of voice to recognize emotions and transmits that information to the server.
[0688] Emotion recognition with emotion engine
[0689] The device uses a camera (e.g., OpenCV) and microphone (e.g., PyDub) to analyze the user's facial expressions and tone of voice. The analysis results are then used to recognize the user's emotional state using a generative AI model. For example, if the user is in a stressful state, that information is sent to the server.
[0690] File monitoring and processing
[0691] The server monitors the specified folder in real time using monitoring software (e.g., the watchdog library). When a new file is added, it immediately detects the file and extracts metadata from the file name and content.
[0692] Metadata-based file storage
[0693] The server determines where to store new files based on the extracted metadata. For example, if the file contains the keyword "blueprint," it moves the file to the blueprints folder. It also renames the file based on predefined rules, for example, changing the file name to "blueprint_date_author."
[0694] File format conversion
[0695] If the new file is not in a specific format (e.g. PDF), the server will automatically convert it to the specified format, for example using a PDF library.
[0696] Adjusting file handling based on sentiment
[0697] If the user is in a stressful state, the server temporarily delays file processing until the user's emotional state improves. On the other hand, if the user is in a positive state, the server suppresses notifications to avoid interrupting the user's work.
[0698] Specific examples
[0699] For example, suppose a user places a file called "Blueprint_123.dwg" into a specific folder. If the emotion engine simultaneously recognizes the user's stress level, the server will detect the file and temporarily delay processing. It will then rename the file to "Blueprint_20231001_Person in Charge.dwg," automatically move it to the appropriate folder, and convert it to PDF format if necessary.
[0700] Prompt Sentence Examples
[0701] For example, consider the following prompt:
[0702] An extremely stressed employee has dropped a file called "Blueprint_789.dwg" into a designated folder. After detecting this file, temporarily delay the process to reduce the employee's stress, then move the file to the appropriate folder as "Blueprint_Employee_20231001.pdf" and convert it to PDF format.
[0703] In this way, the system of the present invention manages files efficiently and appropriately while taking into consideration the user's feelings, thereby improving work efficiency and reducing the psychological burden on the user.
[0704] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0705] Step 1: Recognize emotions
[0706] The device uses a camera and microphone to capture the user's facial expressions and tone of voice. Image data captured using OpenCV and audio data recorded using PyDub are input. The emotion engine inputs this data into a generative AI model to analyze the user's emotions. The resulting emotional state (e.g., stress, joy) is output.
[0707] Step 2: Detecting new files
[0708] The server uses the watchdog library to monitor the specified folder in real time and detects when a new file is added to the folder. In this step, a new file added to the folder is provided as input and an event is output to detect that it has been added to the folder.
[0709] Step 3: Extracting Metadata
[0710] The server analyzes the filename and contents of the detected new file and extracts metadata. For example, information such as "blueprint," "123," and "dwg" is extracted from the filename "blueprint_123.dwg." In this step, the file name and file contents are provided as input, and the analysis results are output as metadata.
[0711] Step 4: Decide on a storage location and change the file name
[0712] The server determines the appropriate storage location based on the extracted metadata and renames the file based on predefined rules. For example, "Design_123.dwg" is renamed to "Design_20231001_Designer.dwg." In this step, the storage location is input based on the metadata, and the new file name and the determined storage location are output.
[0713] Step 5: Moving Files
[0714] The server moves the file with the changed file name to the determined storage location. In this step, the new file name and storage location are input, and the state where the file has been moved to the specified folder is output.
[0715] Step 6: Convert the file format
[0716] If the new file is not in a specific format, the server automatically converts it to the required format. For example, if "Design_123.dwg" is not in PDF format, it will be converted to "Design_123.pdf." This step takes the modified file as input and outputs the converted file in the required format.
[0717] Step 7: Regulating Emotion-Based Processing
[0718] The server adjusts the timing of file processing based on the emotional state from the emotion engine. For example, if the user is feeling stressed, the processing may be temporarily delayed. In this step, the emotion analysis result is input and the output is to delay or speed up the processing.
[0719] Through the above steps, a system is realized in which new files entered by the user are properly managed and flexible responses are made according to the user's emotional state.
[0720] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0721] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0722] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0723] [Third embodiment]
[0724] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0725] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[0726] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0727] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0728] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0729] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0730] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0731] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0732] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0733] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0734] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0735] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0736] This system allows users to simply place electronic files in a specific folder, and the server automatically stores the files in the appropriate folder, renames them to a specific file name, and converts the file format as needed. This system frees users from the burden of manual work and allows for efficient and accurate file management.
[0737] System Program Overview
[0738] The system performs the following main processes on the server:
[0739] 1. New file detection:
[0740] The server constantly monitors a specific folder and immediately detects when a new file is added.
[0741] 2. Extracting Metadata:
[0742] The server extracts file type and related information (metadata) from the name and content of newly detected files, such as file type, company name, creation date, etc.
[0743] 3. Store the file:
[0744] Based on the extracted metadata, the server determines the folder where the file should be saved. If the folder does not exist, the server automatically creates it.
[0745] 4. Change the file name:
[0746] The server renames the new file based on predefined rules, for example, the file name might be changed to "Invoice_Company_Date.pdf".
[0747] 5. File format conversion:
[0748] If the new file is not in a particular format, the server converts the file into a predetermined format, for example, PDF format.
[0749] System operation explanation in natural language
[0750] File submission and detection
[0751] A user places a file called "invoice_123.txt" into a specific monitored folder. The server, using monitoring software, monitors the folder and detects that a new file has been added.
[0752] Metadata extraction
[0753] The server extracts metadata from the detected "invoice_123.txt", including the file type "invoice", the company name "ExampleCorp", and the date "20231001".
[0754] File storage
[0755] Based on the extracted metadata, the server determines the appropriate folder " / path / to / invoices" and moves the file to that folder. If the folder does not exist, the server automatically creates it.
[0756] Renaming files
[0757] The server changes the file name to "Invoice_ExampleCorp_20231001.pdf" based on the pre-defined rules. Therefore, the server renames "invoice_123.txt" to "Invoice_ExampleCorp_20231001.pdf".
[0758] File format conversion
[0759] The server verifies that the renamed file is not in a specific format (PDF in this case), and if necessary, converts the file to PDF and deletes the original file.
[0760] Specific examples
[0761] If a user drops a new report file called "report_456.txt" into a specific folder, the server detects the file and extracts that the file type is "report." It also obtains the author ("AuthorName") and the date ("20231001") as metadata. Based on the metadata, the server moves the file to the " / path / to / reports" folder and renames it to "Report_AuthorName_20231001.pdf." Finally, the server converts the file to PDF format and deletes the original text file.
[0762] In this way, the system of the present invention allows the user to simply place files in a designated folder, and the server automatically manages the files, thereby improving work efficiency and accuracy.
[0763] The processing flow will be explained below.
[0764] Step 1:
[0765] A user submits a file called "invoice_123.txt" to a specific monitored folder.
[0766] Step 2:
[0767] The server uses monitoring software to monitor a specific folder. The server detects when a new file is added. This detection is done by a file system event handler.
[0768] Step 3:
[0769] The server obtains the path of the newly detected file "invoice_123.txt" and uses this file path to extract metadata from the file contents and file name.
[0770] Step 4:
[0771] The server parses the extracted metadata and determines that the file type is "invoice", the company name is "ExampleCorp", and the creation date is "20231001".
[0772] Step 5:
[0773] Based on the extracted metadata, the server determines the folder where the file should be saved. In this case, the folder " / path / to / invoices" is determined as the storage location. If the folder does not exist, the server will automatically create it.
[0774] Step 6:
[0775] The server moves the file "invoice_123.txt" to the determined folder by changing the file path.
[0776] Step 7:
[0777] The server then renames the file to a new format based on predefined rules. In this case, the file name is changed to "Delivery Note_ExampleCorp_20231001.pdf". This is done by changing the string in the file name.
[0778] Step 8:
[0779] The server verifies that the file to which the new filename is applied is not of a specific format (in this case, PDF format).
[0780] Step 9:
[0781] If the file format is not PDF, the server converts it to PDF format by reading the file contents and saving it as a new PDF file. Once this process is complete, the original text file is deleted.
[0782] Step 10:
[0783] The server checks that all operations are complete and returns to the next monitoring cycle.
[0784] In this way, the system of the present invention realizes improved efficiency and accuracy of work by allowing the server to automatically manage files simply by having the user input the files.
[0785] Example 1
[0786] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0787] In conventional file management systems, users had to manually determine where to store files, rename files, and convert file formats as needed, which resulted in low work efficiency and a high risk of operational errors. This not only consumed a lot of time and effort, but also created the problem of not guaranteeing the accuracy of file management.
[0788] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0789] In this invention, the server includes means for detecting that a new file has been added to a predetermined directory, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for changing the file name of the new file based on a preset rule, means for converting the new file into a predetermined format, and means for recording a log each time each processing step is completed, thereby enabling improved efficiency and accuracy of file management.
[0790] A "new file" refers to a file that has been newly added to a specific directory.
[0791] "Predetermined directory" refers to a directory that is designated as a specific location for the server to monitor.
[0792] "Metadata" refers to additional information extracted from the file name and file contents, including, for example, the file type, identifier, company name, creation date, and the like.
[0793] "Storage location" refers to a directory for saving files that is determined based on metadata.
[0794] "File renaming method" refers to a process or algorithm for renaming new files based on pre-established rules.
[0795] "Means for converting to a format" refers to tools or software that convert the new file into a specified predetermined format, such as PDF format.
[0796] "Means for recording logs" refers to a system or software that records the process as each processing step is completed.
[0797] This system allows users to simply place electronic files in a specific directory, and the server automatically stores the files in the appropriate location, renames them to a specific file name, and converts the file format as needed. This system frees users from the burden of manual work and allows for efficient and accurate file management.
[0798] System Program Overview
[0799] The system performs the following main processes on the server:
[0800] 1. Configuring a Watched Folder
[0801] The server is configured to monitor the directory specified by the user, using monitoring software such as inotify-tools.
[0802] Examples:
[0803] When a user specifies a directory called " / upload", the server will configure this directory and start monitoring it.
[0804] 2. New file detection
[0805] The server detects when a new file is added to a specified directory. Monitoring software such as inotifywait can be used.
[0806] Examples:
[0807] When a user uploads a file called "invoice_123.txt", the server immediately detects its presence and begins processing it.
[0808] 3. Metadata extraction
[0809] The server uses a Python script to extract metadata from the name and content of newly detected files, for example, the type "invoice" and the identifier "123" from the file name "invoice_123.txt."
[0810] Examples:
[0811] The server extracts the type "invoice" and the identifier "123" from "invoice_123.txt".
[0812] 4. Determine the destination folder
[0813] The server determines the appropriate destination directory based on the extracted metadata. If the specified folder does not exist, the server automatically creates it. File operations are performed using the os and shutil modules.
[0814] Examples:
[0815] If the type is "invoice", the server will decide to save the file in " / path / to / invoices" and will create the folder if it does not exist.
[0816] 5. Renaming the file
[0817] The server renames the file based on pre-defined rules, for example, renaming "invoice_123.txt" to "Delivery Note_ExampleCorp_20231001.pdf".
[0818] Examples:
[0819] The server renames "invoice_123.txt" to "Delivery Note_ExampleCorp_20231001.pdf".
[0820] 6. File Format Conversion
[0821] The server checks that the renamed file is not in a certain format (e.g. PDF) and converts it if necessary, using LibreOffice or pdftools.
[0822] Examples:
[0823] The server runs libreoffice --headless --convert-to pdf / path / to / invoices / DeliveryNote_ExampleCorp_20231001.pdf.
[0824] 7. Logging
[0825] The server logs each processing step it completes, allowing you to track which files have been processed and how. Use the logging module to write the logs to a file.
[0826] Examples:
[0827] The server writes the log message logging.info("File processed: Invoice_ExampleCorp_20231001.pdf") to the file.
[0828] Example input to a generative AI model
[0829] "Describe a system where a user can drop a file into a designated directory, and the server will detect the file, extract its metadata, move it to the appropriate directory, rename it, and convert its format as needed."
[0830] In this way, with this system, the user simply puts files into the directory, and the server automatically manages all files, improving work efficiency and accuracy.
[0831] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0832] Step 1: Configuring a Watched Folder
[0833] The server is configured to monitor the directory specified by the user. Since the server monitors the directory using monitoring software such as inotify-tools, it can immediately detect when a new file is added to the configured directory.
[0834] Input: The path of the directory specified by the user (e.g. " / upload").
[0835] Output: Set a specific directory to be monitored.
[0836] What it does: The server runs the command inotifywait -m / upload in the background, waiting for new files to be added.
[0837] Step 2: Detecting new files
[0838] The server detects when a new file is added to a monitored directory, which triggers the next processing step.
[0839] Input: The new file to be added to the watched directory (e.g. "invoice_123.txt").
[0840] Output: Notification of new file detection.
[0841] Specific behavior: The server receives the event of a new file being added and proceeds to the next step of metadata extraction.
[0842] Step 3: Extracting Metadata
[0843] The server uses a Python script to extract metadata from the name and content of newly detected files, including file type, identifier, company name, creation date, etc.
[0844] Input: Name and content of the new file (e.g. "invoice_123.txt").
[0845] Output: Extracted metadata (e.g. file type "invoice", identifier "123", company name "Unknown", creation date "Unknown").
[0846] Specific operation: The server runs a Python script to parse filename="invoice_123.txt" and retrieves the metadata in dictionary format.
[0847] Step 4: Determine the destination folder
[0848] The server determines the appropriate destination directory based on the extracted metadata. If the specified folder does not exist, the server automatically creates it and moves the new file into it.
[0849] Input: Extracted metadata (e.g. file type "invoice").
[0850] Output: The determined destination directory (e.g. " / path / to / invoices").
[0851] Specific operation: The server checks whether the folder exists using os.path.exists(" / path / to / invoices"), and if it does not exist, it creates a new one using os.makedirs(" / path / to / invoices"). Next, it moves the file using shutil.move(" / upload / invoice_123.txt", " / path / to / invoices / ").
[0852] Step 5: Renaming the file
[0853] The server renames the file based on predefined rules, for example, renaming "invoice_123.txt" to "Delivery Note_Company Name_Date.pdf".
[0854] Input: A new file (e.g., "invoice_123.txt") and extracted metadata (e.g., company name "Unknown", creation date "Unknown").
[0855] Output: The renamed file name (e.g. "Delivery Note_Unknown_Unknown.pdf").
[0856] Specific behavior: The server executes os.rename(" / path / to / invoices / invoice_123.txt", " / path / to / invoices / DeliveryNote_Unknown_Unknown.pdf").
[0857] Step 6: Convert the file format
[0858] The server checks that the renamed file is not in a specific format (e.g. PDF) and converts it if necessary, using LibreOffice or pdftools.
[0859] Input: The renamed file name (e.g. "Delivery Note_Unknown_Unknown.pdf").
[0860] Output: A file in the specified format (e.g. PDF format file).
[0861] Specific operation: The server runs libreoffice --headless --convert-to pdf / path / to / invoices / DeliveryNote_Unknown_Unknown.pdf and deletes the file in the original format.
[0862] Step 7: Logging
[0863] The server logs each processing step it completes, allowing you to track which files have been processed and how.
[0864] Input: The results of each processing step.
[0865] Output: Processing history recorded in a log file.
[0866] Specific operation: The server uses the logging module to record a log message to a file, for example logging.info("File processed: Delivery note_Unknown_Unknown.pdf").
[0867] (Application example 1)
[0868] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0869] At logistics centers, the management of newly added delivery slips and related files requires a lot of manual work, which can lead to human error and time-consuming problems. Furthermore, the different formats and inconsistencies in storage locations for each file make efficient file management difficult, resulting in a decline in overall operational efficiency. A system that can solve these issues is needed.
[0870] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0871] In this invention, the server includes means for detecting that new digital information has been added to a predetermined area, means for extracting attribute information from the new digital information, means for determining a storage location for the new digital information based on the attribute information and for moving the new digital information to the storage location, means for renaming the new digital information based on preset rules, means for converting the new digital information into a predetermined format, means for determining a desired storage location and automatically creating the location if it does not exist, means for converting the new digital information into a predetermined format if it is detected and the information is not in a specific format, and means for dynamically determining a storage location and deleting files converted into the specified format. This dramatically improves the efficiency of file management in logistics centers, reducing human error and shortening work hours.
[0872] "New electronic information" refers to files or data that have been newly added to a specified area.
[0873] A "predetermined area" refers to a specific folder or directory that is to be monitored.
[0874] "Attribute information" refers to information about a file, such as the file type, shipping destination, shipping origin, and date.
[0875] A "storage location" is a folder or directory to which a file is moved, determined based on attribute information.
[0876] "Name" refers to the file name.
[0877] A "rule" is a pre-defined rule for renaming a file.
[0878] "Format" refers to the digital format of the file (e.g. PDF, TXT, etc.).
[0879] "Dynamic" means that it changes automatically depending on the situation or conditions.
[0880] System Overview
[0881] The system of this invention is designed to efficiently manage newly added delivery slips and related files at a logistics center. The server detects when new digital information is added to a specified area, extracts attribute information, and determines an appropriate storage location based on that information. The server then moves the new digital information to the storage location, renames the file according to predefined rules, and converts it into a specified format as needed.
[0882] Hardware and software used
[0883] The system utilizes the following hardware and software:
[0884] Hardware: Smartphones, smart glasses, head-mounted displays (HMDs)
[0885] Software: Python, monitoring software (watchdog), PDF file manipulation library (PyPDF2)
[0886] Processing flow
[0887] Smart devices constantly monitor monitoring folders in the logistics center, and when a newly added file is detected, the server extracts attribute information from the file. The extracted attribute information includes the file type, shipping destination, shipping origin, and date. The server determines the file storage location based on this attribute information, and automatically creates it if the storage location does not exist. The server then renames the file based on pre-defined rules and converts the file format to a specified format (mainly PDF) as needed. After the file has been converted to a specific format, the original file is finally deleted.
[0888] Specific examples
[0889] For example, if a new shipping slip "shipment_567.txt" is added to the logistics center, the server immediately detects the slip and extracts the shipping destination "Tokyo," the shipping origin "Osaka," and the date "20231001." Next, it moves the file to the " / path / to / shipments / Tokyo" folder and renames it "Shipping Slip_Tokyo_Osaka_20231001.pdf." If the file is in text format, it is then converted to PDF format.
[0890] Example prompts for generative AI models
[0891] Please explain what happens when a new shipping slip "shipment_567.txt" is added to the monitored folder. The shipping destination is "Tokyo", the shipping origin is "Osaka", and the date is "20231001", and the file name is changed to "Shipping slip_Tokyo_Osaka_20231001.pdf". Furthermore, if the file format is not PDF, it is converted to PDF.
[0892] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0893] Step 1:
[0894] The server constantly monitors a specific folder using monitoring software. When new digital information is added to this folder, the monitoring software immediately notifies the user. The input is the monitored folder and the newly added file, and the output is an event indicating that a new file has been added.
[0895] Step 2:
[0896] The server extracts attribute information from newly detected digital information. For example, if the file name is "shipment_567.txt," "shipment" is the file type and "567" is the identifier. It also analyzes metadata (shipping destination, origin, date, etc.) according to specific rules. The input is the new file name, and the output is the extracted attribute information.
[0897] Step 3:
[0898] The server determines the storage location for the new electronic information based on the extracted attribute information. For example, the " / path / to / shipments / Tokyo" folder is determined based on the shipping destination "Tokyo." If this storage location does not exist, the server automatically creates a new folder. The input is the attribute information, and the output is the determined storage location.
[0899] Step 4:
[0900] The server moves the new electronic information to the determined storage location. This action means transferring the file from the original folder to the new folder. The input is the new electronic information and the determined storage location, and the output is the new electronic information in the moved location.
[0901] Step 5:
[0902] The server renames the new electronic information based on predefined rules. For example, it renames "shipment_567.txt" to "Shipping slip_Tokyo_Osaka_20231001.pdf." The input is the current name and rules of the new electronic information, and the output is the electronic information with the new name.
[0903] Step 6:
[0904] The server checks whether the new electronic information is in a specific format and converts it to the required format (e.g. PDF) if necessary. After conversion, it deletes the original format file. The input is the current format of the new electronic information, and the output is the electronic information converted to the required format.
[0905] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0906] This invention combines a system in which a user simply places an electronic file in a specific folder, and the server automatically stores the file in the appropriate folder, renames the file as specified, and converts the file format as necessary, with an emotion engine that recognizes the user's emotions and adjusts operations based on those emotions. This system not only relieves the user from the burden of manual work, but also enables flexible responses according to the user's mental state, allowing for more comfortable and efficient file management.
[0907] System Program Overview
[0908] The system performs the following main processes on the server:
[0909] 1. Emotion recognition with emotion engine:
[0910] It is equipped with an emotion engine that analyzes emotions based on the user's facial expressions, tone of voice, speed of operation, etc.
[0911] If a user feels anxious or stressed about the system, this information is detected.
[0912] 2. New file detection:
[0913] The server constantly monitors a specific folder and immediately detects when a new file is added.
[0914] 3. Extracting Metadata:
[0915] The server extracts file type and related information (metadata) from the name and content of newly detected files.
[0916] 4. Store the file:
[0917] Based on the extracted metadata, the server determines the folder in which the file should be saved and moves the file to that folder.
[0918] 5. Change the file name:
[0919] The server renames the new file based on pre-defined rules.
[0920] 6. File format conversion:
[0921] If the new file is not in a particular format, the server converts the file to the predetermined format.
[0922] 7. Emotion-based processing changes:
[0923] If the user's emotions are recognized as being stressed, the server delays file processing operations to reduce the burden on the user.
[0924] If the user is expressing positive sentiment, the server will proactively suppress notifications to avoid disrupting the user's workflow.
[0925] System operation explanation in natural language
[0926] File input and emotion recognition
[0927] The user places a file called "invoice_123.txt" into a specific monitoring folder. At the same time, the emotion engine analyzes the user's facial expressions, operation speed, tone of voice, etc. to recognize the user's emotions. For example, if the user is feeling stressed, the emotion engine sends that information to the server.
[0928] Detecting new files and extracting metadata
[0929] The server uses monitoring software to monitor the folder and detect when a new file is added, then extracts metadata from the file name and contents, such as file type "invoice", company name "ExampleCorp", and creation date "20231001".
[0930] Storing files and renaming files
[0931] The server determines the appropriate folder (e.g., " / path / to / invoices") based on the extracted metadata, moves the file to that folder, and then renames the file to "Invoice_ExampleCorp_20231001.pdf" based on the configured rules.
[0932] File format conversion and emotion-based behavior adjustment
[0933] The server converts new files to PDF format if they are not already in PDF format. On the other hand, if the user is stressed, the server delays file processing until the user is emotionally stable. If the user is expressing positive emotions, the server suppresses notifications to avoid interrupting the user's work.
[0934] Specific examples
[0935] If a user drops a new report file called "report_456.txt" into a specific folder and the emotion engine recognizes that the user is in a stressed state, the server detects the file and extracts the metadata that the file type is "report," the author is "AuthorName," and the date is "20231001." However, because the user is stressed, the server temporarily delays processing the file and resumes processing once the user's condition improves. It then moves the file to the " / path / to / reports" folder, renames it to "report_AuthorName_20231001.pdf," and converts it to PDF format.
[0936] In this way, the system of the present invention manages files efficiently and appropriately while taking into consideration the user's feelings, thereby improving work efficiency and reducing the psychological burden on the user.
[0937] The processing flow will be explained below.
[0938] Step 1:
[0939] A user submits a file called "invoice_123.txt" to a specific monitored folder.
[0940] Step 2:
[0941] The server uses monitoring software to constantly monitor a specific folder, and the server detects when a new file is added by using a file system event handler.
[0942] Step 3:
[0943] The emotion engine analyzes the user's facial expressions, tone of voice, and speed of operation to recognize the user's emotions.
[0944] Step 4:
[0945] The server obtains the file path of the detected "invoice_123.txt" and uses this file path to extract metadata from the file name and content.
[0946] Step 5:
[0947] The server parses the extracted metadata and determines that the file type is "invoice", the company name is "ExampleCorp", and the date is "20231001".
[0948] Step 6:
[0949] The server determines the folder where the file should be saved based on the metadata. In this case, the folder " / path / to / invoices" is determined as the storage location. If the folder does not exist, the server will automatically create it.
[0950] Step 7:
[0951] The server moves "invoice_123.txt" to the determined folder by changing the file path.
[0952] Step 8:
[0953] The server changes the file name to "Delivery Note_ExampleCorp_20231001.pdf" based on a predefined rule. This operation is performed by changing the string in the file name.
[0954] Step 9:
[0955] The server verifies that the file to which the new filename is applied is not of a specific format (in this case, PDF format).
[0956] Step 10:
[0957] If the file format is not PDF, the server converts it to PDF format by reading the file contents and saving it as a new PDF file. Once this process is complete, the original file is deleted.
[0958] Step 11:
[0959] The emotion engine continuously monitors the user's emotional state. If the user is feeling stressed, the server will delay file processing operations to reduce the user's stress.
[0960] Step 12:
[0961] If the user is expressing positive emotions, the server will proactively suppress notifications to avoid disrupting their work.
[0962] Step 13:
[0963] The server checks that all operations are complete and returns to the next monitoring cycle.
[0964] Example 2
[0965] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0966] Conventional file management systems require users to manually store files in the appropriate folders, rename them, and convert their formats as needed. This tedious manual process not only reduces work efficiency but also increases the psychological burden on users. Furthermore, the lack of flexible response to the user's emotional state limits the user experience.
[0967] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0968] In this invention, the server includes means for detecting that a new file has been added to a predetermined folder, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for renaming the new file based on preset rules, means for converting the new file into a predetermined format, and means for recognizing a user's emotions and adjusting file processing based on the emotions. This reduces the manual burden on the user, enables flexible responses according to the user's mental state, and enables more comfortable and efficient file management.
[0969] A "new file" refers to electronic data that has been newly added to a specified folder.
[0970] The term "detection means" refers to a technology or device for monitoring file additions in a specific folder and detecting that a new file has been added.
[0971] "Metadata" refers to data that includes file content, attributes, and related information, such as file type, creator, and creation date.
[0972] "Means for extracting" refers to a technique or device for extracting metadata from the new file.
[0973] "Storage location" refers to a folder or directory designated for storing new files.
[0974] "Means for determining" refers to a technology or device that selects a storage location for a file based on pre-defined rules or extracted metadata.
[0975] "Means for moving" refers to the technique or device that moves the new file to the determined storage location.
[0976] "File name" refers to the name used to identify a file.
[0977] "Modifying means" refers to a technique or device that renames files based on pre-established rules.
[0978] "Format" refers to the data structure of the file and its storage format.
[0979] "Means for converting" refers to a technique or device for changing a file from one format to another.
[0980] "User" refers to a person who uses the system.
[0981] "Emotion" refers to the user's psychological state or mood, and includes states such as stress, joy, and anxiety.
[0982] "Means for recognition" refers to technology or devices that identify emotions by analyzing the user's facial expressions, tone of voice, operation speed, etc.
[0983] "Adjusting" refers to changing the system's behavior based on the perceived user's emotions.
[0984] This invention combines a system in which a user simply places an electronic file in a specific folder, and the server automatically stores the file in the appropriate folder, renames the file as specified, and converts the file format as necessary, with an emotion engine that recognizes the user's emotions and adjusts its behavior based on those emotions. This system not only relieves the user from the burden of manual work, but also enables flexible responses according to the user's mental state, allowing for more comfortable and efficient file management.
[0985] To implement this system, the following hardware and software are used.
[0986] 1. Emotion recognition using an emotion engine
[0987] The server is equipped with an emotion engine that analyzes emotions based on the user's facial expressions, tone of voice, and speed of operation. This emotion engine uses software called "EmotionAI." The device uses a webcam and microphone to capture the user's facial expressions and voice in real time and transmits the data to the server.
[0988] 2. New file detection
[0989] The server constantly monitors a specific folder using monitoring software called "FolderWatch." When a user places a file called "invoice_123.txt" into the monitored folder, the server immediately detects the change.
[0990] 3. Metadata extraction
[0991] The server uses a tool called "Apache Tika" to extract file types and related information (metadata) from the names and contents of newly detected files, such as file type "invoice," company name "ExampleCorp," and creation date "20231001."
[0992] 4. Storing Files
[0993] Based on the extracted metadata, the server uses a rules engine called RuleEngine to determine the appropriate folder location, for example, moving the file to the " / path / to / invoices" folder.
[0994] 5. Renaming the file
[0995] The server uses the "RenameHandler" script to rename the file based on the configured rules. For example, it renames the file to "Delivery Note_ExampleCorp_20231001.pdf."
[0996] 6. File Format Conversion
[0997] If the newly added file is not in a specific format, the server uses LibreOffice or FFmpeg to convert the file into a specified format, such as PDF.
[0998] 7. Emotion-based processing changes
[0999] The server uses "DelayProcessor" to temporarily delay file processing if the user is perceived as being stressed, and suppresses notifications if the user is showing positive emotions, so as not to disrupt the user's workflow.
[1000] Specific examples
[1001] If a user drops a new report file called "report_456.txt" into a specific folder and the emotion engine recognizes that the user is in a stressed state, the server detects the file and extracts the metadata that the file type is "report," the author is "AuthorName," and the date is "20231001." However, because the user is stressed, the server temporarily delays processing the file and resumes processing once the user's condition improves. It then moves the file to the " / path / to / reports" folder, renames it to "report_AuthorName_20231001.pdf," and converts it to PDF format.
[1002] Example prompts for generative AI models
[1003] "When a user submits a new file to a particular folder, explain how the server processes the file. Include details on how the server renames the file, converts the file format, and adjusts the processing based on emotion."
[1004] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1005] Program processing steps
[1006] Step 1: Collecting and Recognizing Emotional Data
[1007] When a user logs in or starts an operation, the device uses a webcam and microphone to capture the user's facial expressions and voice in real time. This data is sent to the server. The server then uses "Emotion AI" to analyze the received data and recognize the user's emotional state. This emotional information is temporarily stored in the server's database. The specific input is real-time data obtained from the webcam and microphone, and the output is the recognized emotional state.
[1008] Step 2: Detecting new files
[1009] A user drops a file called "invoice_123.txt" into a specific folder. The server uses "FolderWatch" to monitor the folder and immediately detects that a new file has been added. The input to this step is the addition of a new file, and the output is the path and name of the file. The server logs this information.
[1010] Step 3: Extracting Metadata
[1011] The server uses Apache Tika to parse the contents of "invoice_123.txt" and extract the file type and related information (metadata). For example, the file type is "invoice", the company name is "ExampleCorp", and the creation date is "20231001". The input for this step is the file path and file contents, and the output is the extracted metadata.
[1012] Step 4: Determine the appropriate storage folder
[1013] The server uses the RuleEngine to determine the appropriate storage folder based on the extracted metadata. For example, it may determine that the file should be stored in a folder called / path / to / invoices. The input to this step is the metadata, and the output is the determined folder path.
[1014] Step 5: Moving Files
[1015] The server moves the new file "invoice_123.txt" to " / path / to / invoices". The path information of the moved file is recorded in the server's database. The input of this step is the original file path and the determined folder path, and the output is the updated file path after the move.
[1016] Step 6: Renaming the file
[1017] The server uses the "RenameHandler" script to rename the file to "Invoice_ExampleCorp_20231001.pdf" based on the configured rules. The renamed file name is recorded in the server's database. The input for this step is the original file name and metadata, and the output is the new renamed file name.
[1018] Step 7: Convert the file format
[1019] If the newly added file is not in a specific format (e.g., PDF), the server uses LibreOffice or FFmpeg to convert the file to the required format. For example, converting a text file (.txt) to PDF. The inputs to this step are the original file format and the required file format, and the output is the converted file.
[1020] Step 8: Regulating Emotion-Based Processing
[1021] The server adjusts processing based on the user's emotions recognized by the emotion engine. For example, if the user is feeling stressed, it uses "DelayProcessor" to temporarily delay file processing. If the user is showing positive emotions, it suppresses notifications so as not to disrupt the user's workflow. The input of this step is the user's emotional state, and the output is adjusted processing timing and notification settings.
[1022] (Application example 2)
[1023] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1024] Manufacturing sites handle a large number of electronic files, and they need to be properly classified and managed. However, employees are always busy and find it difficult to allocate sufficient time to file management. Furthermore, when employees experience stress or anxiety, their work efficiency decreases. For this reason, there is a need for a system that can efficiently and appropriately manage files while taking into account the user's mental state.
[1025] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1026] In this invention, the server includes means for detecting that a new file has been added to a predetermined folder, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for renaming the new file based on preset rules, means for converting the new file into a predetermined format, and means for recognizing a user's emotion and adjusting the timing of file processing based on the emotion. This enables automatic file management at the manufacturing site, realizes flexible responses according to the mental state of employees, and enables work efficiency to be improved and the psychological burden on users to be reduced.
[1027] "Means for detecting when a new file is added to a specified folder" refers to a system that uses monitoring software or sensors to detect in real time when a new file is added to a specific folder.
[1028] "Metadata extraction means" refers to a mechanism for reading and analyzing relevant information such as file name, content, creation date, and creator from newly detected files.
[1029] The "means for determining a storage location and moving the file to that storage location" is a mechanism for automatically moving new files to appropriate folders or directories based on the extracted metadata.
[1030] "Means for renaming files according to predefined rules" refers to a mechanism for renaming files according to predefined rules, such as renaming files to include the date or the creator's name.
[1031] "Means for converting to a specified format" refers to a mechanism that automatically converts a new file into a pre-specified format if the file is not in a specific format. For example, converting a text file into PDF format.
[1032] "Means for recognizing the user's emotions and adjusting the timing of file processing based on those emotions" refers to a mechanism that uses a camera or microphone to analyze the user's facial expressions and tone of voice, and adjusts the timing of file processing according to the user's psychological state. For example, if the user is feeling stressed, the processing may be temporarily delayed.
[1033] The system embodying the present invention combines file management and processing based on the user's emotions. A specific embodiment of the system will be described below.
[1034] System Overview
[1035] The system consists of a server, a terminal (e.g., smart glasses or a robot), and a user. The server constantly monitors a specific folder and processes new files when they are added. The terminal is equipped with an emotion engine that analyzes the user's facial expressions and tone of voice to recognize emotions and transmits that information to the server.
[1036] Emotion recognition with emotion engine
[1037] The device uses a camera (e.g., OpenCV) and microphone (e.g., PyDub) to analyze the user's facial expressions and tone of voice. The analysis results are then used to recognize the user's emotional state using a generative AI model. For example, if the user is in a stressful state, that information is sent to the server.
[1038] File monitoring and processing
[1039] The server monitors the specified folder in real time using monitoring software (e.g., the watchdog library). When a new file is added, it immediately detects the file and extracts metadata from the file name and content.
[1040] Metadata-based file storage
[1041] The server determines where to store new files based on the extracted metadata. For example, if the file contains the keyword "blueprint," it moves the file to the blueprints folder. It also renames the file based on predefined rules, for example, changing the file name to "blueprint_date_author."
[1042] File format conversion
[1043] If the new file is not in a specific format (e.g. PDF), the server will automatically convert it to the specified format, for example using a PDF library.
[1044] Adjusting file handling based on sentiment
[1045] If the user is in a stressful state, the server temporarily delays file processing until the user's emotional state improves. On the other hand, if the user is in a positive state, the server suppresses notifications to avoid interrupting the user's work.
[1046] Specific examples
[1047] For example, suppose a user places a file called "Blueprint_123.dwg" into a specific folder. If the emotion engine simultaneously recognizes the user's stress level, the server will detect the file and temporarily delay processing. It will then rename the file to "Blueprint_20231001_Person in Charge.dwg," automatically move it to the appropriate folder, and convert it to PDF format if necessary.
[1048] Prompt Sentence Examples
[1049] For example, consider the following prompt:
[1050] An extremely stressed employee has dropped a file called "Blueprint_789.dwg" into a designated folder. After detecting this file, temporarily delay the process to reduce the employee's stress, then move the file to the appropriate folder as "Blueprint_Employee_20231001.pdf" and convert it to PDF format.
[1051] In this way, the system of the present invention manages files efficiently and appropriately while taking into consideration the user's feelings, thereby improving work efficiency and reducing the psychological burden on the user.
[1052] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1053] Step 1: Recognize emotions
[1054] The device uses a camera and microphone to capture the user's facial expressions and tone of voice. Image data captured using OpenCV and audio data recorded using PyDub are input. The emotion engine inputs this data into a generative AI model to analyze the user's emotions. The resulting emotional state (e.g., stress, joy) is output.
[1055] Step 2: Detecting new files
[1056] The server uses the watchdog library to monitor the specified folder in real time and detects when a new file is added to the folder. In this step, a new file added to the folder is provided as input and an event is output to detect that it has been added to the folder.
[1057] Step 3: Extracting Metadata
[1058] The server analyzes the filename and contents of the detected new file and extracts metadata. For example, information such as "blueprint," "123," and "dwg" is extracted from the filename "blueprint_123.dwg." In this step, the file name and file contents are provided as input, and the analysis results are output as metadata.
[1059] Step 4: Decide on a storage location and change the file name
[1060] The server determines the appropriate storage location based on the extracted metadata and renames the file based on predefined rules. For example, "Design_123.dwg" is renamed to "Design_20231001_Designer.dwg." In this step, the storage location is input based on the metadata, and the new file name and the determined storage location are output.
[1061] Step 5: Moving Files
[1062] The server moves the file with the changed file name to the determined storage location. In this step, the new file name and storage location are input, and the state where the file has been moved to the specified folder is output.
[1063] Step 6: Convert the file format
[1064] If the new file is not in a specific format, the server automatically converts it to the required format. For example, if "Design_123.dwg" is not in PDF format, it will be converted to "Design_123.pdf." This step takes the modified file as input and outputs the converted file in the required format.
[1065] Step 7: Regulating Emotion-Based Processing
[1066] The server adjusts the timing of file processing based on the emotional state from the emotion engine. For example, if the user is feeling stressed, the processing may be temporarily delayed. In this step, the emotion analysis result is input and the output is to delay or speed up the processing.
[1067] Through the above steps, a system is realized in which new files entered by the user are properly managed and flexible responses are made according to the user's emotional state.
[1068] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1069] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1070] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1071] [Fourth embodiment]
[1072] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1073] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1074] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1075] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1076] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1077] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1078] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1079] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1080] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1081] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1082] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1083] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1084] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1085] This system allows users to simply place electronic files in a specific folder, and the server automatically stores the files in the appropriate folder, renames them to a specific file name, and converts the file format as needed. This system frees users from the burden of manual work and allows for efficient and accurate file management.
[1086] System Program Overview
[1087] The system performs the following main processes on the server:
[1088] 1. New file detection:
[1089] The server constantly monitors a specific folder and immediately detects when a new file is added.
[1090] 2. Extracting Metadata:
[1091] The server extracts file type and related information (metadata) from the name and content of newly detected files, such as file type, company name, creation date, etc.
[1092] 3. Store the file:
[1093] Based on the extracted metadata, the server determines the folder where the file should be saved. If the folder does not exist, the server automatically creates it.
[1094] 4. Change the file name:
[1095] The server renames the new file based on predefined rules, for example, the file name might be changed to "Invoice_Company_Date.pdf".
[1096] 5. File format conversion:
[1097] If the new file is not in a particular format, the server converts the file into a predetermined format, for example, PDF format.
[1098] System operation explanation in natural language
[1099] File submission and detection
[1100] A user places a file called "invoice_123.txt" into a specific monitored folder. The server, using monitoring software, monitors the folder and detects that a new file has been added.
[1101] Metadata extraction
[1102] The server extracts metadata from the detected "invoice_123.txt", including the file type "invoice", the company name "ExampleCorp", and the date "20231001".
[1103] File storage
[1104] Based on the extracted metadata, the server determines the appropriate folder " / path / to / invoices" and moves the file to that folder. If the folder does not exist, the server automatically creates it.
[1105] Renaming files
[1106] The server changes the file name to "Invoice_ExampleCorp_20231001.pdf" based on the pre-defined rules. Therefore, the server renames "invoice_123.txt" to "Invoice_ExampleCorp_20231001.pdf".
[1107] File format conversion
[1108] The server verifies that the renamed file is not in a specific format (PDF in this case), and if necessary, converts the file to PDF and deletes the original file.
[1109] Specific examples
[1110] If a user drops a new report file called "report_456.txt" into a specific folder, the server detects the file and extracts that the file type is "report." It also obtains the author ("AuthorName") and the date ("20231001") as metadata. Based on the metadata, the server moves the file to the " / path / to / reports" folder and renames it to "Report_AuthorName_20231001.pdf." Finally, the server converts the file to PDF format and deletes the original text file.
[1111] In this way, the system of the present invention allows the user to simply place files in a designated folder, and the server automatically manages the files, thereby improving work efficiency and accuracy.
[1112] The processing flow will be explained below.
[1113] Step 1:
[1114] A user submits a file called "invoice_123.txt" to a specific monitored folder.
[1115] Step 2:
[1116] The server uses monitoring software to monitor a specific folder. The server detects when a new file is added. This detection is done by a file system event handler.
[1117] Step 3:
[1118] The server obtains the path of the newly detected file "invoice_123.txt" and uses this file path to extract metadata from the file contents and file name.
[1119] Step 4:
[1120] The server parses the extracted metadata and determines that the file type is "invoice", the company name is "ExampleCorp", and the creation date is "20231001".
[1121] Step 5:
[1122] Based on the extracted metadata, the server determines the folder where the file should be saved. In this case, the folder " / path / to / invoices" is determined as the storage location. If the folder does not exist, the server will automatically create it.
[1123] Step 6:
[1124] The server moves the file "invoice_123.txt" to the determined folder by changing the file path.
[1125] Step 7:
[1126] The server then renames the file to a new format based on predefined rules. In this case, the file name is changed to "Delivery Note_ExampleCorp_20231001.pdf". This is done by changing the string in the file name.
[1127] Step 8:
[1128] The server verifies that the file to which the new filename is applied is not of a specific format (in this case, PDF format).
[1129] Step 9:
[1130] If the file format is not PDF, the server converts it to PDF format by reading the file contents and saving it as a new PDF file. Once this process is complete, the original text file is deleted.
[1131] Step 10:
[1132] The server checks that all operations are complete and returns to the next monitoring cycle.
[1133] In this way, the system of the present invention realizes improved efficiency and accuracy of work by allowing the server to automatically manage files simply by having the user input the files.
[1134] Example 1
[1135] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1136] In conventional file management systems, users had to manually determine where to store files, rename files, and convert file formats as needed, which resulted in low work efficiency and a high risk of operational errors. This not only consumed a lot of time and effort, but also created the problem of not guaranteeing the accuracy of file management.
[1137] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1138] In this invention, the server includes means for detecting that a new file has been added to a predetermined directory, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for changing the file name of the new file based on a preset rule, means for converting the new file into a predetermined format, and means for recording a log each time each processing step is completed, thereby enabling improved efficiency and accuracy of file management.
[1139] A "new file" refers to a file that has been newly added to a specific directory.
[1140] "Predetermined directory" refers to a directory that is designated as a specific location for the server to monitor.
[1141] "Metadata" refers to additional information extracted from the file name and file contents, including, for example, the file type, identifier, company name, creation date, and the like.
[1142] "Storage location" refers to a directory for saving files that is determined based on metadata.
[1143] "File renaming method" refers to a process or algorithm for renaming new files based on pre-established rules.
[1144] "Means for converting to a format" refers to tools or software that convert the new file into a specified predetermined format, such as PDF format.
[1145] "Means for recording logs" refers to a system or software that records the process as each processing step is completed.
[1146] This system allows users to simply place electronic files in a specific directory, and the server automatically stores the files in the appropriate location, renames them to a specific file name, and converts the file format as needed. This system frees users from the burden of manual work and allows for efficient and accurate file management.
[1147] System Program Overview
[1148] The system performs the following main processes on the server:
[1149] 1. Configuring a Watched Folder
[1150] The server is configured to monitor the directory specified by the user, using monitoring software such as inotify-tools.
[1151] Examples:
[1152] When a user specifies a directory called " / upload", the server will configure this directory and start monitoring it.
[1153] 2. New file detection
[1154] The server detects when a new file is added to a specified directory. Monitoring software such as inotifywait can be used.
[1155] Examples:
[1156] When a user uploads a file called "invoice_123.txt", the server immediately detects its presence and begins processing it.
[1157] 3. Metadata extraction
[1158] The server uses a Python script to extract metadata from the name and content of newly detected files, for example, the type "invoice" and the identifier "123" from the file name "invoice_123.txt."
[1159] Examples:
[1160] The server extracts the type "invoice" and the identifier "123" from "invoice_123.txt".
[1161] 4. Determine the destination folder
[1162] The server determines the appropriate destination directory based on the extracted metadata. If the specified folder does not exist, the server automatically creates it. File operations are performed using the os and shutil modules.
[1163] Examples:
[1164] If the type is "invoice", the server will decide to save the file in " / path / to / invoices" and will create the folder if it does not exist.
[1165] 5. Renaming the file
[1166] The server renames the file based on pre-defined rules, for example, renaming "invoice_123.txt" to "Delivery Note_ExampleCorp_20231001.pdf".
[1167] Examples:
[1168] The server renames "invoice_123.txt" to "Delivery Note_ExampleCorp_20231001.pdf".
[1169] 6. File Format Conversion
[1170] The server checks that the renamed file is not in a certain format (e.g. PDF) and converts it if necessary, using LibreOffice or pdftools.
[1171] Examples:
[1172] The server runs libreoffice --headless --convert-to pdf / path / to / invoices / DeliveryNote_ExampleCorp_20231001.pdf.
[1173] 7. Logging
[1174] The server logs each processing step it completes, allowing you to track which files have been processed and how. Use the logging module to write the logs to a file.
[1175] Examples:
[1176] The server writes the log message logging.info("File processed: Invoice_ExampleCorp_20231001.pdf") to the file.
[1177] Example input to a generative AI model
[1178] "Describe a system where a user can drop a file into a designated directory, and the server will detect the file, extract its metadata, move it to the appropriate directory, rename it, and convert its format as needed."
[1179] In this way, with this system, the user simply puts files into the directory, and the server automatically manages all files, improving work efficiency and accuracy.
[1180] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1181] Step 1: Configuring a Watched Folder
[1182] The server is configured to monitor the directory specified by the user. Since the server monitors the directory using monitoring software such as inotify-tools, it can immediately detect when a new file is added to the configured directory.
[1183] Input: The path of the directory specified by the user (e.g. " / upload").
[1184] Output: Set a specific directory to be monitored.
[1185] What it does: The server runs the command inotifywait -m / upload in the background, waiting for new files to be added.
[1186] Step 2: Detecting new files
[1187] The server detects when a new file is added to a monitored directory, which triggers the next processing step.
[1188] Input: The new file to be added to the watched directory (e.g. "invoice_123.txt").
[1189] Output: Notification of new file detection.
[1190] Specific behavior: The server receives the event of a new file being added and proceeds to the next step of metadata extraction.
[1191] Step 3: Extracting Metadata
[1192] The server uses a Python script to extract metadata from the name and content of newly detected files, including file type, identifier, company name, creation date, etc.
[1193] Input: Name and content of the new file (e.g. "invoice_123.txt").
[1194] Output: Extracted metadata (e.g. file type "invoice", identifier "123", company name "Unknown", creation date "Unknown").
[1195] Specific operation: The server runs a Python script to parse filename="invoice_123.txt" and retrieves the metadata in dictionary format.
[1196] Step 4: Determine the destination folder
[1197] The server determines the appropriate destination directory based on the extracted metadata. If the specified folder does not exist, the server automatically creates it and moves the new file into it.
[1198] Input: Extracted metadata (e.g. file type "invoice").
[1199] Output: The determined destination directory (e.g. " / path / to / invoices").
[1200] Specific operation: The server checks whether the folder exists using os.path.exists(" / path / to / invoices"), and if it does not exist, it creates a new one using os.makedirs(" / path / to / invoices"). Next, it moves the file using shutil.move(" / upload / invoice_123.txt", " / path / to / invoices / ").
[1201] Step 5: Renaming the file
[1202] The server renames the file based on predefined rules, for example, renaming "invoice_123.txt" to "Delivery Note_Company Name_Date.pdf".
[1203] Input: A new file (e.g., "invoice_123.txt") and extracted metadata (e.g., company name "Unknown", creation date "Unknown").
[1204] Output: The renamed file name (e.g. "Delivery Note_Unknown_Unknown.pdf").
[1205] Specific behavior: The server executes os.rename(" / path / to / invoices / invoice_123.txt", " / path / to / invoices / DeliveryNote_Unknown_Unknown.pdf").
[1206] Step 6: Convert the file format
[1207] The server checks that the renamed file is not in a specific format (e.g. PDF) and converts it if necessary, using LibreOffice or pdftools.
[1208] Input: The renamed file name (e.g. "Delivery Note_Unknown_Unknown.pdf").
[1209] Output: A file in the specified format (e.g. PDF format file).
[1210] Specific operation: The server runs libreoffice --headless --convert-to pdf / path / to / invoices / DeliveryNote_Unknown_Unknown.pdf and deletes the file in the original format.
[1211] Step 7: Logging
[1212] The server logs each processing step it completes, allowing you to track which files have been processed and how.
[1213] Input: The results of each processing step.
[1214] Output: Processing history recorded in a log file.
[1215] Specific operation: The server uses the logging module to record a log message to a file, for example logging.info("File processed: Delivery note_Unknown_Unknown.pdf").
[1216] (Application example 1)
[1217] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1218] At logistics centers, the management of newly added delivery slips and related files requires a lot of manual work, which can lead to human error and time-consuming problems. Furthermore, the different formats and inconsistencies in storage locations for each file make efficient file management difficult, resulting in a decline in overall operational efficiency. A system that can solve these issues is needed.
[1219] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1220] In this invention, the server includes means for detecting that new digital information has been added to a predetermined area, means for extracting attribute information from the new digital information, means for determining a storage location for the new digital information based on the attribute information and for moving the new digital information to the storage location, means for renaming the new digital information based on preset rules, means for converting the new digital information into a predetermined format, means for determining a desired storage location and automatically creating the location if it does not exist, means for converting the new digital information into a predetermined format if it is detected and the information is not in a specific format, and means for dynamically determining a storage location and deleting files converted into the specified format. This dramatically improves the efficiency of file management in logistics centers, reducing human error and shortening work hours.
[1221] "New electronic information" refers to files or data that have been newly added to a specified area.
[1222] A "predetermined area" refers to a specific folder or directory that is to be monitored.
[1223] "Attribute information" refers to information about a file, such as the file type, shipping destination, shipping origin, and date.
[1224] A "storage location" is a folder or directory to which a file is moved, determined based on attribute information.
[1225] "Name" refers to the file name.
[1226] A "rule" is a pre-defined rule for renaming a file.
[1227] "Format" refers to the digital format of the file (e.g. PDF, TXT, etc.).
[1228] "Dynamic" means that it changes automatically depending on the situation or conditions.
[1229] System Overview
[1230] The system of this invention is designed to efficiently manage newly added delivery slips and related files at a logistics center. The server detects when new digital information is added to a specified area, extracts attribute information, and determines an appropriate storage location based on that information. The server then moves the new digital information to the storage location, renames the file according to predefined rules, and converts it into a specified format as needed.
[1231] Hardware and software used
[1232] The system utilizes the following hardware and software:
[1233] Hardware: Smartphones, smart glasses, head-mounted displays (HMDs)
[1234] Software: Python, monitoring software (watchdog), PDF file manipulation library (PyPDF2)
[1235] Processing flow
[1236] Smart devices constantly monitor monitoring folders in the logistics center, and when a newly added file is detected, the server extracts attribute information from the file. The extracted attribute information includes the file type, shipping destination, shipping origin, and date. The server determines the file storage location based on this attribute information, and automatically creates it if the storage location does not exist. The server then renames the file based on pre-defined rules and converts the file format to a specified format (mainly PDF) as needed. After the file has been converted to a specific format, the original file is finally deleted.
[1237] Specific examples
[1238] For example, if a new shipping slip "shipment_567.txt" is added to the logistics center, the server immediately detects the slip and extracts the shipping destination "Tokyo," the shipping origin "Osaka," and the date "20231001." Next, it moves the file to the " / path / to / shipments / Tokyo" folder and renames it "Shipping Slip_Tokyo_Osaka_20231001.pdf." If the file is in text format, it is then converted to PDF format.
[1239] Example prompts for generative AI models
[1240] Please explain what happens when a new shipping slip "shipment_567.txt" is added to the monitored folder. The shipping destination is "Tokyo", the shipping origin is "Osaka", and the date is "20231001", and the file name is changed to "Shipping slip_Tokyo_Osaka_20231001.pdf". Furthermore, if the file format is not PDF, it is converted to PDF.
[1241] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1242] Step 1:
[1243] The server constantly monitors a specific folder using monitoring software. When new digital information is added to this folder, the monitoring software immediately notifies the user. The input is the monitored folder and the newly added file, and the output is an event indicating that a new file has been added.
[1244] Step 2:
[1245] The server extracts attribute information from newly detected digital information. For example, if the file name is "shipment_567.txt," "shipment" is the file type and "567" is the identifier. It also analyzes metadata (shipping destination, origin, date, etc.) according to specific rules. The input is the new file name, and the output is the extracted attribute information.
[1246] Step 3:
[1247] The server determines the storage location for the new electronic information based on the extracted attribute information. For example, the " / path / to / shipments / Tokyo" folder is determined based on the shipping destination "Tokyo." If this storage location does not exist, the server automatically creates a new folder. The input is the attribute information, and the output is the determined storage location.
[1248] Step 4:
[1249] The server moves the new electronic information to the determined storage location. This action means transferring the file from the original folder to the new folder. The input is the new electronic information and the determined storage location, and the output is the new electronic information in the moved location.
[1250] Step 5:
[1251] The server renames the new electronic information based on predefined rules. For example, it renames "shipment_567.txt" to "Shipping slip_Tokyo_Osaka_20231001.pdf." The input is the current name and rules of the new electronic information, and the output is the electronic information with the new name.
[1252] Step 6:
[1253] The server checks whether the new electronic information is in a specific format and converts it to the required format (e.g. PDF) if necessary. After conversion, it deletes the original format file. The input is the current format of the new electronic information, and the output is the electronic information converted to the required format.
[1254] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1255] This invention combines a system in which a user simply places an electronic file in a specific folder, and the server automatically stores the file in the appropriate folder, renames the file as specified, and converts the file format as necessary, with an emotion engine that recognizes the user's emotions and adjusts operations based on those emotions. This system not only relieves the user from the burden of manual work, but also enables flexible responses according to the user's mental state, allowing for more comfortable and efficient file management.
[1256] System Program Overview
[1257] The system performs the following main processes on the server:
[1258] 1. Emotion recognition with emotion engine:
[1259] It is equipped with an emotion engine that analyzes emotions based on the user's facial expressions, tone of voice, speed of operation, etc.
[1260] If a user feels anxious or stressed about the system, this information is detected.
[1261] 2. New file detection:
[1262] The server constantly monitors a specific folder and immediately detects when a new file is added.
[1263] 3. Extracting Metadata:
[1264] The server extracts file type and related information (metadata) from the name and content of newly detected files.
[1265] 4. Store the file:
[1266] Based on the extracted metadata, the server determines the folder in which the file should be saved and moves the file to that folder.
[1267] 5. Change the file name:
[1268] The server renames the new file based on pre-defined rules.
[1269] 6. File format conversion:
[1270] If the new file is not in a particular format, the server converts the file to the predetermined format.
[1271] 7. Emotion-based processing changes:
[1272] If the user's emotions are recognized as being stressed, the server delays file processing operations to reduce the burden on the user.
[1273] If the user is expressing positive sentiment, the server will proactively suppress notifications to avoid disrupting the user's workflow.
[1274] System operation explanation in natural language
[1275] File input and emotion recognition
[1276] The user places a file called "invoice_123.txt" into a specific monitoring folder. At the same time, the emotion engine analyzes the user's facial expressions, operation speed, tone of voice, etc. to recognize the user's emotions. For example, if the user is feeling stressed, the emotion engine sends that information to the server.
[1277] Detecting new files and extracting metadata
[1278] The server uses monitoring software to monitor the folder and detect when a new file is added, then extracts metadata from the file name and contents, such as file type "invoice", company name "ExampleCorp", and creation date "20231001".
[1279] Storing files and renaming files
[1280] The server determines the appropriate folder (e.g., " / path / to / invoices") based on the extracted metadata, moves the file to that folder, and then renames the file to "Invoice_ExampleCorp_20231001.pdf" based on the configured rules.
[1281] File format conversion and emotion-based behavior adjustment
[1282] The server converts new files to PDF format if they are not already in PDF format. On the other hand, if the user is stressed, the server delays file processing until the user is emotionally stable. If the user is expressing positive emotions, the server suppresses notifications to avoid interrupting the user's work.
[1283] Specific examples
[1284] If a user drops a new report file called "report_456.txt" into a specific folder and the emotion engine recognizes that the user is in a stressed state, the server detects the file and extracts the metadata that the file type is "report," the author is "AuthorName," and the date is "20231001." However, because the user is stressed, the server temporarily delays processing the file and resumes processing once the user's condition improves. It then moves the file to the " / path / to / reports" folder, renames it to "report_AuthorName_20231001.pdf," and converts it to PDF format.
[1285] In this way, the system of the present invention manages files efficiently and appropriately while taking into consideration the user's feelings, thereby improving work efficiency and reducing the psychological burden on the user.
[1286] The processing flow will be explained below.
[1287] Step 1:
[1288] A user submits a file called "invoice_123.txt" to a specific monitored folder.
[1289] Step 2:
[1290] The server uses monitoring software to constantly monitor a specific folder, and the server detects when a new file is added by using a file system event handler.
[1291] Step 3:
[1292] The emotion engine analyzes the user's facial expressions, tone of voice, and speed of operation to recognize the user's emotions.
[1293] Step 4:
[1294] The server obtains the file path of the detected "invoice_123.txt" and uses this file path to extract metadata from the file name and content.
[1295] Step 5:
[1296] The server parses the extracted metadata and determines that the file type is "invoice", the company name is "ExampleCorp", and the date is "20231001".
[1297] Step 6:
[1298] The server determines the folder where the file should be saved based on the metadata. In this case, the folder " / path / to / invoices" is determined as the storage location. If the folder does not exist, the server will automatically create it.
[1299] Step 7:
[1300] The server moves "invoice_123.txt" to the determined folder by changing the file path.
[1301] Step 8:
[1302] The server changes the file name to "Delivery Note_ExampleCorp_20231001.pdf" based on a predefined rule. This operation is performed by changing the string in the file name.
[1303] Step 9:
[1304] The server verifies that the file to which the new filename is applied is not of a specific format (in this case, PDF format).
[1305] Step 10:
[1306] If the file format is not PDF, the server converts it to PDF format by reading the file contents and saving it as a new PDF file. Once this process is complete, the original file is deleted.
[1307] Step 11:
[1308] The emotion engine continuously monitors the user's emotional state. If the user is feeling stressed, the server will delay file processing operations to reduce the user's stress.
[1309] Step 12:
[1310] If the user is expressing positive emotions, the server will proactively suppress notifications to avoid disrupting their work.
[1311] Step 13:
[1312] The server checks that all operations are complete and returns to the next monitoring cycle.
[1313] Example 2
[1314] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1315] Conventional file management systems require users to manually store files in the appropriate folders, rename them, and convert their formats as needed. This tedious manual process not only reduces work efficiency but also increases the psychological burden on users. Furthermore, the lack of flexible response to the user's emotional state limits the user experience.
[1316] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1317] In this invention, the server includes means for detecting that a new file has been added to a predetermined folder, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for renaming the new file based on preset rules, means for converting the new file into a predetermined format, and means for recognizing a user's emotions and adjusting file processing based on the emotions. This reduces the manual burden on the user, enables flexible responses according to the user's mental state, and enables more comfortable and efficient file management.
[1318] A "new file" refers to electronic data that has been newly added to a specified folder.
[1319] The term "detection means" refers to a technology or device for monitoring file additions in a specific folder and detecting that a new file has been added.
[1320] "Metadata" refers to data that includes file content, attributes, and related information, such as file type, creator, and creation date.
[1321] "Means for extracting" refers to a technique or device for extracting metadata from the new file.
[1322] "Storage location" refers to a folder or directory designated for storing new files.
[1323] "Means for determining" refers to a technology or device that selects a storage location for a file based on pre-defined rules or extracted metadata.
[1324] "Means for moving" refers to the technique or device that moves the new file to the determined storage location.
[1325] "File name" refers to the name used to identify a file.
[1326] "Modifying means" refers to a technique or device that renames files based on pre-established rules.
[1327] "Format" refers to the data structure of the file and its storage format.
[1328] "Means for converting" refers to a technique or device for changing a file from one format to another.
[1329] "User" refers to a person who uses the system.
[1330] "Emotion" refers to the user's psychological state or mood, and includes states such as stress, joy, and anxiety.
[1331] "Means for recognition" refers to technology or devices that identify emotions by analyzing the user's facial expressions, tone of voice, operation speed, etc.
[1332] "Adjusting" refers to changing the system's behavior based on the perceived user's emotions.
[1333] This invention combines a system in which a user simply places an electronic file in a specific folder, and the server automatically stores the file in the appropriate folder, renames the file as specified, and converts the file format as necessary, with an emotion engine that recognizes the user's emotions and adjusts its behavior based on those emotions. This system not only relieves the user from the burden of manual work, but also enables flexible responses according to the user's mental state, allowing for more comfortable and efficient file management.
[1334] To implement this system, the following hardware and software are used.
[1335] 1. Emotion recognition using an emotion engine
[1336] The server is equipped with an emotion engine that analyzes emotions based on the user's facial expressions, tone of voice, and speed of operation. This emotion engine uses software called "EmotionAI." The device uses a webcam and microphone to capture the user's facial expressions and voice in real time and transmits the data to the server.
[1337] 2. New file detection
[1338] The server constantly monitors a specific folder using monitoring software called "FolderWatch." When a user places a file called "invoice_123.txt" into the monitored folder, the server immediately detects the change.
[1339] 3. Metadata extraction
[1340] The server uses a tool called "Apache Tika" to extract file types and related information (metadata) from the names and contents of newly detected files, such as file type "invoice," company name "ExampleCorp," and creation date "20231001."
[1341] 4. Storing Files
[1342] Based on the extracted metadata, the server uses a rules engine called RuleEngine to determine the appropriate folder location, for example, moving the file to the " / path / to / invoices" folder.
[1343] 5. Renaming the file
[1344] The server uses the "RenameHandler" script to rename the file based on the configured rules. For example, it renames the file to "Delivery Note_ExampleCorp_20231001.pdf."
[1345] 6. File Format Conversion
[1346] If the newly added file is not in a specific format, the server uses LibreOffice or FFmpeg to convert the file into a specified format, such as PDF.
[1347] 7. Emotion-based processing changes
[1348] The server uses "DelayProcessor" to temporarily delay file processing if the user is perceived as being stressed, and suppresses notifications if the user is showing positive emotions, so as not to disrupt the user's workflow.
[1349] Specific examples
[1350] If a user drops a new report file called "report_456.txt" into a specific folder and the emotion engine recognizes that the user is in a stressed state, the server detects the file and extracts the metadata that the file type is "report," the author is "AuthorName," and the date is "20231001." However, because the user is stressed, the server temporarily delays processing the file and resumes processing once the user's condition improves. It then moves the file to the " / path / to / reports" folder, renames it to "report_AuthorName_20231001.pdf," and converts it to PDF format.
[1351] Example prompts for generative AI models
[1352] "When a user submits a new file to a particular folder, explain how the server processes the file. Include details on how the server renames the file, converts the file format, and adjusts the processing based on emotion."
[1353] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1354] Program processing steps
[1355] Step 1: Collecting and Recognizing Emotional Data
[1356] When a user logs in or starts an operation, the device uses a webcam and microphone to capture the user's facial expressions and voice in real time. This data is sent to the server. The server then uses "Emotion AI" to analyze the received data and recognize the user's emotional state. This emotional information is temporarily stored in the server's database. The specific input is real-time data obtained from the webcam and microphone, and the output is the recognized emotional state.
[1357] Step 2: Detecting new files
[1358] A user drops a file called "invoice_123.txt" into a specific folder. The server uses "FolderWatch" to monitor the folder and immediately detects that a new file has been added. The input to this step is the addition of a new file, and the output is the path and name of the file. The server logs this information.
[1359] Step 3: Extracting Metadata
[1360] The server uses Apache Tika to parse the contents of "invoice_123.txt" and extract the file type and related information (metadata). For example, the file type is "invoice", the company name is "ExampleCorp", and the creation date is "20231001". The input for this step is the file path and file contents, and the output is the extracted metadata.
[1361] Step 4: Determine the appropriate storage folder
[1362] The server uses the RuleEngine to determine the appropriate storage folder based on the extracted metadata. For example, it may determine that the file should be stored in a folder called / path / to / invoices. The input to this step is the metadata, and the output is the determined folder path.
[1363] Step 5: Moving Files
[1364] The server moves the new file "invoice_123.txt" to " / path / to / invoices". The path information of the moved file is recorded in the server's database. The input of this step is the original file path and the determined folder path, and the output is the updated file path after the move.
[1365] Step 6: Renaming the file
[1366] The server uses the "RenameHandler" script to rename the file to "Invoice_ExampleCorp_20231001.pdf" based on the configured rules. The renamed file name is recorded in the server's database. The input for this step is the original file name and metadata, and the output is the new renamed file name.
[1367] Step 7: Convert the file format
[1368] If the newly added file is not in a specific format (e.g., PDF), the server uses LibreOffice or FFmpeg to convert the file to the required format. For example, converting a text file (.txt) to PDF. The inputs to this step are the original file format and the required file format, and the output is the converted file.
[1369] Step 8: Regulating Emotion-Based Processing
[1370] The server adjusts processing based on the user's emotions recognized by the emotion engine. For example, if the user is feeling stressed, it uses "DelayProcessor" to temporarily delay file processing. If the user is showing positive emotions, it suppresses notifications so as not to disrupt the user's workflow. The input of this step is the user's emotional state, and the output is adjusted processing timing and notification settings.
[1371] (Application example 2)
[1372] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1373] Manufacturing sites handle a large number of electronic files, and they need to be properly classified and managed. However, employees are always busy and find it difficult to allocate sufficient time to file management. Furthermore, when employees experience stress or anxiety, their work efficiency decreases. For this reason, there is a need for a system that can efficiently and appropriately manage files while taking into account the user's mental state.
[1374] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1375] In this invention, the server includes means for detecting that a new file has been added to a predetermined folder, means for extracting metadata from the new file, means for determining a storage location for the new file based on the metadata and moving the new file to the storage location, means for renaming the new file based on preset rules, means for converting the new file into a predetermined format, and means for recognizing a user's emotion and adjusting the timing of file processing based on the emotion. This enables automatic file management at the manufacturing site, realizes flexible responses according to the mental state of employees, and enables work efficiency to be improved and the psychological burden on users to be reduced.
[1376] "Means for detecting when a new file is added to a specified folder" refers to a system that uses monitoring software or sensors to detect in real time when a new file is added to a specific folder.
[1377] "Metadata extraction means" refers to a mechanism for reading and analyzing relevant information such as file name, content, creation date, and creator from newly detected files.
[1378] The "means for determining a storage location and moving the file to that storage location" is a mechanism for automatically moving new files to appropriate folders or directories based on the extracted metadata.
[1379] "Means for renaming files according to predefined rules" refers to a mechanism for renaming files according to predefined rules, such as renaming files to include the date or the creator's name.
[1380] "Means for converting to a specified format" refers to a mechanism that automatically converts a new file into a pre-specified format if the file is not in a specific format. For example, converting a text file into PDF format.
[1381] "Means for recognizing the user's emotions and adjusting the timing of file processing based on those emotions" refers to a mechanism that uses a camera or microphone to analyze the user's facial expressions and tone of voice, and adjusts the timing of file processing according to the user's psychological state. For example, if the user is feeling stressed, the processing may be temporarily delayed.
[1382] The system embodying the present invention combines file management and processing based on the user's emotions. A specific embodiment of the system will be described below.
[1383] System Overview
[1384] The system consists of a server, a terminal (e.g., smart glasses or a robot), and a user. The server constantly monitors a specific folder and processes new files when they are added. The terminal is equipped with an emotion engine that analyzes the user's facial expressions and tone of voice to recognize emotions and transmits that information to the server.
[1385] Emotion recognition with emotion engine
[1386] The device uses a camera (e.g., OpenCV) and microphone (e.g., PyDub) to analyze the user's facial expressions and tone of voice. The analysis results are then used to recognize the user's emotional state using a generative AI model. For example, if the user is in a stressful state, that information is sent to the server.
[1387] File monitoring and processing
[1388] The server monitors the specified folder in real time using monitoring software (e.g., the watchdog library). When a new file is added, it immediately detects the file and extracts metadata from the file name and content.
[1389] Metadata-based file storage
[1390] The server determines where to store new files based on the extracted metadata. For example, if the file contains the keyword "blueprint," it moves the file to the blueprints folder. It also renames the file based on predefined rules, for example, changing the file name to "blueprint_date_author."
[1391] File format conversion
[1392] If the new file is not in a specific format (e.g. PDF), the server will automatically convert it to the specified format, for example using a PDF library.
[1393] Adjusting file handling based on sentiment
[1394] If the user is in a stressful state, the server temporarily delays file processing until the user's emotional state improves. On the other hand, if the user is in a positive state, the server suppresses notifications to avoid interrupting the user's work.
[1395] Specific examples
[1396] For example, suppose a user places a file called "Blueprint_123.dwg" into a specific folder. If the emotion engine simultaneously recognizes the user's stress level, the server will detect the file and temporarily delay processing. It will then rename the file to "Blueprint_20231001_Person in Charge.dwg," automatically move it to the appropriate folder, and convert it to PDF format if necessary.
[1397] Prompt Sentence Examples
[1398] For example, consider the following prompt:
[1399] An extremely stressed employee has dropped a file called "Blueprint_789.dwg" into a designated folder. After detecting this file, temporarily delay the process to reduce the employee's stress, then move the file to the appropriate folder as "Blueprint_Employee_20231001.pdf" and convert it to PDF format.
[1400] In this way, the system of the present invention manages files efficiently and appropriately while taking into consideration the user's feelings, thereby improving work efficiency and reducing the psychological burden on the user.
[1401] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1402] Step 1: Recognize emotions
[1403] The device uses a camera and microphone to capture the user's facial expressions and tone of voice. Image data captured using OpenCV and audio data recorded using PyDub are input. The emotion engine inputs this data into a generative AI model to analyze the user's emotions. The resulting emotional state (e.g., stress, joy) is output.
[1404] Step 2: Detecting new files
[1405] The server uses the watchdog library to monitor the specified folder in real time and detects when a new file is added to the folder. In this step, a new file added to the folder is provided as input and an event is output to detect that it has been added to the folder.
[1406] Step 3: Extracting Metadata
[1407] The server analyzes the filename and contents of the detected new file and extracts metadata. For example, information such as "blueprint," "123," and "dwg" is extracted from the filename "blueprint_123.dwg." In this step, the file name and file contents are provided as input, and the analysis results are output as metadata.
[1408] Step 4: Decide on a storage location and change the file name
[1409] The server determines the appropriate storage location based on the extracted metadata and renames the file based on predefined rules. For example, "Design_123.dwg" is renamed to "Design_20231001_Designer.dwg." In this step, the storage location is input based on the metadata, and the new file name and the determined storage location are output.
[1410] Step 5: Moving Files
[1411] The server moves the file with the changed file name to the determined storage location. In this step, the new file name and storage location are input, and the state where the file has been moved to the specified folder is output.
[1412] Step 6: Convert the file format
[1413] If the new file is not in a specific format, the server automatically converts it to the required format. For example, if "Design_123.dwg" is not in PDF format, it will be converted to "Design_123.pdf." This step takes the modified file as input and outputs the converted file in the required format.
[1414] Step 7: Regulating Emotion-Based Processing
[1415] The server adjusts the timing of file processing based on the emotional state from the emotion engine. For example, if the user is feeling stressed, the processing may be temporarily delayed. In this step, the emotion analysis result is input and the output is to delay or speed up the processing.
[1416] Through the above steps, a system is realized in which new files entered by the user are properly managed and flexible responses are made according to the user's emotional state.
[1417] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1418] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1419] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1420] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1421] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1422] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1423] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1424] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1425] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1426] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1427] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1428] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1429] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1430] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1431] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1432] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1433] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1434] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1435] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1436] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1437] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1438] The following is further disclosed regarding the above embodiment.
[1439] (Claim 1)
[1440] a means for detecting when a new file has been added to a given folder;
[1441] means for extracting metadata from the new file;
[1442] means for determining a storage location for the new file based on the metadata and moving the new file to the storage location;
[1443] means for changing the file name of the new file based on a preset rule;
[1444] means for converting the new file into a predetermined format;
[1445] A system including:
[1446] (Claim 2)
[1447] 10. The system of claim 1, further comprising: means for converting the new file to a predetermined format if the new file is not in the specified format.
[1448] (Claim 3)
[1449] 2. The system of claim 1, further comprising means for including a setting for determining a storage location for the new file, and for appropriately changing the storage location based on the setting.
[1450] "Example 1"
[1451] (Claim 1)
[1452] a means for detecting when a new file has been added to a given directory;
[1453] means for extracting metadata from the new file;
[1454] means for determining a storage location for the new file based on the metadata and moving the new file to the storage location;
[1455] means for changing the file name of the new file based on a preset rule;
[1456] means for converting the new file into a predetermined format;
[1457] means for logging each completed processing step;
[1458] A system including:
[1459] (Claim 2)
[1460] 2. The system of claim 1, further comprising means for converting the new file to a predetermined format if the new file is not in the specified format and deleting the file in the original format.
[1461] (Claim 3)
[1462] 2. The system of claim 1, further comprising means for including a setting for determining a storage location for the new file, and for appropriately changing the storage location based on the setting.
[1463] "Application Example 1"
[1464] (Claim 1)
[1465] means for detecting that new electronic information has been added to a predetermined area;
[1466] means for extracting attribute information from the new electronic information;
[1467] means for determining a storage location for the new electronic information based on the attribute information and for transferring the new electronic information to the storage location;
[1468] means for changing the name of the new electronic information based on a preset rule;
[1469] means for converting the new electronic information into a predetermined format;
[1470] means for determining a desired storage location and automatically creating the location if it does not exist;
[1471] means for converting the new electronic information into a predetermined format if the new electronic information is not in a specific format;
[1472] a means for deleting files whose storage location is dynamically determined and which have been converted to a specified format;
[1473] A system including:
[1474] (Claim 2)
[1475] 10. The system of claim 1, further comprising means for converting the new electronic information file into a predetermined format if the new electronic information is not in the specified format.
[1476] (Claim 3)
[1477] 10. The system of claim 1, further comprising means for including settings for determining a storage location for new electronic information, and for dynamically changing the storage location based on the settings.
[1478] "Example 2: Combining Emotion Engines"
[1479] (Claim 1)
[1480] a means for detecting when a new file has been added to a given folder;
[1481] means for extracting metadata from the new file;
[1482] means for determining a storage location for the new file based on the metadata and moving the new file to the storage location;
[1483] means for changing the file name of the new file based on a preset rule;
[1484] means for converting the new file into a predetermined format;
[1485] means for recognizing a user's emotion and adjusting file processing based on the emotion;
[1486] A system including:
[1487] (Claim 2)
[1488] 10. The system of claim 1, further comprising: means for converting the new file to a predetermined format if the new file is not in the specified format.
[1489] (Claim 3)
[1490] 2. The system of claim 1, further comprising means for including a setting for determining a storage location for the new file, and for appropriately changing the storage location based on the setting.
[1491] "Application example 2 when combining emotion engines"
[1492] (Claim 1)
[1493] a means for detecting when a new file has been added to a given folder;
[1494] means for extracting metadata from the new file;
[1495] means for determining a storage location for the new file based on the metadata and moving the new file to the storage location;
[1496] means for changing the file name of the new file based on a preset rule;
[1497] means for converting the new file into a predetermined format;
[1498] means for recognizing a user's emotion and adjusting the timing of file processing based on the emotion;
[1499] A system including:
[1500] (Claim 2)
[1501] 10. The system of claim 1, further comprising: means for converting the new file to a predetermined format if the new file is not in the specified format.
[1502] (Claim 3)
[1503] 2. The system of claim 1, further comprising means for including a setting for determining a storage location for the new file, and for appropriately changing the storage location based on the setting. [Explanation of symbols]
[1504] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. a means for detecting when a new file has been added to a given folder; means for extracting metadata from the new file; means for determining a storage location for the new file based on the metadata and moving the new file to the storage location; means for changing the file name of the new file based on a preset rule; means for converting the new file into a predetermined format; A system including:
2. 2. The system of claim 1, further comprising means for converting the new file to a predetermined format if the new file is not already in that format.
3. 2. The system according to claim 1, further comprising means for including a setting for determining a storage location of the new file, and for appropriately changing the storage location based on the setting.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A