system

Abstract

Provide a system. [Solution] A means for users to select a template for a request form and enter the necessary information, A means for the server to store the input information in a database and set up an approval route; A means for the server to send an approval request to the approver; A means for inputting the inspection results into a server and storing them in a database; A means for the server to send a notification of completion of inspection to the relevant person in charge and the vendor; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In accounting work, the entire process from approval to contract, ordering, and inspection is complex, making it difficult for people new to the work to understand. It's also often unclear who to ask or what steps to take, which often leads to delays in work as people wait for answers. This reduces work efficiency and makes the overall work process inefficient. [Means for solving the problem]

[0005] In order to solve the above-mentioned problems, the present invention provides a system having the following features:

[0006] A means for users to select a template for a request form and enter the necessary information,

[0007] A means for the server to store the input information in a database and set up an approval route;

[0008] A means for the server to send an approval request to the approver;

[0009] A means for inputting the inspection results into a server and storing them in a database;

[0010] A system is provided that includes a means for a server to send an inspection completion notice to a related person in charge and a vendor.

[0011] Furthermore, it also includes a means for uploading and analyzing the contract, a means for the server to store the analyzed contract data in a database, and a means for sending a request for confirmation of the contract to the person in charge.

[0012] The system also includes a means for a user to input order information, a server to check the information, and a means for the server to generate a purchase order, and a means for the server to send the generated purchase order to the vendor. In this way, the system simplifies user operations and enables efficient work progress in each phase of accounting work.

[0013] A "user" is a person who operates the system and inputs documents such as approval requests, contracts, purchase orders, and inspection information.

[0014] A "server" is a computer device that processes information entered by a user, stores it in a database, and sends notifications.

[0015] A "template" is a standard format for creating specific documents (e.g., approval documents, contracts, purchase orders).

[0016] A "database" is a digital information repository for storing information entered by users or generated by systems.

[0017] An "approval route" is the sequence of people in charge or managers that are established to obtain the necessary approval for a request for approval or a contract.

[0018] An "approver" is a person who has the authority to review and approve requests and contracts created by users.

[0019] "Upload" is the act of a user sending a file from their own terminal to the system server.

[0020] "Analysis" is the process of automatically processing the contents of the uploaded file and extracting the necessary data.

[0021] "Order information" refers to detailed information about the product or service ordered by the user (e.g., order content, quantity, unit price).

[0022] A "purchase order" is a formal order document created based on the order information and is to be sent to a supplier.

[0023] "Inspection" is the process of checking whether the delivered goods are as ordered.

[0024] "Inspection results" are inspection results reports obtained through the inspection process.

[0025] A "notification" is a message or email that the system uses to convey information about a specific event (e.g., approval request, inspection completion) to users and related parties.

[0026] These definitions will clarify the meaning of key terms contained in the claims. [Brief explanation of the drawings]

[0027] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2]1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0028] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0029] First, the terms used in the following description will be explained.

[0030] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0031] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0032] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0033] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0034] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0035] [First embodiment]

[0036] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0037] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0038] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0039] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0040] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0041] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0042] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0043] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0044] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0045] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0046] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0047] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0048] This invention relates to a system that consistently supports accounting operations, from approval to contracts, orders, and acceptance inspection. This system automates and streamlines the processes in each phase of accounting operations.

[0049] Approval phase

[0050] Program processing:

[0051] 1. The user logs in to the system and opens the approval request creation screen.

[0052] 2. The user selects one of the provided templates and enters the required information.

[0053] 3. When the user clicks the "Save" button, the server saves the entered information to the database.

[0054] 4. The server automatically generates an approval route based on the user's position and department.

[0055] 5. The server sends an email or an in-system notification to the approver requesting approval.

[0056] Examples:

[0057] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name of the equipment to be purchased, the quantity, the budget amount, and the reason for the purchase. After that, when they press the save button, the server saves the information in the database and sends notifications to the necessary approvers based on the pre-set approval route.

[0058] Contract Phase

[0059] Program processing:

[0060] 1. The user goes to the contract management screen and uploads the contract file.

[0061] 2. The server receives the file, analyzes the contents, and extracts the necessary information (contract amount, contract period, counterparty information, etc.).

[0062] 3. The server stores the extracted information in a database.

[0063] 4. The server sends a request to the agent to review the contract.

[0064] Examples:

[0065] For example, when a user signs a new contract, they upload the contract file to the system, and the server automatically analyzes the contents and extracts important contract information, making it easier for the person in charge to check the extracted information and enabling a quick response.

[0066] Ordering Phase

[0067] Program processing:

[0068] 1. The user moves to the purchase order creation screen and enters the order information (order details, quantity, unit price, etc.).

[0069] 2. The server checks the entered information to see if there are any errors.

[0070] 3. The server generates a purchase order based on the order information.

[0071] 4. The server generates a purchase order and sends it to the specified vendor via email.

[0072] Examples:

[0073] For example, when a user orders consumables, they log in to the system and enter the necessary information. The server then verifies the information, automatically generates a purchase order, and sends it to the supplier, automating the ordering process.

[0074] Inspection phase

[0075] Program processing:

[0076] 1. The user receives the delivery and inspects the quality and quantity.

[0077] 2. The user enters the inspection results into the system.

[0078] 3. The server saves the entered inspection results in the database.

[0079] 4. The server sends a notification of inspection completion to the relevant personnel and vendors.

[0080] Examples:

[0081] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies the relevant parties that the inspection has been completed, improving the transparency and efficiency of the business. In this way, the system of the present invention consistently supports accounting operations from approval to contract, ordering, and inspection, significantly improving business efficiency.

[0082] The processing flow will be explained below.

[0083] Approval phase

[0084] Program processing

[0085] Step 1:

[0086] The user logs in to the system and opens the approval request creation screen.

[0087] Step 2:

[0088] The user selects a template for the approval document from the templates provided.

[0089] Step 3:

[0090] The user enters the required information (purpose, content, amount, attachments, etc.).

[0091] Step 4:

[0092] The user clicks the Save button.

[0093] Step 5:

[0094] The server stores the entered information in a database.

[0095] Step 6:

[0096] The server automatically generates an approval route based on the user's position and department.

[0097] Step 7:

[0098] The server sends emails and in-system notifications to the configured approvers, requesting their approval.

[0099] Contract Phase

[0100] Program processing

[0101] Step 1:

[0102] The user moves to the contract management screen.

[0103] Step 2:

[0104] The user uploads an agreement file.

[0105] Step 3:

[0106] The server receives the file and parses its contents.

[0107] Step 4:

[0108] The server extracts the necessary information (contract amount, contract period, counterparty information, etc.) from the analysis results.

[0109] Step 5:

[0110] The server stores the extracted information in a database.

[0111] Step 6:

[0112] The server sends a request to the agent to review the contract.

[0113] Ordering Phase

[0114] Program processing

[0115] Step 1:

[0116] The user moves to the purchase order creation screen.

[0117] Step 2:

[0118] The user enters order information (order details, quantity, unit price, etc.).

[0119] Step 3:

[0120] The server checks the entered information to see if there are any errors.

[0121] Step 4:

[0122] The server generates a purchase order based on the order information.

[0123] Step 5:

[0124] The server generates a purchase order and sends it to the designated vendor via email.

[0125] Inspection phase

[0126] Program processing

[0127] Step 1:

[0128] The user receives the delivered goods and inspects the quality and quantity.

[0129] Step 2:

[0130] The user enters the inspection results into the system.

[0131] Step 3:

[0132] The server stores the input inspection results in a database.

[0133] Step 4:

[0134] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[0135] These specific processing steps allow a clear understanding of the mode for carrying out the invention. The detailed description of the specific operations performed at each step also makes it easier to grasp the overall picture of the system.

[0136] Example 1

[0137] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0138] In current accounting work, each phase, from creating approval documents to signing contracts, placing orders, and receiving inspections, is done manually, which takes a lot of time and effort. There is also a high possibility of miscommunication of information and delays in the approval process. This can lead to problems with the efficiency of the entire business and increased costs. The purpose of this invention is to solve these problems and provide a system that consistently automates and streamlines each phase of accounting work.

[0139] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0140] In this invention, the server includes: a means for a user to select a template for a request for approval and input the necessary information; a means for the server to save the input information in a database and perform an error check, and then automatically generate an approval route; a means for the server to send an email or an in-system notification to the approver requesting approval; a means for the user to receive the delivery and input the inspection results into the server, and the server to save the inspection results in a database; and a means for the server to send a notification of inspection completion to the relevant person in charge and the provider. This makes it possible to consistently automate the processes in each phase of accounting work, improving the efficiency and transparency of work.

[0141] "User" refers to a person who uses the system to perform various accounting tasks.

[0142] "Server" refers to a device or system that processes, stores, and notifies various data in response to instructions from a user.

[0143] A "template" refers to a predefined format that users use when creating documents such as approval forms and purchase orders.

[0144] "Database" refers to a system that allows a server to systematically store and manage information entered by users.

[0145] "Error checking" refers to the process by which the server checks the information entered by the user for errors.

[0146] An "approval route" refers to the path that determines who should approve a request form, purchase order, etc. created by a user.

[0147] "Email or internal system notification" refers to various means of communication that the server uses with users and approvers.

[0148] "Delivery Items" refers to goods and services ordered by a User.

[0149] "Inspection results" refers to the results of the user receiving the delivered goods and checking the quality, quantity, etc.

[0150] "Provider" refers to a trader or company that provides the goods or services ordered by the user.

[0151] "Contract file" refers to document data uploaded by a user for a contract.

[0152] "Parsing" refers to the process by which the server extracts the necessary information from the uploaded contract file.

[0153] "Order information" refers to detailed information such as the content, quantity, and unit price of a product or service that a user enters into a purchase order.

[0154] "Purchase Order" means a purchase order created by a User using the System.

[0155] MODE FOR CARRYING OUT THE INVENTION

[0156] The present invention relates to a system that consistently supports accounting operations, from approval to contracts, orders, and acceptance inspections. This system automates and streamlines the processes in each phase of accounting operations. Specific embodiments for each phase are described below.

[0157] Approval phase

[0158] In the approval phase, the user logs into the system and opens the approval document creation screen. The user selects one of the templates provided and enters the required information. Next, when the user clicks the "Save" button, the server saves the entered information in the database. The server automatically generates an approval route according to the user's position and department, and sends an email or an in-system notification to the approver requesting their approval.

[0159] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name, quantity, budget, and reason for the equipment they plan to purchase. After that, when they press the "Save" button, the server saves the information in the database and sends a notification to the approver based on the approval route.

[0160] Contract Phase

[0161] In the contract phase, the user moves to the contract management screen and uploads the contract file. The server receives the file, analyzes the contents using an analysis engine, and extracts the necessary information (contract amount, contract period, counterparty information, etc.). The server saves the extracted information in a database and sends an email or an in-system notification to the person in charge requesting that they review the contract.

[0162] For example, when a user signs a new contract, they upload the contract file to the system, and the server automatically analyzes the contents and extracts important contract information. The extracted information can be easily checked by the person in charge, enabling a quick response.

[0163] Ordering Phase

[0164] In the ordering phase, the user moves to the purchase order creation screen and enters the order information (order details, quantity, unit price, etc.). The server checks the entered information for any errors. The server generates a purchase order based on the order information and sends it to the specified vendor by email.

[0165] For example, when a user orders consumables, they log in to the system and enter the necessary information. The server then verifies the information, automatically generates a purchase order, and sends it to the supplier, automating the ordering process.

[0166] Inspection phase

[0167] In the inspection phase, the user receives the delivered goods and inspects the quality and quantity. When the user enters the inspection results into the system, the server saves the entered inspection results in the database. The server then sends a notification of inspection completion to the relevant person in charge and the vendor.

[0168] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies the relevant parties that the inspection has been completed, improving the transparency and efficiency of operations.

[0169] Use cases and prompts for generative AI models

[0170] Usage example

[0171] 1. When a user wants to order materials for a new project, they log into the system, enter the necessary information, and the server automatically generates a purchase order and sends it to the relevant vendor.

[0172] 2. Remote workers can use the system to upload contracts and smoothly obtain approval from their superiors.

[0173] Example prompts for generative AI models

[0174] "Use this prompt to explain the process for creating a request for approval in your accounting system. For example, explain the detailed steps a user would take to create a request for approval to purchase new equipment."

[0175] This system aims to reduce the workload of users by automating all accounting tasks, from approvals to contracts, orders, and inspections. In particular, it uses a high-performance server and the latest analysis engine for various data processing, improving accuracy and efficiency.

[0176] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0177] Approval phase

[0178] Step 1:

[0179] A user logs in to the system.

[0180] Input: User ID, Password

[0181] Operation: The device sends the entered authentication information to the server.

[0182] Output: The server returns the user authentication result.

[0183] Step 2:

[0184] The user moves to the approval request creation screen.

[0185] Input: User clicks

[0186] Operation: The server sends HTML data to the terminal to display the approval document creation screen.

[0187] Output: The terminal displays the approval request creation screen.

[0188] Step 3:

[0189] The user selects a template.

[0190] Input: Template selection operation

[0191] Operation: The terminal sends the selected template information to the server.

[0192] Output: The server returns the selected template content.

[0193] Step 4:

[0194] The user enters the required information.

[0195] Input: Equipment name, quantity, budget amount, reason for purchase, etc.

[0196] How it works: The device stores the information entered and sends it to the server when the user clicks the "Save" button.

[0197] Output: The server receives the information.

[0198] Step 5:

[0199] The user clicks the Save button.

[0200] Input: Click

[0201] Operation: The terminal sends the entered information to the server.

[0202] Output: The server stores the information in a database.

[0203] Step 6:

[0204] The server checks the entered information for errors.

[0205] Input: Information entered by the user

[0206] Behavior: The server validates the information and performs error checking.

[0207] Output: Error response or normal response

[0208] Step 7:

[0209] The server automatically generates an approval route.

[0210] Input: User's job title, department information, and input approval information

[0211] Action: The server runs the approval route algorithm to determine the appropriate approver.

[0212] Output: Generated approval route

[0213] Step 8:

[0214] The server sends a notification to the approver.

[0215] Input: Approval Route

[0216] Operation: The server processes the sending of email or internal notifications.

[0217] Output: A notification is sent.

[0218] Contract Phase

[0219] Step 1:

[0220] The user moves to the contract management screen.

[0221] Input: User clicks

[0222] Operation: The server sends HTML data to the terminal to display the contract management screen.

[0223] Output: The terminal displays the contract management screen.

[0224] Step 2:

[0225] The user uploads an agreement file.

[0226] Input: Contract file

[0227] Action: The device sends a file to the server.

[0228] Output: The server receives the file.

[0229] Step 3:

[0230] The server parses the file contents.

[0231] Input: Contract file

[0232] What it does: The server runs an OCR engine and extracts the file contents as text data.

[0233] Output: Extracted text data

[0234] Step 4:

[0235] The server extracts the necessary information.

[0236] Input: Text data

[0237] Operation: The server executes an algorithm to analyze and extract information such as the contract amount, contract period, and counterparty information.

[0238] Output: Extracted contract information

[0239] Step 5:

[0240] The server stores the extracted information in a database.

[0241] Input: Extracted contract information

[0242] Operation: The server processes the information and stores it in a database.

[0243] Output: Contract information stored in the database

[0244] Step 6:

[0245] The server sends a request to confirm the contract to the person in charge.

[0246] Input: Contact information, contract information

[0247] Action: The server runs a process that sends email or internal notifications.

[0248] Output: A notification is sent.

[0249] Ordering Phase

[0250] Step 1:

[0251] The user moves to the purchase order creation screen.

[0252] Input: User clicks

[0253] Operation: The server sends HTML data to the terminal to display the purchase order creation screen.

[0254] Output: The terminal displays the purchase order creation screen.

[0255] Step 2:

[0256] The user enters the order information.

[0257] Input: Product details, quantity, unit price, etc.

[0258] How it works: The device stores the information entered and sends it to the server when the user clicks the "Submit" button.

[0259] Output: The server receives the information.

[0260] Step 3:

[0261] The server verifies the information entered.

[0262] Input: Order information entered by the user

[0263] Action: The server validates the information and checks for any errors.

[0264] Output: Verification result (error response or normal response)

[0265] Step 4:

[0266] The server automatically generates a purchase order.

[0267] Input: Confirmed order information

[0268] Operation: The server runs an algorithm that generates a purchase order.

[0269] Output: Generated purchase order

[0270] Step 5:

[0271] The server sends the generated purchase order to the vendor.

[0272] Input: Generated purchase order, vendor information

[0273] Operation: The server processes the purchase order and sends it to the vendor via email.

[0274] Output: Purchase order submitted

[0275] Inspection phase

[0276] Step 1:

[0277] The user receives the delivery.

[0278] Input: Receipt of delivery

[0279] Action: The user inspects the delivery.

[0280] Output: Check the quality and quantity of the delivered items

[0281] Step 2:

[0282] The user enters the inspection results into the system.

[0283] Input: Inspection result (pass, fail, etc.)

[0284] Operation: The terminal sends the entered inspection results to the server.

[0285] Output: The server receives the acceptance result.

[0286] Step 3:

[0287] The server stores the input inspection results in a database.

[0288] Input: Inspection results

[0289] Operation: The server processes the inspection results and stores them in a database.

[0290] Output: Inspection results stored in the database

[0291] Step 4:

[0292] The server sends a notification that the inspection is complete.

[0293] Input: Inspection results, related person and vendor information

[0294] Action: The server runs a process that sends email or internal notifications.

[0295] Output: Completion notification sent

[0296] (Application example 1)

[0297] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0298] The approval, contract, ordering, and inspection processes at logistics centers often involve a lot of manual work and lack efficiency. In addition, inconsistencies and delays can occur at each stage, hindering the smooth progress of the entire business. Therefore, automating and integrating these processes is desirable, and there is a demand for improving the transparency and efficiency of operations.

[0299] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0300] In this invention, the server includes: a means for a user to select a request form template and input the necessary information; a means for the server to save the input information in a database and set an approval route; a means for the server to send an approval request to an approver; a means for a user to upload a contract to a management screen and for the server to analyze the content, extract the necessary information, and save it in a database; a means for the server to send a request to confirm the contract to a person in charge based on the extracted information; a means for a user to input order information into the system, for the server to check the information for any errors, generate a purchase order, and send it to a vendor; a means for a user to input inspection results into the server and save them in a database; and a means for the server to send an inspection completion notification to the relevant person in charge and a vendor. This automates the entire process of approval, contract, ordering, and inspection within a logistics center, making it possible to significantly improve the efficiency and transparency of operations.

[0301] A "requisition document" is a document prepared by a company or other organization to obtain approval for certain economic or business matters.

[0302] A "template" refers to a pre-prepared format that makes it easy to create a specific document or format.

[0303] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[0304] An "approval route" refers to the step-by-step process or path that a document such as a request form or contract takes to be approved.

[0305] "Approval Request" means a request sent to a specific person or department for approval.

[0306] "Inspection results" refers to the results reported after checking the quality and quantity of delivered goods or services.

[0307] "Notification" means a message or communication sent to inform interested parties of specific information.

[0308] A "contract" is a document that documents the formation and content of a contract and serves as legal evidence of the agreement between the parties to the contract.

[0309] "Analysis" is the process of examining the contents of data or documents in detail to clarify their structure and meaning.

[0310] "Order Information" refers to data or documents that describe the contents and conditions of an order.

[0311] A "purchase order" is a document created to place an order, which contains the order details, quantity, unit price, etc.

[0312] "Vendor" refers to a business or organization that provides a particular service or product.

[0313] A "smartphone" is a multi-function mobile phone that has mobile communication capabilities and can install and use a variety of applications.

[0314] "Wireless communication" refers to the technology of transmitting data using radio signals such as radio waves.

[0315] "Real time" means that processing occurs the instant an event occurs.

[0316] "Application" means software designed to perform a specific purpose or function.

[0317] This invention relates to a system that consistently supports, automates, and streamlines processes at logistics centers, from approval to contracts, orders, and inspections. This system uses a server and user devices (e.g., smartphones) to process each phase of the process via real-time wireless communication.

[0318] Hardware and software used

[0319] Server: Centralizes data storage, analysis, notification sending, etc. The server is built using Flask (a lightweight Python web framework).

[0320] Database: Used to manage and store large amounts of data. Uses SQLite.

[0321] Smartphone: Used as a terminal for users to input information for each process.

[0322] Communication technology: Wireless communication (e.g., Wi-Fi, Bluetooth) is used to send and receive data in real time.

[0323] Email sending library: Uses mtplib to send approval requests and notifications in email format.

[0324] Program processing overview

[0325] 1. Approval phase

[0326] The user opens the smartphone app, selects a template on the approval document creation screen, and enters the required information. The entered information is sent to the server and saved.

[0327] The server automatically generates an approval route based on the entered information and sends an email notification of the approval request to the approver.

[0328] 2. Contract Phase

[0329] The user uploads the contract file to the management screen. The server analyzes the file contents and extracts the necessary contract information (e.g., contract amount, contract period).

[0330] The extracted information is stored in a database and a request for contract confirmation is sent to the person in charge via email.

[0331] 3. Ordering Phase

[0332] The user enters order information on their smartphone and sends it to the server, which checks the integrity of the information and automatically generates a purchase order.

[0333] The generated purchase order is sent to the specified vendor via email.

[0334] 4. Inspection Phase

[0335] When the user receives the delivered goods, they inspect the quality and quantity and enter the inspection results into the server using a smartphone app.

[0336] The server stores the inspection results in a database and notifies the relevant personnel and vendors that the inspection has been completed.

[0337] Specific examples

[0338] For example, consider a scenario in which a user is creating a request to purchase a forklift. In this case, the user enters the following information into a smartphone app:

[0339] Equipment Name: "Forklift"

[0340] Quantity: 2

[0341] Budget: 3 million yen

[0342] Reason: "To improve on-site work efficiency"

[0343] Approver Email: "approver@example.com"

[0344] Once these are entered and the user clicks "Save," the system automatically saves the information to the database and sends an email notification to the approver. This operation ensures the approval process is efficient and improves business transparency.

[0345] Prompt Sentence Examples

[0346] The template for creating a request for approval to purchase a new forklift for a distribution center includes the following information:

[0347] Equipment Name: "Forklift"

[0348] Quantity: 2

[0349] Budget: 3 million yen

[0350] Reason: "To improve on-site work efficiency"

[0351] Approver Email: "approver@example.com"

[0352] In this way, by integrating and automating the entire process of approval, contracts, orders, and inspections within the logistics center, it is possible to significantly improve the efficiency of the entire business.

[0353] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0354] Step 1:

[0355] The user opens the smartphone app, selects a template on the approval request creation screen, and enters the required information.

[0356] Input: Facility name, quantity, budget, reason, approver email

[0357] What happens: The user enters this information into a form within the app and presses the "Save" button.

[0358] Output: The entered information is sent to the server.

[0359] Step 2:

[0360] The server stores the entered information in a database.

[0361] Input: Request information sent in Step 1

[0362] How it works: The server parses the data it receives and stores it in an SQLite database.

[0363] Output: The approval request information is saved in the database.

[0364] Step 3:

[0365] The server automatically generates an approval route based on the input information and sends an approval request to the approver by email.

[0366] Input: Approval information stored in the database, approver email

[0367] Operation: The server generates an approval route and sends an approval request email using smtplib.

[0368] Output: An email requesting approval of the request form will be sent to the approver.

[0369] Step 4:

[0370] The user uploads the contract file to the admin panel.

[0371] Input: Contract file

[0372] How it works: The user uploads a contract file and presses the "Analyze" button. The contract file is sent to the server.

[0373] Output: The contract file is sent to the server.

[0374] Step 5:

[0375] The server analyzes the contents of the contract file, extracts the necessary information, and stores it in a database.

[0376] Input: Uploaded agreement file

[0377] How it works: The server parses the contract file, extracts information such as the contract amount and contract period, and stores it in a database.

[0378] Output: The extracted contract information is stored in a database.

[0379] Step 6:

[0380] The server sends an email to the person in charge requesting confirmation of the contract based on the contract information.

[0381] Input: Contract information stored in the database

[0382] Action: The server sends a confirmation email to the person in charge.

[0383] Output: An email requesting confirmation of the contract is sent to the person in charge.

[0384] Step 7:

[0385] The user enters order information into the smartphone app and sends it to the server.

[0386] Input: Product name, quantity, unit price, delivery deadline

[0387] How it works: The user enters this information into the form in the app and presses the "Place Order" button. The order information is sent to the server.

[0388] Output: The order information is sent to the server.

[0389] Step 8:

[0390] The server checks the consistency of the order information and automatically generates a purchase order.

[0391] Input: Submitted order information

[0392] How it works: The server verifies the integrity of all items and generates a purchase order based on the information.

[0393] Output: The automatically generated purchase order is saved as internal data.

[0394] Step 9:

[0395] The server sends the generated purchase order to the specified vendor by email.

[0396] Input: Auto-generated purchase order, vendor email address

[0397] What happens: The server sends a purchase order to the vendor's email address.

[0398] Output: A purchase order is sent to the vendor.

[0399] Step 10:

[0400] The user inspects the quality and quantity of the delivered items and enters the inspection results into a smartphone app.

[0401] Input: Inspection results (e.g. quality status, received quantity)

[0402] Operation: The user enters the inspection results into the form in the app and presses the "Save" button. The inspection results are sent to the server.

[0403] Output: The inspection result is sent to the server.

[0404] Step 11:

[0405] The server stores the inspection results in a database and sends an inspection completion notification by email to the relevant person in charge and the contractor.

[0406] Input: Submitted acceptance result

[0407] Operation: The server saves the inspection results in a database and sends an email to the relevant person in charge and the vendor notifying them of the completion of the inspection.

[0408] Output: Notification of completion of inspection is sent to the person in charge and the vendor.

[0409] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0410] This invention combines a system that consistently supports accounting work, from approval to contract, ordering, and acceptance inspection, with an emotion engine that recognizes the user's emotions. This system automates and streamlines the processes in each phase of accounting work, and can provide appropriate support based on the user's emotional state.

[0411] Approval phase

[0412] Program processing

[0413] 1. The user logs in to the system and opens the approval request creation screen.

[0414] 2. The user selects a request form template from the provided templates and enters the required information.

[0415] 3. When the user clicks the "Save" button, the server saves the entered information to the database.

[0416] 4. The emotion engine evaluates the user's emotional state based on their input and facial expression data.

[0417] 5. The server automatically generates an approval route based on the user's position and department and sends an approval request.

[0418] 6. The emotional engine provides appropriate guidance and support based on the user's emotional state.

[0419] Specific examples

[0420] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name, quantity, budget, and reason for the equipment to be purchased. If the emotion engine analyzes the user's input speed and facial expression and determines that the user is tired, a notification prompting them to take a break will be displayed within the system. When the user saves the request, the server saves the information in a database and sends notifications to the necessary approvers based on the approval route.

[0421] Contract Phase

[0422] Program processing

[0423] 1. The user navigates to the contract management screen.

[0424] 2. The user uploads the agreement file.

[0425] 3. The server receives the file, analyzes its contents, and extracts the necessary information.

[0426] 4. The emotion engine evaluates the user's emotional state and displays a relaxation guide if it detects stress.

[0427] 5. The server stores the extracted information in a database and sends a request for contract confirmation to the person in charge.

[0428] Specific examples

[0429] For example, when a user uploads a contract file to the system when signing a new contract, the server automatically analyzes the contents and extracts important contract information such as the contract amount, contract period, and counterparty information. At that time, the emotion engine monitors the user's facial expressions and operation history, and if it determines that the user is anxious, it displays a psychological support message within the system. This makes it easier for the person in charge to quickly check the contract contents.

[0430] Ordering Phase

[0431] Program processing

[0432] 1. The user navigates to the purchase order creation screen.

[0433] 2. The user enters the order information.

[0434] 3. The server checks the entered information to see if there are any errors.

[0435] 4. The emotion engine assesses the user's emotional state and provides additional information if there is uncertainty.

[0436] 5. The server generates a purchase order based on the order information and sends it to the specified vendor.

[0437] Specific examples

[0438] For example, when a user enters the necessary information to order consumables, the server verifies the information, automatically generates a purchase order, and sends it to the supplier. If the emotion engine detects that the user is confused while entering information, the system will display appropriate input guidance to support the user.

[0439] Inspection phase

[0440] Program processing

[0441] 1. The user receives the delivery and inspects the quality and quantity.

[0442] 2. The user enters the inspection results into the system.

[0443] 3. The server saves the entered inspection results in the database.

[0444] 4. The emotion engine evaluates the user's emotional state and provides appropriate feedback.

[0445] 5. The server sends a notification of inspection completion to the relevant personnel and vendors.

[0446] Specific examples

[0447] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies relevant parties that the inspection has been completed. If the emotion engine detects that the user is feeling stressed during the inspection process, it displays a notification encouraging the user to relax, thereby reducing the user's psychological burden.

[0448] In this way, by incorporating an emotion engine that provides appropriate support based on the user's emotional state, the system of the present invention can consistently support each phase of accounting work, significantly improving work efficiency and user comfort.

[0449] The processing flow will be explained below.

[0450] I understand. Below, I will explain the process step by step.

[0451] Approval phase

[0452] Program processing

[0453] Step 1:

[0454] The user logs in to the system and opens the approval request creation screen.

[0455] Step 2:

[0456] The user selects a template for the approval document from the templates provided.

[0457] Step 3:

[0458] The user enters the required information (purpose, content, amount, attachments, etc.).

[0459] Step 4:

[0460] The emotion engine detects the user's facial expression and operation speed when inputting and evaluates their emotional state.

[0461] Step 5:

[0462] The user clicks the Save button.

[0463] Step 6:

[0464] The server stores the entered information in a database.

[0465] Step 7:

[0466] The server automatically generates an approval route based on the user's position and department.

[0467] Step 8:

[0468] The server sends emails and in-system notifications to the configured approvers, requesting their approval.

[0469] Step 9:

[0470] The emotion engine displays notifications encouraging stress reduction and breaks based on the user's emotional state.

[0471] Contract Phase

[0472] Program processing

[0473] Step 1:

[0474] The user moves to the contract management screen.

[0475] Step 2:

[0476] The user uploads an agreement file.

[0477] Step 3:

[0478] The server receives the file and parses its contents.

[0479] Step 4:

[0480] The server extracts the necessary information (contract amount, contract period, counterparty information, etc.) from the analysis results.

[0481] Step 5:

[0482] The emotion engine monitors the user's facial expressions and operating status to evaluate their emotional state.

[0483] Step 6:

[0484] If the emotion engine detects that the user is feeling stressed, it will display relaxation guidance and psychological support messages.

[0485] Step 7:

[0486] The server stores the extracted information in a database.

[0487] Step 8:

[0488] The server sends a request for contract confirmation to the person in charge.

[0489] Ordering Phase

[0490] Program processing

[0491] Step 1:

[0492] The user moves to the purchase order creation screen.

[0493] Step 2:

[0494] The user enters order information (order details, quantity, unit price, etc.).

[0495] Step 3:

[0496] The emotion engine monitors the user's facial expressions and operation speed while they are typing to evaluate their emotional state.

[0497] Step 4:

[0498] The server checks the entered information to see if there are any errors.

[0499] Step 5:

[0500] The server generates a purchase order based on the order information.

[0501] Step 6:

[0502] The server generates a purchase order and sends it to the designated vendor via email.

[0503] Step 7:

[0504] If the emotion engine detects a user's uncertainty or anxiety, it will display additional input guidance and support messages.

[0505] Inspection phase

[0506] Program processing

[0507] Step 1:

[0508] The user receives the delivered goods and inspects the quality and quantity.

[0509] Step 2:

[0510] The user enters the inspection results into the system.

[0511] Step 3:

[0512] The emotion engine monitors the user's facial expressions and operating status to evaluate their emotional state.

[0513] Step 4:

[0514] The server stores the input inspection results in a database.

[0515] Step 5:

[0516] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[0517] Step 6:

[0518] If the emotion engine detects that the user is feeling stressed, it will display a notification encouraging them to relax.

[0519] In this way, by evaluating the user's emotional state in real time at each phase and providing appropriate support, a system can be realized that improves the efficiency of accounting work and user comfort.

[0520] Example 2

[0521] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0522] Conventional accounting support systems have been required to automate and streamline each phase of the process, from creating approval documents to signing contracts, placing orders, and inspecting acceptance. However, they lacked adequate support that took into account the user's emotional state. This often led to users feeling stressed and fatigued, which could lead to reduced work efficiency. Therefore, a system that can evaluate the user's emotional state in real time and provide appropriate support is needed.

[0523] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to select a template for a request for approval and input necessary information, a means for saving the input information in a database and setting an approval route, a means for sending an approval request to an approver, a means for providing an emotion engine that evaluates the user's emotional state from the user's input operations and facial expression data and provides appropriate guidance and support based on the user's emotional state, a means for inputting the inspection results to the server and saving them in a database, and a means for sending an inspection completion notification to the relevant person in charge and the contractor. This not only automates and streamlines the process in each phase, but also makes it possible to evaluate the user's emotional state and provide appropriate support.

[0524] A "user" is a person or entity who operates the system and inputs information such as approval documents, contracts, purchase orders, and inspection results.

[0525] A "requisition document" is a document used to obtain prior approval within an organization, and includes details such as the name of the equipment to be purchased, the quantity, the budget amount, and the reason for the purchase.

[0526] A "template" is a predefined format that users use when creating documents such as approval documents and contracts.

[0527] A "database" is an information storage system that systematically manages the information stored in the system and facilitates its search and use.

[0528] An "approval route" refers to the path and order that a request for approval, contract, etc. must follow to gain approval.

[0529] An "emotion engine" is software or a system that analyzes a user's input operations and facial expression data and evaluates their emotional state in real time.

[0530] A "guide" is an instruction or advice provided to a user when operating a system, and is intended to assist the user in performing their work efficiently.

[0531] "Support" refers to psychological and operational assistance provided by the emotion engine according to the user's emotional state.

[0532] A "contract" is a document that formally documents an agreement between the parties and includes details such as the contract amount, contract period, and information about the other party.

[0533] A "purchase order" is a document that formally requests the purchase of a specific product or service, and includes details such as the name of the product, quantity, and price.

[0534] "Inspection results" are documents or data that confirm the quality and quantity of delivered items and record the results.

[0535] A "vendor" is a commercial entity with which a user or organization does business, supplying goods or providing services.

[0536] This invention is a system for improving the efficiency of accounting work and providing support based on the user's emotional state. This system automates the process from creating approval documents to contracts, ordering, and acceptance inspection, and evaluates the user's emotional state at each phase to provide appropriate support.

[0537] Approval phase

[0538] The process begins when a user logs into the system using a terminal and opens the approval document creation screen. The user selects a approval document template from the provided templates and enters the necessary information. During the input operation, the emotion engine analyzes the user's input speed and facial expression data, and evaluates the user's emotional state in real time.

[0539] For example, when a user creates a request for approval to purchase new equipment, they input the name of the equipment to be purchased, the quantity, the budget amount, and the reason for the purchase. If an emotion engine (e.g., Azure (registered trademark) Cognitive Services) detects fatigue from the user's input operations and facial expressions, the system displays a notification encouraging the user to take a break. When the user saves the request, the server saves the information in a database, automatically sets up an approval route according to the user's position and department, and sends an approval request to the relevant approver.

[0540] Contract Phase

[0541] The user navigates to the contract management screen and uploads the contract file. The server receives the file, analyzes its contents using OCR technology, and extracts the necessary information. For example, when a contract file is uploaded when creating a new contract, the server extracts important information such as the contract amount, contract period, and counterparty information.

[0542] The emotion engine monitors the user's operation log and facial expressions, and if the user feels anxious, it displays a support message encouraging them to relax. The extracted information is stored in a database, and a request for contract confirmation is sent to the person in charge.

[0543] Ordering Phase

[0544] The user moves to the purchase order creation screen and enters the order information. The server checks the entered information and checks for any errors. For example, when a user orders consumables, the user enters the necessary information and the server validates and confirms the data.

[0545] The emotion engine evaluates the user's emotional state and provides appropriate input guidance if it detects hesitation or confusion. The server automatically generates a purchase order based on the confirmed information and sends it to the specified vendor.

[0546] Inspection phase

[0547] The user receives the delivered goods, inspects the quality and quantity, and enters the results into the system. The server saves the entered inspection results in the database and sends a notification of inspection completion to the relevant person in charge and the vendor.

[0548] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The emotion engine detects that the user is feeling stressed during the inspection and displays a notification encouraging the user to relax.

[0549] Hardware and software used

[0550] Server: Server equipment for high-performance data processing and storage.

[0551] Terminal: A device that a user uses to access the system, such as a computer, tablet, or smartphone.

[0552] Sentiment Engine: Microsoft® Azure Cognitive Services or other sentiment analysis software.

[0553] Database: A relational database management system such as MySQL (registered trademark) or PostgreSQL.

[0554] OCR technology: Optical character recognition technology for converting contracts and other documents into text data.

[0555] Prompt Sentence Examples

[0556] For example, here's a prompt that the emotion engine might display when it detects that the user is tired:

[0557] "Thank you for your long hours of work. Please take a break and refresh yourself."

[0558] As a result, the system of the present invention provides appropriate support based on the user's emotional state, and can consistently streamline and automate each phase of accounting work.

[0559] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0560] Approval phase

[0561] Step 1:

[0562] A user logs in to the system using a terminal.

[0563] Input: User ID and password.

[0564] Data processing: The server checks the authentication information against a database.

[0565] Output: After successful authentication, display the approval request creation screen.

[0566] Specific operation: The user accesses the system and enters their authentication information. The server checks the database, and if authentication is successful, the approval document creation screen is displayed on the terminal.

[0567] Step 2:

[0568] The user selects a request form template and enters the required information.

[0569] Input: Template selection, equipment name, quantity, budget amount, reason for purchase, etc.

[0570] Data processing: The content entered by the user is reflected in the template.

[0571] Output: The completed decision form.

[0572] Specific behavior: The user selects an appropriate template from a list of templates and enters the required information.

[0573] Step 3:

[0574] When the user clicks the "Save" button, the server saves the entered information to a database.

[0575] Input: The completed request form.

[0576] Data processing: The entered data from the request form is saved in the database.

[0577] Output: A confirmation message for the saved decision.

[0578] Specific behavior: The user clicks the "Save" button, and the server saves the received data to the database.

[0579] Step 4:

[0580] The emotion engine evaluates the user's emotional state based on input operations and facial expression data.

[0581] Input: User input speed, facial expression data.

[0582] Data processing: The emotion engine analyzes the emotional state.

[0583] Output: Emotion evaluation result data.

[0584] Specific operation: User input operations and facial expression data from the webcam are collected in real time and analyzed by the emotion engine.

[0585] Step 5:

[0586] The server automatically generates an approval route based on the user's position and department, and sends an approval request.

[0587] Input: User's job title, department information, and approval request data.

[0588] Data processing: Automatically generate approval routes and identify approvers.

[0589] Output: Approval request notification.

[0590] Specific operation: The server retrieves job title and department information from the database, automatically generates an approval route, and sends a notification to the approver based on the generated route.

[0591] Step 6:

[0592] The emotional engine provides appropriate guidance and support based on the user's emotional state.

[0593] Input: Emotion evaluation result data.

[0594] Data processing: Generate guidance and support messages based on emotional state.

[0595] Output: Guides and support notifications.

[0596] Specific operation: If the emotion engine determines that the user's emotional state is fatigue or lethargy, the server displays a message on the user's device encouraging them to relax.

[0597] Contract Phase

[0598] Step 1:

[0599] The user moves to the contract management screen.

[0600] Input: None (screen transition operation).

[0601] Data processing: None (displayed on screen).

[0602] Output: Contract management screen.

[0603] Specific operation: The user clicks the contract management link from the menu and is taken to the contract management screen.

[0604] Step 2:

[0605] The user uploads an agreement file.

[0606] Input: Agreement file.

[0607] Data processing: Send the uploaded file to the server.

[0608] Output: File receipt confirmation message.

[0609] What happens: The user clicks the "Choose File" button, selects the contract file from their device, and uploads it.

[0610] Step 3:

[0611] The server receives the file and parses its contents to extract the required information.

[0612] Input: Agreement file.

[0613] Data processing: Using OCR technology, the content is converted into text data and the necessary information is extracted.

[0614] Output: Extracted contract data.

[0615] How it works: When the uploaded contract arrives at the server, OCR technology is used to automatically analyze the contents of the contract and extract important information.

[0616] Step 4:

[0617] The emotion engine evaluates the user's emotional state and displays relaxation guidance if it detects stress.

[0618] Input: User's facial expression data, operation log.

[0619] Data processing: The emotion engine analyzes stress levels.

[0620] Output: Relaxation guide and support messages.

[0621] Specific operation: The emotion engine evaluates the user's emotional state, and if the user is feeling stressed, a message encouraging relaxation is displayed on the device.

[0622] Step 5:

[0623] The server stores the extracted information in a database and sends a request for contract confirmation to the person in charge.

[0624] Input: Extracted contract data.

[0625] Data processing: The extracted information is stored in a database and a confirmation request is sent to the person in charge.

[0626] Output: Database save confirmation, confirmation request notification.

[0627] Specific operation: The server saves the extracted contract data in a database and sends a confirmation request notification to the relevant parties.

[0628] Ordering Phase

[0629] Step 1:

[0630] The user moves to the purchase order creation screen.

[0631] Input: None (screen transition behavior).

[0632] Data processing: None (displayed on screen).

[0633] Output: Purchase order creation screen.

[0634] Specific behavior: The user clicks the Create Purchase Order link from the menu to open the Create Purchase Order screen.

[0635] Step 2:

[0636] The user enters the order information.

[0637] Input: Order information such as product name, quantity, and amount.

[0638] Data processing: Reflect the entered data in the form.

[0639] Output: Input completion message.

[0640] Specific operation: The user enters the necessary information such as the product name, quantity, and price into the purchase order creation form.

[0641] Step 3:

[0642] The server checks the entered information to see if there are any errors.

[0643] Entered: The order information entered.

[0644] Data processing: Validate the data and check for any errors.

[0645] Output: Validation result message.

[0646] What happens: The server receives the order information, validates it, and checks for any errors.

[0647] Step 4:

[0648] An emotion engine assesses the user's emotional state and provides additional information if there is uncertainty.

[0649] Input: User input operations, facial expression data.

[0650] Data processing: The emotion engine analyzes the emotional state and detects hesitation.

[0651] Output: Additional information and guide messages.

[0652] Specific operation: The emotion engine detects the user's state of hesitation or confusion, and the server displays additional information or guidance messages.

[0653] Step 5:

[0654] The server generates a purchase order based on the order information and sends it to the specified vendor.

[0655] Enter: Your confirmed order information.

[0656] Data processing: Automatically generate purchase orders and send them to vendors via email or other appropriate means.

[0657] Output: Purchase order submission confirmation message.

[0658] Specific operation: The server generates a purchase order based on the confirmed order information and sends it to the specified vendor.

[0659] Inspection phase

[0660] Step 1:

[0661] The user receives the delivered goods and inspects the quality and quantity.

[0662] Input: Deliverables, Inspection Items.

[0663] Data processing: Record the test results.

[0664] Output: Test result data.

[0665] Specific actions: The user receives the delivered goods, inspects the quality and quantity, and records the results.

[0666] Step 2:

[0667] The user enters the inspection results into the system.

[0668] Input: Inspection result data.

[0669] Data processing: The inspection results are entered into the system and stored in the database.

[0670] Output: A message confirming that the inspection results have been saved.

[0671] Specific operation: The user enters the inspection results into the system, and the server receives them and stores them in the database.

[0672] Step 3:

[0673] The server stores the input inspection results in a database.

[0674] Input: Inspection result data.

[0675] Data processing: The inspection results are saved in the database.

[0676] Output: Save confirmation message.

[0677] Specific operation: The server saves the entered inspection results in the database.

[0678] Step 4:

[0679] The emotion engine assesses the user's emotional state and provides appropriate feedback.

[0680] Input: User emotion data.

[0681] Data processing: The emotion engine evaluates the user's emotional state.

[0682] Output: The feedback message.

[0683] Specific operation: The emotion engine analyzes the user's emotional state, and if it detects stress, it displays a notification encouraging relaxation.

[0684] Step 5:

[0685] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[0686] Input: Inspection result data.

[0687] Data processing: Generate and send notifications based on the inspection results.

[0688] Output: Inspection completion notification message.

[0689] Specific operation: Based on the inspection results stored in the database, the server sends a notification of inspection completion to the relevant personnel and vendors.

[0690] (Application example 2)

[0691] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0692] Conventional accounting support systems did not take into account the user's emotional state and did not provide sufficient support to improve work efficiency. In particular, if the user felt fatigued or stressed, appropriate measures could not be taken, which could result in a decrease in work efficiency. Furthermore, because the system did not provide guidance or support according to the user's emotional state, there was concern that the psychological burden on the user increased, which could lead to errors and delays in work.

[0693] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0694] In this invention, the server includes emotion analysis means for analyzing the user's emotional state from image data and operation history, means for providing appropriate support messages based on the emotion analysis results, and means for inputting the inspection results into the server and storing them in a database. This allows appropriate support to be provided according to the user's emotional state, significantly improving work efficiency and user comfort.

[0695] A "user" is a person who uses the system to create business documents such as approval documents, contracts, and purchase orders, and to approve and place orders.

[0696] The "emotion analysis means" is a function for analyzing the user's emotional state based on the user's image data and operation history.

[0697] The "means for providing a support message" is a function for displaying to the user an appropriate message or guide in accordance with the emotional state of the user detected by the emotion analysis means.

[0698] A "database" is an information management device for storing and managing input data to the system (request data, contract data, order information, inspection results, etc.).

[0699] An "approval route" is a setting of a route by which documents such as approval requests, contracts, and purchase orders are approved sequentially by approvers.

[0700] The "means for sending an approval request" is a function for the server to send a notification to the approver requesting approval of the document based on the set approval route.

[0701] "Means for inputting inspection results" is a function that allows the user to input the results of inspection of the quality and quantity of delivered items into the system.

[0702] The "means for sending a notification of completion of inspection" is a function for the server to notify the relevant person in charge or the contractor that the inspection has been completed based on the inspection results entered.

[0703] The "means for uploading and analyzing contracts" is a function that allows a user to upload a contract file to the system and automatically analyze its contents.

[0704] "Means for saving contract data" is a function for saving important information of the analyzed contract (contract amount, period, counterparty information, etc.) in a database.

[0705] "Means for sending a request to confirm the contract" is a function that allows the server to send a request to confirm the uploaded and analyzed contract to the relevant person in charge.

[0706] The "means for inputting order information" is a function that allows a user to input order information for required goods or services into the system.

[0707] The "means for generating a purchase order" is a function that enables the server to automatically generate a purchase order based on the order information entered by the user.

[0708] The "means for sending purchase orders" is a function for sending purchase orders generated by the server to the relevant vendors.

[0709] The "means for providing additional information" is a function that allows the system to display appropriate additional information or guidance when the user is unsure or has questions while entering order information.

[0710] The "means for displaying a relaxation guide" is a function that analyzes the user's emotional state and, if stress is detected, provides guidance and advice for relaxation.

[0711] This invention relates to a system that analyzes the emotions of users in factory production work in real time and provides appropriate support messages. How this system is implemented will be described below in detail.

[0712] System configuration and operation

[0713] The system includes the following main components:

[0714] 1. User terminal: A device used by users to create and manipulate business documents such as approval documents, contracts, and purchase orders. It includes a camera and a screen display device.

[0715] 2. Server: A central device that manages the database and performs various analyses and notifications.

[0716] 3. Emotion analysis device: A device that analyzes the user's facial expressions and operation history to identify their emotional state.

[0717] Hardware and Software Use

[0718] Camera: Used to capture the user's face and obtain video data in real time.

[0719] Display device (monitor): Used to visually provide support messages and relaxation guides to the user.

[0720] OpenCV: An image processing library used as a preprocessing for face detection and emotion analysis.

[0721] TENSORFLOW® / Keras: A machine learning framework for implementing emotion recognition models.

[0722] Data processing and calculation flow

[0723] 1. User emotion analysis: While a user is writing a business document, a camera captures facial images in real time and detects the face using OpenCV. The detected facial images are preprocessed and input to an emotion recognition model trained with TensorFlow / Keras. The emotion analyzer identifies the user's emotional state (e.g., fatigue or stress) based on the model output.

[0724] 2. Providing support messages: Based on the results of emotion analysis, appropriate support messages or relaxation guidance are displayed on the user's device. For example, if the system determines that the user is tired, it will display a message saying, "Please take a short break." This message is selected from a pre-defined template message.

[0725] 3. Data storage and notification: The information entered by the user and the results of sentiment analysis are sent to the server and stored in a database. At the same time, notifications are sent to the necessary parties. This allows the status of business processes to be shared in real time.

[0726] Specific examples

[0727] For example, when a user is operating a machine during a night shift in a factory, the system analyzes the user's facial image to detect signs of fatigue. If fatigue is detected, a message will appear saying, "Please take a short break." When the user takes a break, the information is sent to the server and recorded in the database. At the same time, the system notifies the user's superiors that the break has been taken. This improves work efficiency and safety.

[0728] Example prompt sentence:

[0729] "Generate a Python program to implement a system that recognizes emotions and provides support messages in real time to fatigued factory workers. The system will estimate the worker's emotional state from their facial expressions, display a message encouraging them to take a break as needed, and save the emotional state and a timestamp to a log file. Specifically, we will use OpenCV for facial recognition and TensorFlow / Keras for the emotion recognition model."

[0730] The above is the "Mode for Carrying Out the Invention" of the present invention. This provides appropriate support according to the user's emotional state, and is expected to significantly improve work efficiency and user comfort.

[0731] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0732] Step 1:

[0733] The user terminal captures the user's face image in real time using a camera.

[0734] Input: Real-time facial video data

[0735] Processing: Capture and pre-processing of video data (e.g., image resizing, grayscale conversion)

[0736] Output: Preprocessed face image data

[0737] Step 2:

[0738] The device detects faces from preprocessed facial images using OpenCV.

[0739] Input: Preprocessed face image data

[0740] Processing: Detect face areas from the image and obtain face position information

[0741] Output: Face position information (coordinate data)

[0742] Step 3:

[0743] The device inputs the detected facial image into an emotion recognition model using TensorFlow / Keras to estimate the emotional state.

[0744] Input: A face image cropped based on face position information

[0745] Processing: Emotion recognition model to estimate emotional state (e.g., relaxed, tired, stressed)

[0746] Output: Emotional state estimation result

[0747] Step 4:

[0748] The device displays a support message based on the emotion analysis results.

[0749] Input: Emotional state estimation result

[0750] Processing: Select and display appropriate support messages based on the estimation results

[0751] Output: Display a support message to the user

[0752] Step 5:

[0753] The device sends the emotion analysis results and operation data to the server.

[0754] Input: Emotion analysis results, user operation data

[0755] Processing: Formatting and sending the data (sending the data over the network to the server)

[0756] Output: Sentiment analysis results and operation data stored on the server

[0757] Step 6:

[0758] The server stores the emotion analysis results and operation data in a database.

[0759] Input: Received sentiment analysis results and operational data

[0760] Process: Saving data to the database

[0761] Output: Records stored in the database

[0762] Step 7:

[0763] The server sends the necessary notifications to the relevant parties.

[0764] Input: Sentiment analysis results and operation data stored in the database

[0765] Action: Generate and send notifications to interested parties

[0766] Output: Notifications sent to interested parties

[0767] The above is the specific processing flow of the system. This series of processes provides appropriate support according to the user's emotional state. In addition, the server stores and notifies this data, which improves work efficiency.

[0768] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0769] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0770] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0771] [Second embodiment]

[0772] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0773] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0774] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0775] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0776] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0777] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0778] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0779] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0780] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0781] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0782] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0783] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0784] This invention relates to a system that consistently supports accounting operations, from approval to contracts, orders, and acceptance inspection. This system automates and streamlines the processes in each phase of accounting operations.

[0785] Approval phase

[0786] Program processing:

[0787] 1. The user logs in to the system and opens the approval request creation screen.

[0788] 2. The user selects one of the provided templates and enters the required information.

[0789] 3. When the user clicks the "Save" button, the server saves the entered information to the database.

[0790] 4. The server automatically generates an approval route based on the user's position and department.

[0791] 5. The server sends an email or an in-system notification to the approver requesting approval.

[0792] Examples:

[0793] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name of the equipment to be purchased, the quantity, the budget amount, and the reason for the purchase. After that, when they press the save button, the server saves the information in the database and sends notifications to the necessary approvers based on the pre-set approval route.

[0794] Contract Phase

[0795] Program processing:

[0796] 1. The user goes to the contract management screen and uploads the contract file.

[0797] 2. The server receives the file, analyzes the contents, and extracts the necessary information (contract amount, contract period, counterparty information, etc.).

[0798] 3. The server stores the extracted information in a database.

[0799] 4. The server sends a request to the agent to review the contract.

[0800] Examples:

[0801] For example, when a user signs a new contract, they upload the contract file to the system, and the server automatically analyzes the contents and extracts important contract information, making it easier for the person in charge to check the extracted information and enabling a quick response.

[0802] Ordering Phase

[0803] Program processing:

[0804] 1. The user moves to the purchase order creation screen and enters the order information (order details, quantity, unit price, etc.).

[0805] 2. The server checks the entered information to see if there are any errors.

[0806] 3. The server generates a purchase order based on the order information.

[0807] 4. The server generates a purchase order and sends it to the specified vendor via email.

[0808] Examples:

[0809] For example, when a user orders consumables, they log in to the system and enter the necessary information. The server then verifies the information, automatically generates a purchase order, and sends it to the supplier, automating the ordering process.

[0810] Inspection phase

[0811] Program processing:

[0812] 1. The user receives the delivery and inspects the quality and quantity.

[0813] 2. The user enters the inspection results into the system.

[0814] 3. The server saves the entered inspection results in the database.

[0815] 4. The server sends a notification of inspection completion to the relevant personnel and vendors.

[0816] Examples:

[0817] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies the relevant parties that the inspection has been completed, improving the transparency and efficiency of the business. In this way, the system of the present invention consistently supports accounting operations from approval to contract, ordering, and inspection, significantly improving business efficiency.

[0818] The processing flow will be explained below.

[0819] Approval phase

[0820] Program processing

[0821] Step 1:

[0822] The user logs in to the system and opens the approval request creation screen.

[0823] Step 2:

[0824] The user selects a template for the approval document from the templates provided.

[0825] Step 3:

[0826] The user enters the required information (purpose, content, amount, attachments, etc.).

[0827] Step 4:

[0828] The user clicks the Save button.

[0829] Step 5:

[0830] The server stores the entered information in a database.

[0831] Step 6:

[0832] The server automatically generates an approval route based on the user's position and department.

[0833] Step 7:

[0834] The server sends emails and in-system notifications to the configured approvers, requesting their approval.

[0835] Contract Phase

[0836] Program processing

[0837] Step 1:

[0838] The user moves to the contract management screen.

[0839] Step 2:

[0840] The user uploads an agreement file.

[0841] Step 3:

[0842] The server receives the file and parses its contents.

[0843] Step 4:

[0844] The server extracts the necessary information (contract amount, contract period, counterparty information, etc.) from the analysis results.

[0845] Step 5:

[0846] The server stores the extracted information in a database.

[0847] Step 6:

[0848] The server sends a request to the agent to review the contract.

[0849] Ordering Phase

[0850] Program processing

[0851] Step 1:

[0852] The user moves to the purchase order creation screen.

[0853] Step 2:

[0854] The user enters order information (order details, quantity, unit price, etc.).

[0855] Step 3:

[0856] The server checks the entered information to see if there are any errors.

[0857] Step 4:

[0858] The server generates a purchase order based on the order information.

[0859] Step 5:

[0860] The server generates a purchase order and sends it to the designated vendor via email.

[0861] Inspection phase

[0862] Program processing

[0863] Step 1:

[0864] The user receives the delivered goods and inspects the quality and quantity.

[0865] Step 2:

[0866] The user enters the inspection results into the system.

[0867] Step 3:

[0868] The server stores the input inspection results in a database.

[0869] Step 4:

[0870] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[0871] These specific processing steps allow a clear understanding of the mode for carrying out the invention. The detailed description of the specific operations performed at each step also makes it easier to grasp the overall picture of the system.

[0872] Example 1

[0873] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0874] In current accounting work, each phase, from creating approval documents to signing contracts, placing orders, and receiving inspections, is done manually, which takes a lot of time and effort. There is also a high possibility of miscommunication of information and delays in the approval process. This can lead to problems with the efficiency of the entire business and increased costs. The purpose of this invention is to solve these problems and provide a system that consistently automates and streamlines each phase of accounting work.

[0875] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0876] In this invention, the server includes: a means for a user to select a template for a request for approval and input the necessary information; a means for the server to save the input information in a database and perform an error check, and then automatically generate an approval route; a means for the server to send an email or an in-system notification to the approver requesting approval; a means for the user to receive the delivery and input the inspection results into the server, and the server to save the inspection results in a database; and a means for the server to send a notification of inspection completion to the relevant person in charge and the provider. This makes it possible to consistently automate the processes in each phase of accounting work, improving the efficiency and transparency of work.

[0877] "User" refers to a person who uses the system to perform various accounting tasks.

[0878] "Server" refers to a device or system that processes, stores, and notifies various data in response to instructions from a user.

[0879] A "template" refers to a predefined format that users use when creating documents such as approval forms and purchase orders.

[0880] "Database" refers to a system that allows a server to systematically store and manage information entered by users.

[0881] "Error checking" refers to the process by which the server checks the information entered by the user for errors.

[0882] An "approval route" refers to the path that determines who should approve a request form, purchase order, etc. created by a user.

[0883] "Email or internal system notification" refers to various means of communication that the server uses with users and approvers.

[0884] "Delivery Items" refers to goods and services ordered by a User.

[0885] "Inspection results" refers to the results of the user receiving the delivered goods and checking the quality, quantity, etc.

[0886] "Provider" refers to a trader or company that provides the goods or services ordered by the user.

[0887] "Contract file" refers to document data uploaded by a user for a contract.

[0888] "Parsing" refers to the process by which the server extracts the necessary information from the uploaded contract file.

[0889] "Order information" refers to detailed information such as the content, quantity, and unit price of a product or service that a user enters into a purchase order.

[0890] "Purchase Order" means a purchase order created by a User using the System.

[0891] MODE FOR CARRYING OUT THE INVENTION

[0892] The present invention relates to a system that consistently supports accounting operations, from approval to contracts, orders, and acceptance inspections. This system automates and streamlines the processes in each phase of accounting operations. Specific embodiments for each phase are described below.

[0893] Approval phase

[0894] In the approval phase, the user logs into the system and opens the approval document creation screen. The user selects one of the templates provided and enters the required information. Next, when the user clicks the "Save" button, the server saves the entered information in the database. The server automatically generates an approval route according to the user's position and department, and sends an email or an in-system notification to the approver requesting their approval.

[0895] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name, quantity, budget, and reason for the equipment they plan to purchase. After that, when they press the "Save" button, the server saves the information in the database and sends a notification to the approver based on the approval route.

[0896] Contract Phase

[0897] In the contract phase, the user moves to the contract management screen and uploads the contract file. The server receives the file, analyzes the contents using an analysis engine, and extracts the necessary information (contract amount, contract period, counterparty information, etc.). The server saves the extracted information in a database and sends an email or an in-system notification to the person in charge requesting that they review the contract.

[0898] For example, when a user signs a new contract, they upload the contract file to the system, and the server automatically analyzes the contents and extracts important contract information. The extracted information can be easily checked by the person in charge, enabling a quick response.

[0899] Ordering Phase

[0900] In the ordering phase, the user moves to the purchase order creation screen and enters the order information (order details, quantity, unit price, etc.). The server checks the entered information for any errors. The server generates a purchase order based on the order information and sends it to the specified vendor by email.

[0901] For example, when a user orders consumables, they log in to the system and enter the necessary information. The server then verifies the information, automatically generates a purchase order, and sends it to the supplier, automating the ordering process.

[0902] Inspection phase

[0903] In the inspection phase, the user receives the delivered goods and inspects the quality and quantity. When the user enters the inspection results into the system, the server saves the entered inspection results in the database. The server then sends a notification of inspection completion to the relevant person in charge and the vendor.

[0904] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies the relevant parties that the inspection has been completed, improving the transparency and efficiency of operations.

[0905] Use cases and prompts for generative AI models

[0906] Usage example

[0907] 1. When a user wants to order materials for a new project, they log into the system, enter the necessary information, and the server automatically generates a purchase order and sends it to the relevant vendor.

[0908] 2. Remote workers can use the system to upload contracts and smoothly obtain approval from their superiors.

[0909] Example prompts for generative AI models

[0910] "Use this prompt to explain the process for creating a request for approval in your accounting system. For example, explain the detailed steps a user would take to create a request for approval to purchase new equipment."

[0911] This system aims to reduce the workload of users by automating all accounting tasks, from approvals to contracts, orders, and inspections. In particular, it uses a high-performance server and the latest analysis engine for various data processing, improving accuracy and efficiency.

[0912] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0913] Approval phase

[0914] Step 1:

[0915] A user logs in to the system.

[0916] Input: User ID, Password

[0917] Operation: The device sends the entered authentication information to the server.

[0918] Output: The server returns the user authentication result.

[0919] Step 2:

[0920] The user moves to the approval request creation screen.

[0921] Input: User clicks

[0922] Operation: The server sends HTML data to the terminal to display the approval document creation screen.

[0923] Output: The terminal displays the approval request creation screen.

[0924] Step 3:

[0925] The user selects a template.

[0926] Input: Template selection operation

[0927] Operation: The terminal sends the selected template information to the server.

[0928] Output: The server returns the selected template content.

[0929] Step 4:

[0930] The user enters the required information.

[0931] Input: Equipment name, quantity, budget amount, reason for purchase, etc.

[0932] How it works: The device stores the information entered and sends it to the server when the user clicks the "Save" button.

[0933] Output: The server receives the information.

[0934] Step 5:

[0935] The user clicks the Save button.

[0936] Input: Click

[0937] Operation: The terminal sends the entered information to the server.

[0938] Output: The server stores the information in a database.

[0939] Step 6:

[0940] The server checks the entered information for errors.

[0941] Input: Information entered by the user

[0942] Behavior: The server validates the information and performs error checking.

[0943] Output: Error response or normal response

[0944] Step 7:

[0945] The server automatically generates an approval route.

[0946] Input: User's job title, department information, and input approval information

[0947] Action: The server runs the approval route algorithm to determine the appropriate approver.

[0948] Output: Generated approval route

[0949] Step 8:

[0950] The server sends a notification to the approver.

[0951] Input: Approval Route

[0952] Operation: The server processes the sending of email or internal notifications.

[0953] Output: A notification is sent.

[0954] Contract Phase

[0955] Step 1:

[0956] The user moves to the contract management screen.

[0957] Input: User clicks

[0958] Operation: The server sends HTML data to the terminal to display the contract management screen.

[0959] Output: The terminal displays the contract management screen.

[0960] Step 2:

[0961] The user uploads an agreement file.

[0962] Input: Contract file

[0963] Action: The device sends a file to the server.

[0964] Output: The server receives the file.

[0965] Step 3:

[0966] The server parses the file contents.

[0967] Input: Contract file

[0968] What it does: The server runs an OCR engine and extracts the file contents as text data.

[0969] Output: Extracted text data

[0970] Step 4:

[0971] The server extracts the necessary information.

[0972] Input: Text data

[0973] Operation: The server executes an algorithm to analyze and extract information such as the contract amount, contract period, and counterparty information.

[0974] Output: Extracted contract information

[0975] Step 5:

[0976] The server stores the extracted information in a database.

[0977] Input: Extracted contract information

[0978] Operation: The server processes the information and stores it in a database.

[0979] Output: Contract information stored in the database

[0980] Step 6:

[0981] The server sends a request to confirm the contract to the person in charge.

[0982] Input: Contact information, contract information

[0983] Action: The server runs a process that sends email or internal notifications.

[0984] Output: A notification is sent.

[0985] Ordering Phase

[0986] Step 1:

[0987] The user moves to the purchase order creation screen.

[0988] Input: User clicks

[0989] Operation: The server sends HTML data to the terminal to display the purchase order creation screen.

[0990] Output: The terminal displays the purchase order creation screen.

[0991] Step 2:

[0992] The user enters the order information.

[0993] Input: Product details, quantity, unit price, etc.

[0994] How it works: The device stores the information entered and sends it to the server when the user clicks the "Submit" button.

[0995] Output: The server receives the information.

[0996] Step 3:

[0997] The server verifies the information entered.

[0998] Input: Order information entered by the user

[0999] Action: The server validates the information and checks for any errors.

[1000] Output: Verification result (error response or normal response)

[1001] Step 4:

[1002] The server automatically generates a purchase order.

[1003] Input: Confirmed order information

[1004] Operation: The server runs an algorithm that generates a purchase order.

[1005] Output: Generated purchase order

[1006] Step 5:

[1007] The server sends the generated purchase order to the vendor.

[1008] Input: Generated purchase order, vendor information

[1009] Operation: The server processes the purchase order and sends it to the vendor via email.

[1010] Output: Purchase order submitted

[1011] Inspection phase

[1012] Step 1:

[1013] The user receives the delivery.

[1014] Input: Receipt of delivery

[1015] Action: The user inspects the delivery.

[1016] Output: Check the quality and quantity of the delivered items

[1017] Step 2:

[1018] The user enters the inspection results into the system.

[1019] Input: Inspection result (pass, fail, etc.)

[1020] Operation: The terminal sends the entered inspection results to the server.

[1021] Output: The server receives the acceptance result.

[1022] Step 3:

[1023] The server stores the input inspection results in a database.

[1024] Input: Inspection results

[1025] Operation: The server processes the inspection results and stores them in a database.

[1026] Output: Inspection results stored in the database

[1027] Step 4:

[1028] The server sends a notification that the inspection is complete.

[1029] Input: Inspection results, related person and vendor information

[1030] Action: The server runs a process that sends email or internal notifications.

[1031] Output: Completion notification sent

[1032] (Application example 1)

[1033] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1034] The approval, contract, ordering, and inspection processes at logistics centers often involve a lot of manual work and lack efficiency. In addition, inconsistencies and delays can occur at each stage, hindering the smooth progress of the entire business. Therefore, automating and integrating these processes is desirable, and there is a demand for improving the transparency and efficiency of operations.

[1035] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1036] In this invention, the server includes: a means for a user to select a request form template and input the necessary information; a means for the server to save the input information in a database and set an approval route; a means for the server to send an approval request to an approver; a means for a user to upload a contract to a management screen and for the server to analyze the content, extract the necessary information, and save it in a database; a means for the server to send a request to confirm the contract to a person in charge based on the extracted information; a means for a user to input order information into the system, for the server to check the information for any errors, generate a purchase order, and send it to a vendor; a means for a user to input inspection results into the server and save them in a database; and a means for the server to send an inspection completion notification to the relevant person in charge and a vendor. This automates the entire process of approval, contract, ordering, and inspection within a logistics center, making it possible to significantly improve the efficiency and transparency of operations.

[1037] A "requisition document" is a document prepared by a company or other organization to obtain approval for certain economic or business matters.

[1038] A "template" refers to a pre-prepared format that makes it easy to create a specific document or format.

[1039] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[1040] An "approval route" refers to the step-by-step process or path that a document such as a request form or contract takes to be approved.

[1041] "Approval Request" means a request sent to a specific person or department for approval.

[1042] "Inspection results" refers to the results reported after checking the quality and quantity of delivered goods or services.

[1043] "Notification" means a message or communication sent to inform interested parties of specific information.

[1044] A "contract" is a document that documents the formation and content of a contract and serves as legal evidence of the agreement between the parties to the contract.

[1045] "Analysis" is the process of examining the contents of data or documents in detail to clarify their structure and meaning.

[1046] "Order Information" refers to data or documents that describe the contents and conditions of an order.

[1047] A "purchase order" is a document created to place an order, which contains the order details, quantity, unit price, etc.

[1048] "Vendor" refers to a business or organization that provides a particular service or product.

[1049] A "smartphone" is a multi-function mobile phone that has mobile communication capabilities and can install and use a variety of applications.

[1050] "Wireless communication" refers to the technology of transmitting data using radio signals such as radio waves.

[1051] "Real time" means that processing occurs the instant an event occurs.

[1052] "Application" means software designed to perform a specific purpose or function.

[1053] This invention relates to a system that consistently supports, automates, and streamlines processes at logistics centers, from approval to contracts, orders, and inspections. This system uses a server and user devices (e.g., smartphones) to process each phase of the process via real-time wireless communication.

[1054] Hardware and software used

[1055] Server: Centralizes data storage, analysis, notification sending, etc. The server is built using Flask (a lightweight Python web framework).

[1056] Database: Used to manage and store large amounts of data. Uses SQLite.

[1057] Smartphone: Used as a terminal for users to input information for each process.

[1058] Communication technology: Wireless communication (e.g., Wi-Fi, Bluetooth) is used to send and receive data in real time.

[1059] Email sending library: Uses mtplib to send approval requests and notifications in email format.

[1060] Program processing overview

[1061] 1. Approval phase

[1062] The user opens the smartphone app, selects a template on the approval document creation screen, and enters the required information. The entered information is sent to the server and saved.

[1063] The server automatically generates an approval route based on the entered information and sends an email notification of the approval request to the approver.

[1064] 2. Contract Phase

[1065] The user uploads the contract file to the management screen. The server analyzes the file contents and extracts the necessary contract information (e.g., contract amount, contract period).

[1066] The extracted information is stored in a database and a request for contract confirmation is sent to the person in charge via email.

[1067] 3. Ordering Phase

[1068] The user enters order information on their smartphone and sends it to the server, which checks the integrity of the information and automatically generates a purchase order.

[1069] The generated purchase order is sent to the specified vendor via email.

[1070] 4. Inspection Phase

[1071] When the user receives the delivered goods, they inspect the quality and quantity and enter the inspection results into the server using a smartphone app.

[1072] The server stores the inspection results in a database and notifies the relevant personnel and vendors that the inspection has been completed.

[1073] Specific examples

[1074] For example, consider a scenario in which a user is creating a request to purchase a forklift. In this case, the user enters the following information into a smartphone app:

[1075] Equipment Name: "Forklift"

[1076] Quantity: 2

[1077] Budget: 3 million yen

[1078] Reason: "To improve on-site work efficiency"

[1079] Approver Email: "approver@example.com"

[1080] Once these are entered and the user clicks "Save," the system automatically saves the information to the database and sends an email notification to the approver. This operation ensures the approval process is efficient and improves business transparency.

[1081] Prompt Sentence Examples

[1082] The template for creating a request for approval to purchase a new forklift for a distribution center includes the following information:

[1083] Equipment Name: "Forklift"

[1084] Quantity: 2

[1085] Budget: 3 million yen

[1086] Reason: "To improve on-site work efficiency"

[1087] Approver Email: "approver@example.com"

[1088] In this way, by integrating and automating the entire process of approval, contracts, orders, and inspections within the logistics center, it is possible to significantly improve the efficiency of the entire business.

[1089] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1090] Step 1:

[1091] The user opens the smartphone app, selects a template on the approval request creation screen, and enters the required information.

[1092] Input: Facility name, quantity, budget, reason, approver email

[1093] What happens: The user enters this information into a form within the app and presses the "Save" button.

[1094] Output: The entered information is sent to the server.

[1095] Step 2:

[1096] The server stores the entered information in a database.

[1097] Input: Request information sent in Step 1

[1098] How it works: The server parses the data it receives and stores it in an SQLite database.

[1099] Output: The approval request information is saved in the database.

[1100] Step 3:

[1101] The server automatically generates an approval route based on the input information and sends an approval request to the approver by email.

[1102] Input: Approval information stored in the database, approver email

[1103] Operation: The server generates an approval route and sends an approval request email using smtplib.

[1104] Output: An email requesting approval of the request form will be sent to the approver.

[1105] Step 4:

[1106] The user uploads the contract file to the admin panel.

[1107] Input: Contract file

[1108] How it works: The user uploads a contract file and presses the "Analyze" button. The contract file is sent to the server.

[1109] Output: The contract file is sent to the server.

[1110] Step 5:

[1111] The server analyzes the contents of the contract file, extracts the necessary information, and stores it in a database.

[1112] Input: Uploaded agreement file

[1113] How it works: The server parses the contract file, extracts information such as the contract amount and contract period, and stores it in a database.

[1114] Output: The extracted contract information is stored in a database.

[1115] Step 6:

[1116] The server sends an email to the person in charge requesting confirmation of the contract based on the contract information.

[1117] Input: Contract information stored in the database

[1118] Action: The server sends a confirmation email to the person in charge.

[1119] Output: An email requesting confirmation of the contract is sent to the person in charge.

[1120] Step 7:

[1121] The user enters order information into the smartphone app and sends it to the server.

[1122] Input: Product name, quantity, unit price, delivery deadline

[1123] How it works: The user enters this information into the form in the app and presses the "Place Order" button. The order information is sent to the server.

[1124] Output: The order information is sent to the server.

[1125] Step 8:

[1126] The server checks the consistency of the order information and automatically generates a purchase order.

[1127] Input: Submitted order information

[1128] How it works: The server verifies the integrity of all items and generates a purchase order based on the information.

[1129] Output: The automatically generated purchase order is saved as internal data.

[1130] Step 9:

[1131] The server sends the generated purchase order to the specified vendor by email.

[1132] Input: Auto-generated purchase order, vendor email address

[1133] What happens: The server sends a purchase order to the vendor's email address.

[1134] Output: A purchase order is sent to the vendor.

[1135] Step 10:

[1136] The user inspects the quality and quantity of the delivered items and enters the inspection results into a smartphone app.

[1137] Input: Inspection results (e.g. quality status, received quantity)

[1138] Operation: The user enters the inspection results into the form in the app and presses the "Save" button. The inspection results are sent to the server.

[1139] Output: The inspection result is sent to the server.

[1140] Step 11:

[1141] The server stores the inspection results in a database and sends an inspection completion notification by email to the relevant person in charge and the contractor.

[1142] Input: Submitted acceptance result

[1143] Operation: The server saves the inspection results in a database and sends an email to the relevant person in charge and the vendor notifying them of the completion of the inspection.

[1144] Output: Notification of completion of inspection is sent to the person in charge and the vendor.

[1145] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1146] This invention combines a system that consistently supports accounting work, from approval to contract, ordering, and acceptance inspection, with an emotion engine that recognizes the user's emotions. This system automates and streamlines the processes in each phase of accounting work, and can provide appropriate support based on the user's emotional state.

[1147] Approval phase

[1148] Program processing

[1149] 1. The user logs in to the system and opens the approval request creation screen.

[1150] 2. The user selects a request form template from the provided templates and enters the required information.

[1151] 3. When the user clicks the "Save" button, the server saves the entered information to the database.

[1152] 4. The emotion engine evaluates the user's emotional state based on their input and facial expression data.

[1153] 5. The server automatically generates an approval route based on the user's position and department and sends an approval request.

[1154] 6. The emotional engine provides appropriate guidance and support based on the user's emotional state.

[1155] Specific examples

[1156] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name, quantity, budget, and reason for the equipment to be purchased. If the emotion engine analyzes the user's input speed and facial expression and determines that the user is tired, a notification prompting them to take a break will be displayed within the system. When the user saves the request, the server saves the information in a database and sends notifications to the necessary approvers based on the approval route.

[1157] Contract Phase

[1158] Program processing

[1159] 1. The user navigates to the contract management screen.

[1160] 2. The user uploads the agreement file.

[1161] 3. The server receives the file, analyzes its contents, and extracts the necessary information.

[1162] 4. The emotion engine evaluates the user's emotional state and displays a relaxation guide if it detects stress.

[1163] 5. The server stores the extracted information in a database and sends a request for contract confirmation to the person in charge.

[1164] Specific examples

[1165] For example, when a user uploads a contract file to the system when signing a new contract, the server automatically analyzes the contents and extracts important contract information such as the contract amount, contract period, and counterparty information. At that time, the emotion engine monitors the user's facial expressions and operation history, and if it determines that the user is anxious, it displays a psychological support message within the system. This makes it easier for the person in charge to quickly check the contract contents.

[1166] Ordering Phase

[1167] Program processing

[1168] 1. The user navigates to the purchase order creation screen.

[1169] 2. The user enters the order information.

[1170] 3. The server checks the entered information to see if there are any errors.

[1171] 4. The emotion engine assesses the user's emotional state and provides additional information if there is uncertainty.

[1172] 5. The server generates a purchase order based on the order information and sends it to the specified vendor.

[1173] Specific examples

[1174] For example, when a user enters the necessary information to order consumables, the server verifies the information, automatically generates a purchase order, and sends it to the supplier. If the emotion engine detects that the user is confused while entering information, the system will display appropriate input guidance to support the user.

[1175] Inspection phase

[1176] Program processing

[1177] 1. The user receives the delivery and inspects the quality and quantity.

[1178] 2. The user enters the inspection results into the system.

[1179] 3. The server saves the entered inspection results in the database.

[1180] 4. The emotion engine evaluates the user's emotional state and provides appropriate feedback.

[1181] 5. The server sends a notification of inspection completion to the relevant personnel and vendors.

[1182] Specific examples

[1183] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies relevant parties that the inspection has been completed. If the emotion engine detects that the user is feeling stressed during the inspection process, it displays a notification encouraging the user to relax, thereby reducing the user's psychological burden.

[1184] In this way, by incorporating an emotion engine that provides appropriate support based on the user's emotional state, the system of the present invention can consistently support each phase of accounting work, significantly improving work efficiency and user comfort.

[1185] The processing flow will be explained below.

[1186] I understand. Below, I will explain the process step by step.

[1187] Approval phase

[1188] Program processing

[1189] Step 1:

[1190] The user logs in to the system and opens the approval request creation screen.

[1191] Step 2:

[1192] The user selects a template for the approval document from the templates provided.

[1193] Step 3:

[1194] The user enters the required information (purpose, content, amount, attachments, etc.).

[1195] Step 4:

[1196] The emotion engine detects the user's facial expression and operation speed when inputting and evaluates their emotional state.

[1197] Step 5:

[1198] The user clicks the Save button.

[1199] Step 6:

[1200] The server stores the entered information in a database.

[1201] Step 7:

[1202] The server automatically generates an approval route based on the user's position and department.

[1203] Step 8:

[1204] The server sends emails and in-system notifications to the configured approvers, requesting their approval.

[1205] Step 9:

[1206] The emotion engine displays notifications encouraging stress reduction and breaks based on the user's emotional state.

[1207] Contract Phase

[1208] Program processing

[1209] Step 1:

[1210] The user moves to the contract management screen.

[1211] Step 2:

[1212] The user uploads an agreement file.

[1213] Step 3:

[1214] The server receives the file and parses its contents.

[1215] Step 4:

[1216] The server extracts the necessary information (contract amount, contract period, counterparty information, etc.) from the analysis results.

[1217] Step 5:

[1218] The emotion engine monitors the user's facial expressions and operating status to evaluate their emotional state.

[1219] Step 6:

[1220] If the emotion engine detects that the user is feeling stressed, it will display relaxation guidance and psychological support messages.

[1221] Step 7:

[1222] The server stores the extracted information in a database.

[1223] Step 8:

[1224] The server sends a request for contract confirmation to the person in charge.

[1225] Ordering Phase

[1226] Program processing

[1227] Step 1:

[1228] The user moves to the purchase order creation screen.

[1229] Step 2:

[1230] The user enters order information (order details, quantity, unit price, etc.).

[1231] Step 3:

[1232] The emotion engine monitors the user's facial expressions and operation speed while they are typing to evaluate their emotional state.

[1233] Step 4:

[1234] The server checks the entered information to see if there are any errors.

[1235] Step 5:

[1236] The server generates a purchase order based on the order information.

[1237] Step 6:

[1238] The server generates a purchase order and sends it to the designated vendor via email.

[1239] Step 7:

[1240] If the emotion engine detects a user's uncertainty or anxiety, it will display additional input guidance and support messages.

[1241] Inspection phase

[1242] Program processing

[1243] Step 1:

[1244] The user receives the delivered goods and inspects the quality and quantity.

[1245] Step 2:

[1246] The user enters the inspection results into the system.

[1247] Step 3:

[1248] The emotion engine monitors the user's facial expressions and operating status to evaluate their emotional state.

[1249] Step 4:

[1250] The server stores the input inspection results in a database.

[1251] Step 5:

[1252] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[1253] Step 6:

[1254] If the emotion engine detects that the user is feeling stressed, it will display a notification encouraging them to relax.

[1255] In this way, by evaluating the user's emotional state in real time at each phase and providing appropriate support, a system can be realized that improves the efficiency of accounting work and user comfort.

[1256] Example 2

[1257] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1258] Conventional accounting support systems have been required to automate and streamline each phase of the process, from creating approval documents to signing contracts, placing orders, and inspecting acceptance. However, they lacked adequate support that took into account the user's emotional state. This often led to users feeling stressed and fatigued, which could lead to reduced work efficiency. Therefore, a system that can evaluate the user's emotional state in real time and provide appropriate support is needed.

[1259] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to select a template for a request for approval and input necessary information, a means for saving the input information in a database and setting an approval route, a means for sending an approval request to an approver, a means for providing an emotion engine that evaluates the user's emotional state from the user's input operations and facial expression data and provides appropriate guidance and support based on the user's emotional state, a means for inputting the inspection results to the server and saving them in a database, and a means for sending an inspection completion notification to the relevant person in charge and the contractor. This not only automates and streamlines the process in each phase, but also makes it possible to evaluate the user's emotional state and provide appropriate support.

[1260] A "user" is a person or entity who operates the system and inputs information such as approval documents, contracts, purchase orders, and inspection results.

[1261] A "requisition document" is a document used to obtain prior approval within an organization, and includes details such as the name of the equipment to be purchased, the quantity, the budget amount, and the reason for the purchase.

[1262] A "template" is a predefined format that users use when creating documents such as approval documents and contracts.

[1263] A "database" is an information storage system that systematically manages the information stored in the system and facilitates its search and use.

[1264] An "approval route" refers to the path and order that a request for approval, contract, etc. must follow to gain approval.

[1265] An "emotion engine" is software or a system that analyzes a user's input operations and facial expression data and evaluates their emotional state in real time.

[1266] A "guide" is an instruction or advice provided to a user when operating a system, and is intended to assist the user in performing their work efficiently.

[1267] "Support" refers to psychological and operational assistance provided by the emotion engine according to the user's emotional state.

[1268] A "contract" is a document that formally documents an agreement between the parties and includes details such as the contract amount, contract period, and information about the other party.

[1269] A "purchase order" is a document that formally requests the purchase of a specific product or service, and includes details such as the name of the product, quantity, and price.

[1270] "Inspection results" are documents or data that confirm the quality and quantity of delivered items and record the results.

[1271] A "vendor" is a commercial entity with which a user or organization does business, supplying goods or providing services.

[1272] This invention is a system for improving the efficiency of accounting work and providing support based on the user's emotional state. This system automates the process from creating approval documents to contracts, ordering, and acceptance inspection, and evaluates the user's emotional state at each phase to provide appropriate support.

[1273] Approval phase

[1274] The process begins when a user logs into the system using a terminal and opens the approval document creation screen. The user selects a approval document template from the provided templates and enters the necessary information. During the input operation, the emotion engine analyzes the user's input speed and facial expression data, and evaluates the user's emotional state in real time.

[1275] For example, when a user creates a request for approval to purchase new equipment, they input the name of the equipment to be purchased, the quantity, the budget amount, and the reason for the purchase. If an emotion engine (e.g., Azure Cognitive Services) detects fatigue from the user's input operations and facial expressions, the system displays a notification encouraging them to take a break. When the user saves the request, the server saves the information in a database, automatically sets up an approval route according to the user's position and department, and sends an approval request to the relevant approvers.

[1276] Contract Phase

[1277] The user navigates to the contract management screen and uploads the contract file. The server receives the file, analyzes its contents using OCR technology, and extracts the necessary information. For example, when a contract file is uploaded when creating a new contract, the server extracts important information such as the contract amount, contract period, and counterparty information.

[1278] The emotion engine monitors the user's operation log and facial expressions, and if the user feels anxious, it displays a support message encouraging them to relax. The extracted information is stored in a database, and a request for contract confirmation is sent to the person in charge.

[1279] Ordering Phase

[1280] The user moves to the purchase order creation screen and enters the order information. The server checks the entered information and checks for any errors. For example, when a user orders consumables, the user enters the necessary information and the server validates and confirms the data.

[1281] The emotion engine evaluates the user's emotional state and provides appropriate input guidance if it detects hesitation or confusion. The server automatically generates a purchase order based on the confirmed information and sends it to the specified vendor.

[1282] Inspection phase

[1283] The user receives the delivered goods, inspects the quality and quantity, and enters the results into the system. The server saves the entered inspection results in the database and sends a notification of inspection completion to the relevant person in charge and the vendor.

[1284] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The emotion engine detects that the user is feeling stressed during the inspection and displays a notification encouraging the user to relax.

[1285] Hardware and software used

[1286] Server: Server equipment for high-performance data processing and storage.

[1287] Terminal: A device that a user uses to access the system, such as a computer, tablet, or smartphone.

[1288] Sentiment engine: Microsoft's Azure Cognitive Services or other sentiment analysis software.

[1289] Database: A relational database management system such as MySQL or PostgreSQL.

[1290] OCR technology: Optical character recognition technology for converting contracts and other documents into text data.

[1291] Prompt Sentence Examples

[1292] For example, here's a prompt that the emotion engine might display when it detects that the user is tired:

[1293] "Thank you for your long hours of work. Please take a break and refresh yourself."

[1294] As a result, the system of the present invention provides appropriate support based on the user's emotional state, and can consistently streamline and automate each phase of accounting work.

[1295] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1296] Approval phase

[1297] Step 1:

[1298] A user logs in to the system using a terminal.

[1299] Input: User ID and password.

[1300] Data processing: The server checks the authentication information against a database.

[1301] Output: After successful authentication, display the approval request creation screen.

[1302] Specific operation: The user accesses the system and enters their authentication information. The server checks the database, and if authentication is successful, the approval document creation screen is displayed on the terminal.

[1303] Step 2:

[1304] The user selects a request form template and enters the required information.

[1305] Input: Template selection, equipment name, quantity, budget amount, reason for purchase, etc.

[1306] Data processing: The content entered by the user is reflected in the template.

[1307] Output: The completed decision form.

[1308] Specific behavior: The user selects an appropriate template from a list of templates and enters the required information.

[1309] Step 3:

[1310] When the user clicks the "Save" button, the server saves the entered information to a database.

[1311] Input: The completed request form.

[1312] Data processing: The entered data from the request form is saved in the database.

[1313] Output: A confirmation message for the saved decision.

[1314] Specific behavior: The user clicks the "Save" button, and the server saves the received data to the database.

[1315] Step 4:

[1316] The emotion engine evaluates the user's emotional state based on input operations and facial expression data.

[1317] Input: User input speed, facial expression data.

[1318] Data processing: The emotion engine analyzes the emotional state.

[1319] Output: Emotion evaluation result data.

[1320] Specific operation: User input operations and facial expression data from the webcam are collected in real time and analyzed by the emotion engine.

[1321] Step 5:

[1322] The server automatically generates an approval route based on the user's position and department, and sends an approval request.

[1323] Input: User's job title, department information, and approval request data.

[1324] Data processing: Automatically generate approval routes and identify approvers.

[1325] Output: Approval request notification.

[1326] Specific operation: The server retrieves job title and department information from the database, automatically generates an approval route, and sends a notification to the approver based on the generated route.

[1327] Step 6:

[1328] The emotional engine provides appropriate guidance and support based on the user's emotional state.

[1329] Input: Emotion evaluation result data.

[1330] Data processing: Generate guidance and support messages based on emotional state.

[1331] Output: Guides and support notifications.

[1332] Specific operation: If the emotion engine determines that the user's emotional state is fatigue or lethargy, the server displays a message on the user's device encouraging them to relax.

[1333] Contract Phase

[1334] Step 1:

[1335] The user moves to the contract management screen.

[1336] Input: None (screen transition operation).

[1337] Data processing: None (displayed on screen).

[1338] Output: Contract management screen.

[1339] Specific operation: The user clicks the contract management link from the menu and is taken to the contract management screen.

[1340] Step 2:

[1341] The user uploads an agreement file.

[1342] Input: Agreement file.

[1343] Data processing: Send the uploaded file to the server.

[1344] Output: File receipt confirmation message.

[1345] What happens: The user clicks the "Choose File" button, selects the contract file from their device, and uploads it.

[1346] Step 3:

[1347] The server receives the file and parses its contents to extract the required information.

[1348] Input: Agreement file.

[1349] Data processing: Using OCR technology, the content is converted into text data and the necessary information is extracted.

[1350] Output: Extracted contract data.

[1351] How it works: When the uploaded contract arrives at the server, OCR technology is used to automatically analyze the contents of the contract and extract important information.

[1352] Step 4:

[1353] The emotion engine evaluates the user's emotional state and displays relaxation guidance if it detects stress.

[1354] Input: User's facial expression data, operation log.

[1355] Data processing: The emotion engine analyzes stress levels.

[1356] Output: Relaxation guide and support messages.

[1357] Specific operation: The emotion engine evaluates the user's emotional state, and if the user is feeling stressed, a message encouraging relaxation is displayed on the device.

[1358] Step 5:

[1359] The server stores the extracted information in a database and sends a request for contract confirmation to the person in charge.

[1360] Input: Extracted contract data.

[1361] Data processing: The extracted information is stored in a database and a confirmation request is sent to the person in charge.

[1362] Output: Database save confirmation, confirmation request notification.

[1363] Specific operation: The server saves the extracted contract data in a database and sends a confirmation request notification to the relevant parties.

[1364] Ordering Phase

[1365] Step 1:

[1366] The user moves to the purchase order creation screen.

[1367] Input: None (screen transition behavior).

[1368] Data processing: None (displayed on screen).

[1369] Output: Purchase order creation screen.

[1370] Specific behavior: The user clicks the Create Purchase Order link from the menu to open the Create Purchase Order screen.

[1371] Step 2:

[1372] The user enters the order information.

[1373] Input: Order information such as product name, quantity, and amount.

[1374] Data processing: Reflect the entered data in the form.

[1375] Output: Input completion message.

[1376] Specific operation: The user enters the necessary information such as the product name, quantity, and price into the purchase order creation form.

[1377] Step 3:

[1378] The server checks the entered information to see if there are any errors.

[1379] Entered: The order information entered.

[1380] Data processing: Validate the data and check for any errors.

[1381] Output: Validation result message.

[1382] What happens: The server receives the order information, validates it, and checks for any errors.

[1383] Step 4:

[1384] An emotion engine assesses the user's emotional state and provides additional information if there is uncertainty.

[1385] Input: User input operations, facial expression data.

[1386] Data processing: The emotion engine analyzes the emotional state and detects hesitation.

[1387] Output: Additional information and guide messages.

[1388] Specific operation: The emotion engine detects the user's state of hesitation or confusion, and the server displays additional information or guidance messages.

[1389] Step 5:

[1390] The server generates a purchase order based on the order information and sends it to the specified vendor.

[1391] Enter: Your confirmed order information.

[1392] Data processing: Automatically generate purchase orders and send them to vendors via email or other appropriate means.

[1393] Output: Purchase order submission confirmation message.

[1394] Specific operation: The server generates a purchase order based on the confirmed order information and sends it to the specified vendor.

[1395] Inspection phase

[1396] Step 1:

[1397] The user receives the delivered goods and inspects the quality and quantity.

[1398] Input: Deliverables, Inspection Items.

[1399] Data processing: Record the test results.

[1400] Output: Test result data.

[1401] Specific actions: The user receives the delivered goods, inspects the quality and quantity, and records the results.

[1402] Step 2:

[1403] The user enters the inspection results into the system.

[1404] Input: Inspection result data.

[1405] Data processing: The inspection results are entered into the system and stored in the database.

[1406] Output: A message confirming that the inspection results have been saved.

[1407] Specific operation: The user enters the inspection results into the system, and the server receives them and stores them in the database.

[1408] Step 3:

[1409] The server stores the input inspection results in a database.

[1410] Input: Inspection result data.

[1411] Data processing: The inspection results are saved in the database.

[1412] Output: Save confirmation message.

[1413] Specific operation: The server saves the entered inspection results in the database.

[1414] Step 4:

[1415] The emotion engine assesses the user's emotional state and provides appropriate feedback.

[1416] Input: User emotion data.

[1417] Data processing: The emotion engine evaluates the user's emotional state.

[1418] Output: The feedback message.

[1419] Specific operation: The emotion engine analyzes the user's emotional state, and if it detects stress, it displays a notification encouraging relaxation.

[1420] Step 5:

[1421] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[1422] Input: Inspection result data.

[1423] Data processing: Generate and send notifications based on the inspection results.

[1424] Output: Inspection completion notification message.

[1425] Specific operation: Based on the inspection results stored in the database, the server sends a notification of inspection completion to the relevant personnel and vendors.

[1426] (Application example 2)

[1427] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1428] Conventional accounting support systems did not take into account the user's emotional state and did not provide sufficient support to improve work efficiency. In particular, if the user felt fatigued or stressed, appropriate measures could not be taken, which could result in a decrease in work efficiency. Furthermore, because the system did not provide guidance or support according to the user's emotional state, there was concern that the psychological burden on the user increased, which could lead to errors and delays in work.

[1429] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1430] In this invention, the server includes emotion analysis means for analyzing the user's emotional state from image data and operation history, means for providing appropriate support messages based on the emotion analysis results, and means for inputting the inspection results into the server and storing them in a database. This allows appropriate support to be provided according to the user's emotional state, significantly improving work efficiency and user comfort.

[1431] A "user" is a person who uses the system to create business documents such as approval documents, contracts, and purchase orders, and to approve and place orders.

[1432] The "emotion analysis means" is a function for analyzing the user's emotional state based on the user's image data and operation history.

[1433] The "means for providing a support message" is a function for displaying to the user an appropriate message or guide in accordance with the emotional state of the user detected by the emotion analysis means.

[1434] A "database" is an information management device for storing and managing input data to the system (request data, contract data, order information, inspection results, etc.).

[1435] An "approval route" is a setting of a route by which documents such as approval requests, contracts, and purchase orders are approved sequentially by approvers.

[1436] The "means for sending an approval request" is a function for the server to send a notification to the approver requesting approval of the document based on the set approval route.

[1437] "Means for inputting inspection results" is a function that allows the user to input the results of inspection of the quality and quantity of delivered items into the system.

[1438] The "means for sending a notification of completion of inspection" is a function for the server to notify the relevant person in charge or the contractor that the inspection has been completed based on the inspection results entered.

[1439] The "means for uploading and analyzing contracts" is a function that allows a user to upload a contract file to the system and automatically analyze its contents.

[1440] "Means for saving contract data" is a function for saving important information of the analyzed contract (contract amount, period, counterparty information, etc.) in a database.

[1441] "Means for sending a request to confirm the contract" is a function that allows the server to send a request to confirm the uploaded and analyzed contract to the relevant person in charge.

[1442] The "means for inputting order information" is a function that allows a user to input order information for required goods or services into the system.

[1443] The "means for generating a purchase order" is a function that enables the server to automatically generate a purchase order based on the order information entered by the user.

[1444] The "means for sending purchase orders" is a function for sending purchase orders generated by the server to the relevant vendors.

[1445] The "means for providing additional information" is a function that allows the system to display appropriate additional information or guidance when the user is unsure or has questions while entering order information.

[1446] The "means for displaying a relaxation guide" is a function that analyzes the user's emotional state and, if stress is detected, provides guidance and advice for relaxation.

[1447] This invention relates to a system that analyzes the emotions of users in factory production work in real time and provides appropriate support messages. How this system is implemented will be described below in detail.

[1448] System configuration and operation

[1449] The system includes the following main components:

[1450] 1. User terminal: A device used by users to create and manipulate business documents such as approval documents, contracts, and purchase orders. It includes a camera and a screen display device.

[1451] 2. Server: A central device that manages the database and performs various analyses and notifications.

[1452] 3. Emotion analysis device: A device that analyzes the user's facial expressions and operation history to identify their emotional state.

[1453] Hardware and Software Use

[1454] Camera: Used to capture the user's face and obtain video data in real time.

[1455] Display device (monitor): Used to visually provide support messages and relaxation guides to the user.

[1456] OpenCV: An image processing library used as a preprocessing for face detection and emotion analysis.

[1457] TensorFlow / Keras: A machine learning framework for implementing emotion recognition models.

[1458] Data processing and calculation flow

[1459] 1. User emotion analysis: While a user is writing a business document, a camera captures facial images in real time and detects the face using OpenCV. The detected facial images are preprocessed and input to an emotion recognition model trained with TensorFlow / Keras. The emotion analyzer identifies the user's emotional state (e.g., fatigue or stress) based on the model output.

[1460] 2. Providing support messages: Based on the results of emotion analysis, appropriate support messages or relaxation guidance are displayed on the user's device. For example, if the system determines that the user is tired, it will display a message saying, "Please take a short break." This message is selected from a pre-defined template message.

[1461] 3. Data storage and notification: The information entered by the user and the results of sentiment analysis are sent to the server and stored in a database. At the same time, notifications are sent to the necessary parties. This allows the status of business processes to be shared in real time.

[1462] Specific examples

[1463] For example, when a user is operating a machine during a night shift in a factory, the system analyzes the user's facial image to detect signs of fatigue. If fatigue is detected, a message will appear saying, "Please take a short break." When the user takes a break, the information is sent to the server and recorded in the database. At the same time, the system notifies the user's superiors that the break has been taken. This improves work efficiency and safety.

[1464] Example prompt sentence:

[1465] "Generate a Python program to implement a system that recognizes emotions and provides support messages in real time to fatigued factory workers. The system will estimate the worker's emotional state from their facial expressions, display a message encouraging them to take a break as needed, and save the emotional state and a timestamp to a log file. Specifically, we will use OpenCV for facial recognition and TensorFlow / Keras for the emotion recognition model."

[1466] The above is the "Mode for Carrying Out the Invention" of the present invention. This provides appropriate support according to the user's emotional state, and is expected to significantly improve work efficiency and user comfort.

[1467] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1468] Step 1:

[1469] The user terminal captures the user's face image in real time using a camera.

[1470] Input: Real-time facial video data

[1471] Processing: Capture and pre-processing of video data (e.g., image resizing, grayscale conversion)

[1472] Output: Preprocessed face image data

[1473] Step 2:

[1474] The device detects faces from preprocessed facial images using OpenCV.

[1475] Input: Preprocessed face image data

[1476] Processing: Detect face areas from the image and obtain face position information

[1477] Output: Face position information (coordinate data)

[1478] Step 3:

[1479] The device inputs the detected facial image into an emotion recognition model using TensorFlow / Keras to estimate the emotional state.

[1480] Input: A face image cropped based on face position information

[1481] Processing: Emotion recognition model to estimate emotional state (e.g., relaxed, tired, stressed)

[1482] Output: Emotional state estimation result

[1483] Step 4:

[1484] The device displays a support message based on the emotion analysis results.

[1485] Input: Emotional state estimation result

[1486] Processing: Select and display appropriate support messages based on the estimation results

[1487] Output: Display a support message to the user

[1488] Step 5:

[1489] The device sends the emotion analysis results and operation data to the server.

[1490] Input: Emotion analysis results, user operation data

[1491] Processing: Formatting and sending the data (sending the data over the network to the server)

[1492] Output: Sentiment analysis results and operation data stored on the server

[1493] Step 6:

[1494] The server stores the emotion analysis results and operation data in a database.

[1495] Input: Received sentiment analysis results and operational data

[1496] Process: Saving data to the database

[1497] Output: Records stored in the database

[1498] Step 7:

[1499] The server sends the necessary notifications to the relevant parties.

[1500] Input: Sentiment analysis results and operation data stored in the database

[1501] Action: Generate and send notifications to interested parties

[1502] Output: Notifications sent to interested parties

[1503] The above is the specific processing flow of the system. This series of processes provides appropriate support according to the user's emotional state. In addition, the server stores and notifies this data, which improves work efficiency.

[1504] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1505] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1506] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1507] [Third embodiment]

[1508] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1509] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1510] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1511] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1512] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1513] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1514] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1515] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1516] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1517] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1518] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1519] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1520] This invention relates to a system that consistently supports accounting operations, from approval to contracts, orders, and acceptance inspection. This system automates and streamlines the processes in each phase of accounting operations.

[1521] Approval phase

[1522] Program processing:

[1523] 1. The user logs in to the system and opens the approval request creation screen.

[1524] 2. The user selects one of the provided templates and enters the required information.

[1525] 3. When the user clicks the "Save" button, the server saves the entered information to the database.

[1526] 4. The server automatically generates an approval route based on the user's position and department.

[1527] 5. The server sends an email or an in-system notification to the approver requesting approval.

[1528] Examples:

[1529] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name of the equipment to be purchased, the quantity, the budget amount, and the reason for the purchase. After that, when they press the save button, the server saves the information in the database and sends notifications to the necessary approvers based on the pre-set approval route.

[1530] Contract Phase

[1531] Program processing:

[1532] 1. The user goes to the contract management screen and uploads the contract file.

[1533] 2. The server receives the file, analyzes the contents, and extracts the necessary information (contract amount, contract period, counterparty information, etc.).

[1534] 3. The server stores the extracted information in a database.

[1535] 4. The server sends a request to the agent to review the contract.

[1536] Examples:

[1537] For example, when a user signs a new contract, they upload the contract file to the system, and the server automatically analyzes the contents and extracts important contract information, making it easier for the person in charge to check the extracted information and enabling a quick response.

[1538] Ordering Phase

[1539] Program processing:

[1540] 1. The user moves to the purchase order creation screen and enters the order information (order details, quantity, unit price, etc.).

[1541] 2. The server checks the entered information to see if there are any errors.

[1542] 3. The server generates a purchase order based on the order information.

[1543] 4. The server generates a purchase order and sends it to the specified vendor via email.

[1544] Examples:

[1545] For example, when a user orders consumables, they log in to the system and enter the necessary information. The server then verifies the information, automatically generates a purchase order, and sends it to the supplier, automating the ordering process.

[1546] Inspection phase

[1547] Program processing:

[1548] 1. The user receives the delivery and inspects the quality and quantity.

[1549] 2. The user enters the inspection results into the system.

[1550] 3. The server saves the entered inspection results in the database.

[1551] 4. The server sends a notification of inspection completion to the relevant personnel and vendors.

[1552] Examples:

[1553] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies the relevant parties that the inspection has been completed, improving the transparency and efficiency of the business. In this way, the system of the present invention consistently supports accounting operations from approval to contract, ordering, and inspection, significantly improving business efficiency.

[1554] The processing flow will be explained below.

[1555] Approval phase

[1556] Program processing

[1557] Step 1:

[1558] The user logs in to the system and opens the approval request creation screen.

[1559] Step 2:

[1560] The user selects a template for the approval document from the templates provided.

[1561] Step 3:

[1562] The user enters the required information (purpose, content, amount, attachments, etc.).

[1563] Step 4:

[1564] The user clicks the Save button.

[1565] Step 5:

[1566] The server stores the entered information in a database.

[1567] Step 6:

[1568] The server automatically generates an approval route based on the user's position and department.

[1569] Step 7:

[1570] The server sends emails and in-system notifications to the configured approvers, requesting their approval.

[1571] Contract Phase

[1572] Program processing

[1573] Step 1:

[1574] The user moves to the contract management screen.

[1575] Step 2:

[1576] The user uploads an agreement file.

[1577] Step 3:

[1578] The server receives the file and parses its contents.

[1579] Step 4:

[1580] The server extracts the necessary information (contract amount, contract period, counterparty information, etc.) from the analysis results.

[1581] Step 5:

[1582] The server stores the extracted information in a database.

[1583] Step 6:

[1584] The server sends a request to the agent to review the contract.

[1585] Ordering Phase

[1586] Program processing

[1587] Step 1:

[1588] The user moves to the purchase order creation screen.

[1589] Step 2:

[1590] The user enters order information (order details, quantity, unit price, etc.).

[1591] Step 3:

[1592] The server checks the entered information to see if there are any errors.

[1593] Step 4:

[1594] The server generates a purchase order based on the order information.

[1595] Step 5:

[1596] The server generates a purchase order and sends it to the designated vendor via email.

[1597] Inspection phase

[1598] Program processing

[1599] Step 1:

[1600] The user receives the delivered goods and inspects the quality and quantity.

[1601] Step 2:

[1602] The user enters the inspection results into the system.

[1603] Step 3:

[1604] The server stores the input inspection results in a database.

[1605] Step 4:

[1606] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[1607] These specific processing steps allow a clear understanding of the mode for carrying out the invention. The detailed description of the specific operations performed at each step also makes it easier to grasp the overall picture of the system.

[1608] Example 1

[1609] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1610] In current accounting work, each phase, from creating approval documents to signing contracts, placing orders, and receiving inspections, is done manually, which takes a lot of time and effort. There is also a high possibility of miscommunication of information and delays in the approval process. This can lead to problems with the efficiency of the entire business and increased costs. The purpose of this invention is to solve these problems and provide a system that consistently automates and streamlines each phase of accounting work.

[1611] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1612] In this invention, the server includes: a means for a user to select a template for a request for approval and input the necessary information; a means for the server to save the input information in a database and perform an error check, and then automatically generate an approval route; a means for the server to send an email or an in-system notification to the approver requesting approval; a means for the user to receive the delivery and input the inspection results into the server, and the server to save the inspection results in a database; and a means for the server to send a notification of inspection completion to the relevant person in charge and the provider. This makes it possible to consistently automate the processes in each phase of accounting work, improving the efficiency and transparency of work.

[1613] "User" refers to a person who uses the system to perform various accounting tasks.

[1614] "Server" refers to a device or system that processes, stores, and notifies various data in response to instructions from a user.

[1615] A "template" refers to a predefined format that users use when creating documents such as approval forms and purchase orders.

[1616] "Database" refers to a system that allows a server to systematically store and manage information entered by users.

[1617] "Error checking" refers to the process by which the server checks the information entered by the user for errors.

[1618] An "approval route" refers to the path that determines who should approve a request form, purchase order, etc. created by a user.

[1619] "Email or internal system notification" refers to various means of communication that the server uses with users and approvers.

[1620] "Delivery Items" refers to goods and services ordered by a User.

[1621] "Inspection results" refers to the results of the user receiving the delivered goods and checking the quality, quantity, etc.

[1622] "Provider" refers to a trader or company that provides the goods or services ordered by the user.

[1623] "Contract file" refers to document data uploaded by a user for a contract.

[1624] "Parsing" refers to the process by which the server extracts the necessary information from the uploaded contract file.

[1625] "Order information" refers to detailed information such as the content, quantity, and unit price of a product or service that a user enters into a purchase order.

[1626] "Purchase Order" means a purchase order created by a User using the System.

[1627] MODE FOR CARRYING OUT THE INVENTION

[1628] The present invention relates to a system that consistently supports accounting operations, from approval to contracts, orders, and acceptance inspections. This system automates and streamlines the processes in each phase of accounting operations. Specific embodiments for each phase are described below.

[1629] Approval phase

[1630] In the approval phase, the user logs into the system and opens the approval document creation screen. The user selects one of the templates provided and enters the required information. Next, when the user clicks the "Save" button, the server saves the entered information in the database. The server automatically generates an approval route according to the user's position and department, and sends an email or an in-system notification to the approver requesting their approval.

[1631] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name, quantity, budget, and reason for the equipment they plan to purchase. After that, when they press the "Save" button, the server saves the information in the database and sends a notification to the approver based on the approval route.

[1632] Contract Phase

[1633] In the contract phase, the user moves to the contract management screen and uploads the contract file. The server receives the file, analyzes the contents using an analysis engine, and extracts the necessary information (contract amount, contract period, counterparty information, etc.). The server saves the extracted information in a database and sends an email or an in-system notification to the person in charge requesting that they review the contract.

[1634] For example, when a user signs a new contract, they upload the contract file to the system, and the server automatically analyzes the contents and extracts important contract information. The extracted information can be easily checked by the person in charge, enabling a quick response.

[1635] Ordering Phase

[1636] In the ordering phase, the user moves to the purchase order creation screen and enters the order information (order details, quantity, unit price, etc.). The server checks the entered information for any errors. The server generates a purchase order based on the order information and sends it to the specified vendor by email.

[1637] For example, when a user orders consumables, they log in to the system and enter the necessary information. The server then verifies the information, automatically generates a purchase order, and sends it to the supplier, automating the ordering process.

[1638] Inspection phase

[1639] In the inspection phase, the user receives the delivered goods and inspects the quality and quantity. When the user enters the inspection results into the system, the server saves the entered inspection results in the database. The server then sends a notification of inspection completion to the relevant person in charge and the vendor.

[1640] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies the relevant parties that the inspection has been completed, improving the transparency and efficiency of operations.

[1641] Use cases and prompts for generative AI models

[1642] Usage example

[1643] 1. When a user wants to order materials for a new project, they log into the system, enter the necessary information, and the server automatically generates a purchase order and sends it to the relevant vendor.

[1644] 2. Remote workers can use the system to upload contracts and smoothly obtain approval from their superiors.

[1645] Example prompts for generative AI models

[1646] "Use this prompt to explain the process for creating a request for approval in your accounting system. For example, explain the detailed steps a user would take to create a request for approval to purchase new equipment."

[1647] This system aims to reduce the workload of users by automating all accounting tasks, from approvals to contracts, orders, and inspections. In particular, it uses a high-performance server and the latest analysis engine for various data processing, improving accuracy and efficiency.

[1648] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1649] Approval phase

[1650] Step 1:

[1651] A user logs in to the system.

[1652] Input: User ID, Password

[1653] Operation: The device sends the entered authentication information to the server.

[1654] Output: The server returns the user authentication result.

[1655] Step 2:

[1656] The user moves to the approval request creation screen.

[1657] Input: User clicks

[1658] Operation: The server sends HTML data to the terminal to display the approval document creation screen.

[1659] Output: The terminal displays the approval request creation screen.

[1660] Step 3:

[1661] The user selects a template.

[1662] Input: Template selection operation

[1663] Operation: The terminal sends the selected template information to the server.

[1664] Output: The server returns the selected template content.

[1665] Step 4:

[1666] The user enters the required information.

[1667] Input: Equipment name, quantity, budget amount, reason for purchase, etc.

[1668] How it works: The device stores the information entered and sends it to the server when the user clicks the "Save" button.

[1669] Output: The server receives the information.

[1670] Step 5:

[1671] The user clicks the Save button.

[1672] Input: Click

[1673] Operation: The terminal sends the entered information to the server.

[1674] Output: The server stores the information in a database.

[1675] Step 6:

[1676] The server checks the entered information for errors.

[1677] Input: Information entered by the user

[1678] Behavior: The server validates the information and performs error checking.

[1679] Output: Error response or normal response

[1680] Step 7:

[1681] The server automatically generates an approval route.

[1682] Input: User's job title, department information, and input approval information

[1683] Action: The server runs the approval route algorithm to determine the appropriate approver.

[1684] Output: Generated approval route

[1685] Step 8:

[1686] The server sends a notification to the approver.

[1687] Input: Approval Route

[1688] Operation: The server processes the sending of email or internal notifications.

[1689] Output: A notification is sent.

[1690] Contract Phase

[1691] Step 1:

[1692] The user moves to the contract management screen.

[1693] Input: User clicks

[1694] Operation: The server sends HTML data to the terminal to display the contract management screen.

[1695] Output: The terminal displays the contract management screen.

[1696] Step 2:

[1697] The user uploads an agreement file.

[1698] Input: Contract file

[1699] Action: The device sends a file to the server.

[1700] Output: The server receives the file.

[1701] Step 3:

[1702] The server parses the file contents.

[1703] Input: Contract file

[1704] What it does: The server runs an OCR engine and extracts the file contents as text data.

[1705] Output: Extracted text data

[1706] Step 4:

[1707] The server extracts the necessary information.

[1708] Input: Text data

[1709] Operation: The server executes an algorithm to analyze and extract information such as the contract amount, contract period, and counterparty information.

[1710] Output: Extracted contract information

[1711] Step 5:

[1712] The server stores the extracted information in a database.

[1713] Input: Extracted contract information

[1714] Operation: The server processes the information and stores it in a database.

[1715] Output: Contract information stored in the database

[1716] Step 6:

[1717] The server sends a request to confirm the contract to the person in charge.

[1718] Input: Contact information, contract information

[1719] Action: The server runs a process that sends email or internal notifications.

[1720] Output: A notification is sent.

[1721] Ordering Phase

[1722] Step 1:

[1723] The user moves to the purchase order creation screen.

[1724] Input: User clicks

[1725] Operation: The server sends HTML data to the terminal to display the purchase order creation screen.

[1726] Output: The terminal displays the purchase order creation screen.

[1727] Step 2:

[1728] The user enters the order information.

[1729] Input: Product details, quantity, unit price, etc.

[1730] How it works: The device stores the information entered and sends it to the server when the user clicks the "Submit" button.

[1731] Output: The server receives the information.

[1732] Step 3:

[1733] The server verifies the information entered.

[1734] Input: Order information entered by the user

[1735] Action: The server validates the information and checks for any errors.

[1736] Output: Verification result (error response or normal response)

[1737] Step 4:

[1738] The server automatically generates a purchase order.

[1739] Input: Confirmed order information

[1740] Operation: The server runs an algorithm that generates a purchase order.

[1741] Output: Generated purchase order

[1742] Step 5:

[1743] The server sends the generated purchase order to the vendor.

[1744] Input: Generated purchase order, vendor information

[1745] Operation: The server processes the purchase order and sends it to the vendor via email.

[1746] Output: Purchase order submitted

[1747] Inspection phase

[1748] Step 1:

[1749] The user receives the delivery.

[1750] Input: Receipt of delivery

[1751] Action: The user inspects the delivery.

[1752] Output: Check the quality and quantity of the delivered items

[1753] Step 2:

[1754] The user enters the inspection results into the system.

[1755] Input: Inspection result (pass, fail, etc.)

[1756] Operation: The terminal sends the entered inspection results to the server.

[1757] Output: The server receives the acceptance result.

[1758] Step 3:

[1759] The server stores the input inspection results in a database.

[1760] Input: Inspection results

[1761] Operation: The server processes the inspection results and stores them in a database.

[1762] Output: Inspection results stored in the database

[1763] Step 4:

[1764] The server sends a notification that the inspection is complete.

[1765] Input: Inspection results, related person and vendor information

[1766] Action: The server runs a process that sends email or internal notifications.

[1767] Output: Completion notification sent

[1768] (Application example 1)

[1769] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1770] The approval, contract, ordering, and inspection processes at logistics centers often involve a lot of manual work and lack efficiency. In addition, inconsistencies and delays can occur at each stage, hindering the smooth progress of the entire business. Therefore, automating and integrating these processes is desirable, and there is a demand for improving the transparency and efficiency of operations.

[1771] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1772] In this invention, the server includes: a means for a user to select a request form template and input the necessary information; a means for the server to save the input information in a database and set an approval route; a means for the server to send an approval request to an approver; a means for a user to upload a contract to a management screen and for the server to analyze the content, extract the necessary information, and save it in a database; a means for the server to send a request to confirm the contract to a person in charge based on the extracted information; a means for a user to input order information into the system, for the server to check the information for any errors, generate a purchase order, and send it to a vendor; a means for a user to input inspection results into the server and save them in a database; and a means for the server to send an inspection completion notification to the relevant person in charge and a vendor. This automates the entire process of approval, contract, ordering, and inspection within a logistics center, making it possible to significantly improve the efficiency and transparency of operations.

[1773] A "requisition document" is a document prepared by a company or other organization to obtain approval for certain economic or business matters.

[1774] A "template" refers to a pre-prepared format that makes it easy to create a specific document or format.

[1775] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[1776] An "approval route" refers to the step-by-step process or path that a document such as a request form or contract takes to be approved.

[1777] "Approval Request" means a request sent to a specific person or department for approval.

[1778] "Inspection results" refers to the results reported after checking the quality and quantity of delivered goods or services.

[1779] "Notification" means a message or communication sent to inform interested parties of specific information.

[1780] A "contract" is a document that documents the formation and content of a contract and serves as legal evidence of the agreement between the parties to the contract.

[1781] "Analysis" is the process of examining the contents of data or documents in detail to clarify their structure and meaning.

[1782] "Order Information" refers to data or documents that describe the contents and conditions of an order.

[1783] A "purchase order" is a document created to place an order, which contains the order details, quantity, unit price, etc.

[1784] "Vendor" refers to a business or organization that provides a particular service or product.

[1785] A "smartphone" is a multi-function mobile phone that has mobile communication capabilities and can install and use a variety of applications.

[1786] "Wireless communication" refers to the technology of transmitting data using radio signals such as radio waves.

[1787] "Real time" means that processing occurs the instant an event occurs.

[1788] "Application" means software designed to perform a specific purpose or function.

[1789] This invention relates to a system that consistently supports, automates, and streamlines processes at logistics centers, from approval to contracts, orders, and inspections. This system uses a server and user devices (e.g., smartphones) to process each phase of the process via real-time wireless communication.

[1790] Hardware and software used

[1791] Server: Centralizes data storage, analysis, notification sending, etc. The server is built using Flask (a lightweight Python web framework).

[1792] Database: Used to manage and store large amounts of data. Uses SQLite.

[1793] Smartphone: Used as a terminal for users to input information for each process.

[1794] Communication technology: Wireless communication (e.g., Wi-Fi, Bluetooth) is used to send and receive data in real time.

[1795] Email sending library: Uses mtplib to send approval requests and notifications in email format.

[1796] Program processing overview

[1797] 1. Approval phase

[1798] The user opens the smartphone app, selects a template on the approval document creation screen, and enters the required information. The entered information is sent to the server and saved.

[1799] The server automatically generates an approval route based on the entered information and sends an email notification of the approval request to the approver.

[1800] 2. Contract Phase

[1801] The user uploads the contract file to the management screen. The server analyzes the file contents and extracts the necessary contract information (e.g., contract amount, contract period).

[1802] The extracted information is stored in a database and a request for contract confirmation is sent to the person in charge via email.

[1803] 3. Ordering Phase

[1804] The user enters order information on their smartphone and sends it to the server, which checks the integrity of the information and automatically generates a purchase order.

[1805] The generated purchase order is sent to the specified vendor via email.

[1806] 4. Inspection Phase

[1807] When the user receives the delivered goods, they inspect the quality and quantity and enter the inspection results into the server using a smartphone app.

[1808] The server stores the inspection results in a database and notifies the relevant personnel and vendors that the inspection has been completed.

[1809] Specific examples

[1810] For example, consider a scenario in which a user is creating a request to purchase a forklift. In this case, the user enters the following information into a smartphone app:

[1811] Equipment Name: "Forklift"

[1812] Quantity: 2

[1813] Budget: 3 million yen

[1814] Reason: "To improve on-site work efficiency"

[1815] Approver Email: "approver@example.com"

[1816] Once these are entered and the user clicks "Save," the system automatically saves the information to the database and sends an email notification to the approver. This operation ensures the approval process is efficient and improves business transparency.

[1817] Prompt Sentence Examples

[1818] The template for creating a request for approval to purchase a new forklift for a distribution center includes the following information:

[1819] Equipment Name: "Forklift"

[1820] Quantity: 2

[1821] Budget: 3 million yen

[1822] Reason: "To improve on-site work efficiency"

[1823] Approver Email: "approver@example.com"

[1824] In this way, by integrating and automating the entire process of approval, contracts, orders, and inspections within the logistics center, it is possible to significantly improve the efficiency of the entire business.

[1825] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1826] Step 1:

[1827] The user opens the smartphone app, selects a template on the approval request creation screen, and enters the required information.

[1828] Input: Facility name, quantity, budget, reason, approver email

[1829] What happens: The user enters this information into a form within the app and presses the "Save" button.

[1830] Output: The entered information is sent to the server.

[1831] Step 2:

[1832] The server stores the entered information in a database.

[1833] Input: Request information sent in Step 1

[1834] How it works: The server parses the data it receives and stores it in an SQLite database.

[1835] Output: The approval request information is saved in the database.

[1836] Step 3:

[1837] The server automatically generates an approval route based on the input information and sends an approval request to the approver by email.

[1838] Input: Approval information stored in the database, approver email

[1839] Operation: The server generates an approval route and sends an approval request email using smtplib.

[1840] Output: An email requesting approval of the request form will be sent to the approver.

[1841] Step 4:

[1842] The user uploads the contract file to the admin panel.

[1843] Input: Contract file

[1844] How it works: The user uploads a contract file and presses the "Analyze" button. The contract file is sent to the server.

[1845] Output: The contract file is sent to the server.

[1846] Step 5:

[1847] The server analyzes the contents of the contract file, extracts the necessary information, and stores it in a database.

[1848] Input: Uploaded agreement file

[1849] How it works: The server parses the contract file, extracts information such as the contract amount and contract period, and stores it in a database.

[1850] Output: The extracted contract information is stored in a database.

[1851] Step 6:

[1852] The server sends an email to the person in charge requesting confirmation of the contract based on the contract information.

[1853] Input: Contract information stored in the database

[1854] Action: The server sends a confirmation email to the person in charge.

[1855] Output: An email requesting confirmation of the contract is sent to the person in charge.

[1856] Step 7:

[1857] The user enters order information into the smartphone app and sends it to the server.

[1858] Input: Product name, quantity, unit price, delivery deadline

[1859] How it works: The user enters this information into the form in the app and presses the "Place Order" button. The order information is sent to the server.

[1860] Output: The order information is sent to the server.

[1861] Step 8:

[1862] The server checks the consistency of the order information and automatically generates a purchase order.

[1863] Input: Submitted order information

[1864] How it works: The server verifies the integrity of all items and generates a purchase order based on the information.

[1865] Output: The automatically generated purchase order is saved as internal data.

[1866] Step 9:

[1867] The server sends the generated purchase order to the specified vendor by email.

[1868] Input: Auto-generated purchase order, vendor email address

[1869] What happens: The server sends a purchase order to the vendor's email address.

[1870] Output: A purchase order is sent to the vendor.

[1871] Step 10:

[1872] The user inspects the quality and quantity of the delivered items and enters the inspection results into a smartphone app.

[1873] Input: Inspection results (e.g. quality status, received quantity)

[1874] Operation: The user enters the inspection results into the form in the app and presses the "Save" button. The inspection results are sent to the server.

[1875] Output: The inspection result is sent to the server.

[1876] Step 11:

[1877] The server stores the inspection results in a database and sends an inspection completion notification by email to the relevant person in charge and the contractor.

[1878] Input: Submitted acceptance result

[1879] Operation: The server saves the inspection results in a database and sends an email to the relevant person in charge and the vendor notifying them of the completion of the inspection.

[1880] Output: Notification of completion of inspection is sent to the person in charge and the vendor.

[1881] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1882] This invention combines a system that consistently supports accounting work, from approval to contract, ordering, and acceptance inspection, with an emotion engine that recognizes the user's emotions. This system automates and streamlines the processes in each phase of accounting work, and can provide appropriate support based on the user's emotional state.

[1883] Approval phase

[1884] Program processing

[1885] 1. The user logs in to the system and opens the approval request creation screen.

[1886] 2. The user selects a request form template from the provided templates and enters the required information.

[1887] 3. When the user clicks the "Save" button, the server saves the entered information to the database.

[1888] 4. The emotion engine evaluates the user's emotional state based on their input and facial expression data.

[1889] 5. The server automatically generates an approval route based on the user's position and department and sends an approval request.

[1890] 6. The emotional engine provides appropriate guidance and support based on the user's emotional state.

[1891] Specific examples

[1892] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name, quantity, budget, and reason for the equipment to be purchased. If the emotion engine analyzes the user's input speed and facial expression and determines that the user is tired, a notification prompting them to take a break will be displayed within the system. When the user saves the request, the server saves the information in a database and sends notifications to the necessary approvers based on the approval route.

[1893] Contract Phase

[1894] Program processing

[1895] 1. The user navigates to the contract management screen.

[1896] 2. The user uploads the agreement file.

[1897] 3. The server receives the file, analyzes its contents, and extracts the necessary information.

[1898] 4. The emotion engine evaluates the user's emotional state and displays a relaxation guide if it detects stress.

[1899] 5. The server stores the extracted information in a database and sends a request for contract confirmation to the person in charge.

[1900] Specific examples

[1901] For example, when a user uploads a contract file to the system when signing a new contract, the server automatically analyzes the contents and extracts important contract information such as the contract amount, contract period, and counterparty information. At that time, the emotion engine monitors the user's facial expressions and operation history, and if it determines that the user is anxious, it displays a psychological support message within the system. This makes it easier for the person in charge to quickly check the contract contents.

[1902] Ordering Phase

[1903] Program processing

[1904] 1. The user navigates to the purchase order creation screen.

[1905] 2. The user enters the order information.

[1906] 3. The server checks the entered information to see if there are any errors.

[1907] 4. The emotion engine assesses the user's emotional state and provides additional information if there is uncertainty.

[1908] 5. The server generates a purchase order based on the order information and sends it to the specified vendor.

[1909] Specific examples

[1910] For example, when a user enters the necessary information to order consumables, the server verifies the information, automatically generates a purchase order, and sends it to the supplier. If the emotion engine detects that the user is confused while entering information, the system will display appropriate input guidance to support the user.

[1911] Inspection phase

[1912] Program processing

[1913] 1. The user receives the delivery and inspects the quality and quantity.

[1914] 2. The user enters the inspection results into the system.

[1915] 3. The server saves the entered inspection results in the database.

[1916] 4. The emotion engine evaluates the user's emotional state and provides appropriate feedback.

[1917] 5. The server sends a notification of inspection completion to the relevant personnel and vendors.

[1918] Specific examples

[1919] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies relevant parties that the inspection has been completed. If the emotion engine detects that the user is feeling stressed during the inspection process, it displays a notification encouraging the user to relax, thereby reducing the user's psychological burden.

[1920] In this way, by incorporating an emotion engine that provides appropriate support based on the user's emotional state, the system of the present invention can consistently support each phase of accounting work, significantly improving work efficiency and user comfort.

[1921] The processing flow will be explained below.

[1922] I understand. Below, I will explain the process step by step.

[1923] Approval phase

[1924] Program processing

[1925] Step 1:

[1926] The user logs in to the system and opens the approval request creation screen.

[1927] Step 2:

[1928] The user selects a template for the approval document from the templates provided.

[1929] Step 3:

[1930] The user enters the required information (purpose, content, amount, attachments, etc.).

[1931] Step 4:

[1932] The emotion engine detects the user's facial expression and operation speed when inputting and evaluates their emotional state.

[1933] Step 5:

[1934] The user clicks the Save button.

[1935] Step 6:

[1936] The server stores the entered information in a database.

[1937] Step 7:

[1938] The server automatically generates an approval route based on the user's position and department.

[1939] Step 8:

[1940] The server sends emails and in-system notifications to the configured approvers, requesting their approval.

[1941] Step 9:

[1942] The emotion engine displays notifications encouraging stress reduction and breaks based on the user's emotional state.

[1943] Contract Phase

[1944] Program processing

[1945] Step 1:

[1946] The user moves to the contract management screen.

[1947] Step 2:

[1948] The user uploads an agreement file.

[1949] Step 3:

[1950] The server receives the file and parses its contents.

[1951] Step 4:

[1952] The server extracts the necessary information (contract amount, contract period, counterparty information, etc.) from the analysis results.

[1953] Step 5:

[1954] The emotion engine monitors the user's facial expressions and operating status to evaluate their emotional state.

[1955] Step 6:

[1956] If the emotion engine detects that the user is feeling stressed, it will display relaxation guidance and psychological support messages.

[1957] Step 7:

[1958] The server stores the extracted information in a database.

[1959] Step 8:

[1960] The server sends a request for contract confirmation to the person in charge.

[1961] Ordering Phase

[1962] Program processing

[1963] Step 1:

[1964] The user moves to the purchase order creation screen.

[1965] Step 2:

[1966] The user enters order information (order details, quantity, unit price, etc.).

[1967] Step 3:

[1968] The emotion engine monitors the user's facial expressions and operation speed while they are typing to evaluate their emotional state.

[1969] Step 4:

[1970] The server checks the entered information to see if there are any errors.

[1971] Step 5:

[1972] The server generates a purchase order based on the order information.

[1973] Step 6:

[1974] The server generates a purchase order and sends it to the designated vendor via email.

[1975] Step 7:

[1976] If the emotion engine detects a user's uncertainty or anxiety, it will display additional input guidance and support messages.

[1977] Inspection phase

[1978] Program processing

[1979] Step 1:

[1980] The user receives the delivered goods and inspects the quality and quantity.

[1981] Step 2:

[1982] The user enters the inspection results into the system.

[1983] Step 3:

[1984] The emotion engine monitors the user's facial expressions and operating status to evaluate their emotional state.

[1985] Step 4:

[1986] The server stores the input inspection results in a database.

[1987] Step 5:

[1988] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[1989] Step 6:

[1990] If the emotion engine detects that the user is feeling stressed, it will display a notification encouraging them to relax.

[1991] In this way, by evaluating the user's emotional state in real time at each phase and providing appropriate support, a system can be realized that improves the efficiency of accounting work and user comfort.

[1992] Example 2

[1993] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1994] Conventional accounting support systems have been required to automate and streamline each phase of the process, from creating approval documents to signing contracts, placing orders, and inspecting acceptance. However, they lacked adequate support that took into account the user's emotional state. This often led to users feeling stressed and fatigued, which could lead to reduced work efficiency. Therefore, a system that can evaluate the user's emotional state in real time and provide appropriate support is needed.

[1995] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to select a template for a request for approval and input necessary information, a means for saving the input information in a database and setting an approval route, a means for sending an approval request to an approver, a means for providing an emotion engine that evaluates the user's emotional state from the user's input operations and facial expression data and provides appropriate guidance and support based on the user's emotional state, a means for inputting the inspection results to the server and saving them in a database, and a means for sending an inspection completion notification to the relevant person in charge and the contractor. This not only automates and streamlines the process in each phase, but also makes it possible to evaluate the user's emotional state and provide appropriate support.

[1996] A "user" is a person or entity who operates the system and inputs information such as approval documents, contracts, purchase orders, and inspection results.

[1997] A "requisition document" is a document used to obtain prior approval within an organization, and includes details such as the name of the equipment to be purchased, the quantity, the budget amount, and the reason for the purchase.

[1998] A "template" is a predefined format that users use when creating documents such as approval documents and contracts.

[1999] A "database" is an information storage system that systematically manages the information stored in the system and facilitates its search and use.

[2000] An "approval route" refers to the path and order that a request for approval, contract, etc. must follow to gain approval.

[2001] An "emotion engine" is software or a system that analyzes a user's input operations and facial expression data and evaluates their emotional state in real time.

[2002] A "guide" is an instruction or advice provided to a user when operating a system, and is intended to assist the user in performing their work efficiently.

[2003] "Support" refers to psychological and operational assistance provided by the emotion engine according to the user's emotional state.

[2004] A "contract" is a document that formally documents an agreement between the parties and includes details such as the contract amount, contract period, and information about the other party.

[2005] A "purchase order" is a document that formally requests the purchase of a specific product or service, and includes details such as the name of the product, quantity, and price.

[2006] "Inspection results" are documents or data that confirm the quality and quantity of delivered items and record the results.

[2007] A "vendor" is a commercial entity with which a user or organization does business, supplying goods or providing services.

[2008] This invention is a system for improving the efficiency of accounting work and providing support based on the user's emotional state. This system automates the process from creating approval documents to contracts, ordering, and acceptance inspection, and evaluates the user's emotional state at each phase to provide appropriate support.

[2009] Approval phase

[2010] The process begins when a user logs into the system using a terminal and opens the approval document creation screen. The user selects a approval document template from the provided templates and enters the necessary information. During the input operation, the emotion engine analyzes the user's input speed and facial expression data, and evaluates the user's emotional state in real time.

[2011] For example, when a user creates a request for approval to purchase new equipment, they input the name of the equipment to be purchased, the quantity, the budget amount, and the reason for the purchase. If an emotion engine (e.g., Azure Cognitive Services) detects fatigue from the user's input operations and facial expressions, the system displays a notification encouraging them to take a break. When the user saves the request, the server saves the information in a database, automatically sets up an approval route according to the user's position and department, and sends an approval request to the relevant approvers.

[2012] Contract Phase

[2013] The user navigates to the contract management screen and uploads the contract file. The server receives the file, analyzes its contents using OCR technology, and extracts the necessary information. For example, when a contract file is uploaded when creating a new contract, the server extracts important information such as the contract amount, contract period, and counterparty information.

[2014] The emotion engine monitors the user's operation log and facial expressions, and if the user feels anxious, it displays a support message encouraging them to relax. The extracted information is stored in a database, and a request for contract confirmation is sent to the person in charge.

[2015] Ordering Phase

[2016] The user moves to the purchase order creation screen and enters the order information. The server checks the entered information and checks for any errors. For example, when a user orders consumables, the user enters the necessary information and the server validates and confirms the data.

[2017] The emotion engine evaluates the user's emotional state and provides appropriate input guidance if it detects hesitation or confusion. The server automatically generates a purchase order based on the confirmed information and sends it to the specified vendor.

[2018] Inspection phase

[2019] The user receives the delivered goods, inspects the quality and quantity, and enters the results into the system. The server saves the entered inspection results in the database and sends a notification of inspection completion to the relevant person in charge and the vendor.

[2020] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The emotion engine detects that the user is feeling stressed during the inspection and displays a notification encouraging the user to relax.

[2021] Hardware and software used

[2022] Server: Server equipment for high-performance data processing and storage.

[2023] Terminal: A device that a user uses to access the system, such as a computer, tablet, or smartphone.

[2024] Sentiment engine: Microsoft's Azure Cognitive Services or other sentiment analysis software.

[2025] Database: A relational database management system such as MySQL or PostgreSQL.

[2026] OCR technology: Optical character recognition technology for converting contracts and other documents into text data.

[2027] Prompt Sentence Examples

[2028] For example, here's a prompt that the emotion engine might display when it detects that the user is tired:

[2029] "Thank you for your long hours of work. Please take a break and refresh yourself."

[2030] As a result, the system of the present invention provides appropriate support based on the user's emotional state, and can consistently streamline and automate each phase of accounting work.

[2031] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2032] Approval phase

[2033] Step 1:

[2034] A user logs in to the system using a terminal.

[2035] Input: User ID and password.

[2036] Data processing: The server checks the authentication information against a database.

[2037] Output: After successful authentication, display the approval request creation screen.

[2038] Specific operation: The user accesses the system and enters their authentication information. The server checks the database, and if authentication is successful, the approval document creation screen is displayed on the terminal.

[2039] Step 2:

[2040] The user selects a request form template and enters the required information.

[2041] Input: Template selection, equipment name, quantity, budget amount, reason for purchase, etc.

[2042] Data processing: The content entered by the user is reflected in the template.

[2043] Output: The completed decision form.

[2044] Specific behavior: The user selects an appropriate template from a list of templates and enters the required information.

[2045] Step 3:

[2046] When the user clicks the "Save" button, the server saves the entered information to a database.

[2047] Input: The completed request form.

[2048] Data processing: The entered data from the request form is saved in the database.

[2049] Output: A confirmation message for the saved decision.

[2050] Specific behavior: The user clicks the "Save" button, and the server saves the received data to the database.

[2051] Step 4:

[2052] The emotion engine evaluates the user's emotional state based on input operations and facial expression data.

[2053] Input: User input speed, facial expression data.

[2054] Data processing: The emotion engine analyzes the emotional state.

[2055] Output: Emotion evaluation result data.

[2056] Specific operation: User input operations and facial expression data from the webcam are collected in real time and analyzed by the emotion engine.

[2057] Step 5:

[2058] The server automatically generates an approval route based on the user's position and department, and sends an approval request.

[2059] Input: User's job title, department information, and approval request data.

[2060] Data processing: Automatically generate approval routes and identify approvers.

[2061] Output: Approval request notification.

[2062] Specific operation: The server retrieves job title and department information from the database, automatically generates an approval route, and sends a notification to the approver based on the generated route.

[2063] Step 6:

[2064] The emotional engine provides appropriate guidance and support based on the user's emotional state.

[2065] Input: Emotion evaluation result data.

[2066] Data processing: Generate guidance and support messages based on emotional state.

[2067] Output: Guides and support notifications.

[2068] Specific operation: If the emotion engine determines that the user's emotional state is fatigue or lethargy, the server displays a message on the user's device encouraging them to relax.

[2069] Contract Phase

[2070] Step 1:

[2071] The user moves to the contract management screen.

[2072] Input: None (screen transition operation).

[2073] Data processing: None (displayed on screen).

[2074] Output: Contract management screen.

[2075] Specific operation: The user clicks the contract management link from the menu and is taken to the contract management screen.

[2076] Step 2:

[2077] The user uploads an agreement file.

[2078] Input: Agreement file.

[2079] Data processing: Send the uploaded file to the server.

[2080] Output: File receipt confirmation message.

[2081] What happens: The user clicks the "Choose File" button, selects the contract file from their device, and uploads it.

[2082] Step 3:

[2083] The server receives the file and parses its contents to extract the required information.

[2084] Input: Agreement file.

[2085] Data processing: Using OCR technology, the content is converted into text data and the necessary information is extracted.

[2086] Output: Extracted contract data.

[2087] How it works: When the uploaded contract arrives at the server, OCR technology is used to automatically analyze the contents of the contract and extract important information.

[2088] Step 4:

[2089] The emotion engine evaluates the user's emotional state and displays relaxation guidance if it detects stress.

[2090] Input: User's facial expression data, operation log.

[2091] Data processing: The emotion engine analyzes stress levels.

[2092] Output: Relaxation guide and support messages.

[2093] Specific operation: The emotion engine evaluates the user's emotional state, and if the user is feeling stressed, a message encouraging relaxation is displayed on the device.

[2094] Step 5:

[2095] The server stores the extracted information in a database and sends a request for contract confirmation to the person in charge.

[2096] Input: Extracted contract data.

[2097] Data processing: The extracted information is stored in a database and a confirmation request is sent to the person in charge.

[2098] Output: Database save confirmation, confirmation request notification.

[2099] Specific operation: The server saves the extracted contract data in a database and sends a confirmation request notification to the relevant parties.

[2100] Ordering Phase

[2101] Step 1:

[2102] The user moves to the purchase order creation screen.

[2103] Input: None (screen transition behavior).

[2104] Data processing: None (displayed on screen).

[2105] Output: Purchase order creation screen.

[2106] Specific behavior: The user clicks the Create Purchase Order link from the menu to open the Create Purchase Order screen.

[2107] Step 2:

[2108] The user enters the order information.

[2109] Input: Order information such as product name, quantity, and amount.

[2110] Data processing: Reflect the entered data in the form.

[2111] Output: Input completion message.

[2112] Specific operation: The user enters the necessary information such as the product name, quantity, and price into the purchase order creation form.

[2113] Step 3:

[2114] The server checks the entered information to see if there are any errors.

[2115] Entered: The order information entered.

[2116] Data processing: Validate the data and check for any errors.

[2117] Output: Validation result message.

[2118] What happens: The server receives the order information, validates it, and checks for any errors.

[2119] Step 4:

[2120] An emotion engine assesses the user's emotional state and provides additional information if there is uncertainty.

[2121] Input: User input operations, facial expression data.

[2122] Data processing: The emotion engine analyzes the emotional state and detects hesitation.

[2123] Output: Additional information and guide messages.

[2124] Specific operation: The emotion engine detects the user's state of hesitation or confusion, and the server displays additional information or guidance messages.

[2125] Step 5:

[2126] The server generates a purchase order based on the order information and sends it to the specified vendor.

[2127] Enter: Your confirmed order information.

[2128] Data processing: Automatically generate purchase orders and send them to vendors via email or other appropriate means.

[2129] Output: Purchase order submission confirmation message.

[2130] Specific operation: The server generates a purchase order based on the confirmed order information and sends it to the specified vendor.

[2131] Inspection phase

[2132] Step 1:

[2133] The user receives the delivered goods and inspects the quality and quantity.

[2134] Input: Deliverables, Inspection Items.

[2135] Data processing: Record the test results.

[2136] Output: Test result data.

[2137] Specific actions: The user receives the delivered goods, inspects the quality and quantity, and records the results.

[2138] Step 2:

[2139] The user enters the inspection results into the system.

[2140] Input: Inspection result data.

[2141] Data processing: The inspection results are entered into the system and stored in the database.

[2142] Output: A message confirming that the inspection results have been saved.

[2143] Specific operation: The user enters the inspection results into the system, and the server receives them and stores them in the database.

[2144] Step 3:

[2145] The server stores the input inspection results in a database.

[2146] Input: Inspection result data.

[2147] Data processing: The inspection results are saved in the database.

[2148] Output: Save confirmation message.

[2149] Specific operation: The server saves the entered inspection results in the database.

[2150] Step 4:

[2151] The emotion engine assesses the user's emotional state and provides appropriate feedback.

[2152] Input: User emotion data.

[2153] Data processing: The emotion engine evaluates the user's emotional state.

[2154] Output: The feedback message.

[2155] Specific operation: The emotion engine analyzes the user's emotional state, and if it detects stress, it displays a notification encouraging relaxation.

[2156] Step 5:

[2157] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[2158] Input: Inspection result data.

[2159] Data processing: Generate and send notifications based on the inspection results.

[2160] Output: Inspection completion notification message.

[2161] Specific operation: Based on the inspection results stored in the database, the server sends a notification of inspection completion to the relevant personnel and vendors.

[2162] (Application example 2)

[2163] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2164] Conventional accounting support systems did not take into account the user's emotional state and did not provide sufficient support to improve work efficiency. In particular, if the user felt fatigued or stressed, appropriate measures could not be taken, which could result in a decrease in work efficiency. Furthermore, because the system did not provide guidance or support according to the user's emotional state, there was concern that the psychological burden on the user increased, which could lead to errors and delays in work.

[2165] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2166] In this invention, the server includes emotion analysis means for analyzing the user's emotional state from image data and operation history, means for providing appropriate support messages based on the emotion analysis results, and means for inputting the inspection results into the server and storing them in a database. This allows appropriate support to be provided according to the user's emotional state, significantly improving work efficiency and user comfort.

[2167] A "user" is a person who uses the system to create business documents such as approval documents, contracts, and purchase orders, and to approve and place orders.

[2168] The "emotion analysis means" is a function for analyzing the user's emotional state based on the user's image data and operation history.

[2169] The "means for providing a support message" is a function for displaying to the user an appropriate message or guide in accordance with the emotional state of the user detected by the emotion analysis means.

[2170] A "database" is an information management device for storing and managing input data to the system (request data, contract data, order information, inspection results, etc.).

[2171] An "approval route" is a setting of a route by which documents such as approval requests, contracts, and purchase orders are approved sequentially by approvers.

[2172] The "means for sending an approval request" is a function for the server to send a notification to the approver requesting approval of the document based on the set approval route.

[2173] "Means for inputting inspection results" is a function that allows the user to input the results of inspection of the quality and quantity of delivered items into the system.

[2174] The "means for sending a notification of completion of inspection" is a function for the server to notify the relevant person in charge or the contractor that the inspection has been completed based on the inspection results entered.

[2175] The "means for uploading and analyzing contracts" is a function that allows a user to upload a contract file to the system and automatically analyze its contents.

[2176] "Means for saving contract data" is a function for saving important information of the analyzed contract (contract amount, period, counterparty information, etc.) in a database.

[2177] "Means for sending a request to confirm the contract" is a function that allows the server to send a request to confirm the uploaded and analyzed contract to the relevant person in charge.

[2178] The "means for inputting order information" is a function that allows a user to input order information for required goods or services into the system.

[2179] The "means for generating a purchase order" is a function that enables the server to automatically generate a purchase order based on the order information entered by the user.

[2180] The "means for sending purchase orders" is a function for sending purchase orders generated by the server to the relevant vendors.

[2181] The "means for providing additional information" is a function that allows the system to display appropriate additional information or guidance when the user is unsure or has questions while entering order information.

[2182] The "means for displaying a relaxation guide" is a function that analyzes the user's emotional state and, if stress is detected, provides guidance and advice for relaxation.

[2183] This invention relates to a system that analyzes the emotions of users in factory production work in real time and provides appropriate support messages. How this system is implemented will be described below in detail.

[2184] System configuration and operation

[2185] The system includes the following main components:

[2186] 1. User terminal: A device used by users to create and manipulate business documents such as approval documents, contracts, and purchase orders. It includes a camera and a screen display device.

[2187] 2. Server: A central device that manages the database and performs various analyses and notifications.

[2188] 3. Emotion analysis device: A device that analyzes the user's facial expressions and operation history to identify their emotional state.

[2189] Hardware and Software Use

[2190] Camera: Used to capture the user's face and obtain video data in real time.

[2191] Display device (monitor): Used to visually provide support messages and relaxation guides to the user.

[2192] OpenCV: An image processing library used as a preprocessing for face detection and emotion analysis.

[2193] TensorFlow / Keras: A machine learning framework for implementing emotion recognition models.

[2194] Data processing and calculation flow

[2195] 1. User emotion analysis: While a user is writing a business document, a camera captures facial images in real time and detects the face using OpenCV. The detected facial images are preprocessed and input to an emotion recognition model trained with TensorFlow / Keras. The emotion analyzer identifies the user's emotional state (e.g., fatigue or stress) based on the model output.

[2196] 2. Providing support messages: Based on the results of emotion analysis, appropriate support messages or relaxation guidance are displayed on the user's device. For example, if the system determines that the user is tired, it will display a message saying, "Please take a short break." This message is selected from a pre-defined template message.

[2197] 3. Data storage and notification: The information entered by the user and the results of sentiment analysis are sent to the server and stored in a database. At the same time, notifications are sent to the necessary parties. This allows the status of business processes to be shared in real time.

[2198] Specific examples

[2199] For example, when a user is operating a machine during a night shift in a factory, the system analyzes the user's facial image to detect signs of fatigue. If fatigue is detected, a message will appear saying, "Please take a short break." When the user takes a break, the information is sent to the server and recorded in the database. At the same time, the system notifies the user's superiors that the break has been taken. This improves work efficiency and safety.

[2200] Example prompt sentence:

[2201] "Generate a Python program to implement a system that recognizes emotions and provides support messages in real time to fatigued factory workers. The system will estimate the worker's emotional state from their facial expressions, display a message encouraging them to take a break as needed, and save the emotional state and a timestamp to a log file. Specifically, we will use OpenCV for facial recognition and TensorFlow / Keras for the emotion recognition model."

[2202] The above is the "Mode for Carrying Out the Invention" of the present invention. This provides appropriate support according to the user's emotional state, and is expected to significantly improve work efficiency and user comfort.

[2203] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2204] Step 1:

[2205] The user terminal captures the user's face image in real time using a camera.

[2206] Input: Real-time facial video data

[2207] Processing: Capture and pre-processing of video data (e.g., image resizing, grayscale conversion)

[2208] Output: Preprocessed face image data

[2209] Step 2:

[2210] The device detects faces from preprocessed facial images using OpenCV.

[2211] Input: Preprocessed face image data

[2212] Processing: Detect face areas from the image and obtain face position information

[2213] Output: Face position information (coordinate data)

[2214] Step 3:

[2215] The device inputs the detected facial image into an emotion recognition model using TensorFlow / Keras to estimate the emotional state.

[2216] Input: A face image cropped based on face position information

[2217] Processing: Emotion recognition model to estimate emotional state (e.g., relaxed, tired, stressed)

[2218] Output: Emotional state estimation result

[2219] Step 4:

[2220] The device displays a support message based on the emotion analysis results.

[2221] Input: Emotional state estimation result

[2222] Processing: Select and display appropriate support messages based on the estimation results

[2223] Output: Display a support message to the user

[2224] Step 5:

[2225] The device sends the emotion analysis results and operation data to the server.

[2226] Input: Emotion analysis results, user operation data

[2227] Processing: Formatting and sending the data (sending the data over the network to the server)

[2228] Output: Sentiment analysis results and operation data stored on the server

[2229] Step 6:

[2230] The server stores the emotion analysis results and operation data in a database.

[2231] Input: Received sentiment analysis results and operational data

[2232] Process: Saving data to the database

[2233] Output: Records stored in the database

[2234] Step 7:

[2235] The server sends the necessary notifications to the relevant parties.

[2236] Input: Sentiment analysis results and operation data stored in the database

[2237] Action: Generate and send notifications to interested parties

[2238] Output: Notifications sent to interested parties

[2239] The above is the specific processing flow of the system. This series of processes provides appropriate support according to the user's emotional state. In addition, the server stores and notifies this data, which improves work efficiency.

[2240] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2241] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2242] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2243] [Fourth embodiment]

[2244] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2245] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2246] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2247] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2248] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2249] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2250] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2251] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2252] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2253] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2254] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2255] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2256] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2257] This invention relates to a system that consistently supports accounting operations, from approval to contracts, orders, and acceptance inspection. This system automates and streamlines the processes in each phase of accounting operations.

[2258] Approval phase

[2259] Program processing:

[2260] 1. The user logs in to the system and opens the approval request creation screen.

[2261] 2. The user selects one of the provided templates and enters the required information.

[2262] 3. When the user clicks the "Save" button, the server saves the entered information to the database.

[2263] 4. The server automatically generates an approval route based on the user's position and department.

[2264] 5. The server sends an email or an in-system notification to the approver requesting approval.

[2265] Examples:

[2266] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name of the equipment to be purchased, the quantity, the budget amount, and the reason for the purchase. After that, when they press the save button, the server saves the information in the database and sends notifications to the necessary approvers based on the pre-set approval route.

[2267] Contract Phase

[2268] Program processing:

[2269] 1. The user goes to the contract management screen and uploads the contract file.

[2270] 2. The server receives the file, analyzes the contents, and extracts the necessary information (contract amount, contract period, counterparty information, etc.).

[2271] 3. The server stores the extracted information in a database.

[2272] 4. The server sends a request to the agent to review the contract.

[2273] Examples:

[2274] For example, when a user signs a new contract, they upload the contract file to the system, and the server automatically analyzes the contents and extracts important contract information, making it easier for the person in charge to check the extracted information and enabling a quick response.

[2275] Ordering Phase

[2276] Program processing:

[2277] 1. The user moves to the purchase order creation screen and enters the order information (order details, quantity, unit price, etc.).

[2278] 2. The server checks the entered information to see if there are any errors.

[2279] 3. The server generates a purchase order based on the order information.

[2280] 4. The server generates a purchase order and sends it to the specified vendor via email.

[2281] Examples:

[2282] For example, when a user orders consumables, they log in to the system and enter the necessary information. The server then verifies the information, automatically generates a purchase order, and sends it to the supplier, automating the ordering process.

[2283] Inspection phase

[2284] Program processing:

[2285] 1. The user receives the delivery and inspects the quality and quantity.

[2286] 2. The user enters the inspection results into the system.

[2287] 3. The server saves the entered inspection results in the database.

[2288] 4. The server sends a notification of inspection completion to the relevant personnel and vendors.

[2289] Examples:

[2290] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies the relevant parties that the inspection has been completed, improving the transparency and efficiency of the business. In this way, the system of the present invention consistently supports accounting operations from approval to contract, ordering, and inspection, significantly improving business efficiency.

[2291] The processing flow will be explained below.

[2292] Approval phase

[2293] Program processing

[2294] Step 1:

[2295] The user logs in to the system and opens the approval request creation screen.

[2296] Step 2:

[2297] The user selects a template for the approval document from the templates provided.

[2298] Step 3:

[2299] The user enters the required information (purpose, content, amount, attachments, etc.).

[2300] Step 4:

[2301] The user clicks the Save button.

[2302] Step 5:

[2303] The server stores the entered information in a database.

[2304] Step 6:

[2305] The server automatically generates an approval route based on the user's position and department.

[2306] Step 7:

[2307] The server sends emails and in-system notifications to the configured approvers, requesting their approval.

[2308] Contract Phase

[2309] Program processing

[2310] Step 1:

[2311] The user moves to the contract management screen.

[2312] Step 2:

[2313] The user uploads an agreement file.

[2314] Step 3:

[2315] The server receives the file and parses its contents.

[2316] Step 4:

[2317] The server extracts the necessary information (contract amount, contract period, counterparty information, etc.) from the analysis results.

[2318] Step 5:

[2319] The server stores the extracted information in a database.

[2320] Step 6:

[2321] The server sends a request to the agent to review the contract.

[2322] Ordering Phase

[2323] Program processing

[2324] Step 1:

[2325] The user moves to the purchase order creation screen.

[2326] Step 2:

[2327] The user enters order information (order details, quantity, unit price, etc.).

[2328] Step 3:

[2329] The server checks the entered information to see if there are any errors.

[2330] Step 4:

[2331] The server generates a purchase order based on the order information.

[2332] Step 5:

[2333] The server generates a purchase order and sends it to the designated vendor via email.

[2334] Inspection phase

[2335] Program processing

[2336] Step 1:

[2337] The user receives the delivered goods and inspects the quality and quantity.

[2338] Step 2:

[2339] The user enters the inspection results into the system.

[2340] Step 3:

[2341] The server stores the input inspection results in a database.

[2342] Step 4:

[2343] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[2344] These specific processing steps allow a clear understanding of the mode for carrying out the invention. The detailed description of the specific operations performed at each step also makes it easier to grasp the overall picture of the system.

[2345] Example 1

[2346] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2347] In current accounting work, each phase, from creating approval documents to signing contracts, placing orders, and receiving inspections, is done manually, which takes a lot of time and effort. There is also a high possibility of miscommunication of information and delays in the approval process. This can lead to problems with the efficiency of the entire business and increased costs. The purpose of this invention is to solve these problems and provide a system that consistently automates and streamlines each phase of accounting work.

[2348] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2349] In this invention, the server includes: a means for a user to select a template for a request for approval and input the necessary information; a means for the server to save the input information in a database and perform an error check, and then automatically generate an approval route; a means for the server to send an email or an in-system notification to the approver requesting approval; a means for the user to receive the delivery and input the inspection results into the server, and the server to save the inspection results in a database; and a means for the server to send a notification of inspection completion to the relevant person in charge and the provider. This makes it possible to consistently automate the processes in each phase of accounting work, improving the efficiency and transparency of work.

[2350] "User" refers to a person who uses the system to perform various accounting tasks.

[2351] "Server" refers to a device or system that processes, stores, and notifies various data in response to instructions from a user.

[2352] A "template" refers to a predefined format that users use when creating documents such as approval forms and purchase orders.

[2353] "Database" refers to a system that allows a server to systematically store and manage information entered by users.

[2354] "Error checking" refers to the process by which the server checks the information entered by the user for errors.

[2355] An "approval route" refers to the path that determines who should approve a request form, purchase order, etc. created by a user.

[2356] "Email or internal system notification" refers to various means of communication that the server uses with users and approvers.

[2357] "Delivery Items" refers to goods and services ordered by a User.

[2358] "Inspection results" refers to the results of the user receiving the delivered goods and checking the quality, quantity, etc.

[2359] "Provider" refers to a trader or company that provides the goods or services ordered by the user.

[2360] "Contract file" refers to document data uploaded by a user for a contract.

[2361] "Parsing" refers to the process by which the server extracts the necessary information from the uploaded contract file.

[2362] "Order information" refers to detailed information such as the content, quantity, and unit price of a product or service that a user enters into a purchase order.

[2363] "Purchase Order" means a purchase order created by a User using the System.

[2364] MODE FOR CARRYING OUT THE INVENTION

[2365] The present invention relates to a system that consistently supports accounting operations, from approval to contracts, orders, and acceptance inspections. This system automates and streamlines the processes in each phase of accounting operations. Specific embodiments for each phase are described below.

[2366] Approval phase

[2367] In the approval phase, the user logs into the system and opens the approval document creation screen. The user selects one of the templates provided and enters the required information. Next, when the user clicks the "Save" button, the server saves the entered information in the database. The server automatically generates an approval route according to the user's position and department, and sends an email or an in-system notification to the approver requesting their approval.

[2368] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name, quantity, budget, and reason for the equipment they plan to purchase. After that, when they press the "Save" button, the server saves the information in the database and sends a notification to the approver based on the approval route.

[2369] Contract Phase

[2370] In the contract phase, the user moves to the contract management screen and uploads the contract file. The server receives the file, analyzes the contents using an analysis engine, and extracts the necessary information (contract amount, contract period, counterparty information, etc.). The server saves the extracted information in a database and sends an email or an in-system notification to the person in charge requesting that they review the contract.

[2371] For example, when a user signs a new contract, they upload the contract file to the system, and the server automatically analyzes the contents and extracts important contract information. The extracted information can be easily checked by the person in charge, enabling a quick response.

[2372] Ordering Phase

[2373] In the ordering phase, the user moves to the purchase order creation screen and enters the order information (order details, quantity, unit price, etc.). The server checks the entered information for any errors. The server generates a purchase order based on the order information and sends it to the specified vendor by email.

[2374] For example, when a user orders consumables, they log in to the system and enter the necessary information. The server then verifies the information, automatically generates a purchase order, and sends it to the supplier, automating the ordering process.

[2375] Inspection phase

[2376] In the inspection phase, the user receives the delivered goods and inspects the quality and quantity. When the user enters the inspection results into the system, the server saves the entered inspection results in the database. The server then sends a notification of inspection completion to the relevant person in charge and the vendor.

[2377] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies the relevant parties that the inspection has been completed, improving the transparency and efficiency of operations.

[2378] Use cases and prompts for generative AI models

[2379] Usage example

[2380] 1. When a user wants to order materials for a new project, they log into the system, enter the necessary information, and the server automatically generates a purchase order and sends it to the relevant vendor.

[2381] 2. Remote workers can use the system to upload contracts and smoothly obtain approval from their superiors.

[2382] Example prompts for generative AI models

[2383] "Use this prompt to explain the process for creating a request for approval in your accounting system. For example, explain the detailed steps a user would take to create a request for approval to purchase new equipment."

[2384] This system aims to reduce the workload of users by automating all accounting tasks, from approvals to contracts, orders, and inspections. In particular, it uses a high-performance server and the latest analysis engine for various data processing, improving accuracy and efficiency.

[2385] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2386] Approval phase

[2387] Step 1:

[2388] A user logs in to the system.

[2389] Input: User ID, Password

[2390] Operation: The device sends the entered authentication information to the server.

[2391] Output: The server returns the user authentication result.

[2392] Step 2:

[2393] The user moves to the approval request creation screen.

[2394] Input: User clicks

[2395] Operation: The server sends HTML data to the terminal to display the approval document creation screen.

[2396] Output: The terminal displays the approval request creation screen.

[2397] Step 3:

[2398] The user selects a template.

[2399] Input: Template selection operation

[2400] Operation: The terminal sends the selected template information to the server.

[2401] Output: The server returns the selected template content.

[2402] Step 4:

[2403] The user enters the required information.

[2404] Input: Equipment name, quantity, budget amount, reason for purchase, etc.

[2405] How it works: The device stores the information entered and sends it to the server when the user clicks the "Save" button.

[2406] Output: The server receives the information.

[2407] Step 5:

[2408] The user clicks the Save button.

[2409] Input: Click

[2410] Operation: The terminal sends the entered information to the server.

[2411] Output: The server stores the information in a database.

[2412] Step 6:

[2413] The server checks the entered information for errors.

[2414] Input: Information entered by the user

[2415] Behavior: The server validates the information and performs error checking.

[2416] Output: Error response or normal response

[2417] Step 7:

[2418] The server automatically generates an approval route.

[2419] Input: User's job title, department information, and input approval information

[2420] Action: The server runs the approval route algorithm to determine the appropriate approver.

[2421] Output: Generated approval route

[2422] Step 8:

[2423] The server sends a notification to the approver.

[2424] Input: Approval Route

[2425] Operation: The server processes the sending of email or internal notifications.

[2426] Output: A notification is sent.

[2427] Contract Phase

[2428] Step 1:

[2429] The user moves to the contract management screen.

[2430] Input: User clicks

[2431] Operation: The server sends HTML data to the terminal to display the contract management screen.

[2432] Output: The terminal displays the contract management screen.

[2433] Step 2:

[2434] The user uploads an agreement file.

[2435] Input: Contract file

[2436] Action: The device sends a file to the server.

[2437] Output: The server receives the file.

[2438] Step 3:

[2439] The server parses the file contents.

[2440] Input: Contract file

[2441] What it does: The server runs an OCR engine and extracts the file contents as text data.

[2442] Output: Extracted text data

[2443] Step 4:

[2444] The server extracts the necessary information.

[2445] Input: Text data

[2446] Operation: The server executes an algorithm to analyze and extract information such as the contract amount, contract period, and counterparty information.

[2447] Output: Extracted contract information

[2448] Step 5:

[2449] The server stores the extracted information in a database.

[2450] Input: Extracted contract information

[2451] Operation: The server processes the information and stores it in a database.

[2452] Output: Contract information stored in the database

[2453] Step 6:

[2454] The server sends a request to confirm the contract to the person in charge.

[2455] Input: Contact information, contract information

[2456] Action: The server runs a process that sends email or internal notifications.

[2457] Output: A notification is sent.

[2458] Ordering Phase

[2459] Step 1:

[2460] The user moves to the purchase order creation screen.

[2461] Input: User clicks

[2462] Operation: The server sends HTML data to the terminal to display the purchase order creation screen.

[2463] Output: The terminal displays the purchase order creation screen.

[2464] Step 2:

[2465] The user enters the order information.

[2466] Input: Product details, quantity, unit price, etc.

[2467] How it works: The device stores the information entered and sends it to the server when the user clicks the "Submit" button.

[2468] Output: The server receives the information.

[2469] Step 3:

[2470] The server verifies the information entered.

[2471] Input: Order information entered by the user

[2472] Action: The server validates the information and checks for any errors.

[2473] Output: Verification result (error response or normal response)

[2474] Step 4:

[2475] The server automatically generates a purchase order.

[2476] Input: Confirmed order information

[2477] Operation: The server runs an algorithm that generates a purchase order.

[2478] Output: Generated purchase order

[2479] Step 5:

[2480] The server sends the generated purchase order to the vendor.

[2481] Input: Generated purchase order, vendor information

[2482] Operation: The server processes the purchase order and sends it to the vendor via email.

[2483] Output: Purchase order submitted

[2484] Inspection phase

[2485] Step 1:

[2486] The user receives the delivery.

[2487] Input: Receipt of delivery

[2488] Action: The user inspects the delivery.

[2489] Output: Check the quality and quantity of the delivered items

[2490] Step 2:

[2491] The user enters the inspection results into the system.

[2492] Input: Inspection result (pass, fail, etc.)

[2493] Operation: The terminal sends the entered inspection results to the server.

[2494] Output: The server receives the acceptance result.

[2495] Step 3:

[2496] The server stores the input inspection results in a database.

[2497] Input: Inspection results

[2498] Operation: The server processes the inspection results and stores them in a database.

[2499] Output: Inspection results stored in the database

[2500] Step 4:

[2501] The server sends a notification that the inspection is complete.

[2502] Input: Inspection results, related person and vendor information

[2503] Action: The server runs a process that sends email or internal notifications.

[2504] Output: Completion notification sent

[2505] (Application example 1)

[2506] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2507] The approval, contract, ordering, and inspection processes at logistics centers often involve a lot of manual work and lack efficiency. In addition, inconsistencies and delays can occur at each stage, hindering the smooth progress of the entire business. Therefore, automating and integrating these processes is desirable, and there is a demand for improving the transparency and efficiency of operations.

[2508] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2509] In this invention, the server includes: a means for a user to select a request form template and input the necessary information; a means for the server to save the input information in a database and set an approval route; a means for the server to send an approval request to an approver; a means for a user to upload a contract to a management screen and for the server to analyze the content, extract the necessary information, and save it in a database; a means for the server to send a request to confirm the contract to a person in charge based on the extracted information; a means for a user to input order information into the system, for the server to check the information for any errors, generate a purchase order, and send it to a vendor; a means for a user to input inspection results into the server and save them in a database; and a means for the server to send an inspection completion notification to the relevant person in charge and a vendor. This automates the entire process of approval, contract, ordering, and inspection within a logistics center, making it possible to significantly improve the efficiency and transparency of operations.

[2510] A "requisition document" is a document prepared by a company or other organization to obtain approval for certain economic or business matters.

[2511] A "template" refers to a pre-prepared format that makes it easy to create a specific document or format.

[2512] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[2513] An "approval route" refers to the step-by-step process or path that a document such as a request form or contract takes to be approved.

[2514] "Approval Request" means a request sent to a specific person or department for approval.

[2515] "Inspection results" refers to the results reported after checking the quality and quantity of delivered goods or services.

[2516] "Notification" means a message or communication sent to inform interested parties of specific information.

[2517] A "contract" is a document that documents the formation and content of a contract and serves as legal evidence of the agreement between the parties to the contract.

[2518] "Analysis" is the process of examining the contents of data or documents in detail to clarify their structure and meaning.

[2519] "Order Information" refers to data or documents that describe the contents and conditions of an order.

[2520] A "purchase order" is a document created to place an order, which contains the order details, quantity, unit price, etc.

[2521] "Vendor" refers to a business or organization that provides a particular service or product.

[2522] A "smartphone" is a multi-function mobile phone that has mobile communication capabilities and can install and use a variety of applications.

[2523] "Wireless communication" refers to the technology of transmitting data using radio signals such as radio waves.

[2524] "Real time" means that processing occurs the instant an event occurs.

[2525] "Application" means software designed to perform a specific purpose or function.

[2526] This invention relates to a system that consistently supports, automates, and streamlines processes at logistics centers, from approval to contracts, orders, and inspections. This system uses a server and user devices (e.g., smartphones) to process each phase of the process via real-time wireless communication.

[2527] Hardware and software used

[2528] Server: Centralizes data storage, analysis, notification sending, etc. The server is built using Flask (a lightweight Python web framework).

[2529] Database: Used to manage and store large amounts of data. Uses SQLite.

[2530] Smartphone: Used as a terminal for users to input information for each process.

[2531] Communication technology: Wireless communication (e.g., Wi-Fi, Bluetooth) is used to send and receive data in real time.

[2532] Email sending library: Uses mtplib to send approval requests and notifications in email format.

[2533] Program processing overview

[2534] 1. Approval phase

[2535] The user opens the smartphone app, selects a template on the approval document creation screen, and enters the required information. The entered information is sent to the server and saved.

[2536] The server automatically generates an approval route based on the entered information and sends an email notification of the approval request to the approver.

[2537] 2. Contract Phase

[2538] The user uploads the contract file to the management screen. The server analyzes the file contents and extracts the necessary contract information (e.g., contract amount, contract period).

[2539] The extracted information is stored in a database and a request for contract confirmation is sent to the person in charge via email.

[2540] 3. Ordering Phase

[2541] The user enters order information on their smartphone and sends it to the server, which checks the integrity of the information and automatically generates a purchase order.

[2542] The generated purchase order is sent to the specified vendor via email.

[2543] 4. Inspection Phase

[2544] When the user receives the delivered goods, they inspect the quality and quantity and enter the inspection results into the server using a smartphone app.

[2545] The server stores the inspection results in a database and notifies the relevant personnel and vendors that the inspection has been completed.

[2546] Specific examples

[2547] For example, consider a scenario in which a user is creating a request to purchase a forklift. In this case, the user enters the following information into a smartphone app:

[2548] Equipment Name: "Forklift"

[2549] Quantity: 2

[2550] Budget: 3 million yen

[2551] Reason: "To improve on-site work efficiency"

[2552] Approver Email: "approver@example.com"

[2553] Once these are entered and the user clicks "Save," the system automatically saves the information to the database and sends an email notification to the approver. This operation ensures the approval process is efficient and improves business transparency.

[2554] Prompt Sentence Examples

[2555] The template for creating a request for approval to purchase a new forklift for a distribution center includes the following information:

[2556] Equipment Name: "Forklift"

[2557] Quantity: 2

[2558] Budget: 3 million yen

[2559] Reason: "To improve on-site work efficiency"

[2560] Approver Email: "approver@example.com"

[2561] In this way, by integrating and automating the entire process of approval, contracts, orders, and inspections within the logistics center, it is possible to significantly improve the efficiency of the entire business.

[2562] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2563] Step 1:

[2564] The user opens the smartphone app, selects a template on the approval request creation screen, and enters the required information.

[2565] Input: Facility name, quantity, budget, reason, approver email

[2566] What happens: The user enters this information into a form within the app and presses the "Save" button.

[2567] Output: The entered information is sent to the server.

[2568] Step 2:

[2569] The server stores the entered information in a database.

[2570] Input: Request information sent in Step 1

[2571] How it works: The server parses the data it receives and stores it in an SQLite database.

[2572] Output: The approval request information is saved in the database.

[2573] Step 3:

[2574] The server automatically generates an approval route based on the input information and sends an approval request to the approver by email.

[2575] Input: Approval information stored in the database, approver email

[2576] Operation: The server generates an approval route and sends an approval request email using smtplib.

[2577] Output: An email requesting approval of the request form will be sent to the approver.

[2578] Step 4:

[2579] The user uploads the contract file to the admin panel.

[2580] Input: Contract file

[2581] How it works: The user uploads a contract file and presses the "Analyze" button. The contract file is sent to the server.

[2582] Output: The contract file is sent to the server.

[2583] Step 5:

[2584] The server analyzes the contents of the contract file, extracts the necessary information, and stores it in a database.

[2585] Input: Uploaded agreement file

[2586] How it works: The server parses the contract file, extracts information such as the contract amount and contract period, and stores it in a database.

[2587] Output: The extracted contract information is stored in a database.

[2588] Step 6:

[2589] The server sends an email to the person in charge requesting confirmation of the contract based on the contract information.

[2590] Input: Contract information stored in the database

[2591] Action: The server sends a confirmation email to the person in charge.

[2592] Output: An email requesting confirmation of the contract is sent to the person in charge.

[2593] Step 7:

[2594] The user enters order information into the smartphone app and sends it to the server.

[2595] Input: Product name, quantity, unit price, delivery deadline

[2596] How it works: The user enters this information into the form in the app and presses the "Place Order" button. The order information is sent to the server.

[2597] Output: The order information is sent to the server.

[2598] Step 8:

[2599] The server checks the consistency of the order information and automatically generates a purchase order.

[2600] Input: Submitted order information

[2601] How it works: The server verifies the integrity of all items and generates a purchase order based on the information.

[2602] Output: The automatically generated purchase order is saved as internal data.

[2603] Step 9:

[2604] The server sends the generated purchase order to the specified vendor by email.

[2605] Input: Auto-generated purchase order, vendor email address

[2606] What happens: The server sends a purchase order to the vendor's email address.

[2607] Output: A purchase order is sent to the vendor.

[2608] Step 10:

[2609] The user inspects the quality and quantity of the delivered items and enters the inspection results into a smartphone app.

[2610] Input: Inspection results (e.g. quality status, received quantity)

[2611] Operation: The user enters the inspection results into the form in the app and presses the "Save" button. The inspection results are sent to the server.

[2612] Output: The inspection result is sent to the server.

[2613] Step 11:

[2614] The server stores the inspection results in a database and sends an inspection completion notification by email to the relevant person in charge and the contractor.

[2615] Input: Submitted acceptance result

[2616] Operation: The server saves the inspection results in a database and sends an email to the relevant person in charge and the vendor notifying them of the completion of the inspection.

[2617] Output: Notification of completion of inspection is sent to the person in charge and the vendor.

[2618] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2619] This invention combines a system that consistently supports accounting work, from approval to contract, ordering, and acceptance inspection, with an emotion engine that recognizes the user's emotions. This system automates and streamlines the processes in each phase of accounting work, and can provide appropriate support based on the user's emotional state.

[2620] Approval phase

[2621] Program processing

[2622] 1. The user logs in to the system and opens the approval request creation screen.

[2623] 2. The user selects a request form template from the provided templates and enters the required information.

[2624] 3. When the user clicks the "Save" button, the server saves the entered information to the database.

[2625] 4. The emotion engine evaluates the user's emotional state based on their input and facial expression data.

[2626] 5. The server automatically generates an approval route based on the user's position and department and sends an approval request.

[2627] 6. The emotional engine provides appropriate guidance and support based on the user's emotional state.

[2628] Specific examples

[2629] For example, when a user creates a request for approval to purchase new equipment, they select a template and enter the name, quantity, budget, and reason for the equipment to be purchased. If the emotion engine analyzes the user's input speed and facial expression and determines that the user is tired, a notification prompting them to take a break will be displayed within the system. When the user saves the request, the server saves the information in a database and sends notifications to the necessary approvers based on the approval route.

[2630] Contract Phase

[2631] Program processing

[2632] 1. The user navigates to the contract management screen.

[2633] 2. The user uploads the agreement file.

[2634] 3. The server receives the file, analyzes its contents, and extracts the necessary information.

[2635] 4. The emotion engine evaluates the user's emotional state and displays a relaxation guide if it detects stress.

[2636] 5. The server stores the extracted information in a database and sends a request for contract confirmation to the person in charge.

[2637] Specific examples

[2638] For example, when a user uploads a contract file to the system when signing a new contract, the server automatically analyzes the contents and extracts important contract information such as the contract amount, contract period, and counterparty information. At that time, the emotion engine monitors the user's facial expressions and operation history, and if it determines that the user is anxious, it displays a psychological support message within the system. This makes it easier for the person in charge to quickly check the contract contents.

[2639] Ordering Phase

[2640] Program processing

[2641] 1. The user navigates to the purchase order creation screen.

[2642] 2. The user enters the order information.

[2643] 3. The server checks the entered information to see if there are any errors.

[2644] 4. The emotion engine assesses the user's emotional state and provides additional information if there is uncertainty.

[2645] 5. The server generates a purchase order based on the order information and sends it to the specified vendor.

[2646] Specific examples

[2647] For example, when a user enters the necessary information to order consumables, the server verifies the information, automatically generates a purchase order, and sends it to the supplier. If the emotion engine detects that the user is confused while entering information, the system will display appropriate input guidance to support the user.

[2648] Inspection phase

[2649] Program processing

[2650] 1. The user receives the delivery and inspects the quality and quantity.

[2651] 2. The user enters the inspection results into the system.

[2652] 3. The server saves the entered inspection results in the database.

[2653] 4. The emotion engine evaluates the user's emotional state and provides appropriate feedback.

[2654] 5. The server sends a notification of inspection completion to the relevant personnel and vendors.

[2655] Specific examples

[2656] For example, after a product ordered by a user is delivered and inspected, the inspection results are entered into the system. The server stores the information in a database and notifies relevant parties that the inspection has been completed. If the emotion engine detects that the user is feeling stressed during the inspection process, it displays a notification encouraging the user to relax, thereby reducing the user's psychological burden.

[2657] In this way, by incorporating an emotion engine that provides appropriate support based on the user's emotional state, the system of the present invention can consistently support each phase of accounting work, significantly improving work efficiency and user comfort.

[2658] The processing flow will be explained below.

[2659] I understand. Below, I will explain the process step by step.

[2660] Approval phase

[2661] Program processing

[2662] Step 1:

[2663] The user logs in to the system and opens the approval request creation screen.

[2664] Step 2:

[2665] The user selects a template for the approval document from the templates provided.

[2666] Step 3:

[2667] The user enters the required information (purpose, content, amount, attachments, etc.).

[2668] Step 4:

[2669] The emotion engine detects the user's facial expression and operation speed when inputting and evaluates their emotional state.

[2670] Step 5:

[2671] The user clicks the Save button.

[2672] Step 6:

[2673] The server stores the entered information in a database.

[2674] Step 7:

[2675] The server automatically generates an approval route based on the user's position and department.

[2676] Step 8:

[2677] The server sends emails and in-system notifications to the configured approvers, requesting their approval.

[2678] Step 9:

[2679] The emotion engine displays notifications encouraging stress reduction and breaks based on the user's emotional state.

[2680] Contract Phase

[2681] Program processing

[2682] Step 1:

[2683] The user moves to the contract management screen.

[2684] Step 2:

[2685] The user uploads an agreement file.

[2686] Step 3:

[2687] The server receives the file and parses its contents.

[2688] Step 4:

[2689] The server extracts the necessary information (contract amount, contract period, counterparty information, etc.) from the analysis results.

[2690] Step 5:

[2691] The emotion engine monitors the user's facial expressions and operating status to evaluate their emotional state.

[2692] Step 6:

[2693] If the emotion engine detects that the user is feeling stressed, it will display relaxation guidance and psychological support messages.

[2694] Step 7:

[2695] The server stores the extracted information in a database.

[2696] Step 8:

[2697] The server sends a request for contract confirmation to the person in charge.

[2698] Ordering Phase

[2699] Program processing

[2700] Step 1:

[2701] The user moves to the purchase order creation screen.

[2702] Step 2:

[2703] The user enters order information (order details, quantity, unit price, etc.).

[2704] Step 3:

[2705] The emotion engine monitors the user's facial expressions and operation speed while they are typing to evaluate their emotional state.

[2706] Step 4:

[2707] The server checks the entered information to see if there are any errors.

[2708] Step 5:

[2709] The server generates a purchase order based on the order information.

[2710] Step 6:

[2711] The server generates a purchase order and sends it to the designated vendor via email.

[2712] Step 7:

[2713] If the emotion engine detects a user's uncertainty or anxiety, it will display additional input guidance and support messages.

[2714] Inspection phase

[2715] Program processing

[2716] Step 1:

[2717] The user receives the delivered goods and inspects the quality and quantity.

[2718] Step 2:

[2719] The user enters the inspection results into the system.

[2720] Step 3:

[2721] The emotion engine monitors the user's facial expressions and operating status to evaluate their emotional state.

[2722] Step 4:

[2723] The server stores the input inspection results in a database.

[2724] Step 5:

[2725] The server sends a notification of the completion of the inspection to the relevant person in charge and the vendor.

[2726] Step 6:

[2727] If the emotion engine detects that the user is feeling stressed, it will display a notification encouraging them to relax.

[2728] In this way, by evaluating the user's emotional state in real time at each phase and providing appropriate support, a system can be realized that improves the efficiency of accounting work and user comfort.

[2729] Example 2

[2730] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2731] Conventional accounting support systems have been required to automate and streamline each phase of the process, from creating approval documents to signing contracts, placing orders, and inspecting acceptance. However, they lacked adequate support that took into account the user's emotional state. This often led to users feeling stressed and fatigued, which could lead to reduced work efficiency. Therefore, a system that can evaluate the user's emotional state in real time and provide appropriate support is needed.

[2732] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to select a template for a request for approval and input necessary information, a means for saving the input information in a database and setting an approval route, a means for sending an approval request to an approver, a means for providing an emotion engine that evaluates the user's emotional state from the user's input operations and facial expression data and provides appropriate guidance and support based on the user's emotional state, a means for inputting the inspe...

Claims

1. A means for users to select a template for a request form and enter the necessary information, A means for the server to store the input information in a database and set up an approval route; A means for the server to send an approval request to the approver; A means for inputting the inspection results into a server and storing them in a database; A means for the server to send a notification of completion of inspection to the relevant person in charge and the vendor; A system including:

2. 2. The system according to claim 1, further comprising: means for uploading and analyzing the contract; means for the server to store the analyzed contract data in a database; and means for sending a request to confirm the contract to the person in charge.

3. 2. The system of claim 1, further comprising: means for a user to input order information and for a server to verify the information and generate a purchase order; and means for the server to transmit the generated purchase order to a vendor.

Images