system

Abstract

A system is provided.SOLUTION: A system, comprising: means for inputting postal information based on a destination address, sender information, and a type of a mail piece; means for transmitting the postal information to a server; means for the server calling an API of a post office and issuing a management number based on the transmitted postal information; means for the server storing the issued management number and the postal information in a database; means for returning the management number to a terminal and displaying the management number to a user; and means for the server periodically calling the API of the post office, acquiring tracking information associated with each management number, and updating the database.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Postal work involves many manual operations, which take a great deal of time and effort. In particular, the issuance of registered mail numbers, obtaining control numbers, and checking tracking information are often done manually, making it difficult to process efficiently. This not only slows down work, but also increases the likelihood of errors and data duplication. [Means for solving the problem]

[0005] In order to solve this problem, the present invention provides the following system.

[0006] It has a means for inputting postal information based on the destination address, sender information, and type of mail. It has a means for sending postal information to a server. It includes a means for the server to call the post office's API and issue a control number based on the sent postal information. The server has a means for saving the issued control number and postal information in a database and returning the control number to the terminal to display it to the user. It also has a means for the server to periodically call the post office's API, obtain tracking information related to each control number, and update the database. It also includes a means for the user to check the tracking information from the terminal.

[0007] Furthermore, the terminal has a means for sending postal information to the server using a secure communication protocol, and the server has a means for using a batch job or scheduling tool to periodically call the post office's API, thereby making postal operations more efficient.

[0008] "Destination address" is information that includes the name, address, and postal code of the person receiving the mail.

[0009] "Sender information" is information that includes the name, address, and zip code of the person sending the mail.

[0010] "Type of mail" is information indicating the classification of the mail being sent, examples of which include registered mail and regular mail.

[0011] "Postal information" is a collective term for data including destination address, sender information, and mail type.

[0012] A "terminal" is an electronic device used by a user to enter and review postal information. Examples include a personal computer or smartphone.

[0013] A "server" is a computer system on a network that receives and processes postal information sent from terminals.

[0014] "Control Number" means a unique identification code issued for the purpose of tracking and managing mail.

[0015] "API" means an application programming interface for communicating with other software programs and performing specific functions.

[0016] A "secure communication protocol" is a communication rule for securely sending and receiving data, and an example of this is HTTPS.

[0017] A "database" is an information system for storing and managing structured data.

[0018] "Tracking information" is information that includes the current status, location information, and timestamp of the mailpiece associated with the control number.

[0019] A "batch job" is a batch processing program for automatically executing a series of processes.

[0020] A "scheduling tool" is software that automatically executes tasks based on specific times or events. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6]FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0022] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0023] First, the terms used in the following description will be explained.

[0024] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0025] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0026] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0027] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0028] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0029] [First embodiment]

[0030] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0031] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0032] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0033] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0034] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0035] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0036] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0037] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0038] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0039] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0040] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0041] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0042] The present invention relates to a system for automating the process of issuing mail numbers, acquiring control numbers, and acquiring tracking information. Specific embodiments will be described below.

[0043] 1. Enter your postal information

[0044] The user uses the terminal to enter the destination address, sender information, and mail type.

[0045] For example, a user enters the following information into a terminal:

[0046] Destination address: recipient's name, address, and postal code

[0047] Sender information: sender's name, address, and postal code

[0048] Type of mail: Simple registered mail, regular mail, etc.

[0049] 2. Sending data to the server

[0050] The terminal transmits the entered postal information to the server.

[0051] Data is transmitted securely using secure communication protocols (e.g. HTTPS).

[0052] 3. Issuing and saving the control number

[0053] The server calls the post office's API and requests the issuance of a control number based on the submitted postal information.

[0054] For example, by sending an HTTP POST request to an API endpoint.

[0055] The server receives the control number returned from the API and stores it in a database.

[0056] 4. Return and display of control number

[0057] The server returns the acquired control number to the terminal and displays it to the user.

[0058] As a specific example, the issued control number "EX123456789JP" is displayed on the terminal screen so that the user can confirm it.

[0059] 5. Regular tracking updates

[0060] The server periodically calls the post office's API to retrieve the tracking information associated with each control number.

[0061] For example, set up a batch job that causes the server to call the API every hour.

[0062] The acquired tracking information is updated in the database.

[0063] 6. Check your tracking information

[0064] The user enters the control number on the terminal and checks the latest tracking information.

[0065] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[0066] The terminal displays tracking information, allowing users to check the current location and status of their mail.

[0067] Specific examples

[0068] Consider a scenario where a user wants to send an important document by registered mail.

[0069] The user enters the following information into the terminal:

[0070] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[0071] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[0072] Type of mail: Simple registered mail

[0073] The device sends the input information to the server, for example in JSON format like this:

[0074] json

[0075] {

[0076] "recipient_name": "Recipient name",

[0077] "recipient_address": "1-1-1 Yotsuya, Shinjuku-ku, Tokyo",

[0078] "recipient_postal_code": "160-0004",

[0079] "sender_name": "sender name",

[0080] "sender_address": "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture",

[0081] "sender_postal_code": "231-0023",

[0082] "mail_type": "Registered mail"

[0083] }

[0084] The server sends a request to the post office's API and obtains the control number "EX123456789JP".

[0085] The server stores the control number in a database and returns the control number to the terminal.

[0086] The terminal displays this control number to the user, who then mails the mail based on the control number.

[0087] The server periodically calls the post office's API to retrieve tracking information related to the control number and update it in the database.

[0088] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[0089] Through this series of steps, postal operations will be automated, improving work efficiency and reducing errors.

[0090] The processing flow will be explained below.

[0091] Step 1:

[0092] The user uses the terminal to input the destination address, sender information, and type of mail, such as the recipient's name, address, and postal code, the sender's name, address, and postal code, and the type of mail (e.g., registered mail).

[0093] Step 2:

[0094] The terminal sends the entered postal information to the server. The terminal uses a secure communication protocol (e.g., HTTPS) to securely transmit the data to the server. The data is sent in a structured data format, such as JSON.

[0095] Step 3:

[0096] The server receives the postal information and prepares it to call the post office's API. Specifically, it converts the received postal information into a data format for the API request.

[0097] Step 4:

[0098] The server sends a request to the post office API to issue a control number. The request is sent using an HTTP POST request, including the necessary postal information.

[0099] Step 5:

[0100] The server receives the response from the post office API and extracts the control number. The response data is returned in JSON format, and the server obtains the control number from that.

[0101] Step 6:

[0102] The server stores the control number and associated postal information in a database, using an SQL query to store information such as the control number, destination address, sender information, and mail type.

[0103] Step 7:

[0104] The server returns the control number to the terminal, which then displays the received control number to the user so that the user can confirm it.

[0105] Step 8:

[0106] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number. For example, a batch job or scheduling tool could be used to send an API request every hour.

[0107] Step 9:

[0108] The server updates the database with the tracking information it has acquired, specifically by running SQL queries to update information such as the last location, status, and timestamp.

[0109] Step 10:

[0110] The user enters the control number on the terminal and checks the latest tracking information. The terminal sends the control number to the server, which retrieves the tracking information from the database and returns it to the terminal. The terminal then displays the latest tracking information to the user.

[0111] Example 1

[0112] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0113] In conventional mailing procedures, issuing control numbers and checking tracking information is done manually, which results in low work efficiency and a high likelihood of errors. Furthermore, issuing control numbers and obtaining tracking information often takes time, which can be inconvenient for users. There was a need to solve these problems and improve the efficiency of mailing operations while reducing errors.

[0114] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0115] In this invention, the server includes: means for inputting postal information based on a destination address, sender information, and type of mail; means for transmitting the postal information to the server; means for the server to call an API of a postal service and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to the terminal and displaying it to the user; means for the server to periodically call an API of a postal service to obtain tracking information associated with each control number and update the database; means for the user to check the tracking information from the terminal; means for the terminal to convert the input data into JSON format and send it to the server; means for the server to obtain the control number using an authentication token of the API of the postal service; and means for the server to periodically call the API using a scheduling service. This makes it possible to automate processes from inputting postal information to issuing a control number and checking tracking information.

[0116] "Destination address" refers to information such as the name, address, and postal code of the recipient of the mail.

[0117] "Sender information" refers to information such as the name, address, and postal code of the sender of the mail.

[0118] "Type of mail" refers to the type of mailing method or service, such as registered mail or regular mail.

[0119] "Postal Information" refers to information about a mail item, including the destination address, sender information, and type of mail item.

[0120] "Terminal" refers to an electronic device through which a user enters postal information and communicates with a server.

[0121] "Server" refers to the computer system that receives and processes postal information and calls various APIs.

[0122] "API" refers to an application program interface that provides specific functionality.

[0123] "Control Number" means a unique identification number used for tracking and managing mail.

[0124] "Database" refers to an information management system for storing acquired postal information, control numbers, and tracking information.

[0125] "JSON format" is an abbreviation for JavaScript Object Notation, and refers to a lightweight text format for structuring and displaying data.

[0126] A "secure communication protocol" refers to a communication protocol that ensures the safety of data transmission. A specific example is HTTPS.

[0127] "Scheduling service" refers to technology for executing tasks or jobs at specific times or intervals.

[0128] An "authentication token" refers to data that contains information used to identify a user and verify their permissions when accessing a service such as an API.

[0129] "Tracking Information" means information including the current location and status of a mail piece associated with a control number.

[0130] The present invention relates to a system that automates the process of sending mail, obtaining control numbers, and obtaining tracking information. This system inputs postal information based on the destination address, sender information, and type of mail, and sends it to a server. The server then calls the postal service's API to issue a control number. The issued control number and postal information are then stored in a database, and the control number is returned to the terminal and displayed to the user. The server also periodically calls the postal service's API to obtain tracking information associated with each control number and update the database. Finally, the user can check the tracking information from their terminal.

[0131] Hardware and Software Configuration

[0132] The system uses the following hardware and software:

[0133] Devices: General personal computers, smartphones, tablets, etc.

[0134] Server: A computer system with high-performance processing power. It can also be implemented on cloud servers such as Amazon Web Services (AWS) or Microsoft Azure.

[0135] Database: A relational database system such as MySQL or PostgreSQL.

[0136] Program processing

[0137] 1. Enter your postal information

[0138] Users use the terminal to enter the recipient's address, sender information, and mail type through a web browser or a dedicated application.

[0139] 2. Data transmission

[0140] The terminal converts the entered postal information into JSON format and sends it to the server using a secure communication protocol (e.g., HTTPS).

[0141] 3. Issuing and saving the control number

[0142] The server calls the postal service's API and requests the issuance of a control number based on the postal information. The API call uses an authentication token.

[0143] The server receives the control number returned from the API (for example, "EX123456789JP") and stores it in a database.

[0144] 4. Return and display of control number

[0145] The server returns the acquired control number to the terminal and displays it to the user. The terminal then displays this control number on its user interface.

[0146] 5. Regular tracking updates

[0147] The server uses a scheduling service to call the postal service's API, say every hour, to retrieve the latest tracking information associated with each control number.

[0148] The server updates the acquired tracking information to a database.

[0149] 6. Check your tracking information

[0150] The user enters the control number on the terminal and checks the latest tracking information.

[0151] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal, which displays the tracking information and allows the user to check the current location and status of the mail item.

[0152] Specific examples

[0153] Consider a scenario where a user wants to send an important document by registered mail.

[0154] The user enters the following information into the terminal:

[0155] Address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004

[0156] Sender information: 2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023

[0157] Type of mail: Simple registered mail

[0158] The terminal sends the input information to the server, for example in the following text format:

[0159] Address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004

[0160] Sender information: 2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023

[0161] Type of mail: Simple registered mail

[0162] The server sends a request to the postal service's API and obtains the control number "EX123456789JP".

[0163] The server stores the control number in a database and returns it to the terminal, which displays the control number to the user, who then mails the item based on the control number.

[0164] The server periodically calls the postal service's API to retrieve tracking information related to the control number and update the database.

[0165] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: YYYY-MM-DDTHH:MM:SSZ."

[0166] In this way, the system can automate mailing operations efficiently and accurately.

[0167] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0168] Step 1:

[0169] Enter your postal information

[0170] The user uses the terminal to enter the destination address, sender information, and mail type.

[0171] What happens: The user accesses a form displayed on the device screen and manually enters the following information:

[0172] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[0173] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[0174] Mail type: "Registered mail"

[0175] Input: Destination address, sender information, mail type

[0176] Output: Postal information entered

[0177] Step 2:

[0178] Sending data

[0179] The terminal converts the entered postal information into JSON format and sends it to the server.

[0180] What it does: The device takes the postal information entered by the user and converts it into the following JSON format:

[0181] json

[0182] {

[0183] "recipient_name": "Recipient name",

[0184] "recipient_address": "1-1-1 Yotsuya, Shinjuku-ku, Tokyo",

[0185] "recipient_postal_code": "160-0004",

[0186] "sender_name": "sender name",

[0187] "sender_address": "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture",

[0188] "sender_postal_code": "231-0023",

[0189] "mail_type": "Registered mail"

[0190] }

[0191] This data is sent to the server using the HTTPS protocol.

[0192] Input: Postal information entered by the user

[0193] Output: Postal information sent to the server in JSON format

[0194] Step 3:

[0195] Issuing and saving the control number

[0196] The server calls the postal service's API and makes a request to issue a control number based on the postal information.

[0197] Specific operation: The server sends an HTTP POST request to the postal service's API endpoint based on the received JSON data, including the API key and authentication token.

[0198] Input: JSON postal information, API key, and authentication token

[0199] Output: Obtained control number (e.g. "EX123456789JP")

[0200] Step 4:

[0201] Save control number

[0202] The server stores the acquired control number and postal information in a database.

[0203] Specific operation: The server executes an INSERT statement into the database, saving the control number and related postal information as a single record. The database can be MySQL or PostgreSQL.

[0204] Input: Obtained control number, postal information

[0205] Output: Control number and postal information stored in the database

[0206] Step 5:

[0207] Return and display of control number

[0208] The server returns the acquired control number to the terminal and displays it to the user.

[0209] Specific operation: The server generates a JSON response including the control number and sends it to the device using the HTTPS protocol. The device receives the response and displays it in the user interface. Example: "Control number: EX123456789JP"

[0210] Input: Obtained control number

[0211] Output: Control number returned to the terminal

[0212] Step 6:

[0213] Regular tracking updates

[0214] The server uses a scheduling service to periodically call the postal service's API to retrieve tracking information associated with each control number and update the database.

[0215] Specific operation: Set up a scheduling service such as a cron job on the server to send a request to the API endpoint every hour. Execute an UPDATE statement to update the acquired tracking information in the database.

[0216] Input: Each control number

[0217] Output: Updated tracking information

[0218] Step 7:

[0219] Check tracking information

[0220] The user enters the control number on the terminal and checks the latest tracking information.

[0221] Specific operation: The user enters the control number in the input field displayed on the terminal and clicks the "Check tracking information" button. The terminal receives this input and sends a request in JSON format to the server.

[0222] Input: Control Number

[0223] Output: Request sent to the server

[0224] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[0225] Specific operation: The server executes a SELECT statement on the database to obtain the latest tracking information associated with the specified control number, creates a JSON response containing the obtained tracking information, and sends it to the terminal.

[0226] Input: Control Number

[0227] Output: Retrieved tracking information

[0228] The terminal displays tracking information, allowing users to check the current location and status of their mail.

[0229] Specific operation: The device parses the JSON response received from the server and displays the information on the user interface. Example: "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: YYYY-MM-DDTHH:MM:SSZ".

[0230] Input: Retrieved tracking information

[0231] Output: Displayed tracking information

[0232] The above are the specific processing steps of the present invention. Through this series of steps, mailing operations can be automated efficiently and accurately.

[0233] (Application example 1)

[0234] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0235] In modern logistics facilities, product management and tracking are often inefficient, leading to human error and delays in management information. This results in poor tracking accuracy and lower customer satisfaction. Furthermore, the inability to respond quickly to important status changes calls for operational efficiency improvements.

[0236] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0237] In this invention, the server includes: means for inputting postal information based on the destination address, sender information, and type of mail; means for transmitting the postal information to the server; means for the server to call a post office API and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to a terminal and displaying it to a user; means for the server to periodically call a post office API to obtain tracking information associated with each control number and update the database; means for a user to check the tracking information from a terminal; means for a logistics facility to scan a barcode to obtain product information and input delivery destination and sender information; means for transmitting the product information and delivery information to the server and obtaining a control number; means for the server to update the tracking information in real time and notify important status changes via push notifications. This enables more efficient product management and tracking at logistics facilities, reduces human error, improves tracking accuracy, and increases customer satisfaction.

[0238] "Destination address" is information indicating the location where mail or merchandise is to be sent.

[0239] "Sender information" refers to information such as the name and address of the person sending the mail or product.

[0240] "Type of mail" is a category that indicates the format or service in which the mail is sent (e.g., registered mail, regular mail).

[0241] "Postal information" is a collection of detailed information such as the destination address, sender information, and type of mail.

[0242] "Server" means the part of the computer system that processes postal information and manages control numbers and tracking information.

[0243] "API" stands for Application Programming Interface, a specification that allows different software systems to communicate with each other.

[0244] "Control number" means a unique identifier issued for the purpose of tracking and managing mail or merchandise.

[0245] A "database" is a system for systematically storing and managing data such as postal information and control numbers.

[0246] A "terminal" is a device (e.g., smartphone, computer) that a user uses to enter information and view results.

[0247] "Tracking information" is detailed information about the current location and delivery status of mail or goods.

[0248] "User" means a person who uses this system to manage mail and product information.

[0249] A "logistics facility" is a place where goods are stored, sorted, and shipped.

[0250] A "barcode" is a visual identification code for machine-readable product information.

[0251] "Scanning" is the process of optically reading a barcode and capturing the information as digital data.

[0252] "Tracking accuracy" refers to the ability to accurately determine the location and status of mail or goods.

[0253] "Push notification" is a technology that allows applications to notify users of important information in real time.

[0254] "Managing goods at a logistics facility" means efficiently carrying out a series of operations, including receiving, storing, picking, and shipping goods.

[0255] "Human error" refers to mistakes or errors that people make while working.

[0256] The present invention relates to a system for improving the efficiency of product management and tracking in a logistics facility. Specific embodiments will be described below.

[0257] 1. Enter shipping address and sender information

[0258] The user uses the terminal to input the delivery address, sender information, and product type. Specifically, the user uses a smartphone app to input detailed product information, the delivery address, and sender information.

[0259] 2. Obtaining product information

[0260] At the logistics facility, users use their smartphones to scan product barcodes, which automatically enters product information into the app.

[0261] 3. Sending data to the server

[0262] The terminal sends the entered product information and delivery information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the data is transmitted safely.

[0263] 4. Issuing and saving the control number

[0264] The server calls the API of the logistics system and issues a control number based on the product information and delivery information sent. The server receives the control number returned from the API and stores it in a database.

[0265] 5. Return and display of control number

[0266] The server returns the acquired control number to the terminal and displays it to the user. For example, the issued control number "LM123456789DN" is displayed on the terminal screen so that the user can confirm it.

[0267] 6. Regular tracking updates

[0268] The server periodically calls the API of the logistics system to obtain tracking information related to each control number. A scheduling tool (e.g., a CRON job) is set up so that the server can call the API in real time. The obtained tracking information is then updated in the database.

[0269] 7. Tracking Information and Notifications

[0270] Users can enter the control number on their device to check the latest tracking information. The server retrieves the tracking information related to the control number from the database and returns it to the device. In addition, if an important status change occurs, the user will be notified via push notification.

[0271] Hardware and software used

[0272] Devices: Smartphones, tablets, laptops, etc.

[0273] Server: Cloud-based server, VPS, etc.

[0274] Software: Smartphone apps (e.g., iOS, Android apps), server-side programs (e.g., Node.js, Python), database management systems (e.g., MySQL, PostgreSQL), secure communication protocols (e.g., HTTPS), and scheduling tools (e.g., CRON jobs).

[0275] API: Logistics system API, post office API, etc.

[0276] Specific examples

[0277] Consider a scenario where a worker at a logistics facility scans the barcode of product "1234567890" with a smartphone app and sends the product to a specific address. The user uses the app to enter the recipient's name and address and obtains the control number "LM123456789DN." The control number is used to place the product in the logistics flow, and tracking information can be checked in real time. Additionally, if there are any important status changes, the worker can be notified via push notification.

[0278] Example prompts to input to a generative AI model:

[0279] "We would like to develop a smartphone app that will be useful in logistics facilities. This app will have functions such as barcode scanning, inputting delivery addresses, issuing control numbers, and managing tracking information. We would like to use the logistics system API to update tracking information in real time and send push notifications if there are any important status changes. Please generate the specific program part for this purpose."

[0280] This invention improves the efficiency of product management and tracking in logistics facilities, reducing human error, improving tracking accuracy, and increasing customer satisfaction.

[0281] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0282] Step 1:

[0283] The user scans the barcode of a product using a smartphone app. By scanning the barcode, product information is imported into the device as digital data. Input: Product barcode information. Output: Product information (e.g. product ID, name, quantity, etc.). Operation: The barcode is read using the smartphone camera, and the product information is analyzed from the barcode and displayed in the app.

[0284] Step 2:

[0285] The user enters the shipping address, sender information, and product type into the app. Input: Shipping address, sender information, and product type manually entered by the user. Output: A complete dataset of products with shipping information. Behavior: The user enters the required information into the app's input fields, which are then integrated within the app.

[0286] Step 3:

[0287] The terminal sends the entered product information and delivery information to the server. Input: Product information and delivery information. Output: JSON data sent to the server. Operation: The app sends information to the server using a secure communication protocol (HTTPS).

[0288] Step 4:

[0289] The server issues a control number based on the submitted product information and delivery information. Input: Product information and delivery information. Output: Control number. Operation: The server sends a request to the logistics system's API and obtains the control number.

[0290] Step 5:

[0291] The server saves the acquired control number in a database. Input: Control number and corresponding product information, delivery information. Output: Control number and related information saved in the database. Operation: The server writes information to the database.

[0292] Step 6:

[0293] The server returns the issued control number to the terminal and displays it to the user. Input: Control number. Output: Control number displayed on the terminal screen. Operation: The server sends the control number to the terminal, and the app displays it to the user.

[0294] Step 7:

[0295] The server periodically calls the API of the logistics system to obtain tracking information related to the control number. Input: Control number list. Output: Latest tracking information. Operation: The server periodically calls the API using a scheduling tool (e.g., CRON job) to obtain tracking information.

[0296] Step 8:

[0297] The server updates the database with the acquired tracking information. Input: Latest tracking information. Output: Updated database. Operation: The server writes the new tracking information to the database.

[0298] Step 9:

[0299] The user enters the control number on the device and checks the latest tracking information. Input: Control number. Output: Latest tracking information displayed on the device. Operation: The app sends the control number to the server, which retrieves the tracking information from the database and sends it back to the device.

[0300] Step 10:

[0301] The server notifies the user via push notification when an important status change occurs. Input: Tracking information status. Output: Push notification. Operation: The server detects the status change, generates a push notification and sends it to the device. This notification allows the user to receive important information in real time.

[0302] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0303] The present invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. Specific embodiments are described below.

[0304] 1. Enter your postal information

[0305] The user uses the terminal to enter the destination address, sender information, and mail type.

[0306] For example, a user enters the following information into a terminal:

[0307] Destination address: recipient's name, address, and postal code

[0308] Sender information: sender's name, address, and postal code

[0309] Type of mail: Simple registered mail, regular mail, etc.

[0310] 2. Use of Emotion Engine

[0311] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice while the user is typing, and uses an emotion engine to recognize the user's emotions.

[0312] The emotion engine analyzes the user's emotional data in real time and, if it detects that the user is feeling stressed, it will provide supportive messages and guidance. The emotion engine also adjusts the input screen interface in real time according to the user's emotions.

[0313] 3. Sending data to the server

[0314] The terminal transmits the input postal information and emotion data to the server.

[0315] The data is sent securely to the server using a secure communication protocol (e.g., HTTPS) and in a structured data format such as JSON.

[0316] 4. Issuing and saving the control number

[0317] The server receives the postal information and emotion data, prepares to call the post office's API, and converts the received postal information into a data format for the API request.

[0318] The server sends a request to the post office's API to issue a control number and receives the control number returned from the API.

[0319] 5. Saving to the database

[0320] The server stores the control number and associated postal and emotional data in a database for future reference and analysis.

[0321] 6. Return and display of control number

[0322] The server returns the acquired control number to the terminal and instructs the terminal to display it to the user.

[0323] The terminal displays the returned control number to the user so that the user can check it.

[0324] 7. Regular tracking updates

[0325] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number.

[0326] The server updates the acquired tracking information to a database by sending API requests at regular intervals using a batch job or scheduling tool.

[0327] 8. Check your tracking information

[0328] The user enters the control number on the terminal and checks the latest tracking information.

[0329] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[0330] The device displays the latest tracking information to the user.

[0331] Specific examples

[0332] Consider a scenario where a user wants to send an important document by registered mail.

[0333] The user enters the following information into the terminal:

[0334] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[0335] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[0336] Type of mail: Simple registered mail

[0337] The device sends the input information along with the user's emotions (e.g., if the user is feeling stressed) to the server. This data is transmitted using a secure communication protocol.

[0338] The server calls the post office's API, obtains the control number "EX123456789JP", and stores this data in the database.

[0339] The server returns the control number to the terminal, which then displays the control number to the user, who then mails the item based on that control number.

[0340] The server periodically calls the post office's API to retrieve the latest tracking information associated with the control number and update the database.

[0341] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[0342] Through this series of steps, not only is postal work automated, but the emotional engine also improves the user experience.

[0343] The processing flow will be explained below.

[0344] Step 1:

[0345] A user uses a terminal to enter a destination address, sender information, and the type of mail (e.g., registered mail). For example, the user enters the following data: "Destination address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo, 160-0004" and "Sender information: 2-2-2 Yamashita-cho, Naka-ku, Yokohama-shi, Kanagawa, 231-0023."

[0346] Step 2:

[0347] The device uses an emotion engine to analyze the user's facial expressions and tone of voice, recognizing the user's emotions (e.g., stress, joy, surprise, etc.) in real time and capturing that data.

[0348] Step 3:

[0349] If the emotion engine detects the user's stress level, the device will display a support message (e.g., "There's an easier way to input") to the user. If the emotion engine deems appropriate, it will also adjust the input screen interface to make input more comfortable for the user.

[0350] Step 4:

[0351] The device sends the entered postal information and emotion data to the server. This data is securely transmitted using a secure communication protocol (e.g., HTTPS). The transmitted data is in a structured data format such as JSON.

[0352] Step 5:

[0353] The server receives the postal information and emotion data. Based on the received data, it prepares to call the post office's API. The received data is converted into a data format for the API request.

[0354] Step 6:

[0355] The server sends a request to the post office API to issue a control number. The request is sent using an HTTP POST request, including the necessary postal information.

[0356] Step 7:

[0357] The server receives the response from the post office API, extracts the control number from the response data, and stores it in the system.

[0358] Step 8:

[0359] The server then stores the acquired control number and associated postal and emotional data in a database for future reference and analysis.

[0360] Step 9:

[0361] The server returns the control number to the terminal, which then displays this control number to the user so that the user can confirm it.

[0362] Step 10:

[0363] The server periodically calls the post office's API to retrieve the tracking information associated with each control number, using a batch job or scheduling tool to send requests every hour.

[0364] Step 11:

[0365] The server updates the database with the acquired tracking information, specifically by executing SQL queries to update the status, last location, and timestamp of the tracking information.

[0366] Step 12:

[0367] The user inputs the control number on the terminal to check the latest tracking information. The terminal sends the request to the server, which retrieves the latest tracking information from the database and returns it to the terminal.

[0368] Step 13:

[0369] The tracking information for the returned device is displayed to the user. For example, the user can see information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[0370] Example 2

[0371] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0372] Conventional mail numbering and tracking systems require users to manually enter information without considering their feelings, which can lead to input errors and increased effort. Furthermore, obtaining mail control numbers and tracking information is cumbersome, resulting in a poor user experience. Furthermore, there is a risk of information leaks due to insufficient consideration given to security.

[0373] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0374] In this invention, the server includes: means for inputting postal information based on the destination address, sender information, and type of mail; means for using an emotion engine that analyzes the user's facial expressions and tone of voice to acquire emotion data; means for transmitting the postal information and emotion data to the server; means for the server to call a post office API and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to the terminal and displaying it to the user; means for the server to periodically call the post office API to acquire tracking information associated with each control number and update the database; and means for the user to check the tracking information from the terminal. This automates and streamlines the process of mail numbering, acquiring control numbers, and periodically updating and checking tracking information, improving the user experience. Furthermore, the use of the emotion engine allows support messages and interfaces to be adjusted according to the user's emotions, further improving security.

[0375] "Postal Information" refers to data regarding destination address, sender information, and mail type.

[0376] An "emotion engine" refers to an analysis system that analyzes a user's facial expressions and tone of voice to recognize the user's emotions in real time.

[0377] "Terminal" refers to a device for a user to input information and a device for transmitting the input information to a server.

[0378] "Server" refers to the computer system that processes postal information and sentiment data, issues control numbers, stores them in a database, and updates and provides tracking information.

[0379] "Control number" refers to a unique identifier issued through the post office's API to identify a specific piece of mail.

[0380] "Database" refers to a data structure that stores postal information, emotion data, control numbers, and tracking information and allows for easy searching and updating.

[0381] "Secure communications protocol" refers to a communications method that includes encryption technology to ensure the secure transmission and reception of data.

[0382] A "batch job" refers to a series of processes that are executed automatically and periodically, and is used in particular to periodically call the post office's API.

[0383] A "scheduling tool" refers to software that configures certain tasks to be performed automatically at specified times or intervals.

[0384] "Tracking Information" refers to data containing the current status and location of a mail piece associated with a particular control number.

[0385] The present invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and further improves the user experience by using an emotion engine. Specific embodiments are described below.

[0386] 1. Enter your postal information

[0387] The user uses the terminal to enter the destination address, sender information, and mail type.

[0388] As an example, a user enters the following information into a terminal:

[0389] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[0390] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[0391] Type of mail: Simple registered mail

[0392] 2. Use of Emotion Engine

[0393] The device uses a camera and microphone to capture the user's facial expressions and tone of voice, and sends them to the emotion engine, which analyzes them in real time and generates the user's emotion data.

[0394] If the emotion engine recognizes that the user is feeling stressed, it displays support messages and guidance and adjusts the input screen interface.

[0395] 3. Sending data to the server

[0396] The terminal sends the entered postal information and emotion data to the server using a secure communication protocol (e.g., HTTPS). The sent data is structured data in JSON format.

[0397] 4. Issuing and saving the control number

[0398] The server converts the received postal information and emotion data into a data format for API requests and calls the post office's API.

[0399] The server sends a request to issue a control number to the post office's API and receives the control number in return.

[0400] 5. Saving to the database

[0401] The server stores the acquired control number and associated postal and emotion data in a database for future reference and analysis.

[0402] 6. Return and display of control number

[0403] The server returns the acquired control number to the terminal and displays it to the user.

[0404] The terminal displays the returned control number to the user so that the user can check it.

[0405] 7. Regular tracking updates

[0406] The server calls the post office's API at regular intervals to retrieve the latest tracking information associated with each control number and updates the database, using batch jobs and scheduling tools to accomplish this.

[0407] 8. Check your tracking information

[0408] The user enters the control number into the terminal to check the latest tracking information.

[0409] The server retrieves the relevant tracking information from the database and returns it to the terminal.

[0410] The terminal displays the latest tracking information to the user.

[0411] Specific examples and prompts for the generative AI model

[0412] Specific examples

[0413] Consider a scenario where a user wants to send an important document by registered mail.

[0414] The user enters the following information into the terminal:

[0415] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[0416] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[0417] Type of mail: Simple registered mail

[0418] The device sends the input information along with the user's emotional data (e.g., if the user is feeling stressed) to the server using a secure communication protocol.

[0419] The server calls the post office's API, obtains the control number "EX123456789JP", and stores this data in the database.

[0420] The server returns the control number to the terminal, which then displays the control number to the user, who then mails the item based on that control number.

[0421] The server periodically calls the post office's API to retrieve the latest tracking information associated with the control number and update the database.

[0422] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[0423] Example prompts for generative AI models

[0424] "Create a scenario in which a user sends a registered letter. The user enters the recipient address, sender information, and type of mail. Also include a scenario in which the emotion engine provides a supportive message to the user who is feeling stressed."

[0425] Through the system of the present invention, not only are mailing numbers, obtaining control numbers, and regular updates and confirmation of tracking information automated and efficient, but the use of an emotion engine also improves the user experience.

[0426] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0427] Step 1:

[0428] The user uses the terminal to enter postal information.

[0429] Input: Destination address, sender information, mail type

[0430] Output: Temporarily save input information

[0431] How it works: The user types in an address or other information on the keyboard, and the data appears in fields on the screen. The data is temporarily stored in memory.

[0432] Step 2:

[0433] The device uses a camera and microphone to capture the user's facial expressions and tone of voice.

[0434] Input: User's facial expressions, tone of voice

[0435] Output: Captured emotion data

[0436] How it works: The camera and microphone are activated to collect data in real time, which is then sent to the emotion engine API.

[0437] Step 3:

[0438] The emotion engine analyzes the user's emotion data.

[0439] Input: Captured emotion data

[0440] Output: Analysis results (e.g., whether the user is feeling stressed)

[0441] How it works: The emotion engine performs analysis in real time and returns the results in JSON format to the device.

[0442] Step 4:

[0443] The terminal receives the analysis results and displays a support message if necessary.

[0444] Input: Analysis results from the emotion engine

[0445] Output: Helpful message (if needed)

[0446] How it works: If it detects you are stressed, a message such as "Please stay calm when typing" will pop up.

[0447] Step 5:

[0448] The terminal transmits the input postal information and emotion data to the server.

[0449] Input: Postal information and emotion data

[0450] Output: Data sent to the server

[0451] How it works: Data is sent to the server in JSON format using the HTTPS protocol.

[0452] Step 6:

[0453] The server converts the received postal information and emotion data into a format suitable for API requests.

[0454] Input: Postal information and emotion data sent to the server

[0455] Output: Data format for API requests

[0456] What it does: The server converts the data into the appropriate JSON format.

[0457] Step 7:

[0458] The server calls the post office's API and issues a control number.

[0459] Input: Data format for API requests

[0460] Output: Retrieved control number

[0461] Operation: The server generates an API request and returns the control number "EX123456789JP".

[0462] Step 8:

[0463] The server stores the obtained control number and associated postal information and emotion data in a database.

[0464] Input: Control number, postal information, and emotion data

[0465] Output: Data stored in the database

[0466] What it does: Inserts data into a database using an SQL query.

[0467] Step 9:

[0468] The server returns the control number to the terminal and instructs it to be displayed to the user.

[0469] Input: Control number

[0470] Output: Control number returned to the terminal

[0471] Operation: Generates a management number in JSON format and sends it to the terminal via HTTPS protocol.

[0472] Step 10:

[0473] The terminal displays the returned control number to the user.

[0474] Input: Returned control number

[0475] Output: Control number displayed on the screen

[0476] Operation: The control number is displayed on the screen.

[0477] Step 11:

[0478] The server calls the post office's API at regular intervals to obtain the latest tracking information.

[0479] Input: Each control number

[0480] Output: Retrieved tracking information

[0481] How it works: Use a batch job or scheduling tool to send API requests and get the latest information.

[0482] Step 12:

[0483] The server updates the acquired tracking information to a database.

[0484] Input:Tracking information

[0485] Output: Updated database

[0486] Action: Updates the tracking information for that entry in the database.

[0487] Step 13:

[0488] The user enters the control number into the terminal and checks the latest tracking information.

[0489] Input: Control number

[0490] Output: Retrieved tracking information

[0491] Action: Enter the control number into the input form and click the submit button.

[0492] Step 14:

[0493] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[0494] Input: Control number

[0495] Output: Tracking information sent to the device

[0496] What it does: Searches the database and sends tracking information in JSON format to the device.

[0497] Step 15:

[0498] The device displays the latest tracking information to the user.

[0499] Input: Returned tracking information

[0500] Output: Tracking information displayed on screen

[0501] What it does: The screen will display "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[0502] (Application example 2)

[0503] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0504] In modern logistics centers, managing mail order and tracking information is important, but it is a labor-intensive and time-consuming task. Furthermore, when employees manually perform these tasks, fatigue and stress accumulate, resulting in reduced efficiency. Therefore, there is a need for a system that automates the management of mail order and tracking information while also analyzing employee emotions to improve the working environment.

[0505] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0506] In this invention, the server includes: a means for inputting postal information based on the destination address, sender information, and type of mail; a means for transmitting the postal information to the server; a means for the server to call a post office API and issue a control number based on the transmitted postal information; a means for analyzing the user's facial expression and tone of voice while inputting the postal information and acquiring emotional data; a means for the server to store the issued control number, postal information, and emotional data in a database; a means for returning the control number to the terminal and displaying it to the user; a means for the server to periodically call a post office API, acquire tracking information related to each control number, and update the database; a means for the user to check the tracking information on the terminal; and a means for analyzing the user's fatigue and stress and displaying a support message encouraging them to take a break as needed. This not only enables efficient mail management, but also provides a comfortable working environment by analyzing employees' emotional data and providing appropriate support.

[0507] "Destination address" refers to information such as the name, address, and postal code of the person receiving the mail.

[0508] "Sender information" refers to information such as the name, address, and postal code of the person sending the mail.

[0509] "Type of mail" indicates whether the mail is classified as a specific delivery method or type, such as registered mail, regular mail, or express mail.

[0510] "Postal information" refers to information including the destination address, sender information, and type of mail.

[0511] A "server" is a computer system that receives postal information and performs processes such as issuing control numbers, storing data, and obtaining tracking information.

[0512] "Smart glasses" are wearable devices that can acquire visual and audio information when worn by a user, and analyze and display it in real time.

[0513] "Emotion data" is data that indicates the user's emotional state, obtained from the user's facial expression, tone of voice, etc.

[0514] An "API" is an interface that a program uses to communicate with external services and resources.

[0515] A "control number" is a specific number issued to uniquely identify a mail item.

[0516] "Tracking information" is information that indicates the current location and delivery status of mail.

[0517] A "batch job" is a series of tasks or processes that are executed periodically.

[0518] A "scheduling tool" is software that automatically executes tasks at specific times or intervals.

[0519] A "secure communication protocol" is a standardized method for securely sending and receiving data, and HTTPS is commonly used.

[0520] A "terminal" is a device used by a user to enter or receive information.

[0521] This invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. Specific embodiments are described below.

[0522] System configuration and operation

[0523] 1. Enter your postal information

[0524] The user uses the smart glasses to enter the recipient address, sender information, and mail type. The user inputs the information using touch or voice commands, following the input form displayed on the smart glasses screen.

[0525] 2. Acquiring Emotion Data

[0526] While the user is entering information, the smart glasses' built-in camera and microphone analyze the user's facial expressions and tone of voice, which are then processed in real time by the emotion engine to obtain the user's emotional data.

[0527] 3. Sending data to the server

[0528] The device (smart glasses) sends the entered postal information and emotion data to the server. This communication is performed using a secure protocol (e.g., HTTPS). The data is sent in a structured data format such as JSON.

[0529] 4. Issuing and saving the control number

[0530] The server calls the post office's API based on the received postal information and issues a control number. At this time, the server converts the received postal information into a data format for API requests. The issued control number, related postal information, and emotion data are stored in a database.

[0531] 5. Return and display of control number

[0532] The server instructs the terminal to return the acquired control number, and the control number is displayed on the screen of the smart glasses. The user can confirm this control number and use it to send mail.

[0533] 6. Updating and Checking Tracking Information

[0534] The server periodically calls the post office's API to obtain the latest tracking information associated with each control number and updates the database. Users can then enter the control number through the smart glasses to check the latest tracking information at any time.

[0535] 7. Support based on emotional data

[0536] By analyzing the emotional data, if the user feels tired or stressed, a support message encouraging them to take a break will be displayed on the smart glasses.

[0537] Hardware and software used

[0538] Smart glasses: Devices with built-in cameras and microphones that capture visual and auditory information from the user.

[0539] Emotion Engine Library (EmotionAnalyzer): Software that recognizes emotions by analyzing the user's facial expressions and tone of voice.

[0540] Server: A computer system that stores data and communicates with APIs.

[0541] Secure communication protocol (e.g. HTTPS): A standardized way of sending and receiving data securely.

[0542] Post Office API: An external service that issues mail control numbers and provides tracking information.

[0543] Specific examples

[0544] Consider a scenario where an employee wants to send an important document by registered mail. The employee uses the smart glasses to input the recipient's address, sender's information, and the type of mail. The camera and microphone also analyze the employee's facial expressions and tone of voice in real time. If the employee feels fatigued or stressed, the emotion engine will suggest taking a break at the appropriate time.

[0545] Prompt Sentence Examples

[0546] Please tell me about a system that automates the process of sending mail, obtaining control numbers, and obtaining tracking information. This system also incorporates an emotion engine that recognizes user emotions, aiming to improve the user experience. Specifically, in the following scenarios:

[0547] 1. The user enters postal information (sender, recipient, type of mail) through the smart glasses.

[0548] 2. The emotion engine analyzes facial expressions and tone of voice in real time.

[0549] 3. Based on the recognized emotions, the system provides appropriate support messages and guidance.

[0550] Please elaborate on the detailed process flow and technologies used.

[0551] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0552] Step 1:

[0553] The user uses the smart glasses to enter the recipient's address, sender information, and mail type, which are then entered into a form displayed on the glasses' display using touch or voice input.

[0554] Input: User's destination address, sender information, mail type

[0555] Output: Input postal information data (recipient address, sender information, type of mail)

[0556] Step 2:

[0557] The smart glasses' built-in camera and microphone capture the user's facial expressions and tone of voice while they are typing, and pass the data to the emotion engine, which analyzes the data in real time to generate the user's emotion data.

[0558] Input: User's facial expression data, voice tone data

[0559] Output: Emotion data (user's stress and emotional state)

[0560] Step 3:

[0561] The device (smart glasses) sends the entered postal information and emotion data to the server using a secure communication protocol. The data is sent in a structured data format such as JSON.

[0562] Input: Postal information data, emotion data

[0563] Output: Transmission result to the server (success / failure)

[0564] Step 4:

[0565] The server calls the post office's API based on the received postal information, prepares to issue a control number, converts the received postal information into a data format for API requests, and calls the API.

[0566] Input: Postal information data

[0567] Output: Control number (data returned from API)

[0568] Step 5:

[0569] The server stores the issued control number and related postal information and emotion data in a database.

[0570] Input: Control number, postal information, emotion data

[0571] Output: Database save result (success / failure)

[0572] Step 6:

[0573] The server returns the management number to the device, and the device (smart glasses) displays the acquired management number to the user. The user confirms this management number.

[0574] Input: Control Number

[0575] Output: Control number returned to the terminal, displayed to the user

[0576] Step 7:

[0577] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number and updates the database, an operation that can be automated using batch jobs or scheduling tools.

[0578] Input: Control Number

[0579] Output: Latest tracking information, database updates

[0580] Step 8:

[0581] The user inputs the control number through the smart glasses to check the latest tracking information. The server retrieves the tracking information associated with the control number from the database and returns it to the terminal. The terminal then displays the latest tracking information to the user.

[0582] Input: Control Number

[0583] Output: Latest tracking information, returned to device, displayed to user

[0584] Step 9:

[0585] If the user feels fatigued or stressed based on the emotion data, a support message encouraging them to take a break will be displayed on the smart glasses. This message is displayed in real time based on the analysis of the emotion data.

[0586] Input: Emotion data

[0587] Output: Support message (display a break message if necessary)

[0588] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0589] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0590] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0591] [Second embodiment]

[0592] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0593] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0594] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0595] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0596] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0597] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0598] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0599] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0600] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0601] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0602] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0603] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0604] The present invention relates to a system for automating the process of issuing mail numbers, acquiring control numbers, and acquiring tracking information. Specific embodiments will be described below.

[0605] 1. Enter your postal information

[0606] The user uses the terminal to enter the destination address, sender information, and mail type.

[0607] For example, a user enters the following information into a terminal:

[0608] Destination address: recipient's name, address, and postal code

[0609] Sender information: sender's name, address, and postal code

[0610] Type of mail: Simple registered mail, regular mail, etc.

[0611] 2. Sending data to the server

[0612] The terminal transmits the entered postal information to the server.

[0613] Data is transmitted securely using secure communication protocols (e.g. HTTPS).

[0614] 3. Issuing and saving the control number

[0615] The server calls the post office's API and requests the issuance of a control number based on the submitted postal information.

[0616] For example, by sending an HTTP POST request to an API endpoint.

[0617] The server receives the control number returned from the API and stores it in a database.

[0618] 4. Return and display of control number

[0619] The server returns the acquired control number to the terminal and displays it to the user.

[0620] As a specific example, the issued control number "EX123456789JP" is displayed on the terminal screen so that the user can confirm it.

[0621] 5. Regular tracking updates

[0622] The server periodically calls the post office's API to retrieve the tracking information associated with each control number.

[0623] For example, set up a batch job that causes the server to call the API every hour.

[0624] The acquired tracking information is updated in the database.

[0625] 6. Check your tracking information

[0626] The user enters the control number on the terminal and checks the latest tracking information.

[0627] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[0628] The terminal displays tracking information, allowing users to check the current location and status of their mail.

[0629] Specific examples

[0630] Consider a scenario where a user wants to send an important document by registered mail.

[0631] The user enters the following information into the terminal:

[0632] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[0633] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[0634] Type of mail: Simple registered mail

[0635] The device sends the input information to the server, for example in JSON format like this:

[0636] json

[0637] {

[0638] "recipient_name": "Recipient name",

[0639] "recipient_address": "1-1-1 Yotsuya, Shinjuku-ku, Tokyo",

[0640] "recipient_postal_code": "160-0004",

[0641] "sender_name": "sender name",

[0642] "sender_address": "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture",

[0643] "sender_postal_code": "231-0023",

[0644] "mail_type": "Registered mail"

[0645] }

[0646] The server sends a request to the post office's API and obtains the control number "EX123456789JP".

[0647] The server stores the control number in a database and returns the control number to the terminal.

[0648] The terminal displays this control number to the user, who then mails the mail based on the control number.

[0649] The server periodically calls the post office's API to retrieve tracking information related to the control number and update it in the database.

[0650] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[0651] Through this series of steps, postal operations will be automated, improving work efficiency and reducing errors.

[0652] The processing flow will be explained below.

[0653] Step 1:

[0654] The user uses the terminal to input the destination address, sender information, and type of mail, such as the recipient's name, address, and postal code, the sender's name, address, and postal code, and the type of mail (e.g., registered mail).

[0655] Step 2:

[0656] The terminal sends the entered postal information to the server. The terminal uses a secure communication protocol (e.g., HTTPS) to securely transmit the data to the server. The data is sent in a structured data format, such as JSON.

[0657] Step 3:

[0658] The server receives the postal information and prepares it to call the post office's API. Specifically, it converts the received postal information into a data format for the API request.

[0659] Step 4:

[0660] The server sends a request to the post office API to issue a control number. The request is sent using an HTTP POST request, including the necessary postal information.

[0661] Step 5:

[0662] The server receives the response from the post office API and extracts the control number. The response data is returned in JSON format, and the server obtains the control number from that.

[0663] Step 6:

[0664] The server stores the control number and associated postal information in a database, using an SQL query to store information such as the control number, destination address, sender information, and mail type.

[0665] Step 7:

[0666] The server returns the control number to the terminal, which then displays the received control number to the user so that the user can confirm it.

[0667] Step 8:

[0668] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number. For example, a batch job or scheduling tool could be used to send an API request every hour.

[0669] Step 9:

[0670] The server updates the database with the tracking information it has acquired, specifically by running SQL queries to update information such as the last location, status, and timestamp.

[0671] Step 10:

[0672] The user enters the control number on the terminal and checks the latest tracking information. The terminal sends the control number to the server, which retrieves the tracking information from the database and returns it to the terminal. The terminal then displays the latest tracking information to the user.

[0673] Example 1

[0674] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0675] In conventional mailing procedures, issuing control numbers and checking tracking information is done manually, which results in low work efficiency and a high likelihood of errors. Furthermore, issuing control numbers and obtaining tracking information often takes time, which can be inconvenient for users. There was a need to solve these problems and improve the efficiency of mailing operations while reducing errors.

[0676] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0677] In this invention, the server includes: means for inputting postal information based on a destination address, sender information, and type of mail; means for transmitting the postal information to the server; means for the server to call an API of a postal service and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to the terminal and displaying it to the user; means for the server to periodically call an API of a postal service to obtain tracking information associated with each control number and update the database; means for the user to check the tracking information from the terminal; means for the terminal to convert the input data into JSON format and send it to the server; means for the server to obtain the control number using an authentication token of the API of the postal service; and means for the server to periodically call the API using a scheduling service. This makes it possible to automate processes from inputting postal information to issuing a control number and checking tracking information.

[0678] "Destination address" refers to information such as the name, address, and postal code of the recipient of the mail.

[0679] "Sender information" refers to information such as the name, address, and postal code of the sender of the mail.

[0680] "Type of mail" refers to the type of mailing method or service, such as registered mail or regular mail.

[0681] "Postal Information" refers to information about a mail item, including the destination address, sender information, and type of mail item.

[0682] "Terminal" refers to an electronic device through which a user enters postal information and communicates with a server.

[0683] "Server" refers to the computer system that receives and processes postal information and calls various APIs.

[0684] "API" refers to an application program interface that provides specific functionality.

[0685] "Control Number" means a unique identification number used for tracking and managing mail.

[0686] "Database" refers to an information management system for storing acquired postal information, control numbers, and tracking information.

[0687] "JSON format" is an abbreviation for JavaScript Object Notation, and refers to a lightweight text format for structuring and displaying data.

[0688] A "secure communication protocol" refers to a communication protocol that ensures the safety of data transmission. A specific example is HTTPS.

[0689] "Scheduling service" refers to technology for executing tasks or jobs at specific times or intervals.

[0690] An "authentication token" refers to data that contains information used to identify a user and verify their permissions when accessing a service such as an API.

[0691] "Tracking Information" means information including the current location and status of a mail piece associated with a control number.

[0692] The present invention relates to a system that automates the process of sending mail, obtaining control numbers, and obtaining tracking information. This system inputs postal information based on the destination address, sender information, and type of mail, and sends it to a server. The server then calls the postal service's API to issue a control number. The issued control number and postal information are then stored in a database, and the control number is returned to the terminal and displayed to the user. The server also periodically calls the postal service's API to obtain tracking information associated with each control number and update the database. Finally, the user can check the tracking information from their terminal.

[0693] Hardware and Software Configuration

[0694] The system uses the following hardware and software:

[0695] Devices: General personal computers, smartphones, tablets, etc.

[0696] Server: A computer system with high-performance processing power. It can also be implemented on cloud servers such as Amazon Web Services (AWS) or Microsoft Azure.

[0697] Database: A relational database system such as MySQL or PostgreSQL.

[0698] Program processing

[0699] 1. Enter your postal information

[0700] Users use the terminal to enter the recipient's address, sender information, and mail type through a web browser or a dedicated application.

[0701] 2. Data transmission

[0702] The terminal converts the entered postal information into JSON format and sends it to the server using a secure communication protocol (e.g., HTTPS).

[0703] 3. Issuing and saving the control number

[0704] The server calls the postal service's API and requests the issuance of a control number based on the postal information. The API call uses an authentication token.

[0705] The server receives the control number returned from the API (for example, "EX123456789JP") and stores it in a database.

[0706] 4. Return and display of control number

[0707] The server returns the acquired control number to the terminal and displays it to the user. The terminal then displays this control number on its user interface.

[0708] 5. Regular tracking updates

[0709] The server uses a scheduling service to call the postal service's API, say every hour, to retrieve the latest tracking information associated with each control number.

[0710] The server updates the acquired tracking information to a database.

[0711] 6. Check your tracking information

[0712] The user enters the control number on the terminal and checks the latest tracking information.

[0713] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal, which displays the tracking information and allows the user to check the current location and status of the mail item.

[0714] Specific examples

[0715] Consider a scenario where a user wants to send an important document by registered mail.

[0716] The user enters the following information into the terminal:

[0717] Address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004

[0718] Sender information: 2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023

[0719] Type of mail: Simple registered mail

[0720] The terminal sends the input information to the server, for example in the following text format:

[0721] Address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004

[0722] Sender information: 2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023

[0723] Type of mail: Simple registered mail

[0724] The server sends a request to the postal service's API and obtains the control number "EX123456789JP".

[0725] The server stores the control number in a database and returns it to the terminal, which displays the control number to the user, who then mails the item based on the control number.

[0726] The server periodically calls the postal service's API to retrieve tracking information related to the control number and update the database.

[0727] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: YYYY-MM-DDTHH:MM:SSZ."

[0728] In this way, the system can automate mailing operations efficiently and accurately.

[0729] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0730] Step 1:

[0731] Enter your postal information

[0732] The user uses the terminal to enter the destination address, sender information, and mail type.

[0733] What happens: The user accesses a form displayed on the device screen and manually enters the following information:

[0734] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[0735] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[0736] Mail type: "Registered mail"

[0737] Input: Destination address, sender information, mail type

[0738] Output: Postal information entered

[0739] Step 2:

[0740] Sending data

[0741] The terminal converts the entered postal information into JSON format and sends it to the server.

[0742] What it does: The device takes the postal information entered by the user and converts it into the following JSON format:

[0743] json

[0744] {

[0745] "recipient_name": "Recipient name",

[0746] "recipient_address": "1-1-1 Yotsuya, Shinjuku-ku, Tokyo",

[0747] "recipient_postal_code": "160-0004",

[0748] "sender_name": "sender name",

[0749] "sender_address": "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture",

[0750] "sender_postal_code": "231-0023",

[0751] "mail_type": "Registered mail"

[0752] }

[0753] This data is sent to the server using the HTTPS protocol.

[0754] Input: Postal information entered by the user

[0755] Output: Postal information sent to the server in JSON format

[0756] Step 3:

[0757] Issuing and saving the control number

[0758] The server calls the postal service's API and makes a request to issue a control number based on the postal information.

[0759] Specific operation: The server sends an HTTP POST request to the postal service's API endpoint based on the received JSON data, including the API key and authentication token.

[0760] Input: JSON postal information, API key, and authentication token

[0761] Output: Obtained control number (e.g. "EX123456789JP")

[0762] Step 4:

[0763] Save control number

[0764] The server stores the acquired control number and postal information in a database.

[0765] Specific operation: The server executes an INSERT statement into the database, saving the control number and related postal information as a single record. The database can be MySQL or PostgreSQL.

[0766] Input: Obtained control number, postal information

[0767] Output: Control number and postal information stored in the database

[0768] Step 5:

[0769] Return and display of control number

[0770] The server returns the acquired control number to the terminal and displays it to the user.

[0771] Specific operation: The server generates a JSON response including the control number and sends it to the device using the HTTPS protocol. The device receives the response and displays it in the user interface. Example: "Control number: EX123456789JP"

[0772] Input: Obtained control number

[0773] Output: Control number returned to the terminal

[0774] Step 6:

[0775] Regular tracking updates

[0776] The server uses a scheduling service to periodically call the postal service's API to retrieve tracking information associated with each control number and update the database.

[0777] Specific operation: Set up a scheduling service such as a cron job on the server to send a request to the API endpoint every hour. Execute an UPDATE statement to update the acquired tracking information in the database.

[0778] Input: Each control number

[0779] Output: Updated tracking information

[0780] Step 7:

[0781] Check tracking information

[0782] The user enters the control number on the terminal and checks the latest tracking information.

[0783] Specific operation: The user enters the control number in the input field displayed on the terminal and clicks the "Check tracking information" button. The terminal receives this input and sends a request in JSON format to the server.

[0784] Input: Control Number

[0785] Output: Request sent to the server

[0786] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[0787] Specific operation: The server executes a SELECT statement on the database to obtain the latest tracking information associated with the specified control number, creates a JSON response containing the obtained tracking information, and sends it to the terminal.

[0788] Input: Control Number

[0789] Output: Retrieved tracking information

[0790] The terminal displays tracking information, allowing users to check the current location and status of their mail.

[0791] Specific operation: The device parses the JSON response received from the server and displays the information on the user interface. Example: "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: YYYY-MM-DDTHH:MM:SSZ".

[0792] Input: Retrieved tracking information

[0793] Output: Displayed tracking information

[0794] The above are the specific processing steps of the present invention. Through this series of steps, mailing operations can be automated efficiently and accurately.

[0795] (Application example 1)

[0796] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0797] In modern logistics facilities, product management and tracking are often inefficient, leading to human error and delays in management information. This results in poor tracking accuracy and lower customer satisfaction. Furthermore, the inability to respond quickly to important status changes calls for operational efficiency improvements.

[0798] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0799] In this invention, the server includes: means for inputting postal information based on the destination address, sender information, and type of mail; means for transmitting the postal information to the server; means for the server to call a post office API and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to a terminal and displaying it to a user; means for the server to periodically call a post office API to obtain tracking information associated with each control number and update the database; means for a user to check the tracking information from a terminal; means for a logistics facility to scan a barcode to obtain product information and input delivery destination and sender information; means for transmitting the product information and delivery information to the server and obtaining a control number; means for the server to update the tracking information in real time and notify important status changes via push notifications. This enables more efficient product management and tracking at logistics facilities, reduces human error, improves tracking accuracy, and increases customer satisfaction.

[0800] "Destination address" is information indicating the location where mail or merchandise is to be sent.

[0801] "Sender information" refers to information such as the name and address of the person sending the mail or product.

[0802] "Type of mail" is a category that indicates the format or service in which the mail is sent (e.g., registered mail, regular mail).

[0803] "Postal information" is a collection of detailed information such as the destination address, sender information, and type of mail.

[0804] "Server" means the part of the computer system that processes postal information and manages control numbers and tracking information.

[0805] "API" stands for Application Programming Interface, a specification that allows different software systems to communicate with each other.

[0806] "Control number" means a unique identifier issued for the purpose of tracking and managing mail or merchandise.

[0807] A "database" is a system for systematically storing and managing data such as postal information and control numbers.

[0808] A "terminal" is a device (e.g., smartphone, computer) that a user uses to enter information and view results.

[0809] "Tracking information" is detailed information about the current location and delivery status of mail or goods.

[0810] "User" means a person who uses this system to manage mail and product information.

[0811] A "logistics facility" is a place where goods are stored, sorted, and shipped.

[0812] A "barcode" is a visual identification code for machine-readable product information.

[0813] "Scanning" is the process of optically reading a barcode and capturing the information as digital data.

[0814] "Tracking accuracy" refers to the ability to accurately determine the location and status of mail or goods.

[0815] "Push notification" is a technology that allows applications to notify users of important information in real time.

[0816] "Managing goods at a logistics facility" means efficiently carrying out a series of operations, including receiving, storing, picking, and shipping goods.

[0817] "Human error" refers to mistakes or errors that people make while working.

[0818] The present invention relates to a system for improving the efficiency of product management and tracking in a logistics facility. Specific embodiments will be described below.

[0819] 1. Enter shipping address and sender information

[0820] The user uses the terminal to input the delivery address, sender information, and product type. Specifically, the user uses a smartphone app to input detailed product information, the delivery address, and sender information.

[0821] 2. Obtaining product information

[0822] At the logistics facility, users use their smartphones to scan product barcodes, which automatically enters product information into the app.

[0823] 3. Sending data to the server

[0824] The terminal sends the entered product information and delivery information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the data is transmitted safely.

[0825] 4. Issuing and saving the control number

[0826] The server calls the API of the logistics system and issues a control number based on the product information and delivery information sent. The server receives the control number returned from the API and stores it in a database.

[0827] 5. Return and display of control number

[0828] The server returns the acquired control number to the terminal and displays it to the user. For example, the issued control number "LM123456789DN" is displayed on the terminal screen so that the user can confirm it.

[0829] 6. Regular tracking updates

[0830] The server periodically calls the API of the logistics system to obtain tracking information related to each control number. A scheduling tool (e.g., a CRON job) is set up so that the server can call the API in real time. The obtained tracking information is then updated in the database.

[0831] 7. Tracking Information and Notifications

[0832] Users can enter the control number on their device to check the latest tracking information. The server retrieves the tracking information related to the control number from the database and returns it to the device. In addition, if an important status change occurs, the user will be notified via push notification.

[0833] Hardware and software used

[0834] Devices: Smartphones, tablets, laptops, etc.

[0835] Server: Cloud-based server, VPS, etc.

[0836] Software: Smartphone apps (e.g., iOS, Android apps), server-side programs (e.g., Node.js, Python), database management systems (e.g., MySQL, PostgreSQL), secure communication protocols (e.g., HTTPS), and scheduling tools (e.g., CRON jobs).

[0837] API: Logistics system API, post office API, etc.

[0838] Specific examples

[0839] Consider a scenario where a worker at a logistics facility scans the barcode of product "1234567890" with a smartphone app and sends the product to a specific address. The user uses the app to enter the recipient's name and address and obtains the control number "LM123456789DN." The control number is used to place the product in the logistics flow, and tracking information can be checked in real time. Additionally, if there are any important status changes, the worker can be notified via push notification.

[0840] Example prompts to input to a generative AI model:

[0841] "We would like to develop a smartphone app that will be useful in logistics facilities. This app will have functions such as barcode scanning, inputting delivery addresses, issuing control numbers, and managing tracking information. We would like to use the logistics system API to update tracking information in real time and send push notifications if there are any important status changes. Please generate the specific program part for this purpose."

[0842] This invention improves the efficiency of product management and tracking in logistics facilities, reducing human error, improving tracking accuracy, and increasing customer satisfaction.

[0843] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0844] Step 1:

[0845] The user scans the barcode of a product using a smartphone app. By scanning the barcode, product information is imported into the device as digital data. Input: Product barcode information. Output: Product information (e.g. product ID, name, quantity, etc.). Operation: The barcode is read using the smartphone camera, and the product information is analyzed from the barcode and displayed in the app.

[0846] Step 2:

[0847] The user enters the shipping address, sender information, and product type into the app. Input: Shipping address, sender information, and product type manually entered by the user. Output: A complete dataset of products with shipping information. Behavior: The user enters the required information into the app's input fields, which are then integrated within the app.

[0848] Step 3:

[0849] The terminal sends the entered product information and delivery information to the server. Input: Product information and delivery information. Output: JSON data sent to the server. Operation: The app sends information to the server using a secure communication protocol (HTTPS).

[0850] Step 4:

[0851] The server issues a control number based on the submitted product information and delivery information. Input: Product information and delivery information. Output: Control number. Operation: The server sends a request to the logistics system's API and obtains the control number.

[0852] Step 5:

[0853] The server saves the acquired control number in a database. Input: Control number and corresponding product information, delivery information. Output: Control number and related information saved in the database. Operation: The server writes information to the database.

[0854] Step 6:

[0855] The server returns the issued control number to the terminal and displays it to the user. Input: Control number. Output: Control number displayed on the terminal screen. Operation: The server sends the control number to the terminal, and the app displays it to the user.

[0856] Step 7:

[0857] The server periodically calls the API of the logistics system to obtain tracking information related to the control number. Input: Control number list. Output: Latest tracking information. Operation: The server periodically calls the API using a scheduling tool (e.g., CRON job) to obtain tracking information.

[0858] Step 8:

[0859] The server updates the database with the acquired tracking information. Input: Latest tracking information. Output: Updated database. Operation: The server writes the new tracking information to the database.

[0860] Step 9:

[0861] The user enters the control number on the device and checks the latest tracking information. Input: Control number. Output: Latest tracking information displayed on the device. Operation: The app sends the control number to the server, which retrieves the tracking information from the database and sends it back to the device.

[0862] Step 10:

[0863] The server notifies the user via push notification when an important status change occurs. Input: Tracking information status. Output: Push notification. Operation: The server detects the status change, generates a push notification and sends it to the device. This notification allows the user to receive important information in real time.

[0864] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0865] The present invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. Specific embodiments are described below.

[0866] 1. Enter your postal information

[0867] The user uses the terminal to enter the destination address, sender information, and mail type.

[0868] For example, a user enters the following information into a terminal:

[0869] Destination address: recipient's name, address, and postal code

[0870] Sender information: sender's name, address, and postal code

[0871] Type of mail: Simple registered mail, regular mail, etc.

[0872] 2. Use of Emotion Engine

[0873] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice while the user is typing, and uses an emotion engine to recognize the user's emotions.

[0874] The emotion engine analyzes the user's emotional data in real time and, if it detects that the user is feeling stressed, it will provide supportive messages and guidance. The emotion engine also adjusts the input screen interface in real time according to the user's emotions.

[0875] 3. Sending data to the server

[0876] The terminal transmits the input postal information and emotion data to the server.

[0877] The data is sent securely to the server using a secure communication protocol (e.g., HTTPS) and in a structured data format such as JSON.

[0878] 4. Issuing and saving the control number

[0879] The server receives the postal information and emotion data, prepares to call the post office's API, and converts the received postal information into a data format for the API request.

[0880] The server sends a request to the post office's API to issue a control number and receives the control number returned from the API.

[0881] 5. Saving to the database

[0882] The server stores the control number and associated postal and emotional data in a database for future reference and analysis.

[0883] 6. Return and display of control number

[0884] The server returns the acquired control number to the terminal and instructs the terminal to display it to the user.

[0885] The terminal displays the returned control number to the user so that the user can check it.

[0886] 7. Regular tracking updates

[0887] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number.

[0888] The server updates the acquired tracking information to a database by sending API requests at regular intervals using a batch job or scheduling tool.

[0889] 8. Check your tracking information

[0890] The user enters the control number on the terminal and checks the latest tracking information.

[0891] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[0892] The device displays the latest tracking information to the user.

[0893] Specific examples

[0894] Consider a scenario where a user wants to send an important document by registered mail.

[0895] The user enters the following information into the terminal:

[0896] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[0897] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[0898] Type of mail: Simple registered mail

[0899] The device sends the input information along with the user's emotions (e.g., if the user is feeling stressed) to the server. This data is transmitted using a secure communication protocol.

[0900] The server calls the post office's API, obtains the control number "EX123456789JP", and stores this data in the database.

[0901] The server returns the control number to the terminal, which then displays the control number to the user, who then mails the item based on that control number.

[0902] The server periodically calls the post office's API to retrieve the latest tracking information associated with the control number and update the database.

[0903] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[0904] Through this series of steps, not only is postal work automated, but the emotional engine also improves the user experience.

[0905] The processing flow will be explained below.

[0906] Step 1:

[0907] A user uses a terminal to enter a destination address, sender information, and the type of mail (e.g., registered mail). For example, the user enters the following data: "Destination address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo, 160-0004" and "Sender information: 2-2-2 Yamashita-cho, Naka-ku, Yokohama-shi, Kanagawa, 231-0023."

[0908] Step 2:

[0909] The device uses an emotion engine to analyze the user's facial expressions and tone of voice, recognizing the user's emotions (e.g., stress, joy, surprise, etc.) in real time and capturing that data.

[0910] Step 3:

[0911] If the emotion engine detects the user's stress level, the device will display a support message (e.g., "There's an easier way to input") to the user. If the emotion engine deems appropriate, it will also adjust the input screen interface to make input more comfortable for the user.

[0912] Step 4:

[0913] The device sends the entered postal information and emotion data to the server. This data is securely transmitted using a secure communication protocol (e.g., HTTPS). The transmitted data is in a structured data format such as JSON.

[0914] Step 5:

[0915] The server receives the postal information and emotion data. Based on the received data, it prepares to call the post office's API. The received data is converted into a data format for the API request.

[0916] Step 6:

[0917] The server sends a request to the post office API to issue a control number. The request is sent using an HTTP POST request, including the necessary postal information.

[0918] Step 7:

[0919] The server receives the response from the post office API, extracts the control number from the response data, and stores it in the system.

[0920] Step 8:

[0921] The server then stores the acquired control number and associated postal and emotional data in a database for future reference and analysis.

[0922] Step 9:

[0923] The server returns the control number to the terminal, which then displays this control number to the user so that the user can confirm it.

[0924] Step 10:

[0925] The server periodically calls the post office's API to retrieve the tracking information associated with each control number, using a batch job or scheduling tool to send requests every hour.

[0926] Step 11:

[0927] The server updates the database with the acquired tracking information, specifically by executing SQL queries to update the status, last location, and timestamp of the tracking information.

[0928] Step 12:

[0929] The user inputs the control number on the terminal to check the latest tracking information. The terminal sends the request to the server, which retrieves the latest tracking information from the database and returns it to the terminal.

[0930] Step 13:

[0931] The tracking information for the returned device is displayed to the user. For example, the user can see information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[0932] Example 2

[0933] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0934] Conventional mail numbering and tracking systems require users to manually enter information without considering their feelings, which can lead to input errors and increased effort. Furthermore, obtaining mail control numbers and tracking information is cumbersome, resulting in a poor user experience. Furthermore, there is a risk of information leaks due to insufficient consideration given to security.

[0935] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0936] In this invention, the server includes: means for inputting postal information based on the destination address, sender information, and type of mail; means for using an emotion engine that analyzes the user's facial expressions and tone of voice to acquire emotion data; means for transmitting the postal information and emotion data to the server; means for the server to call a post office API and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to the terminal and displaying it to the user; means for the server to periodically call the post office API to acquire tracking information associated with each control number and update the database; and means for the user to check the tracking information from the terminal. This automates and streamlines the process of mail numbering, acquiring control numbers, and periodically updating and checking tracking information, improving the user experience. Furthermore, the use of the emotion engine allows support messages and interfaces to be adjusted according to the user's emotions, further improving security.

[0937] "Postal Information" refers to data regarding destination address, sender information, and mail type.

[0938] An "emotion engine" refers to an analysis system that analyzes a user's facial expressions and tone of voice to recognize the user's emotions in real time.

[0939] "Terminal" refers to a device for a user to input information and a device for transmitting the input information to a server.

[0940] "Server" refers to the computer system that processes postal information and sentiment data, issues control numbers, stores them in a database, and updates and provides tracking information.

[0941] "Control number" refers to a unique identifier issued through the post office's API to identify a specific piece of mail.

[0942] "Database" refers to a data structure that stores postal information, emotion data, control numbers, and tracking information and allows for easy searching and updating.

[0943] "Secure communications protocol" refers to a communications method that includes encryption technology to ensure the secure transmission and reception of data.

[0944] A "batch job" refers to a series of processes that are executed automatically and periodically, and is used in particular to periodically call the post office's API.

[0945] A "scheduling tool" refers to software that configures certain tasks to be performed automatically at specified times or intervals.

[0946] "Tracking Information" refers to data containing the current status and location of a mail piece associated with a particular control number.

[0947] The present invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and further improves the user experience by using an emotion engine. Specific embodiments are described below.

[0948] 1. Enter your postal information

[0949] The user uses the terminal to enter the destination address, sender information, and mail type.

[0950] As an example, a user enters the following information into a terminal:

[0951] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[0952] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[0953] Type of mail: Simple registered mail

[0954] 2. Use of Emotion Engine

[0955] The device uses a camera and microphone to capture the user's facial expressions and tone of voice, and sends them to the emotion engine, which analyzes them in real time and generates the user's emotion data.

[0956] If the emotion engine recognizes that the user is feeling stressed, it displays support messages and guidance and adjusts the input screen interface.

[0957] 3. Sending data to the server

[0958] The terminal sends the entered postal information and emotion data to the server using a secure communication protocol (e.g., HTTPS). The sent data is structured data in JSON format.

[0959] 4. Issuing and saving the control number

[0960] The server converts the received postal information and emotion data into a data format for API requests and calls the post office's API.

[0961] The server sends a request to issue a control number to the post office's API and receives the control number in return.

[0962] 5. Saving to the database

[0963] The server stores the acquired control number and associated postal and emotion data in a database for future reference and analysis.

[0964] 6. Return and display of control number

[0965] The server returns the acquired control number to the terminal and displays it to the user.

[0966] The terminal displays the returned control number to the user so that the user can check it.

[0967] 7. Regular tracking updates

[0968] The server calls the post office's API at regular intervals to retrieve the latest tracking information associated with each control number and updates the database, using batch jobs and scheduling tools to accomplish this.

[0969] 8. Check your tracking information

[0970] The user enters the control number into the terminal to check the latest tracking information.

[0971] The server retrieves the relevant tracking information from the database and returns it to the terminal.

[0972] The terminal displays the latest tracking information to the user.

[0973] Specific examples and prompts for the generative AI model

[0974] Specific examples

[0975] Consider a scenario where a user wants to send an important document by registered mail.

[0976] The user enters the following information into the terminal:

[0977] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[0978] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[0979] Type of mail: Simple registered mail

[0980] The device sends the input information along with the user's emotional data (e.g., if the user is feeling stressed) to the server using a secure communication protocol.

[0981] The server calls the post office's API, obtains the control number "EX123456789JP", and stores this data in the database.

[0982] The server returns the control number to the terminal, which then displays the control number to the user, who then mails the item based on that control number.

[0983] The server periodically calls the post office's API to retrieve the latest tracking information associated with the control number and update the database.

[0984] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[0985] Example prompts for generative AI models

[0986] "Create a scenario in which a user sends a registered letter. The user enters the recipient address, sender information, and type of mail. Also include a scenario in which the emotion engine provides a supportive message to the user who is feeling stressed."

[0987] Through the system of the present invention, not only are mailing numbers, obtaining control numbers, and regular updates and confirmation of tracking information automated and efficient, but the use of an emotion engine also improves the user experience.

[0988] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0989] Step 1:

[0990] The user uses the terminal to enter postal information.

[0991] Input: Destination address, sender information, mail type

[0992] Output: Temporarily save input information

[0993] How it works: The user types in an address or other information on the keyboard, and the data appears in fields on the screen. The data is temporarily stored in memory.

[0994] Step 2:

[0995] The device uses a camera and microphone to capture the user's facial expressions and tone of voice.

[0996] Input: User's facial expressions, tone of voice

[0997] Output: Captured emotion data

[0998] How it works: The camera and microphone are activated to collect data in real time, which is then sent to the emotion engine API.

[0999] Step 3:

[1000] The emotion engine analyzes the user's emotion data.

[1001] Input: Captured emotion data

[1002] Output: Analysis results (e.g., whether the user is feeling stressed)

[1003] How it works: The emotion engine performs analysis in real time and returns the results in JSON format to the device.

[1004] Step 4:

[1005] The terminal receives the analysis results and displays a support message if necessary.

[1006] Input: Analysis results from the emotion engine

[1007] Output: Helpful message (if needed)

[1008] How it works: If it detects you are stressed, a message such as "Please stay calm when typing" will pop up.

[1009] Step 5:

[1010] The terminal transmits the input postal information and emotion data to the server.

[1011] Input: Postal information and emotion data

[1012] Output: Data sent to the server

[1013] How it works: Data is sent to the server in JSON format using the HTTPS protocol.

[1014] Step 6:

[1015] The server converts the received postal information and emotion data into a format suitable for API requests.

[1016] Input: Postal information and emotion data sent to the server

[1017] Output: Data format for API requests

[1018] What it does: The server converts the data into the appropriate JSON format.

[1019] Step 7:

[1020] The server calls the post office's API and issues a control number.

[1021] Input: Data format for API requests

[1022] Output: Retrieved control number

[1023] Operation: The server generates an API request and returns the control number "EX123456789JP".

[1024] Step 8:

[1025] The server stores the obtained control number and associated postal information and emotion data in a database.

[1026] Input: Control number, postal information, and emotion data

[1027] Output: Data stored in the database

[1028] What it does: Inserts data into a database using an SQL query.

[1029] Step 9:

[1030] The server returns the control number to the terminal and instructs it to be displayed to the user.

[1031] Input: Control number

[1032] Output: Control number returned to the terminal

[1033] Operation: Generates a management number in JSON format and sends it to the terminal via HTTPS protocol.

[1034] Step 10:

[1035] The terminal displays the returned control number to the user.

[1036] Input: Returned control number

[1037] Output: Control number displayed on the screen

[1038] Operation: The control number is displayed on the screen.

[1039] Step 11:

[1040] The server calls the post office's API at regular intervals to obtain the latest tracking information.

[1041] Input: Each control number

[1042] Output: Retrieved tracking information

[1043] How it works: Use a batch job or scheduling tool to send API requests and get the latest information.

[1044] Step 12:

[1045] The server updates the acquired tracking information to a database.

[1046] Input:Tracking information

[1047] Output: Updated database

[1048] Action: Updates the tracking information for that entry in the database.

[1049] Step 13:

[1050] The user enters the control number into the terminal and checks the latest tracking information.

[1051] Input: Control number

[1052] Output: Retrieved tracking information

[1053] Action: Enter the control number into the input form and click the submit button.

[1054] Step 14:

[1055] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[1056] Input: Control number

[1057] Output: Tracking information sent to the device

[1058] What it does: Searches the database and sends tracking information in JSON format to the device.

[1059] Step 15:

[1060] The device displays the latest tracking information to the user.

[1061] Input: Returned tracking information

[1062] Output: Tracking information displayed on screen

[1063] What it does: The screen will display "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[1064] (Application example 2)

[1065] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1066] In modern logistics centers, managing mail order and tracking information is important, but it is a labor-intensive and time-consuming task. Furthermore, when employees manually perform these tasks, fatigue and stress accumulate, resulting in reduced efficiency. Therefore, there is a need for a system that automates the management of mail order and tracking information while also analyzing employee emotions to improve the working environment.

[1067] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1068] In this invention, the server includes: a means for inputting postal information based on the destination address, sender information, and type of mail; a means for transmitting the postal information to the server; a means for the server to call a post office API and issue a control number based on the transmitted postal information; a means for analyzing the user's facial expression and tone of voice while inputting the postal information and acquiring emotional data; a means for the server to store the issued control number, postal information, and emotional data in a database; a means for returning the control number to the terminal and displaying it to the user; a means for the server to periodically call a post office API, acquire tracking information related to each control number, and update the database; a means for the user to check the tracking information on the terminal; and a means for analyzing the user's fatigue and stress and displaying a support message encouraging them to take a break as needed. This not only enables efficient mail management, but also provides a comfortable working environment by analyzing employees' emotional data and providing appropriate support.

[1069] "Destination address" refers to information such as the name, address, and postal code of the person receiving the mail.

[1070] "Sender information" refers to information such as the name, address, and postal code of the person sending the mail.

[1071] "Type of mail" indicates whether the mail is classified as a specific delivery method or type, such as registered mail, regular mail, or express mail.

[1072] "Postal information" refers to information including the destination address, sender information, and type of mail.

[1073] A "server" is a computer system that receives postal information and performs processes such as issuing control numbers, storing data, and obtaining tracking information.

[1074] "Smart glasses" are wearable devices that can acquire visual and audio information when worn by a user, and analyze and display it in real time.

[1075] "Emotion data" is data that indicates the user's emotional state, obtained from the user's facial expression, tone of voice, etc.

[1076] An "API" is an interface that a program uses to communicate with external services and resources.

[1077] A "control number" is a specific number issued to uniquely identify a mail item.

[1078] "Tracking information" is information that indicates the current location and delivery status of mail.

[1079] A "batch job" is a series of tasks or processes that are executed periodically.

[1080] A "scheduling tool" is software that automatically executes tasks at specific times or intervals.

[1081] A "secure communication protocol" is a standardized method for securely sending and receiving data, and HTTPS is commonly used.

[1082] A "terminal" is a device used by a user to enter or receive information.

[1083] This invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. Specific embodiments are described below.

[1084] System configuration and operation

[1085] 1. Enter your postal information

[1086] The user uses the smart glasses to enter the recipient address, sender information, and mail type. The user inputs the information using touch or voice commands, following the input form displayed on the smart glasses screen.

[1087] 2. Acquiring Emotion Data

[1088] While the user is entering information, the smart glasses' built-in camera and microphone analyze the user's facial expressions and tone of voice, which are then processed in real time by the emotion engine to obtain the user's emotional data.

[1089] 3. Sending data to the server

[1090] The device (smart glasses) sends the entered postal information and emotion data to the server. This communication is performed using a secure protocol (e.g., HTTPS). The data is sent in a structured data format such as JSON.

[1091] 4. Issuing and saving the control number

[1092] The server calls the post office's API based on the received postal information and issues a control number. At this time, the server converts the received postal information into a data format for API requests. The issued control number, related postal information, and emotion data are stored in a database.

[1093] 5. Return and display of control number

[1094] The server instructs the terminal to return the acquired control number, and the control number is displayed on the screen of the smart glasses. The user can confirm this control number and use it to send mail.

[1095] 6. Updating and Checking Tracking Information

[1096] The server periodically calls the post office's API to obtain the latest tracking information associated with each control number and updates the database. Users can then enter the control number through the smart glasses to check the latest tracking information at any time.

[1097] 7. Support based on emotional data

[1098] By analyzing the emotional data, if the user feels tired or stressed, a support message encouraging them to take a break will be displayed on the smart glasses.

[1099] Hardware and software used

[1100] Smart glasses: Devices with built-in cameras and microphones that capture visual and auditory information from the user.

[1101] Emotion Engine Library (EmotionAnalyzer): Software that recognizes emotions by analyzing the user's facial expressions and tone of voice.

[1102] Server: A computer system that stores data and communicates with APIs.

[1103] Secure communication protocol (e.g. HTTPS): A standardized way of sending and receiving data securely.

[1104] Post Office API: An external service that issues mail control numbers and provides tracking information.

[1105] Specific examples

[1106] Consider a scenario where an employee wants to send an important document by registered mail. The employee uses the smart glasses to input the recipient's address, sender's information, and the type of mail. The camera and microphone also analyze the employee's facial expressions and tone of voice in real time. If the employee feels fatigued or stressed, the emotion engine will suggest taking a break at the appropriate time.

[1107] Prompt Sentence Examples

[1108] Please tell me about a system that automates the process of sending mail, obtaining control numbers, and obtaining tracking information. This system also incorporates an emotion engine that recognizes user emotions, aiming to improve the user experience. Specifically, in the following scenarios:

[1109] 1. The user enters postal information (sender, recipient, type of mail) through the smart glasses.

[1110] 2. The emotion engine analyzes facial expressions and tone of voice in real time.

[1111] 3. Based on the recognized emotions, the system provides appropriate support messages and guidance.

[1112] Please elaborate on the detailed process flow and technologies used.

[1113] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1114] Step 1:

[1115] The user uses the smart glasses to enter the recipient's address, sender information, and mail type, which are then entered into a form displayed on the glasses' display using touch or voice input.

[1116] Input: User's destination address, sender information, mail type

[1117] Output: Input postal information data (recipient address, sender information, type of mail)

[1118] Step 2:

[1119] The smart glasses' built-in camera and microphone capture the user's facial expressions and tone of voice while they are typing, and pass the data to the emotion engine, which analyzes the data in real time to generate the user's emotion data.

[1120] Input: User's facial expression data, voice tone data

[1121] Output: Emotion data (user's stress and emotional state)

[1122] Step 3:

[1123] The device (smart glasses) sends the entered postal information and emotion data to the server using a secure communication protocol. The data is sent in a structured data format such as JSON.

[1124] Input: Postal information data, emotion data

[1125] Output: Transmission result to the server (success / failure)

[1126] Step 4:

[1127] The server calls the post office's API based on the received postal information, prepares to issue a control number, converts the received postal information into a data format for API requests, and calls the API.

[1128] Input: Postal information data

[1129] Output: Control number (data returned from API)

[1130] Step 5:

[1131] The server stores the issued control number and related postal information and emotion data in a database.

[1132] Input: Control number, postal information, emotion data

[1133] Output: Database save result (success / failure)

[1134] Step 6:

[1135] The server returns the management number to the device, and the device (smart glasses) displays the acquired management number to the user. The user confirms this management number.

[1136] Input: Control Number

[1137] Output: Control number returned to the terminal, displayed to the user

[1138] Step 7:

[1139] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number and updates the database, an operation that can be automated using batch jobs or scheduling tools.

[1140] Input: Control Number

[1141] Output: Latest tracking information, database updates

[1142] Step 8:

[1143] The user inputs the control number through the smart glasses to check the latest tracking information. The server retrieves the tracking information associated with the control number from the database and returns it to the terminal. The terminal then displays the latest tracking information to the user.

[1144] Input: Control Number

[1145] Output: Latest tracking information, returned to device, displayed to user

[1146] Step 9:

[1147] If the user feels fatigued or stressed based on the emotion data, a support message encouraging them to take a break will be displayed on the smart glasses. This message is displayed in real time based on the analysis of the emotion data.

[1148] Input: Emotion data

[1149] Output: Support message (display a break message if necessary)

[1150] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1151] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1152] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1153] [Third embodiment]

[1154] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1155] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1156] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1157] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1158] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1159] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1160] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1161] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1162] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1163] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1164] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1165] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1166] The present invention relates to a system for automating the process of issuing mail numbers, acquiring control numbers, and acquiring tracking information. Specific embodiments will be described below.

[1167] 1. Enter your postal information

[1168] The user uses the terminal to enter the destination address, sender information, and mail type.

[1169] For example, a user enters the following information into a terminal:

[1170] Destination address: recipient's name, address, and postal code

[1171] Sender information: sender's name, address, and postal code

[1172] Type of mail: Simple registered mail, regular mail, etc.

[1173] 2. Sending data to the server

[1174] The terminal transmits the entered postal information to the server.

[1175] Data is transmitted securely using secure communication protocols (e.g. HTTPS).

[1176] 3. Issuing and saving the control number

[1177] The server calls the post office's API and requests the issuance of a control number based on the submitted postal information.

[1178] For example, by sending an HTTP POST request to an API endpoint.

[1179] The server receives the control number returned from the API and stores it in a database.

[1180] 4. Return and display of control number

[1181] The server returns the acquired control number to the terminal and displays it to the user.

[1182] As a specific example, the issued control number "EX123456789JP" is displayed on the terminal screen so that the user can confirm it.

[1183] 5. Regular tracking updates

[1184] The server periodically calls the post office's API to retrieve the tracking information associated with each control number.

[1185] For example, set up a batch job that causes the server to call the API every hour.

[1186] The acquired tracking information is updated in the database.

[1187] 6. Check your tracking information

[1188] The user enters the control number on the terminal and checks the latest tracking information.

[1189] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[1190] The terminal displays tracking information, allowing users to check the current location and status of their mail.

[1191] Specific examples

[1192] Consider a scenario where a user wants to send an important document by registered mail.

[1193] The user enters the following information into the terminal:

[1194] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[1195] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[1196] Type of mail: Simple registered mail

[1197] The device sends the input information to the server, for example in JSON format like this:

[1198] json

[1199] {

[1200] "recipient_name": "Recipient name",

[1201] "recipient_address": "1-1-1 Yotsuya, Shinjuku-ku, Tokyo",

[1202] "recipient_postal_code": "160-0004",

[1203] "sender_name": "sender name",

[1204] "sender_address": "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture",

[1205] "sender_postal_code": "231-0023",

[1206] "mail_type": "Registered mail"

[1207] }

[1208] The server sends a request to the post office's API and obtains the control number "EX123456789JP".

[1209] The server stores the control number in a database and returns the control number to the terminal.

[1210] The terminal displays this control number to the user, who then mails the mail based on the control number.

[1211] The server periodically calls the post office's API to retrieve tracking information related to the control number and update it in the database.

[1212] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[1213] Through this series of steps, postal operations will be automated, improving work efficiency and reducing errors.

[1214] The processing flow will be explained below.

[1215] Step 1:

[1216] The user uses the terminal to input the destination address, sender information, and type of mail, such as the recipient's name, address, and postal code, the sender's name, address, and postal code, and the type of mail (e.g., registered mail).

[1217] Step 2:

[1218] The terminal sends the entered postal information to the server. The terminal uses a secure communication protocol (e.g., HTTPS) to securely transmit the data to the server. The data is sent in a structured data format, such as JSON.

[1219] Step 3:

[1220] The server receives the postal information and prepares it to call the post office's API. Specifically, it converts the received postal information into a data format for the API request.

[1221] Step 4:

[1222] The server sends a request to the post office API to issue a control number. The request is sent using an HTTP POST request, including the necessary postal information.

[1223] Step 5:

[1224] The server receives the response from the post office API and extracts the control number. The response data is returned in JSON format, and the server obtains the control number from that.

[1225] Step 6:

[1226] The server stores the control number and associated postal information in a database, using an SQL query to store information such as the control number, destination address, sender information, and mail type.

[1227] Step 7:

[1228] The server returns the control number to the terminal, which then displays the received control number to the user so that the user can confirm it.

[1229] Step 8:

[1230] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number. For example, a batch job or scheduling tool could be used to send an API request every hour.

[1231] Step 9:

[1232] The server updates the database with the tracking information it has acquired, specifically by running SQL queries to update information such as the last location, status, and timestamp.

[1233] Step 10:

[1234] The user enters the control number on the terminal and checks the latest tracking information. The terminal sends the control number to the server, which retrieves the tracking information from the database and returns it to the terminal. The terminal then displays the latest tracking information to the user.

[1235] Example 1

[1236] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1237] In conventional mailing procedures, issuing control numbers and checking tracking information is done manually, which results in low work efficiency and a high likelihood of errors. Furthermore, issuing control numbers and obtaining tracking information often takes time, which can be inconvenient for users. There was a need to solve these problems and improve the efficiency of mailing operations while reducing errors.

[1238] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1239] In this invention, the server includes: means for inputting postal information based on a destination address, sender information, and type of mail; means for transmitting the postal information to the server; means for the server to call an API of a postal service and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to the terminal and displaying it to the user; means for the server to periodically call an API of a postal service to obtain tracking information associated with each control number and update the database; means for the user to check the tracking information from the terminal; means for the terminal to convert the input data into JSON format and send it to the server; means for the server to obtain the control number using an authentication token of the API of the postal service; and means for the server to periodically call the API using a scheduling service. This makes it possible to automate processes from inputting postal information to issuing a control number and checking tracking information.

[1240] "Destination address" refers to information such as the name, address, and postal code of the recipient of the mail.

[1241] "Sender information" refers to information such as the name, address, and postal code of the sender of the mail.

[1242] "Type of mail" refers to the type of mailing method or service, such as registered mail or regular mail.

[1243] "Postal Information" refers to information about a mail item, including the destination address, sender information, and type of mail item.

[1244] "Terminal" refers to an electronic device through which a user enters postal information and communicates with a server.

[1245] "Server" refers to the computer system that receives and processes postal information and calls various APIs.

[1246] "API" refers to an application program interface that provides specific functionality.

[1247] "Control Number" means a unique identification number used for tracking and managing mail.

[1248] "Database" refers to an information management system for storing acquired postal information, control numbers, and tracking information.

[1249] "JSON format" is an abbreviation for JavaScript Object Notation, and refers to a lightweight text format for structuring and displaying data.

[1250] A "secure communication protocol" refers to a communication protocol that ensures the safety of data transmission. A specific example is HTTPS.

[1251] "Scheduling service" refers to technology for executing tasks or jobs at specific times or intervals.

[1252] An "authentication token" refers to data that contains information used to identify a user and verify their permissions when accessing a service such as an API.

[1253] "Tracking Information" means information including the current location and status of a mail piece associated with a control number.

[1254] The present invention relates to a system that automates the process of sending mail, obtaining control numbers, and obtaining tracking information. This system inputs postal information based on the destination address, sender information, and type of mail, and sends it to a server. The server then calls the postal service's API to issue a control number. The issued control number and postal information are then stored in a database, and the control number is returned to the terminal and displayed to the user. The server also periodically calls the postal service's API to obtain tracking information associated with each control number and update the database. Finally, the user can check the tracking information from their terminal.

[1255] Hardware and Software Configuration

[1256] The system uses the following hardware and software:

[1257] Devices: General personal computers, smartphones, tablets, etc.

[1258] Server: A computer system with high-performance processing power. It can also be implemented on cloud servers such as Amazon Web Services (AWS) or Microsoft Azure.

[1259] Database: A relational database system such as MySQL or PostgreSQL.

[1260] Program processing

[1261] 1. Enter your postal information

[1262] Users use the terminal to enter the recipient's address, sender information, and mail type through a web browser or a dedicated application.

[1263] 2. Data transmission

[1264] The terminal converts the entered postal information into JSON format and sends it to the server using a secure communication protocol (e.g., HTTPS).

[1265] 3. Issuing and saving the control number

[1266] The server calls the postal service's API and requests the issuance of a control number based on the postal information. The API call uses an authentication token.

[1267] The server receives the control number returned from the API (for example, "EX123456789JP") and stores it in a database.

[1268] 4. Return and display of control number

[1269] The server returns the acquired control number to the terminal and displays it to the user. The terminal then displays this control number on its user interface.

[1270] 5. Regular tracking updates

[1271] The server uses a scheduling service to call the postal service's API, say every hour, to retrieve the latest tracking information associated with each control number.

[1272] The server updates the acquired tracking information to a database.

[1273] 6. Check your tracking information

[1274] The user enters the control number on the terminal and checks the latest tracking information.

[1275] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal, which displays the tracking information and allows the user to check the current location and status of the mail item.

[1276] Specific examples

[1277] Consider a scenario where a user wants to send an important document by registered mail.

[1278] The user enters the following information into the terminal:

[1279] Address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004

[1280] Sender information: 2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023

[1281] Type of mail: Simple registered mail

[1282] The terminal sends the input information to the server, for example in the following text format:

[1283] Address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004

[1284] Sender information: 2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023

[1285] Type of mail: Simple registered mail

[1286] The server sends a request to the postal service's API and obtains the control number "EX123456789JP".

[1287] The server stores the control number in a database and returns it to the terminal, which displays the control number to the user, who then mails the item based on the control number.

[1288] The server periodically calls the postal service's API to retrieve tracking information related to the control number and update the database.

[1289] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: YYYY-MM-DDTHH:MM:SSZ."

[1290] In this way, the system can automate mailing operations efficiently and accurately.

[1291] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1292] Step 1:

[1293] Enter your postal information

[1294] The user uses the terminal to enter the destination address, sender information, and mail type.

[1295] What happens: The user accesses a form displayed on the device screen and manually enters the following information:

[1296] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[1297] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[1298] Mail type: "Registered mail"

[1299] Input: Destination address, sender information, mail type

[1300] Output: Postal information entered

[1301] Step 2:

[1302] Sending data

[1303] The terminal converts the entered postal information into JSON format and sends it to the server.

[1304] What it does: The device takes the postal information entered by the user and converts it into the following JSON format:

[1305] json

[1306] {

[1307] "recipient_name": "Recipient name",

[1308] "recipient_address": "1-1-1 Yotsuya, Shinjuku-ku, Tokyo",

[1309] "recipient_postal_code": "160-0004",

[1310] "sender_name": "sender name",

[1311] "sender_address": "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture",

[1312] "sender_postal_code": "231-0023",

[1313] "mail_type": "Registered mail"

[1314] }

[1315] This data is sent to the server using the HTTPS protocol.

[1316] Input: Postal information entered by the user

[1317] Output: Postal information sent to the server in JSON format

[1318] Step 3:

[1319] Issuing and saving the control number

[1320] The server calls the postal service's API and makes a request to issue a control number based on the postal information.

[1321] Specific operation: The server sends an HTTP POST request to the postal service's API endpoint based on the received JSON data, including the API key and authentication token.

[1322] Input: JSON postal information, API key, and authentication token

[1323] Output: Obtained control number (e.g. "EX123456789JP")

[1324] Step 4:

[1325] Save control number

[1326] The server stores the acquired control number and postal information in a database.

[1327] Specific operation: The server executes an INSERT statement into the database, saving the control number and related postal information as a single record. The database can be MySQL or PostgreSQL.

[1328] Input: Obtained control number, postal information

[1329] Output: Control number and postal information stored in the database

[1330] Step 5:

[1331] Return and display of control number

[1332] The server returns the acquired control number to the terminal and displays it to the user.

[1333] Specific operation: The server generates a JSON response including the control number and sends it to the device using the HTTPS protocol. The device receives the response and displays it in the user interface. Example: "Control number: EX123456789JP"

[1334] Input: Obtained control number

[1335] Output: Control number returned to the terminal

[1336] Step 6:

[1337] Regular tracking updates

[1338] The server uses a scheduling service to periodically call the postal service's API to retrieve tracking information associated with each control number and update the database.

[1339] Specific operation: Set up a scheduling service such as a cron job on the server to send a request to the API endpoint every hour. Execute an UPDATE statement to update the acquired tracking information in the database.

[1340] Input: Each control number

[1341] Output: Updated tracking information

[1342] Step 7:

[1343] Check tracking information

[1344] The user enters the control number on the terminal and checks the latest tracking information.

[1345] Specific operation: The user enters the control number in the input field displayed on the terminal and clicks the "Check tracking information" button. The terminal receives this input and sends a request in JSON format to the server.

[1346] Input: Control Number

[1347] Output: Request sent to the server

[1348] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[1349] Specific operation: The server executes a SELECT statement on the database to obtain the latest tracking information associated with the specified control number, creates a JSON response containing the obtained tracking information, and sends it to the terminal.

[1350] Input: Control Number

[1351] Output: Retrieved tracking information

[1352] The terminal displays tracking information, allowing users to check the current location and status of their mail.

[1353] Specific operation: The device parses the JSON response received from the server and displays the information on the user interface. Example: "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: YYYY-MM-DDTHH:MM:SSZ".

[1354] Input: Retrieved tracking information

[1355] Output: Displayed tracking information

[1356] The above are the specific processing steps of the present invention. Through this series of steps, mailing operations can be automated efficiently and accurately.

[1357] (Application example 1)

[1358] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1359] In modern logistics facilities, product management and tracking are often inefficient, leading to human error and delays in management information. This results in poor tracking accuracy and lower customer satisfaction. Furthermore, the inability to respond quickly to important status changes calls for operational efficiency improvements.

[1360] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1361] In this invention, the server includes: means for inputting postal information based on the destination address, sender information, and type of mail; means for transmitting the postal information to the server; means for the server to call a post office API and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to a terminal and displaying it to a user; means for the server to periodically call a post office API to obtain tracking information associated with each control number and update the database; means for a user to check the tracking information from a terminal; means for a logistics facility to scan a barcode to obtain product information and input delivery destination and sender information; means for transmitting the product information and delivery information to the server and obtaining a control number; means for the server to update the tracking information in real time and notify important status changes via push notifications. This enables more efficient product management and tracking at logistics facilities, reduces human error, improves tracking accuracy, and increases customer satisfaction.

[1362] "Destination address" is information indicating the location where mail or merchandise is to be sent.

[1363] "Sender information" refers to information such as the name and address of the person sending the mail or product.

[1364] "Type of mail" is a category that indicates the format or service in which the mail is sent (e.g., registered mail, regular mail).

[1365] "Postal information" is a collection of detailed information such as the destination address, sender information, and type of mail.

[1366] "Server" means the part of the computer system that processes postal information and manages control numbers and tracking information.

[1367] "API" stands for Application Programming Interface, a specification that allows different software systems to communicate with each other.

[1368] "Control number" means a unique identifier issued for the purpose of tracking and managing mail or merchandise.

[1369] A "database" is a system for systematically storing and managing data such as postal information and control numbers.

[1370] A "terminal" is a device (e.g., smartphone, computer) that a user uses to enter information and view results.

[1371] "Tracking information" is detailed information about the current location and delivery status of mail or goods.

[1372] "User" means a person who uses this system to manage mail and product information.

[1373] A "logistics facility" is a place where goods are stored, sorted, and shipped.

[1374] A "barcode" is a visual identification code for machine-readable product information.

[1375] "Scanning" is the process of optically reading a barcode and capturing the information as digital data.

[1376] "Tracking accuracy" refers to the ability to accurately determine the location and status of mail or goods.

[1377] "Push notification" is a technology that allows applications to notify users of important information in real time.

[1378] "Managing goods at a logistics facility" means efficiently carrying out a series of operations, including receiving, storing, picking, and shipping goods.

[1379] "Human error" refers to mistakes or errors that people make while working.

[1380] The present invention relates to a system for improving the efficiency of product management and tracking in a logistics facility. Specific embodiments will be described below.

[1381] 1. Enter shipping address and sender information

[1382] The user uses the terminal to input the delivery address, sender information, and product type. Specifically, the user uses a smartphone app to input detailed product information, the delivery address, and sender information.

[1383] 2. Obtaining product information

[1384] At the logistics facility, users use their smartphones to scan product barcodes, which automatically enters product information into the app.

[1385] 3. Sending data to the server

[1386] The terminal sends the entered product information and delivery information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the data is transmitted safely.

[1387] 4. Issuing and saving the control number

[1388] The server calls the API of the logistics system and issues a control number based on the product information and delivery information sent. The server receives the control number returned from the API and stores it in a database.

[1389] 5. Return and display of control number

[1390] The server returns the acquired control number to the terminal and displays it to the user. For example, the issued control number "LM123456789DN" is displayed on the terminal screen so that the user can confirm it.

[1391] 6. Regular tracking updates

[1392] The server periodically calls the API of the logistics system to obtain tracking information related to each control number. A scheduling tool (e.g., a CRON job) is set up so that the server can call the API in real time. The obtained tracking information is then updated in the database.

[1393] 7. Tracking Information and Notifications

[1394] Users can enter the control number on their device to check the latest tracking information. The server retrieves the tracking information related to the control number from the database and returns it to the device. In addition, if an important status change occurs, the user will be notified via push notification.

[1395] Hardware and software used

[1396] Devices: Smartphones, tablets, laptops, etc.

[1397] Server: Cloud-based server, VPS, etc.

[1398] Software: Smartphone apps (e.g., iOS, Android apps), server-side programs (e.g., Node.js, Python), database management systems (e.g., MySQL, PostgreSQL), secure communication protocols (e.g., HTTPS), and scheduling tools (e.g., CRON jobs).

[1399] API: Logistics system API, post office API, etc.

[1400] Specific examples

[1401] Consider a scenario where a worker at a logistics facility scans the barcode of product "1234567890" with a smartphone app and sends the product to a specific address. The user uses the app to enter the recipient's name and address and obtains the control number "LM123456789DN." The control number is used to place the product in the logistics flow, and tracking information can be checked in real time. Additionally, if there are any important status changes, the worker can be notified via push notification.

[1402] Example prompts to input to a generative AI model:

[1403] "We would like to develop a smartphone app that will be useful in logistics facilities. This app will have functions such as barcode scanning, inputting delivery addresses, issuing control numbers, and managing tracking information. We would like to use the logistics system API to update tracking information in real time and send push notifications if there are any important status changes. Please generate the specific program part for this purpose."

[1404] This invention improves the efficiency of product management and tracking in logistics facilities, reducing human error, improving tracking accuracy, and increasing customer satisfaction.

[1405] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1406] Step 1:

[1407] The user scans the barcode of a product using a smartphone app. By scanning the barcode, product information is imported into the device as digital data. Input: Product barcode information. Output: Product information (e.g. product ID, name, quantity, etc.). Operation: The barcode is read using the smartphone camera, and the product information is analyzed from the barcode and displayed in the app.

[1408] Step 2:

[1409] The user enters the shipping address, sender information, and product type into the app. Input: Shipping address, sender information, and product type manually entered by the user. Output: A complete dataset of products with shipping information. Behavior: The user enters the required information into the app's input fields, which are then integrated within the app.

[1410] Step 3:

[1411] The terminal sends the entered product information and delivery information to the server. Input: Product information and delivery information. Output: JSON data sent to the server. Operation: The app sends information to the server using a secure communication protocol (HTTPS).

[1412] Step 4:

[1413] The server issues a control number based on the submitted product information and delivery information. Input: Product information and delivery information. Output: Control number. Operation: The server sends a request to the logistics system's API and obtains the control number.

[1414] Step 5:

[1415] The server saves the acquired control number in a database. Input: Control number and corresponding product information, delivery information. Output: Control number and related information saved in the database. Operation: The server writes information to the database.

[1416] Step 6:

[1417] The server returns the issued control number to the terminal and displays it to the user. Input: Control number. Output: Control number displayed on the terminal screen. Operation: The server sends the control number to the terminal, and the app displays it to the user.

[1418] Step 7:

[1419] The server periodically calls the API of the logistics system to obtain tracking information related to the control number. Input: Control number list. Output: Latest tracking information. Operation: The server periodically calls the API using a scheduling tool (e.g., CRON job) to obtain tracking information.

[1420] Step 8:

[1421] The server updates the database with the acquired tracking information. Input: Latest tracking information. Output: Updated database. Operation: The server writes the new tracking information to the database.

[1422] Step 9:

[1423] The user enters the control number on the device and checks the latest tracking information. Input: Control number. Output: Latest tracking information displayed on the device. Operation: The app sends the control number to the server, which retrieves the tracking information from the database and sends it back to the device.

[1424] Step 10:

[1425] The server notifies the user via push notification when an important status change occurs. Input: Tracking information status. Output: Push notification. Operation: The server detects the status change, generates a push notification and sends it to the device. This notification allows the user to receive important information in real time.

[1426] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1427] The present invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. Specific embodiments are described below.

[1428] 1. Enter your postal information

[1429] The user uses the terminal to enter the destination address, sender information, and mail type.

[1430] For example, a user enters the following information into a terminal:

[1431] Destination address: recipient's name, address, and postal code

[1432] Sender information: sender's name, address, and postal code

[1433] Type of mail: Simple registered mail, regular mail, etc.

[1434] 2. Use of Emotion Engine

[1435] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice while the user is typing, and uses an emotion engine to recognize the user's emotions.

[1436] The emotion engine analyzes the user's emotional data in real time and, if it detects that the user is feeling stressed, it will provide supportive messages and guidance. The emotion engine also adjusts the input screen interface in real time according to the user's emotions.

[1437] 3. Sending data to the server

[1438] The terminal transmits the input postal information and emotion data to the server.

[1439] The data is sent securely to the server using a secure communication protocol (e.g., HTTPS) and in a structured data format such as JSON.

[1440] 4. Issuing and saving the control number

[1441] The server receives the postal information and emotion data, prepares to call the post office's API, and converts the received postal information into a data format for the API request.

[1442] The server sends a request to the post office's API to issue a control number and receives the control number returned from the API.

[1443] 5. Saving to the database

[1444] The server stores the control number and associated postal and emotional data in a database for future reference and analysis.

[1445] 6. Return and display of control number

[1446] The server returns the acquired control number to the terminal and instructs the terminal to display it to the user.

[1447] The terminal displays the returned control number to the user so that the user can check it.

[1448] 7. Regular tracking updates

[1449] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number.

[1450] The server updates the acquired tracking information to a database by sending API requests at regular intervals using a batch job or scheduling tool.

[1451] 8. Check your tracking information

[1452] The user enters the control number on the terminal and checks the latest tracking information.

[1453] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[1454] The device displays the latest tracking information to the user.

[1455] Specific examples

[1456] Consider a scenario where a user wants to send an important document by registered mail.

[1457] The user enters the following information into the terminal:

[1458] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[1459] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[1460] Type of mail: Simple registered mail

[1461] The device sends the input information along with the user's emotions (e.g., if the user is feeling stressed) to the server. This data is transmitted using a secure communication protocol.

[1462] The server calls the post office's API, obtains the control number "EX123456789JP", and stores this data in the database.

[1463] The server returns the control number to the terminal, which then displays the control number to the user, who then mails the item based on that control number.

[1464] The server periodically calls the post office's API to retrieve the latest tracking information associated with the control number and update the database.

[1465] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[1466] Through this series of steps, not only is postal work automated, but the emotional engine also improves the user experience.

[1467] The processing flow will be explained below.

[1468] Step 1:

[1469] A user uses a terminal to enter a destination address, sender information, and the type of mail (e.g., registered mail). For example, the user enters the following data: "Destination address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo, 160-0004" and "Sender information: 2-2-2 Yamashita-cho, Naka-ku, Yokohama-shi, Kanagawa, 231-0023."

[1470] Step 2:

[1471] The device uses an emotion engine to analyze the user's facial expressions and tone of voice, recognizing the user's emotions (e.g., stress, joy, surprise, etc.) in real time and capturing that data.

[1472] Step 3:

[1473] If the emotion engine detects the user's stress level, the device will display a support message (e.g., "There's an easier way to input") to the user. If the emotion engine deems appropriate, it will also adjust the input screen interface to make input more comfortable for the user.

[1474] Step 4:

[1475] The device sends the entered postal information and emotion data to the server. This data is securely transmitted using a secure communication protocol (e.g., HTTPS). The transmitted data is in a structured data format such as JSON.

[1476] Step 5:

[1477] The server receives the postal information and emotion data. Based on the received data, it prepares to call the post office's API. The received data is converted into a data format for the API request.

[1478] Step 6:

[1479] The server sends a request to the post office API to issue a control number. The request is sent using an HTTP POST request, including the necessary postal information.

[1480] Step 7:

[1481] The server receives the response from the post office API, extracts the control number from the response data, and stores it in the system.

[1482] Step 8:

[1483] The server then stores the acquired control number and associated postal and emotional data in a database for future reference and analysis.

[1484] Step 9:

[1485] The server returns the control number to the terminal, which then displays this control number to the user so that the user can confirm it.

[1486] Step 10:

[1487] The server periodically calls the post office's API to retrieve the tracking information associated with each control number, using a batch job or scheduling tool to send requests every hour.

[1488] Step 11:

[1489] The server updates the database with the acquired tracking information, specifically by executing SQL queries to update the status, last location, and timestamp of the tracking information.

[1490] Step 12:

[1491] The user inputs the control number on the terminal to check the latest tracking information. The terminal sends the request to the server, which retrieves the latest tracking information from the database and returns it to the terminal.

[1492] Step 13:

[1493] The tracking information for the returned device is displayed to the user. For example, the user can see information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[1494] Example 2

[1495] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1496] Conventional mail numbering and tracking systems require users to manually enter information without considering their feelings, which can lead to input errors and increased effort. Furthermore, obtaining mail control numbers and tracking information is cumbersome, resulting in a poor user experience. Furthermore, there is a risk of information leaks due to insufficient consideration given to security.

[1497] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1498] In this invention, the server includes: means for inputting postal information based on the destination address, sender information, and type of mail; means for using an emotion engine that analyzes the user's facial expressions and tone of voice to acquire emotion data; means for transmitting the postal information and emotion data to the server; means for the server to call a post office API and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to the terminal and displaying it to the user; means for the server to periodically call the post office API to acquire tracking information associated with each control number and update the database; and means for the user to check the tracking information from the terminal. This automates and streamlines the process of mail numbering, acquiring control numbers, and periodically updating and checking tracking information, improving the user experience. Furthermore, the use of the emotion engine allows support messages and interfaces to be adjusted according to the user's emotions, further improving security.

[1499] "Postal Information" refers to data regarding destination address, sender information, and mail type.

[1500] An "emotion engine" refers to an analysis system that analyzes a user's facial expressions and tone of voice to recognize the user's emotions in real time.

[1501] "Terminal" refers to a device for a user to input information and a device for transmitting the input information to a server.

[1502] "Server" refers to the computer system that processes postal information and sentiment data, issues control numbers, stores them in a database, and updates and provides tracking information.

[1503] "Control number" refers to a unique identifier issued through the post office's API to identify a specific piece of mail.

[1504] "Database" refers to a data structure that stores postal information, emotion data, control numbers, and tracking information and allows for easy searching and updating.

[1505] "Secure communications protocol" refers to a communications method that includes encryption technology to ensure the secure transmission and reception of data.

[1506] A "batch job" refers to a series of processes that are executed automatically and periodically, and is used in particular to periodically call the post office's API.

[1507] A "scheduling tool" refers to software that configures certain tasks to be performed automatically at specified times or intervals.

[1508] "Tracking Information" refers to data containing the current status and location of a mail piece associated with a particular control number.

[1509] The present invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and further improves the user experience by using an emotion engine. Specific embodiments are described below.

[1510] 1. Enter your postal information

[1511] The user uses the terminal to enter the destination address, sender information, and mail type.

[1512] As an example, a user enters the following information into a terminal:

[1513] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[1514] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[1515] Type of mail: Simple registered mail

[1516] 2. Use of Emotion Engine

[1517] The device uses a camera and microphone to capture the user's facial expressions and tone of voice, and sends them to the emotion engine, which analyzes them in real time and generates the user's emotion data.

[1518] If the emotion engine recognizes that the user is feeling stressed, it displays support messages and guidance and adjusts the input screen interface.

[1519] 3. Sending data to the server

[1520] The terminal sends the entered postal information and emotion data to the server using a secure communication protocol (e.g., HTTPS). The sent data is structured data in JSON format.

[1521] 4. Issuing and saving the control number

[1522] The server converts the received postal information and emotion data into a data format for API requests and calls the post office's API.

[1523] The server sends a request to issue a control number to the post office's API and receives the control number in return.

[1524] 5. Saving to the database

[1525] The server stores the acquired control number and associated postal and emotion data in a database for future reference and analysis.

[1526] 6. Return and display of control number

[1527] The server returns the acquired control number to the terminal and displays it to the user.

[1528] The terminal displays the returned control number to the user so that the user can check it.

[1529] 7. Regular tracking updates

[1530] The server calls the post office's API at regular intervals to retrieve the latest tracking information associated with each control number and updates the database, using batch jobs and scheduling tools to accomplish this.

[1531] 8. Check your tracking information

[1532] The user enters the control number into the terminal to check the latest tracking information.

[1533] The server retrieves the relevant tracking information from the database and returns it to the terminal.

[1534] The terminal displays the latest tracking information to the user.

[1535] Specific examples and prompts for the generative AI model

[1536] Specific examples

[1537] Consider a scenario where a user wants to send an important document by registered mail.

[1538] The user enters the following information into the terminal:

[1539] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[1540] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[1541] Type of mail: Simple registered mail

[1542] The device sends the input information along with the user's emotional data (e.g., if the user is feeling stressed) to the server using a secure communication protocol.

[1543] The server calls the post office's API, obtains the control number "EX123456789JP", and stores this data in the database.

[1544] The server returns the control number to the terminal, which then displays the control number to the user, who then mails the item based on that control number.

[1545] The server periodically calls the post office's API to retrieve the latest tracking information associated with the control number and update the database.

[1546] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[1547] Example prompts for generative AI models

[1548] "Create a scenario in which a user sends a registered letter. The user enters the recipient address, sender information, and type of mail. Also include a scenario in which the emotion engine provides a supportive message to the user who is feeling stressed."

[1549] Through the system of the present invention, not only are mailing numbers, obtaining control numbers, and regular updates and confirmation of tracking information automated and efficient, but the use of an emotion engine also improves the user experience.

[1550] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1551] Step 1:

[1552] The user uses the terminal to enter postal information.

[1553] Input: Destination address, sender information, mail type

[1554] Output: Temporarily save input information

[1555] How it works: The user types in an address or other information on the keyboard, and the data appears in fields on the screen. The data is temporarily stored in memory.

[1556] Step 2:

[1557] The device uses a camera and microphone to capture the user's facial expressions and tone of voice.

[1558] Input: User's facial expressions, tone of voice

[1559] Output: Captured emotion data

[1560] How it works: The camera and microphone are activated to collect data in real time, which is then sent to the emotion engine API.

[1561] Step 3:

[1562] The emotion engine analyzes the user's emotion data.

[1563] Input: Captured emotion data

[1564] Output: Analysis results (e.g., whether the user is feeling stressed)

[1565] How it works: The emotion engine performs analysis in real time and returns the results in JSON format to the device.

[1566] Step 4:

[1567] The terminal receives the analysis results and displays a support message if necessary.

[1568] Input: Analysis results from the emotion engine

[1569] Output: Helpful message (if needed)

[1570] How it works: If it detects you are stressed, a message such as "Please stay calm when typing" will pop up.

[1571] Step 5:

[1572] The terminal transmits the input postal information and emotion data to the server.

[1573] Input: Postal information and emotion data

[1574] Output: Data sent to the server

[1575] How it works: Data is sent to the server in JSON format using the HTTPS protocol.

[1576] Step 6:

[1577] The server converts the received postal information and emotion data into a format suitable for API requests.

[1578] Input: Postal information and emotion data sent to the server

[1579] Output: Data format for API requests

[1580] What it does: The server converts the data into the appropriate JSON format.

[1581] Step 7:

[1582] The server calls the post office's API and issues a control number.

[1583] Input: Data format for API requests

[1584] Output: Retrieved control number

[1585] Operation: The server generates an API request and returns the control number "EX123456789JP".

[1586] Step 8:

[1587] The server stores the obtained control number and associated postal information and emotion data in a database.

[1588] Input: Control number, postal information, and emotion data

[1589] Output: Data stored in the database

[1590] What it does: Inserts data into a database using an SQL query.

[1591] Step 9:

[1592] The server returns the control number to the terminal and instructs it to be displayed to the user.

[1593] Input: Control number

[1594] Output: Control number returned to the terminal

[1595] Operation: Generates a management number in JSON format and sends it to the terminal via HTTPS protocol.

[1596] Step 10:

[1597] The terminal displays the returned control number to the user.

[1598] Input: Returned control number

[1599] Output: Control number displayed on the screen

[1600] Operation: The control number is displayed on the screen.

[1601] Step 11:

[1602] The server calls the post office's API at regular intervals to obtain the latest tracking information.

[1603] Input: Each control number

[1604] Output: Retrieved tracking information

[1605] How it works: Use a batch job or scheduling tool to send API requests and get the latest information.

[1606] Step 12:

[1607] The server updates the acquired tracking information to a database.

[1608] Input:Tracking information

[1609] Output: Updated database

[1610] Action: Updates the tracking information for that entry in the database.

[1611] Step 13:

[1612] The user enters the control number into the terminal and checks the latest tracking information.

[1613] Input: Control number

[1614] Output: Retrieved tracking information

[1615] Action: Enter the control number into the input form and click the submit button.

[1616] Step 14:

[1617] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[1618] Input: Control number

[1619] Output: Tracking information sent to the device

[1620] What it does: Searches the database and sends tracking information in JSON format to the device.

[1621] Step 15:

[1622] The device displays the latest tracking information to the user.

[1623] Input: Returned tracking information

[1624] Output: Tracking information displayed on screen

[1625] What it does: The screen will display "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[1626] (Application example 2)

[1627] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1628] In modern logistics centers, managing mail order and tracking information is important, but it is a labor-intensive and time-consuming task. Furthermore, when employees manually perform these tasks, fatigue and stress accumulate, resulting in reduced efficiency. Therefore, there is a need for a system that automates the management of mail order and tracking information while also analyzing employee emotions to improve the working environment.

[1629] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1630] In this invention, the server includes: a means for inputting postal information based on the destination address, sender information, and type of mail; a means for transmitting the postal information to the server; a means for the server to call a post office API and issue a control number based on the transmitted postal information; a means for analyzing the user's facial expression and tone of voice while inputting the postal information and acquiring emotional data; a means for the server to store the issued control number, postal information, and emotional data in a database; a means for returning the control number to the terminal and displaying it to the user; a means for the server to periodically call a post office API, acquire tracking information related to each control number, and update the database; a means for the user to check the tracking information on the terminal; and a means for analyzing the user's fatigue and stress and displaying a support message encouraging them to take a break as needed. This not only enables efficient mail management, but also provides a comfortable working environment by analyzing employees' emotional data and providing appropriate support.

[1631] "Destination address" refers to information such as the name, address, and postal code of the person receiving the mail.

[1632] "Sender information" refers to information such as the name, address, and postal code of the person sending the mail.

[1633] "Type of mail" indicates whether the mail is classified as a specific delivery method or type, such as registered mail, regular mail, or express mail.

[1634] "Postal information" refers to information including the destination address, sender information, and type of mail.

[1635] A "server" is a computer system that receives postal information and performs processes such as issuing control numbers, storing data, and obtaining tracking information.

[1636] "Smart glasses" are wearable devices that can acquire visual and audio information when worn by a user, and analyze and display it in real time.

[1637] "Emotion data" is data that indicates the user's emotional state, obtained from the user's facial expression, tone of voice, etc.

[1638] An "API" is an interface that a program uses to communicate with external services and resources.

[1639] A "control number" is a specific number issued to uniquely identify a mail item.

[1640] "Tracking information" is information that indicates the current location and delivery status of mail.

[1641] A "batch job" is a series of tasks or processes that are executed periodically.

[1642] A "scheduling tool" is software that automatically executes tasks at specific times or intervals.

[1643] A "secure communication protocol" is a standardized method for securely sending and receiving data, and HTTPS is commonly used.

[1644] A "terminal" is a device used by a user to enter or receive information.

[1645] This invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. Specific embodiments are described below.

[1646] System configuration and operation

[1647] 1. Enter your postal information

[1648] The user uses the smart glasses to enter the recipient address, sender information, and mail type. The user inputs the information using touch or voice commands, following the input form displayed on the smart glasses screen.

[1649] 2. Acquiring Emotion Data

[1650] While the user is entering information, the smart glasses' built-in camera and microphone analyze the user's facial expressions and tone of voice, which are then processed in real time by the emotion engine to obtain the user's emotional data.

[1651] 3. Sending data to the server

[1652] The device (smart glasses) sends the entered postal information and emotion data to the server. This communication is performed using a secure protocol (e.g., HTTPS). The data is sent in a structured data format such as JSON.

[1653] 4. Issuing and saving the control number

[1654] The server calls the post office's API based on the received postal information and issues a control number. At this time, the server converts the received postal information into a data format for API requests. The issued control number, related postal information, and emotion data are stored in a database.

[1655] 5. Return and display of control number

[1656] The server instructs the terminal to return the acquired control number, and the control number is displayed on the screen of the smart glasses. The user can confirm this control number and use it to send mail.

[1657] 6. Updating and Checking Tracking Information

[1658] The server periodically calls the post office's API to obtain the latest tracking information associated with each control number and updates the database. Users can then enter the control number through the smart glasses to check the latest tracking information at any time.

[1659] 7. Support based on emotional data

[1660] By analyzing the emotional data, if the user feels tired or stressed, a support message encouraging them to take a break will be displayed on the smart glasses.

[1661] Hardware and software used

[1662] Smart glasses: Devices with built-in cameras and microphones that capture visual and auditory information from the user.

[1663] Emotion Engine Library (EmotionAnalyzer): Software that recognizes emotions by analyzing the user's facial expressions and tone of voice.

[1664] Server: A computer system that stores data and communicates with APIs.

[1665] Secure communication protocol (e.g. HTTPS): A standardized way of sending and receiving data securely.

[1666] Post Office API: An external service that issues mail control numbers and provides tracking information.

[1667] Specific examples

[1668] Consider a scenario where an employee wants to send an important document by registered mail. The employee uses the smart glasses to input the recipient's address, sender's information, and the type of mail. The camera and microphone also analyze the employee's facial expressions and tone of voice in real time. If the employee feels fatigued or stressed, the emotion engine will suggest taking a break at the appropriate time.

[1669] Prompt Sentence Examples

[1670] Please tell me about a system that automates the process of sending mail, obtaining control numbers, and obtaining tracking information. This system also incorporates an emotion engine that recognizes user emotions, aiming to improve the user experience. Specifically, in the following scenarios:

[1671] 1. The user enters postal information (sender, recipient, type of mail) through the smart glasses.

[1672] 2. The emotion engine analyzes facial expressions and tone of voice in real time.

[1673] 3. Based on the recognized emotions, the system provides appropriate support messages and guidance.

[1674] Please elaborate on the detailed process flow and technologies used.

[1675] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1676] Step 1:

[1677] The user uses the smart glasses to enter the recipient's address, sender information, and mail type, which are then entered into a form displayed on the glasses' display using touch or voice input.

[1678] Input: User's destination address, sender information, mail type

[1679] Output: Input postal information data (recipient address, sender information, type of mail)

[1680] Step 2:

[1681] The smart glasses' built-in camera and microphone capture the user's facial expressions and tone of voice while they are typing, and pass the data to the emotion engine, which analyzes the data in real time to generate the user's emotion data.

[1682] Input: User's facial expression data, voice tone data

[1683] Output: Emotion data (user's stress and emotional state)

[1684] Step 3:

[1685] The device (smart glasses) sends the entered postal information and emotion data to the server using a secure communication protocol. The data is sent in a structured data format such as JSON.

[1686] Input: Postal information data, emotion data

[1687] Output: Transmission result to the server (success / failure)

[1688] Step 4:

[1689] The server calls the post office's API based on the received postal information, prepares to issue a control number, converts the received postal information into a data format for API requests, and calls the API.

[1690] Input: Postal information data

[1691] Output: Control number (data returned from API)

[1692] Step 5:

[1693] The server stores the issued control number and related postal information and emotion data in a database.

[1694] Input: Control number, postal information, emotion data

[1695] Output: Database save result (success / failure)

[1696] Step 6:

[1697] The server returns the management number to the device, and the device (smart glasses) displays the acquired management number to the user. The user confirms this management number.

[1698] Input: Control Number

[1699] Output: Control number returned to the terminal, displayed to the user

[1700] Step 7:

[1701] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number and updates the database, an operation that can be automated using batch jobs or scheduling tools.

[1702] Input: Control Number

[1703] Output: Latest tracking information, database updates

[1704] Step 8:

[1705] The user inputs the control number through the smart glasses to check the latest tracking information. The server retrieves the tracking information associated with the control number from the database and returns it to the terminal. The terminal then displays the latest tracking information to the user.

[1706] Input: Control Number

[1707] Output: Latest tracking information, returned to device, displayed to user

[1708] Step 9:

[1709] If the user feels fatigued or stressed based on the emotion data, a support message encouraging them to take a break will be displayed on the smart glasses. This message is displayed in real time based on the analysis of the emotion data.

[1710] Input: Emotion data

[1711] Output: Support message (display a break message if necessary)

[1712] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1713] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1714] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1715] [Fourth embodiment]

[1716] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1717] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1718] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1719] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1720] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1721] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1722] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1723] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1724] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1725] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1726] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1727] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1728] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1729] The present invention relates to a system for automating the process of issuing mail numbers, acquiring control numbers, and acquiring tracking information. Specific embodiments will be described below.

[1730] 1. Enter your postal information

[1731] The user uses the terminal to enter the destination address, sender information, and mail type.

[1732] For example, a user enters the following information into a terminal:

[1733] Destination address: recipient's name, address, and postal code

[1734] Sender information: sender's name, address, and postal code

[1735] Type of mail: Simple registered mail, regular mail, etc.

[1736] 2. Sending data to the server

[1737] The terminal transmits the entered postal information to the server.

[1738] Data is transmitted securely using secure communication protocols (e.g. HTTPS).

[1739] 3. Issuing and saving the control number

[1740] The server calls the post office's API and requests the issuance of a control number based on the submitted postal information.

[1741] For example, by sending an HTTP POST request to an API endpoint.

[1742] The server receives the control number returned from the API and stores it in a database.

[1743] 4. Return and display of control number

[1744] The server returns the acquired control number to the terminal and displays it to the user.

[1745] As a specific example, the issued control number "EX123456789JP" is displayed on the terminal screen so that the user can confirm it.

[1746] 5. Regular tracking updates

[1747] The server periodically calls the post office's API to retrieve the tracking information associated with each control number.

[1748] For example, set up a batch job that causes the server to call the API every hour.

[1749] The acquired tracking information is updated in the database.

[1750] 6. Check your tracking information

[1751] The user enters the control number on the terminal and checks the latest tracking information.

[1752] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[1753] The terminal displays tracking information, allowing users to check the current location and status of their mail.

[1754] Specific examples

[1755] Consider a scenario where a user wants to send an important document by registered mail.

[1756] The user enters the following information into the terminal:

[1757] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[1758] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[1759] Type of mail: Simple registered mail

[1760] The device sends the input information to the server, for example in JSON format like this:

[1761] json

[1762] {

[1763] "recipient_name": "Recipient name",

[1764] "recipient_address": "1-1-1 Yotsuya, Shinjuku-ku, Tokyo",

[1765] "recipient_postal_code": "160-0004",

[1766] "sender_name": "sender name",

[1767] "sender_address": "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture",

[1768] "sender_postal_code": "231-0023",

[1769] "mail_type": "Registered mail"

[1770] }

[1771] The server sends a request to the post office's API and obtains the control number "EX123456789JP".

[1772] The server stores the control number in a database and returns the control number to the terminal.

[1773] The terminal displays this control number to the user, who then mails the mail based on the control number.

[1774] The server periodically calls the post office's API to retrieve tracking information related to the control number and update it in the database.

[1775] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[1776] Through this series of steps, postal operations will be automated, improving work efficiency and reducing errors.

[1777] The processing flow will be explained below.

[1778] Step 1:

[1779] The user uses the terminal to input the destination address, sender information, and type of mail, such as the recipient's name, address, and postal code, the sender's name, address, and postal code, and the type of mail (e.g., registered mail).

[1780] Step 2:

[1781] The terminal sends the entered postal information to the server. The terminal uses a secure communication protocol (e.g., HTTPS) to securely transmit the data to the server. The data is sent in a structured data format, such as JSON.

[1782] Step 3:

[1783] The server receives the postal information and prepares it to call the post office's API. Specifically, it converts the received postal information into a data format for the API request.

[1784] Step 4:

[1785] The server sends a request to the post office API to issue a control number. The request is sent using an HTTP POST request, including the necessary postal information.

[1786] Step 5:

[1787] The server receives the response from the post office API and extracts the control number. The response data is returned in JSON format, and the server obtains the control number from that.

[1788] Step 6:

[1789] The server stores the control number and associated postal information in a database, using an SQL query to store information such as the control number, destination address, sender information, and mail type.

[1790] Step 7:

[1791] The server returns the control number to the terminal, which then displays the received control number to the user so that the user can confirm it.

[1792] Step 8:

[1793] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number. For example, a batch job or scheduling tool could be used to send an API request every hour.

[1794] Step 9:

[1795] The server updates the database with the tracking information it has acquired, specifically by running SQL queries to update information such as the last location, status, and timestamp.

[1796] Step 10:

[1797] The user enters the control number on the terminal and checks the latest tracking information. The terminal sends the control number to the server, which retrieves the tracking information from the database and returns it to the terminal. The terminal then displays the latest tracking information to the user.

[1798] Example 1

[1799] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1800] In conventional mailing procedures, issuing control numbers and checking tracking information is done manually, which results in low work efficiency and a high likelihood of errors. Furthermore, issuing control numbers and obtaining tracking information often takes time, which can be inconvenient for users. There was a need to solve these problems and improve the efficiency of mailing operations while reducing errors.

[1801] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1802] In this invention, the server includes: means for inputting postal information based on a destination address, sender information, and type of mail; means for transmitting the postal information to the server; means for the server to call an API of a postal service and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to the terminal and displaying it to the user; means for the server to periodically call an API of a postal service to obtain tracking information associated with each control number and update the database; means for the user to check the tracking information from the terminal; means for the terminal to convert the input data into JSON format and send it to the server; means for the server to obtain the control number using an authentication token of the API of the postal service; and means for the server to periodically call the API using a scheduling service. This makes it possible to automate processes from inputting postal information to issuing a control number and checking tracking information.

[1803] "Destination address" refers to information such as the name, address, and postal code of the recipient of the mail.

[1804] "Sender information" refers to information such as the name, address, and postal code of the sender of the mail.

[1805] "Type of mail" refers to the type of mailing method or service, such as registered mail or regular mail.

[1806] "Postal Information" refers to information about a mail item, including the destination address, sender information, and type of mail item.

[1807] "Terminal" refers to an electronic device through which a user enters postal information and communicates with a server.

[1808] "Server" refers to the computer system that receives and processes postal information and calls various APIs.

[1809] "API" refers to an application program interface that provides specific functionality.

[1810] "Control Number" means a unique identification number used for tracking and managing mail.

[1811] "Database" refers to an information management system for storing acquired postal information, control numbers, and tracking information.

[1812] "JSON format" is an abbreviation for JavaScript Object Notation, and refers to a lightweight text format for structuring and displaying data.

[1813] A "secure communication protocol" refers to a communication protocol that ensures the safety of data transmission. A specific example is HTTPS.

[1814] "Scheduling service" refers to technology for executing tasks or jobs at specific times or intervals.

[1815] An "authentication token" refers to data that contains information used to identify a user and verify their permissions when accessing a service such as an API.

[1816] "Tracking Information" means information including the current location and status of a mail piece associated with a control number.

[1817] The present invention relates to a system that automates the process of sending mail, obtaining control numbers, and obtaining tracking information. This system inputs postal information based on the destination address, sender information, and type of mail, and sends it to a server. The server then calls the postal service's API to issue a control number. The issued control number and postal information are then stored in a database, and the control number is returned to the terminal and displayed to the user. The server also periodically calls the postal service's API to obtain tracking information associated with each control number and update the database. Finally, the user can check the tracking information from their terminal.

[1818] Hardware and Software Configuration

[1819] The system uses the following hardware and software:

[1820] Devices: General personal computers, smartphones, tablets, etc.

[1821] Server: A computer system with high-performance processing power. It can also be implemented on cloud servers such as Amazon Web Services (AWS) or Microsoft Azure.

[1822] Database: A relational database system such as MySQL or PostgreSQL.

[1823] Program processing

[1824] 1. Enter your postal information

[1825] Users use the terminal to enter the recipient's address, sender information, and mail type through a web browser or a dedicated application.

[1826] 2. Data transmission

[1827] The terminal converts the entered postal information into JSON format and sends it to the server using a secure communication protocol (e.g., HTTPS).

[1828] 3. Issuing and saving the control number

[1829] The server calls the postal service's API and requests the issuance of a control number based on the postal information. The API call uses an authentication token.

[1830] The server receives the control number returned from the API (for example, "EX123456789JP") and stores it in a database.

[1831] 4. Return and display of control number

[1832] The server returns the acquired control number to the terminal and displays it to the user. The terminal then displays this control number on its user interface.

[1833] 5. Regular tracking updates

[1834] The server uses a scheduling service to call the postal service's API, say every hour, to retrieve the latest tracking information associated with each control number.

[1835] The server updates the acquired tracking information to a database.

[1836] 6. Check your tracking information

[1837] The user enters the control number on the terminal and checks the latest tracking information.

[1838] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal, which displays the tracking information and allows the user to check the current location and status of the mail item.

[1839] Specific examples

[1840] Consider a scenario where a user wants to send an important document by registered mail.

[1841] The user enters the following information into the terminal:

[1842] Address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004

[1843] Sender information: 2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023

[1844] Type of mail: Simple registered mail

[1845] The terminal sends the input information to the server, for example in the following text format:

[1846] Address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004

[1847] Sender information: 2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023

[1848] Type of mail: Simple registered mail

[1849] The server sends a request to the postal service's API and obtains the control number "EX123456789JP".

[1850] The server stores the control number in a database and returns it to the terminal, which displays the control number to the user, who then mails the item based on the control number.

[1851] The server periodically calls the postal service's API to retrieve tracking information related to the control number and update the database.

[1852] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: YYYY-MM-DDTHH:MM:SSZ."

[1853] In this way, the system can automate mailing operations efficiently and accurately.

[1854] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1855] Step 1:

[1856] Enter your postal information

[1857] The user uses the terminal to enter the destination address, sender information, and mail type.

[1858] What happens: The user accesses a form displayed on the device screen and manually enters the following information:

[1859] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[1860] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[1861] Mail type: "Registered mail"

[1862] Input: Destination address, sender information, mail type

[1863] Output: Postal information entered

[1864] Step 2:

[1865] Sending data

[1866] The terminal converts the entered postal information into JSON format and sends it to the server.

[1867] What it does: The device takes the postal information entered by the user and converts it into the following JSON format:

[1868] json

[1869] {

[1870] "recipient_name": "Recipient name",

[1871] "recipient_address": "1-1-1 Yotsuya, Shinjuku-ku, Tokyo",

[1872] "recipient_postal_code": "160-0004",

[1873] "sender_name": "sender name",

[1874] "sender_address": "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture",

[1875] "sender_postal_code": "231-0023",

[1876] "mail_type": "Registered mail"

[1877] }

[1878] This data is sent to the server using the HTTPS protocol.

[1879] Input: Postal information entered by the user

[1880] Output: Postal information sent to the server in JSON format

[1881] Step 3:

[1882] Issuing and saving the control number

[1883] The server calls the postal service's API and makes a request to issue a control number based on the postal information.

[1884] Specific operation: The server sends an HTTP POST request to the postal service's API endpoint based on the received JSON data, including the API key and authentication token.

[1885] Input: JSON postal information, API key, and authentication token

[1886] Output: Obtained control number (e.g. "EX123456789JP")

[1887] Step 4:

[1888] Save control number

[1889] The server stores the acquired control number and postal information in a database.

[1890] Specific operation: The server executes an INSERT statement into the database, saving the control number and related postal information as a single record. The database can be MySQL or PostgreSQL.

[1891] Input: Obtained control number, postal information

[1892] Output: Control number and postal information stored in the database

[1893] Step 5:

[1894] Return and display of control number

[1895] The server returns the acquired control number to the terminal and displays it to the user.

[1896] Specific operation: The server generates a JSON response including the control number and sends it to the device using the HTTPS protocol. The device receives the response and displays it in the user interface. Example: "Control number: EX123456789JP"

[1897] Input: Obtained control number

[1898] Output: Control number returned to the terminal

[1899] Step 6:

[1900] Regular tracking updates

[1901] The server uses a scheduling service to periodically call the postal service's API to retrieve tracking information associated with each control number and update the database.

[1902] Specific operation: Set up a scheduling service such as a cron job on the server to send a request to the API endpoint every hour. Execute an UPDATE statement to update the acquired tracking information in the database.

[1903] Input: Each control number

[1904] Output: Updated tracking information

[1905] Step 7:

[1906] Check tracking information

[1907] The user enters the control number on the terminal and checks the latest tracking information.

[1908] Specific operation: The user enters the control number in the input field displayed on the terminal and clicks the "Check tracking information" button. The terminal receives this input and sends a request in JSON format to the server.

[1909] Input: Control Number

[1910] Output: Request sent to the server

[1911] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[1912] Specific operation: The server executes a SELECT statement on the database to obtain the latest tracking information associated with the specified control number, creates a JSON response containing the obtained tracking information, and sends it to the terminal.

[1913] Input: Control Number

[1914] Output: Retrieved tracking information

[1915] The terminal displays tracking information, allowing users to check the current location and status of their mail.

[1916] Specific operation: The device parses the JSON response received from the server and displays the information on the user interface. Example: "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: YYYY-MM-DDTHH:MM:SSZ".

[1917] Input: Retrieved tracking information

[1918] Output: Displayed tracking information

[1919] The above are the specific processing steps of the present invention. Through this series of steps, mailing operations can be automated efficiently and accurately.

[1920] (Application example 1)

[1921] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1922] In modern logistics facilities, product management and tracking are often inefficient, leading to human error and delays in management information. This results in poor tracking accuracy and lower customer satisfaction. Furthermore, the inability to respond quickly to important status changes calls for operational efficiency improvements.

[1923] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1924] In this invention, the server includes: means for inputting postal information based on the destination address, sender information, and type of mail; means for transmitting the postal information to the server; means for the server to call a post office API and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to a terminal and displaying it to a user; means for the server to periodically call a post office API to obtain tracking information associated with each control number and update the database; means for a user to check the tracking information from a terminal; means for a logistics facility to scan a barcode to obtain product information and input delivery destination and sender information; means for transmitting the product information and delivery information to the server and obtaining a control number; means for the server to update the tracking information in real time and notify important status changes via push notifications. This enables more efficient product management and tracking at logistics facilities, reduces human error, improves tracking accuracy, and increases customer satisfaction.

[1925] "Destination address" is information indicating the location where mail or merchandise is to be sent.

[1926] "Sender information" refers to information such as the name and address of the person sending the mail or product.

[1927] "Type of mail" is a category that indicates the format or service in which the mail is sent (e.g., registered mail, regular mail).

[1928] "Postal information" is a collection of detailed information such as the destination address, sender information, and type of mail.

[1929] "Server" means the part of the computer system that processes postal information and manages control numbers and tracking information.

[1930] "API" stands for Application Programming Interface, a specification that allows different software systems to communicate with each other.

[1931] "Control number" means a unique identifier issued for the purpose of tracking and managing mail or merchandise.

[1932] A "database" is a system for systematically storing and managing data such as postal information and control numbers.

[1933] A "terminal" is a device (e.g., smartphone, computer) that a user uses to enter information and view results.

[1934] "Tracking information" is detailed information about the current location and delivery status of mail or goods.

[1935] "User" means a person who uses this system to manage mail and product information.

[1936] A "logistics facility" is a place where goods are stored, sorted, and shipped.

[1937] A "barcode" is a visual identification code for machine-readable product information.

[1938] "Scanning" is the process of optically reading a barcode and capturing the information as digital data.

[1939] "Tracking accuracy" refers to the ability to accurately determine the location and status of mail or goods.

[1940] "Push notification" is a technology that allows applications to notify users of important information in real time.

[1941] "Managing goods at a logistics facility" means efficiently carrying out a series of operations, including receiving, storing, picking, and shipping goods.

[1942] "Human error" refers to mistakes or errors that people make while working.

[1943] The present invention relates to a system for improving the efficiency of product management and tracking in a logistics facility. Specific embodiments will be described below.

[1944] 1. Enter shipping address and sender information

[1945] The user uses the terminal to input the delivery address, sender information, and product type. Specifically, the user uses a smartphone app to input detailed product information, the delivery address, and sender information.

[1946] 2. Obtaining product information

[1947] At the logistics facility, users use their smartphones to scan product barcodes, which automatically enters product information into the app.

[1948] 3. Sending data to the server

[1949] The terminal sends the entered product information and delivery information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the data is transmitted safely.

[1950] 4. Issuing and saving the control number

[1951] The server calls the API of the logistics system and issues a control number based on the product information and delivery information sent. The server receives the control number returned from the API and stores it in a database.

[1952] 5. Return and display of control number

[1953] The server returns the acquired control number to the terminal and displays it to the user. For example, the issued control number "LM123456789DN" is displayed on the terminal screen so that the user can confirm it.

[1954] 6. Regular tracking updates

[1955] The server periodically calls the API of the logistics system to obtain tracking information related to each control number. A scheduling tool (e.g., a CRON job) is set up so that the server can call the API in real time. The obtained tracking information is then updated in the database.

[1956] 7. Tracking Information and Notifications

[1957] Users can enter the control number on their device to check the latest tracking information. The server retrieves the tracking information related to the control number from the database and returns it to the device. In addition, if an important status change occurs, the user will be notified via push notification.

[1958] Hardware and software used

[1959] Devices: Smartphones, tablets, laptops, etc.

[1960] Server: Cloud-based server, VPS, etc.

[1961] Software: Smartphone apps (e.g., iOS, Android apps), server-side programs (e.g., Node.js, Python), database management systems (e.g., MySQL, PostgreSQL), secure communication protocols (e.g., HTTPS), and scheduling tools (e.g., CRON jobs).

[1962] API: Logistics system API, post office API, etc.

[1963] Specific examples

[1964] Consider a scenario where a worker at a logistics facility scans the barcode of product "1234567890" with a smartphone app and sends the product to a specific address. The user uses the app to enter the recipient's name and address and obtains the control number "LM123456789DN." The control number is used to place the product in the logistics flow, and tracking information can be checked in real time. Additionally, if there are any important status changes, the worker can be notified via push notification.

[1965] Example prompts to input to a generative AI model:

[1966] "We would like to develop a smartphone app that will be useful in logistics facilities. This app will have functions such as barcode scanning, inputting delivery addresses, issuing control numbers, and managing tracking information. We would like to use the logistics system API to update tracking information in real time and send push notifications if there are any important status changes. Please generate the specific program part for this purpose."

[1967] This invention improves the efficiency of product management and tracking in logistics facilities, reducing human error, improving tracking accuracy, and increasing customer satisfaction.

[1968] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1969] Step 1:

[1970] The user scans the barcode of a product using a smartphone app. By scanning the barcode, product information is imported into the device as digital data. Input: Product barcode information. Output: Product information (e.g. product ID, name, quantity, etc.). Operation: The barcode is read using the smartphone camera, and the product information is analyzed from the barcode and displayed in the app.

[1971] Step 2:

[1972] The user enters the shipping address, sender information, and product type into the app. Input: Shipping address, sender information, and product type manually entered by the user. Output: A complete dataset of products with shipping information. Behavior: The user enters the required information into the app's input fields, which are then integrated within the app.

[1973] Step 3:

[1974] The terminal sends the entered product information and delivery information to the server. Input: Product information and delivery information. Output: JSON data sent to the server. Operation: The app sends information to the server using a secure communication protocol (HTTPS).

[1975] Step 4:

[1976] The server issues a control number based on the submitted product information and delivery information. Input: Product information and delivery information. Output: Control number. Operation: The server sends a request to the logistics system's API and obtains the control number.

[1977] Step 5:

[1978] The server saves the acquired control number in a database. Input: Control number and corresponding product information, delivery information. Output: Control number and related information saved in the database. Operation: The server writes information to the database.

[1979] Step 6:

[1980] The server returns the issued control number to the terminal and displays it to the user. Input: Control number. Output: Control number displayed on the terminal screen. Operation: The server sends the control number to the terminal, and the app displays it to the user.

[1981] Step 7:

[1982] The server periodically calls the API of the logistics system to obtain tracking information related to the control number. Input: Control number list. Output: Latest tracking information. Operation: The server periodically calls the API using a scheduling tool (e.g., CRON job) to obtain tracking information.

[1983] Step 8:

[1984] The server updates the database with the acquired tracking information. Input: Latest tracking information. Output: Updated database. Operation: The server writes the new tracking information to the database.

[1985] Step 9:

[1986] The user enters the control number on the device and checks the latest tracking information. Input: Control number. Output: Latest tracking information displayed on the device. Operation: The app sends the control number to the server, which retrieves the tracking information from the database and sends it back to the device.

[1987] Step 10:

[1988] The server notifies the user via push notification when an important status change occurs. Input: Tracking information status. Output: Push notification. Operation: The server detects the status change, generates a push notification and sends it to the device. This notification allows the user to receive important information in real time.

[1989] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1990] The present invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. Specific embodiments are described below.

[1991] 1. Enter your postal information

[1992] The user uses the terminal to enter the destination address, sender information, and mail type.

[1993] For example, a user enters the following information into a terminal:

[1994] Destination address: recipient's name, address, and postal code

[1995] Sender information: sender's name, address, and postal code

[1996] Type of mail: Simple registered mail, regular mail, etc.

[1997] 2. Use of Emotion Engine

[1998] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice while the user is typing, and uses an emotion engine to recognize the user's emotions.

[1999] The emotion engine analyzes the user's emotional data in real time and, if it detects that the user is feeling stressed, it will provide supportive messages and guidance. The emotion engine also adjusts the input screen interface in real time according to the user's emotions.

[2000] 3. Sending data to the server

[2001] The terminal transmits the input postal information and emotion data to the server.

[2002] The data is sent securely to the server using a secure communication protocol (e.g., HTTPS) and in a structured data format such as JSON.

[2003] 4. Issuing and saving the control number

[2004] The server receives the postal information and emotion data, prepares to call the post office's API, and converts the received postal information into a data format for the API request.

[2005] The server sends a request to the post office's API to issue a control number and receives the control number returned from the API.

[2006] 5. Saving to the database

[2007] The server stores the control number and associated postal and emotional data in a database for future reference and analysis.

[2008] 6. Return and display of control number

[2009] The server returns the acquired control number to the terminal and instructs the terminal to display it to the user.

[2010] The terminal displays the returned control number to the user so that the user can check it.

[2011] 7. Regular tracking updates

[2012] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number.

[2013] The server updates the acquired tracking information to a database by sending API requests at regular intervals using a batch job or scheduling tool.

[2014] 8. Check your tracking information

[2015] The user enters the control number on the terminal and checks the latest tracking information.

[2016] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[2017] The device displays the latest tracking information to the user.

[2018] Specific examples

[2019] Consider a scenario where a user wants to send an important document by registered mail.

[2020] The user enters the following information into the terminal:

[2021] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[2022] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[2023] Type of mail: Simple registered mail

[2024] The device sends the input information along with the user's emotions (e.g., if the user is feeling stressed) to the server. This data is transmitted using a secure communication protocol.

[2025] The server calls the post office's API, obtains the control number "EX123456789JP", and stores this data in the database.

[2026] The server returns the control number to the terminal, which then displays the control number to the user, who then mails the item based on that control number.

[2027] The server periodically calls the post office's API to retrieve the latest tracking information associated with the control number and update the database.

[2028] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[2029] Through this series of steps, not only is postal work automated, but the emotional engine also improves the user experience.

[2030] The processing flow will be explained below.

[2031] Step 1:

[2032] A user uses a terminal to enter a destination address, sender information, and the type of mail (e.g., registered mail). For example, the user enters the following data: "Destination address: 1-1-1 Yotsuya, Shinjuku-ku, Tokyo, 160-0004" and "Sender information: 2-2-2 Yamashita-cho, Naka-ku, Yokohama-shi, Kanagawa, 231-0023."

[2033] Step 2:

[2034] The device uses an emotion engine to analyze the user's facial expressions and tone of voice, recognizing the user's emotions (e.g., stress, joy, surprise, etc.) in real time and capturing that data.

[2035] Step 3:

[2036] If the emotion engine detects the user's stress level, the device will display a support message (e.g., "There's an easier way to input") to the user. If the emotion engine deems appropriate, it will also adjust the input screen interface to make input more comfortable for the user.

[2037] Step 4:

[2038] The device sends the entered postal information and emotion data to the server. This data is securely transmitted using a secure communication protocol (e.g., HTTPS). The transmitted data is in a structured data format such as JSON.

[2039] Step 5:

[2040] The server receives the postal information and emotion data. Based on the received data, it prepares to call the post office's API. The received data is converted into a data format for the API request.

[2041] Step 6:

[2042] The server sends a request to the post office API to issue a control number. The request is sent using an HTTP POST request, including the necessary postal information.

[2043] Step 7:

[2044] The server receives the response from the post office API, extracts the control number from the response data, and stores it in the system.

[2045] Step 8:

[2046] The server then stores the acquired control number and associated postal and emotional data in a database for future reference and analysis.

[2047] Step 9:

[2048] The server returns the control number to the terminal, which then displays this control number to the user so that the user can confirm it.

[2049] Step 10:

[2050] The server periodically calls the post office's API to retrieve the tracking information associated with each control number, using a batch job or scheduling tool to send requests every hour.

[2051] Step 11:

[2052] The server updates the database with the acquired tracking information, specifically by executing SQL queries to update the status, last location, and timestamp of the tracking information.

[2053] Step 12:

[2054] The user inputs the control number on the terminal to check the latest tracking information. The terminal sends the request to the server, which retrieves the latest tracking information from the database and returns it to the terminal.

[2055] Step 13:

[2056] The tracking information for the returned device is displayed to the user. For example, the user can see information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[2057] Example 2

[2058] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2059] Conventional mail numbering and tracking systems require users to manually enter information without considering their feelings, which can lead to input errors and increased effort. Furthermore, obtaining mail control numbers and tracking information is cumbersome, resulting in a poor user experience. Furthermore, there is a risk of information leaks due to insufficient consideration given to security.

[2060] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2061] In this invention, the server includes: means for inputting postal information based on the destination address, sender information, and type of mail; means for using an emotion engine that analyzes the user's facial expressions and tone of voice to acquire emotion data; means for transmitting the postal information and emotion data to the server; means for the server to call a post office API and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the control number to the terminal and displaying it to the user; means for the server to periodically call the post office API to acquire tracking information associated with each control number and update the database; and means for the user to check the tracking information from the terminal. This automates and streamlines the process of mail numbering, acquiring control numbers, and periodically updating and checking tracking information, improving the user experience. Furthermore, the use of the emotion engine allows support messages and interfaces to be adjusted according to the user's emotions, further improving security.

[2062] "Postal Information" refers to data regarding destination address, sender information, and mail type.

[2063] An "emotion engine" refers to an analysis system that analyzes a user's facial expressions and tone of voice to recognize the user's emotions in real time.

[2064] "Terminal" refers to a device for a user to input information and a device for transmitting the input information to a server.

[2065] "Server" refers to the computer system that processes postal information and sentiment data, issues control numbers, stores them in a database, and updates and provides tracking information.

[2066] "Control number" refers to a unique identifier issued through the post office's API to identify a specific piece of mail.

[2067] "Database" refers to a data structure that stores postal information, emotion data, control numbers, and tracking information and allows for easy searching and updating.

[2068] "Secure communications protocol" refers to a communications method that includes encryption technology to ensure the secure transmission and reception of data.

[2069] A "batch job" refers to a series of processes that are executed automatically and periodically, and is used in particular to periodically call the post office's API.

[2070] A "scheduling tool" refers to software that configures certain tasks to be performed automatically at specified times or intervals.

[2071] "Tracking Information" refers to data containing the current status and location of a mail piece associated with a particular control number.

[2072] The present invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and further improves the user experience by using an emotion engine. Specific embodiments are described below.

[2073] 1. Enter your postal information

[2074] The user uses the terminal to enter the destination address, sender information, and mail type.

[2075] As an example, a user enters the following information into a terminal:

[2076] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[2077] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[2078] Type of mail: Simple registered mail

[2079] 2. Use of Emotion Engine

[2080] The device uses a camera and microphone to capture the user's facial expressions and tone of voice, and sends them to the emotion engine, which analyzes them in real time and generates the user's emotion data.

[2081] If the emotion engine recognizes that the user is feeling stressed, it displays support messages and guidance and adjusts the input screen interface.

[2082] 3. Sending data to the server

[2083] The terminal sends the entered postal information and emotion data to the server using a secure communication protocol (e.g., HTTPS). The sent data is structured data in JSON format.

[2084] 4. Issuing and saving the control number

[2085] The server converts the received postal information and emotion data into a data format for API requests and calls the post office's API.

[2086] The server sends a request to issue a control number to the post office's API and receives the control number in return.

[2087] 5. Saving to the database

[2088] The server stores the acquired control number and associated postal and emotion data in a database for future reference and analysis.

[2089] 6. Return and display of control number

[2090] The server returns the acquired control number to the terminal and displays it to the user.

[2091] The terminal displays the returned control number to the user so that the user can check it.

[2092] 7. Regular tracking updates

[2093] The server calls the post office's API at regular intervals to retrieve the latest tracking information associated with each control number and updates the database, using batch jobs and scheduling tools to accomplish this.

[2094] 8. Check your tracking information

[2095] The user enters the control number into the terminal to check the latest tracking information.

[2096] The server retrieves the relevant tracking information from the database and returns it to the terminal.

[2097] The terminal displays the latest tracking information to the user.

[2098] Specific examples and prompts for the generative AI model

[2099] Specific examples

[2100] Consider a scenario where a user wants to send an important document by registered mail.

[2101] The user enters the following information into the terminal:

[2102] Address: "1-1-1 Yotsuya, Shinjuku-ku, Tokyo 160-0004"

[2103] Sender information: "2-2-2 Yamashitacho, Naka-ku, Yokohama, Kanagawa Prefecture, 231-0023"

[2104] Type of mail: Simple registered mail

[2105] The device sends the input information along with the user's emotional data (e.g., if the user is feeling stressed) to the server using a secure communication protocol.

[2106] The server calls the post office's API, obtains the control number "EX123456789JP", and stores this data in the database.

[2107] The server returns the control number to the terminal, which then displays the control number to the user, who then mails the item based on that control number.

[2108] The server periodically calls the post office's API to retrieve the latest tracking information associated with the control number and update the database.

[2109] Users can enter the control number on their device to check tracking information and obtain information such as "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[2110] Example prompts for generative AI models

[2111] "Create a scenario in which a user sends a registered letter. The user enters the recipient address, sender information, and type of mail. Also include a scenario in which the emotion engine provides a supportive message to the user who is feeling stressed."

[2112] Through the system of the present invention, not only are mailing numbers, obtaining control numbers, and regular updates and confirmation of tracking information automated and efficient, but the use of an emotion engine also improves the user experience.

[2113] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2114] Step 1:

[2115] The user uses the terminal to enter postal information.

[2116] Input: Destination address, sender information, mail type

[2117] Output: Temporarily save input information

[2118] How it works: The user types in an address or other information on the keyboard, and the data appears in fields on the screen. The data is temporarily stored in memory.

[2119] Step 2:

[2120] The device uses a camera and microphone to capture the user's facial expressions and tone of voice.

[2121] Input: User's facial expressions, tone of voice

[2122] Output: Captured emotion data

[2123] How it works: The camera and microphone are activated to collect data in real time, which is then sent to the emotion engine API.

[2124] Step 3:

[2125] The emotion engine analyzes the user's emotion data.

[2126] Input: Captured emotion data

[2127] Output: Analysis results (e.g., whether the user is feeling stressed)

[2128] How it works: The emotion engine performs analysis in real time and returns the results in JSON format to the device.

[2129] Step 4:

[2130] The terminal receives the analysis results and displays a support message if necessary.

[2131] Input: Analysis results from the emotion engine

[2132] Output: Helpful message (if needed)

[2133] How it works: If it detects you are stressed, a message such as "Please stay calm when typing" will pop up.

[2134] Step 5:

[2135] The terminal transmits the input postal information and emotion data to the server.

[2136] Input: Postal information and emotion data

[2137] Output: Data sent to the server

[2138] How it works: Data is sent to the server in JSON format using the HTTPS protocol.

[2139] Step 6:

[2140] The server converts the received postal information and emotion data into a format suitable for API requests.

[2141] Input: Postal information and emotion data sent to the server

[2142] Output: Data format for API requests

[2143] What it does: The server converts the data into the appropriate JSON format.

[2144] Step 7:

[2145] The server calls the post office's API and issues a control number.

[2146] Input: Data format for API requests

[2147] Output: Retrieved control number

[2148] Operation: The server generates an API request and returns the control number "EX123456789JP".

[2149] Step 8:

[2150] The server stores the obtained control number and associated postal information and emotion data in a database.

[2151] Input: Control number, postal information, and emotion data

[2152] Output: Data stored in the database

[2153] What it does: Inserts data into a database using an SQL query.

[2154] Step 9:

[2155] The server returns the control number to the terminal and instructs it to be displayed to the user.

[2156] Input: Control number

[2157] Output: Control number returned to the terminal

[2158] Operation: Generates a management number in JSON format and sends it to the terminal via HTTPS protocol.

[2159] Step 10:

[2160] The terminal displays the returned control number to the user.

[2161] Input: Returned control number

[2162] Output: Control number displayed on the screen

[2163] Operation: The control number is displayed on the screen.

[2164] Step 11:

[2165] The server calls the post office's API at regular intervals to obtain the latest tracking information.

[2166] Input: Each control number

[2167] Output: Retrieved tracking information

[2168] How it works: Use a batch job or scheduling tool to send API requests and get the latest information.

[2169] Step 12:

[2170] The server updates the acquired tracking information to a database.

[2171] Input:Tracking information

[2172] Output: Updated database

[2173] Action: Updates the tracking information for that entry in the database.

[2174] Step 13:

[2175] The user enters the control number into the terminal and checks the latest tracking information.

[2176] Input: Control number

[2177] Output: Retrieved tracking information

[2178] Action: Enter the control number into the input form and click the submit button.

[2179] Step 14:

[2180] The server retrieves the tracking information associated with the control number from the database and returns it to the terminal.

[2181] Input: Control number

[2182] Output: Tracking information sent to the device

[2183] What it does: Searches the database and sends tracking information in JSON format to the device.

[2184] Step 15:

[2185] The device displays the latest tracking information to the user.

[2186] Input: Returned tracking information

[2187] Output: Tracking information displayed on screen

[2188] What it does: The screen will display "Current status: Shipped, Last location: Shinjuku-ku, Tokyo, Last updated: 2023-10-02T10:00:00Z."

[2189] (Application example 2)

[2190] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2191] In modern logistics centers, managing mail order and tracking information is important, but it is a labor-intensive and time-consuming task. Furthermore, when employees manually perform these tasks, fatigue and stress accumulate, resulting in reduced efficiency. Therefore, there is a need for a system that automates the management of mail order and tracking information while also analyzing employee emotions to improve the working environment.

[2192] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2193] In this invention, the server includes: a means for inputting postal information based on the destination address, sender information, and type of mail; a means for transmitting the postal information to the server; a means for the server to call a post office API and issue a control number based on the transmitted postal information; a means for analyzing the user's facial expression and tone of voice while inputting the postal information and acquiring emotional data; a means for the server to store the issued control number, postal information, and emotional data in a database; a means for returning the control number to the terminal and displaying it to the user; a means for the server to periodically call a post office API, acquire tracking information related to each control number, and update the database; a means for the user to check the tracking information on the terminal; and a means for analyzing the user's fatigue and stress and displaying a support message encouraging them to take a break as needed. This not only enables efficient mail management, but also provides a comfortable working environment by analyzing employees' emotional data and providing appropriate support.

[2194] "Destination address" refers to information such as the name, address, and postal code of the person receiving the mail.

[2195] "Sender information" refers to information such as the name, address, and postal code of the person sending the mail.

[2196] "Type of mail" indicates whether the mail is classified as a specific delivery method or type, such as registered mail, regular mail, or express mail.

[2197] "Postal information" refers to information including the destination address, sender information, and type of mail.

[2198] A "server" is a computer system that receives postal information and performs processes such as issuing control numbers, storing data, and obtaining tracking information.

[2199] "Smart glasses" are wearable devices that can acquire visual and audio information when worn by a user, and analyze and display it in real time.

[2200] "Emotion data" is data that indicates the user's emotional state, obtained from the user's facial expression, tone of voice, etc.

[2201] An "API" is an interface that a program uses to communicate with external services and resources.

[2202] A "control number" is a specific number issued to uniquely identify a mail item.

[2203] "Tracking information" is information that indicates the current location and delivery status of mail.

[2204] A "batch job" is a series of tasks or processes that are executed periodically.

[2205] A "scheduling tool" is software that automatically executes tasks at specific times or intervals.

[2206] A "secure communication protocol" is a standardized method for securely sending and receiving data, and HTTPS is commonly used.

[2207] A "terminal" is a device used by a user to enter or receive information.

[2208] This invention relates to a system that automates the process of sending mail, acquiring control numbers, and acquiring tracking information, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. Specific embodiments are described below.

[2209] System configuration and operation

[2210] 1. Enter your postal information

[2211] The user uses the smart glasses to enter the recipient address, sender information, and mail type. The user inputs the information using touch or voice commands, following the input form displayed on the smart glasses screen.

[2212] 2. Acquiring Emotion Data

[2213] While the user is entering information, the smart glasses' built-in camera and microphone analyze the user's facial expressions and tone of voice, which are then processed in real time by the emotion engine to obtain the user's emotional data.

[2214] 3. Sending data to the server

[2215] The device (smart glasses) sends the entered postal information and emotion data to the server. This communication is performed using a secure protocol (e.g., HTTPS). The data is sent in a structured data format such as JSON.

[2216] 4. Issuing and saving the control number

[2217] The server calls the post office's API based on the received postal information and issues a control number. At this time, the server converts the received postal information into a data format for API requests. The issued control number, related postal information, and emotion data are stored in a database.

[2218] 5. Return and display of control number

[2219] The server instructs the terminal to return the acquired control number, and the control number is displayed on the screen of the smart glasses. The user can confirm this control number and use it to send mail.

[2220] 6. Updating and Checking Tracking Information

[2221] The server periodically calls the post office's API to obtain the latest tracking information associated with each control number and updates the database. Users can then enter the control number through the smart glasses to check the latest tracking information at any time.

[2222] 7. Support based on emotional data

[2223] By analyzing the emotional data, if the user feels tired or stressed, a support message encouraging them to take a break will be displayed on the smart glasses.

[2224] Hardware and software used

[2225] Smart glasses: Devices with built-in cameras and microphones that capture visual and auditory information from the user.

[2226] Emotion Engine Library (EmotionAnalyzer): Software that recognizes emotions by analyzing the user's facial expressions and tone of voice.

[2227] Server: A computer system that stores data and communicates with APIs.

[2228] Secure communication protocol (e.g. HTTPS): A standardized way of sending and receiving data securely.

[2229] Post Office API: An external service that issues mail control numbers and provides tracking information.

[2230] Specific examples

[2231] Consider a scenario where an employee wants to send an important document by registered mail. The employee uses the smart glasses to input the recipient's address, sender's information, and the type of mail. The camera and microphone also analyze the employee's facial expressions and tone of voice in real time. If the employee feels fatigued or stressed, the emotion engine will suggest taking a break at the appropriate time.

[2232] Prompt Sentence Examples

[2233] Please tell me about a system that automates the process of sending mail, obtaining control numbers, and obtaining tracking information. This system also incorporates an emotion engine that recognizes user emotions, aiming to improve the user experience. Specifically, in the following scenarios:

[2234] 1. The user enters postal information (sender, recipient, type of mail) through the smart glasses.

[2235] 2. The emotion engine analyzes facial expressions and tone of voice in real time.

[2236] 3. Based on the recognized emotions, the system provides appropriate support messages and guidance.

[2237] Please elaborate on the detailed process flow and technologies used.

[2238] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2239] Step 1:

[2240] The user uses the smart glasses to enter the recipient's address, sender information, and mail type, which are then entered into a form displayed on the glasses' display using touch or voice input.

[2241] Input: User's destination address, sender information, mail type

[2242] Output: Input postal information data (recipient address, sender information, type of mail)

[2243] Step 2:

[2244] The smart glasses' built-in camera and microphone capture the user's facial expressions and tone of voice while they are typing, and pass the data to the emotion engine, which analyzes the data in real time to generate the user's emotion data.

[2245] Input: User's facial expression data, voice tone data

[2246] Output: Emotion data (user's stress and emotional state)

[2247] Step 3:

[2248] The device (smart glasses) sends the entered postal information and emotion data to the server using a secure communication protocol. The data is sent in a structured data format such as JSON.

[2249] Input: Postal information data, emotion data

[2250] Output: Transmission result to the server (success / failure)

[2251] Step 4:

[2252] The server calls the post office's API based on the received postal information, prepares to issue a control number, converts the received postal information into a data format for API requests, and calls the API.

[2253] Input: Postal information data

[2254] Output: Control number (data returned from API)

[2255] Step 5:

[2256] The server stores the issued control number and related postal information and emotion data in a database.

[2257] Input: Control number, postal information, emotion data

[2258] Output: Database save result (success / failure)

[2259] Step 6:

[2260] The server returns the management number to the device, and the device (smart glasses) displays the acquired management number to the user. The user confirms this management number.

[2261] Input: Control Number

[2262] Output: Control number returned to the terminal, displayed to the user

[2263] Step 7:

[2264] The server periodically calls the post office's API to retrieve the latest tracking information associated with each control number and updates the database, an operation that can be automated using batch jobs or scheduling tools.

[2265] Input: Control Number

[2266] Output: Latest tracking information, database updates

[2267] Step 8:

[2268] The user inputs the control number through the smart glasses to check the latest tracking information. The server retrieves the tracking information associated with the control number from the database and returns it to the terminal. The terminal then displays the latest tracking information to the user.

[2269] Input: Control Number

[2270] Output: Latest tracking information, returned to device, displayed to user

[2271] Step 9:

[2272] If the user feels fatigued or stressed based on the emotion data, a support message encouraging them to take a break will be displayed on the smart glasses. This message is displayed in real time based on the analysis of the emotion data.

[2273] Input: Emotion data

[2274] Output: Support message (display a break message if necessary)

[2275] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2276] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2277] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2278] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, a...

Claims

1. means for inputting postal information based on the destination address, sender information, and mail type; means for transmitting the postal information to a server; A means for the server to call an API of a post office and issue a control number based on the transmitted postal information; means for the server to store the issued control number and postal information in a database; means for returning the management number to the terminal and displaying it to the user; a means for the server to periodically call the API of the post office, obtain tracking information related to each control number, and update the database; A means for a user to check the tracking information from a terminal; A system including:

2. 2. The system of claim 1, wherein the terminal includes means for transmitting postal information to a server using a secure communications protocol.

3. 2. The system of claim 1, wherein the server has means for using a batch job or scheduling tool to periodically call the Post Office API.

Images