system

A system using terminal input, locker reservation, and QR code generation facilitates smooth package delivery and collection at train stations, addressing the challenge of absent recipients.

JP2026024076APending Publication Date: 2026-02-13SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024126397
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2026-02-13

Smart Images

  • Figure 2026024076000001_ABST
    Figure 2026024076000001_ABST
Patent Text Reader

Abstract

A system is provided.SOLUTION: Means for inputting information by a user using a terminal and transmitting the information to a server, means for storing the information received by the server in a database, means for generating a new member ID by the server and notifying the user, means for reserving a locker by a courier using the terminal and transmitting the member ID to the server, means for checking the availability of the locker by the server, generating a unique QR code, and notifying the courier, and the courier unlocking the locker using the QR code; A system, comprising: means for depositing a package; means for recording, by a server, deposit of the package and notifying a courier; means for sending, by the courier, a QR code to a sender; means for unlocking, by a deliverer, a locker by using the QR code and receiving the package; and means for recording, by the server, receipt of the package and notifying the sender and the courier.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Modern delivery systems have the problem of being unable to smoothly receive packages when the recipient is not at home. This problem is a burden for both the recipient and the delivery company, and requires the effort and expense of redelivery. Individuals and businesses, especially those living busy lives, are seeking ways to make receiving packages more convenient. Therefore, there is a need for an efficient delivery system that utilizes coin lockers at train stations. [Means for solving the problem]

[0005] The present invention provides a means for users to input information using a terminal and send it to a server. The server stores the received information in a database, generates a new member ID, and notifies the user. The delivery company then reserves a locker using the terminal and sends the information to the server. The server checks the availability of the locker, generates a unique QR code, and notifies the delivery company.

[0006] The delivery company uses the QR code to unlock the locker and deposit the package. The server records the information, completes the deposit of the package, and notifies the delivery company. This QR code is sent to the sender and eventually given to the recipient. The recipient can then use the QR code to unlock the locker and collect the package. The server records the receipt of the package and notifies the sender and delivery company of the completion.

[0007] This allows packages to be received smoothly even when the recipient is not at home, improving convenience especially for busy individuals and companies.

[0008] "User" means an individual or organization that uses the system to input information and receive services.

[0009] "Terminal" refers to the computing device used by users and delivery agents to access the system. Examples include PCs, smartphones, and tablets.

[0010] A "server" is a computer system that serves as the core of the system, and is a device that receives information sent from users and stores it in a database.

[0011] A "database" is a computer system that stores and manages data required by the system, such as user information, locker information, and QR code information.

[0012] "Member ID" is a unique identifier generated by the server when a user registers, and is used to individually identify the user.

[0013] A "delivery company" is a company that is responsible for receiving packages from users and depositing them in designated lockers.

[0014] A "locker" is a box-shaped device for storing luggage that is installed in public places such as stations.

[0015] A "QR code" is a unique code generated by a server that is required to unlock a locker or retrieve luggage.

[0016] "Locker reservation" is an operation that a delivery company performs on the server to use a locker at a specified station for a certain period of time.

[0017] "Availability" is information that indicates the number and status of lockers currently available.

[0018] "Depositing" refers to the act of placing a package in a locker designated by the delivery company.

[0019] "Unlocking" refers to the act of unlocking the locker using a QR code and opening the locker.

[0020] "Locking" refers to the act of locking the locker after depositing your luggage.

[0021] "Recording" refers to the server storing information about each step in the system (e.g., dropping off and picking up luggage) in a database.

[0022] "Notification" is communication that the server sends to inform the user or delivery company of the progress and completion of each step in the system. [Brief explanation of the drawings]

[0023] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2]1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0024] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0025] First, the terms used in the following description will be explained.

[0026] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0027] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0028] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0029] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0030] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0031] [First embodiment]

[0032] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0033] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0034] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0035] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0036] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0037] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0038] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0039] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0040] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0041] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0042] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0043] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0044] The present invention relates to a system that uses coin lockers at stations as delivery boxes, and is implemented as follows.

[0045] User Registration

[0046] The user opens the system's user registration screen using their own device (PC or smartphone) and enters information such as their name, address, phone number, email address, and password. When the user clicks the "Register" button, the device sends the entered information to the server.

[0047] The server saves the received information in the database, generates a new member ID, and notifies the user of the generated member ID and the password for the first login by email.

[0048] Locker reservation and QR code generation

[0049] The delivery person opens the system's locker reservation screen on their device, selects the station they wish to use and the number of lockers they wish to use, and when they click the "Reserve" button, the device sends the selected information to the server.

[0050] The server checks the availability of lockers and allocates an available locker. It generates a locker ID and a unique QR code, which is stored in a database along with the respective locker ID. The server then notifies the courier of the reservation details (locker ID and QR code).

[0051] Checked baggage

[0052] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the scanned information to the server.

[0053] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[0054] The server records that the package has been deposited and sends a confirmation to the courier.

[0055] QR code notification

[0056] The delivery company will send a QR code to the sender along with a notification of the completion of the delivery, and the sender will then pass the received QR code on to the recipient.

[0057] Picking up your luggage

[0058] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The QR code is then scanned using the terminal's QR code reader.

[0059] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[0060] The server records that the package has been received and sends a notification of receipt to the sender and the delivery company.

[0061] Specific examples

[0062] For example, if User A registers with the system and requests delivery company B to leave a package in a locker at a station, the following process will occur: Delivery company B reserves a locker and receives a QR code. B leaves the package in the designated locker and sends the QR code to User A. User A then transmits the QR code to recipient C, who arrives at the designated locker and uses the QR code to retrieve the package.

[0063] In this way, the system of the present invention allows users to use lockers at designated stations as delivery boxes, facilitating smooth package collection.

[0064] The processing flow will be explained below.

[0065] Step 1:

[0066] The user uses a terminal to open the system's user registration screen and enters information such as name, address, telephone number, email address, and password.

[0067] Step 2:

[0068] The terminal transmits the input information to the server.

[0069] Step 3:

[0070] The server stores the received information in a database.

[0071] Step 4:

[0072] The server generates a new member ID and creates an email to notify the user.

[0073] Step 5:

[0074] The server will email the user a new member ID and initial login password.

[0075] Step 6:

[0076] Delivery workers open the system's locker reservation screen on their own devices and select the station they wish to use and the number of lockers they wish to use.

[0077] Step 7:

[0078] The terminal sends information about the selected station and the number of lockers to the server.

[0079] Step 8:

[0080] The server checks the availability of lockers and assigns an available locker.

[0081] Step 9:

[0082] The server generates a locker ID and a unique QR code and stores it in a database.

[0083] Step 10:

[0084] The server sends the locker ID and QR code details to the delivery company via email or in-system notification.

[0085] Step 11:

[0086] The delivery person goes to the coin locker at the designated station and displays the QR code on the terminal.

[0087] Step 12:

[0088] The delivery person scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[0089] Step 13:

[0090] The server checks the received QR code against its database.

[0091] Step 14:

[0092] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[0093] Step 15:

[0094] The delivery person opens the locker, deposits the package, and then locks it again.

[0095] Step 16:

[0096] The server records the completion of the package deposit in a database and sends a confirmation notice to the courier.

[0097] Step 17:

[0098] The delivery company will email the sender a QR code along with a notification that the delivery has been completed.

[0099] Step 18:

[0100] The sender transmits the received QR code to the recipient.

[0101] Step 19:

[0102] The recipient arrives at the coin locker at the designated station and displays the QR code they received on the terminal.

[0103] Step 20:

[0104] The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[0105] Step 21:

[0106] The server checks the received QR code against its database.

[0107] Step 22:

[0108] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[0109] Step 23:

[0110] The recipient opens the locker and collects the package.

[0111] Step 24:

[0112] The server records in the database that the parcel has been received, and sends a notification of the completion of the parcel to the sender and the delivery company.

[0113] Example 1

[0114] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0115] Conventional delivery systems have had problems with smooth delivery of goods when the user is absent or when receiving the goods takes time. There is also a need for a more efficient method of delivering and receiving goods. In addition, there is a need for a method to check the storage information of goods in real time and to safely deposit and receive goods.

[0116] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0117] In this invention, the server includes: a means for a user to input information using a terminal and send it to the server; a means for the server to store the received information in a database; a means for the server to generate a new identifier and notify the user; a means for a delivery company to reserve a storage account using a terminal and send it to the server; a means for the server to check the availability of the storage account, generate a unique identifier code and notify the delivery company; a means for the delivery company to unlock the storage account using the identifier code and deposit the item; a means for the server to record the deposit of the item and notify the delivery company; a means for the delivery company to send the identifier code to the item sender; a means for the customer to unlock the storage account using the identifier code and receive the item; a means for the server to record the receipt of the item and notify the item sender and the delivery company; and a means for displaying the status and facilitating processing using an AI model. This streamlines the process from depositing to receiving the item, enabling a home delivery system that is highly convenient for users and delivery companies to be realized.

[0118] A "user" is an entity that registers with the system and deposits and receives items.

[0119] A "terminal" is a device used by a user or delivery company to communicate with the system, including a PC or smartphone.

[0120] A "server" is a computer system that manages information at the center of the system and performs various processes.

[0121] An "identifier" is a unique number or code generated by the server to identify a user or item.

[0122] A "delivery company" is an entity that delivers goods and reserves a storage account and deposits goods via a terminal.

[0123] A "storage account" is a coin locker at a station or other storage facility, and is an account for the temporary storage of items.

[0124] A "unique identifier code" is an individual QR code or barcode generated to identify an item or storage account.

[0125] The "item sender" is the user who deposits the item.

[0126] A "customer" is a user who receives an item.

[0127] An "AI model" is an artificial intelligence algorithm that optimizes processes such as depositing and receiving items.

[0128] A "database" is a collection of information stored on the system's server, including user information and reservation information.

[0129] An "unlock signal" is an electronic instruction sent from the server to open a custodial account.

[0130] The present invention relates to a system that utilizes coin lockers at train stations and other storage facilities as delivery lockers, and is designed to allow users, delivery companies, and customers to efficiently deposit and receive items.

[0131] System configuration

[0132] The system is primarily comprised of the following elements: the devices (PCs and smartphones) used by users and delivery companies, the server that manages the information, the communication means for exchanging information between them, and the database that functions as the core of the system. It also uses an AI model to facilitate the deposit and receipt of goods.

[0133] Hardware and Software

[0134] Hardware:

[0135] Device: PC or smartphone used by the user or delivery company.

[0136] Storage Accounts: Coin lockers and other storage facilities at train stations.

[0137] software:

[0138] Server: Java Spring Framework and Node.js for storing and processing information.

[0139] Database: MySQL or MongoDB to manage user and reservation information.

[0140] QR Code Generation: Python qrcode library.

[0141] Notification: Send email using Python's smtplib.

[0142] AI models: Algorithms used to optimize information and streamline processes.

[0143] Program processing

[0144] The specific process of the system is as follows: the user registers with the system, the delivery company deposits the item, and the customer receives the item. This process is carried out smoothly. Specifically, the user registers as a user of the system using a terminal, and the server receives the information and stores it in a database. The server then generates a new identifier and notifies the user.

[0145] Adding specific examples

[0146] For example, if user A registers with the system and requests delivery company B to store a package in a storage account at a station, the following process takes place: Delivery company B reserves the storage account and receives a QR code. B stores the package in the specified storage account and sends the QR code to user A. User A transmits the QR code to recipient C, who arrives at the specified storage account and uses the QR code to collect the package. In this way, the system of the present invention allows users to use the specified station storage account as a delivery locker, facilitating a smooth package collection process.

[0147] Prompt Sentence Examples

[0148] For example, an explanatory text can be generated by inputting the following prompt text into the generative AI model:

[0149] "Please explain in detail the processing of a system that uses coin lockers at train stations as delivery boxes from the perspectives of the server, the terminal, and the user."

[0150] By entering this prompt, a detailed description of a system that uses coin lockers at train stations as delivery boxes will be generated.

[0151] As described above, the system of the present invention is designed to allow users to conveniently use coin lockers at train stations and other storage facilities as delivery lockers.

[0152] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0153] Step 1: User Registration

[0154] 1. The user opens the system's user registration screen using their own device (PC or smartphone).

[0155] 2. The user enters information such as name, address, phone number, email address, and password, and clicks the "Register" button.

[0156] Input: User's name, address, phone number, email address, password

[0157] Output: Send registration information to the server

[0158] 3. The device sends the entered information to the server in JSON format.

[0159] What it does: Converts form data to JSON format and sends it to the server as an HTTP POST request.

[0160] Step 2: Storing user information on the server and notifying users

[0161] 1. The server stores the received information in a database.

[0162] Input: User registration information sent from the device

[0163] Output: Registration information is saved in the database

[0164] Behavior: Makes a database connection and executes an INSERT statement to save the user information.

[0165] 2. The server generates a new member ID and password for the first login and notifies the user by email.

[0166] Operation: Runs the member ID generation algorithm and sends an email using Python's smtplib.

[0167] Step 3: Enter and submit your locker reservation information

[0168] 1. The delivery person opens the system's locker reservation screen on their own device.

[0169] 2. The delivery person selects the station they wish to use and the number of storage accounts they wish to use, and clicks the "Reserve" button.

[0170] Input: Station name, number of required storage accounts

[0171] Output: Send reservation information to the server

[0172] 3. The device sends the selection information to the server in JSON format.

[0173] What it does: Converts form data to JSON format and sends it to the server as an HTTP POST request.

[0174] Step 4: Locker assignment and notification on the server

[0175] 1. The server checks the availability of storage accounts and assigns an available storage account.

[0176] Input: Station name, number of required storage accounts

[0177] Output: Assigned custody account ID and QR code

[0178] What it does: Performs a database query to check availability, stores the assigned custodial account ID in the database, and generates a QR code.

[0179] 2. The server generates a unique QR code and stores it in the database along with the custodial account ID.

[0180] What it does: Generates QR codes using Python's qrcode library.

[0181] 3. The server notifies the delivery company of the reservation details (storage account ID and QR code) by email.

[0182] Operation: Sends email using Python's smtplib.

[0183] Step 5: Arrive at the locker and scan the QR code

[0184] 1. The courier goes to the designated station's storage account and uses the QR code they received.

[0185] 2. The courier scans the QR code using a QR code reader app on their device.

[0186] Input: QR code

[0187] Output: Send QR code information to the server

[0188] 3. The device sends the scanned QR code information to the server in JSON format.

[0189] What it does: It converts data obtained from a QR code reader app into JSON format and sends it to the server as an HTTP POST request.

[0190] Step 6: Authenticate with the server and unlock the locker

[0191] 1. The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker.

[0192] Input: QR code information

[0193] Output: Locker unlock signal

[0194] Operation: Searches for a corresponding record in the database, and if a match occurs, generates and sends an unlock signal.

[0195] 2. The courier opens the locker, deposits the item, and then locks it again.

[0196] How it works: After depositing the item in the locker, manually lock the locker.

[0197] Step 7: Baggage drop-off notification

[0198] 1. The server records in the database that the item has been deposited.

[0199] Input: Notification data

[0200] Output: Records in the database

[0201] 2. The server sends a confirmation email to the delivery company.

[0202] Operation: Sends email using Python's smtplib.

[0203] Step 8: QR Code Notification

[0204] 1. The delivery company will email the sender a QR code along with a notification that the item has been deposited.

[0205] Operation: Sends email using Python's smtplib.

[0206] 2. The sender of the item will send the received QR code to the customer.

[0207] How it works: Send a QR code via email or message.

[0208] Step 9: Arrive at the locker and scan the QR code

[0209] 1. The customer arrives at the designated station's storage account and displays the QR code received on the terminal.

[0210] 2. The customer uses the QR code reader on their device to scan the newly received QR code.

[0211] Input: QR code

[0212] Output: Send QR code information to the server

[0213] 3. The device sends the scanned QR code information to the server in JSON format.

[0214] What it does: It converts data obtained from a QR code reader app into JSON format and sends it to the server as an HTTP POST request.

[0215] Step 10: Authenticate with the server and unlock the locker

[0216] 1. The server reconfirms the received QR code in the database, and if authentication is successful, sends a signal to unlock the locker.

[0217] Input: QR code information

[0218] Output: Locker unlock signal

[0219] Operation: Searches for a corresponding record in the database, and if a match occurs, generates and sends an unlock signal.

[0220] 2. The customer opens the locker and collects the item.

[0221] Action: Unlocks locker and removes item.

[0222] Step 11: Notification of package receipt completion

[0223] 1. The server records in the database that the item has been received.

[0224] Input: Notification data

[0225] Output: Records in the database

[0226] 2. The server sends an email to the sender and delivery company notifying them of the completion of the delivery.

[0227] Operation: Sends email using Python's smtplib.

[0228] As described above, this system allows users to use coin lockers at stations and other storage facilities as delivery boxes, streamlining the process from depositing items to receiving them.

[0229] (Application example 1)

[0230] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0231] In modern logistics systems, the need for temporary storage of deliveries is increasing, but securing appropriate storage locations and prompt notification to recipients are becoming issues. Furthermore, the food delivery industry requires a system that can ensure that recipients receive their food reliably while maintaining the quality of the food. An effective method to deal with such situations is needed.

[0232] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0233] In this invention, the server includes a means for a user to input information using a terminal and send it to the server, a means for a delivery company to reserve a storage device using a terminal and send it to the server, and a means for the server to check the availability of the storage device, generate a unique QR code, and notify the delivery company. This allows for smooth temporary storage and receipt of deliveries and food, and particularly in food delivery, makes it possible for recipients to receive food reliably while maintaining the quality of the food.

[0234] "User" refers to any individual or legal entity that uses the Service.

[0235] "Terminal" refers to electronic devices such as personal computers and smartphones.

[0236] "Server" refers to a computer or similar device that performs central processing within a system.

[0237] A "database" is a system that organizes and stores information so that it can be retrieved as needed.

[0238] "Member ID" refers to a unique identification number generated by the server to identify a user.

[0239] "Delivery Company" refers to a company or individual engaged in the delivery of goods.

[0240] "Storage device" means a coin locker at a train station or similar device for temporary storage of items.

[0241] "Availability" refers to information indicating whether or not there is available space in the storage device.

[0242] "QR Code" refers to a two-dimensional barcode that visually represents information and can be read using a QR Code reader.

[0243] "Goods" refers to general items, including parcels for delivery and food for delivery.

[0244] "Provider" refers to the person who provides the QR code to the recipient and provides the item.

[0245] "Recipient" refers to a person who receives an item from a storage device using a QR code.

[0246] A "timestamp" refers to digital information that records the date and time that a particular event occurred.

[0247] "Reservation" refers to the act of reserving the use of a storage device in advance.

[0248] "Authentication unlocking" refers to the act of unlocking a storage device using authentication means such as a QR code.

[0249] This invention is a system that uses coin lockers at train stations as delivery boxes, enabling users, delivery companies, and recipients to work together to smoothly deliver goods. This specification details the specific system configuration and operation procedures.

[0250] First, a user accesses the system using a terminal and enters information such as their name, address, phone number, email address, and password. The information sent from the terminal is received by the server and stored in a database. The server then generates a new member ID and notifies the user by email.

[0251] Next, the delivery company opens the system's storage device reservation screen on their device and selects the station they wish to use and the number of storage devices they wish to use. The selection information is sent from the device to the server, which checks the availability of storage devices. An available storage device is assigned, a unique QR code is generated, and stored in a database along with the respective storage device ID. The server then notifies the delivery company of the reservation details (storage device ID and QR code).

[0252] The delivery person goes to the storage device at the designated station and unlocks it using the QR code they received. They scan the QR code using the QR code reader on their device, and the scanned information is sent to the server. The server checks the received QR code against its database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the delivery person to open the device and deposit the item.

[0253] Once the item has been deposited, the server records the details and sends a confirmation to the delivery company. The delivery company then emails the sender a QR code to notify them of the completion of the deposit, which the sender then passes on to the recipient.

[0254] The recipient arrives at the storage device at the designated station and displays the QR code they received on their terminal. It is scanned using a QR code reader, and the information is sent to the server. The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the recipient to open the storage device and collect the item.

[0255] The hardware used includes a personal computer, a smartphone, and a QR code reader. The software used includes the Flask framework and an SQLite database. The qrcode module is used to generate the QR code.

[0256] For example, when a user registers with the system using their smartphone, a new user ID is generated. Next, a delivery company reserves a storage device, and a unique QR code is generated. The delivery company deposits the item in the designated storage device and notifies the provider of the QR code by email. The provider then transmits the QR code to the recipient, who then unlocks the storage device and collects the item.

[0257] An example prompt for a generative AI model might look like this:

[0258] "Receive the user's registration information and store it in the database. Generate a new user ID and notify the user by email."

[0259] This prompt sentence allows the server to perform the appropriate data manipulations and ensures smooth functioning of the entire system.

[0260] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0261] Step 1:

[0262] A user accesses the system using a terminal and enters information such as name, address, phone number, email address, and password. This information is sent from the terminal to the server by pressing the send button. The server stores the received user information in a database. Input: Name, address, phone number, email address, password. Output: User information stored in the database.

[0263] Step 2:

[0264] The server generates a new member ID and notifies the user of that member ID. Specifically, the server generates a unique ID in the database and sends a notification email to the registered email address. This action allows the user to be recognized in the system. Input: User information. Output: Generation of a new member ID and email notification.

[0265] Step 3:

[0266] The delivery company uses a terminal to open the system's storage device reservation screen, select the station they wish to use and the number of storage devices they wish to use, and send the entered information to the server. The server confirms the received selection information and allocates available storage devices. Input: Station information, number of storage devices. Output: Allocated storage device ID and QR code.

[0267] Step 4:

[0268] The server generates a unique QR code and stores it in the database along with the respective storage device ID. Then the server notifies the delivery company of the reservation details (storage device ID and QR code). The qrcode module is used to generate the QR code. Input: Storage device ID. Output: Generated QR code and reservation details.

[0269] Step 5:

[0270] The delivery company goes to the storage device at the designated station and unlocks it using the QR code they received. The delivery company's terminal is equipped with a QR code reader, which they use to scan the QR code and send the information to the server. The server checks the received QR code in its database, and if authentication is successful, it sends a signal to unlock the storage device. Input: QR code. Output: Signal to unlock the storage device.

[0271] Step 6:

[0272] The delivery company opens the storage device and deposits the item. Then it locks it again. The server records that the item has been deposited and sends a confirmation to the delivery company. Input: Item deposit information. Output: Record and notification of deposit completion.

[0273] Step 7:

[0274] The delivery company will email the provider a QR code along with a notification that the item has been deposited. The provider will then pass the QR code on to the recipient, who will then display the QR code upon arriving at the designated station. Input: QR code. Output: Notification email sent to the provider.

[0275] Step 8:

[0276] The recipient arrives at the storage device at the designated station and displays the QR code they received on their terminal. They then scan the QR code using a QR code reader and send the information to the server. The server checks the received QR code against its database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the recipient to open the storage device and collect the item. Input: QR code. Output: Storage device unlock signal.

[0277] Step 9:

[0278] The server records the receipt of the item with a timestamp and notifies the donor and delivery company, including details such as the date and time of receipt. Input: Receipt information. Output: Record and notification of receipt details.

[0279] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0280] The present invention optimizes the user experience by combining a system that uses coin lockers at train stations as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[0281] User Registration

[0282] The user opens the system's user registration screen using their own device (PC or smartphone). The device is equipped with an emotion engine that identifies emotions from the user's facial expressions and voice during the registration process. The user enters information such as their name, address, phone number, email address, and password. Both the registration information and emotion data are sent to the server.

[0283] The server stores the received information in a database. At the same time, it provides appropriate feedback and guidance based on the emotional data. The server generates a new member ID and creates an email to notify the user. The content of the notification is chosen with consideration for the user's emotions. For example, if the user is feeling anxious, detailed and careful guidance will be included.

[0284] Locker reservation and QR code generation

[0285] The delivery person opens the system's locker reservation screen on their device. The device's emotion engine identifies the delivery person's emotion and provides appropriate support as the task progresses. The delivery person selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server.

[0286] The server checks the availability of lockers and assigns an available locker. It generates a locker ID and a unique QR code and stores it in a database. The server then notifies the courier of the reservation details (locker ID and QR code). The content of this notification is also based on the courier's emotion.

[0287] Checked baggage

[0288] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the information to the server.

[0289] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[0290] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[0291] QR code notification

[0292] The courier will then email the sender a QR code to notify them of the delivery, and the content and tone of the email will be adjusted based on the sender's emotions as detected by the emotion engine.

[0293] Picking up your luggage

[0294] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion engine identifies the recipient's emotion and provides the necessary support. The recipient scans the QR code, and the terminal sends the information to the server.

[0295] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[0296] The server records the completion of the delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also determines the content of the notification based on the user's emotion.

[0297] Specific examples

[0298] For example, if User A registers with the system and requests courier B to leave a package in a locker at a train station, the emotion engine will sense User A's nervousness and provide detailed guidance that gives the impression of stability. When Courier B reserves the locker, the emotion engine will sense his fatigue and provide an interface that simplifies the process. Finally, when Recipient C picks up the package, the emotion engine will sense the recipient's impatience and provide quick, easy-to-understand instructions.

[0299] In this way, the system of the present invention recognizes the user's emotions and provides optimal support accordingly, improving the overall user experience.

[0300] The processing flow will be explained below.

[0301] Step 1:

[0302] The user uses their own terminal to open the system's user registration screen and enters information such as their name, address, telephone number, email address, and password.

[0303] Step 2:

[0304] The device identifies the user's emotions using an emotion engine, which utilizes facial recognition cameras and voice analysis functions.

[0305] Step 3:

[0306] The terminal transmits the input information and the identified emotion data to the server.

[0307] Step 4:

[0308] The server stores the received information in a database and simultaneously provides appropriate feedback and guidance based on the emotional data.

[0309] Step 5:

[0310] The server generates a new member ID and creates an email to notify the user. At this time, the notification content is chosen taking into consideration the user's feelings.

[0311] Step 6:

[0312] The server will email the user a new member ID and initial login password.

[0313] Step 7:

[0314] Delivery workers open the system's locker reservation screen on their own devices and select the station they wish to use and the number of lockers they wish to use.

[0315] Step 8:

[0316] The device uses an emotion engine to identify the delivery person's emotions and provides appropriate support as the work progresses.

[0317] Step 9:

[0318] The terminal sends information about the selected station and the number of lockers to the server.

[0319] Step 10:

[0320] The server checks the availability of lockers and assigns an available locker.

[0321] Step 11:

[0322] The server generates a locker ID and a unique QR code and stores it in a database.

[0323] Step 12:

[0324] The server then sends the locker ID and QR code details to the delivery company via email or an in-system notification, which also depends on the delivery company's emotion.

[0325] Step 13:

[0326] The delivery person goes to the coin locker at the designated station and displays the QR code on the terminal.

[0327] Step 14:

[0328] The delivery person scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[0329] Step 15:

[0330] The server checks the received QR code against its database.

[0331] Step 16:

[0332] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[0333] Step 17:

[0334] The delivery person opens the locker, deposits the package, and then locks it again.

[0335] Step 18:

[0336] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[0337] Step 19:

[0338] The delivery company will email the sender a QR code along with a notification that the delivery has been completed.

[0339] Step 20:

[0340] The sender transmits the received QR code to the recipient.

[0341] Step 21:

[0342] The recipient arrives at the coin locker at the designated station and displays the QR code they received on the terminal.

[0343] Step 22:

[0344] The device's emotion engine identifies the recipient's emotions and provides the necessary support.

[0345] Step 23:

[0346] The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[0347] Step 24:

[0348] The server checks the received QR code against its database.

[0349] Step 25:

[0350] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[0351] Step 26:

[0352] The recipient opens the locker and collects the package.

[0353] Step 27:

[0354] The server records the completion of delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also adjusts the content of the notification to reflect the recipient's emotions.

[0355] Example 2

[0356] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0357] In modern society, there is a demand for services that take people's emotions into consideration. However, conventional systems lack the ability to identify the emotions of users and service providers, and can only respond uniformly, resulting in an underoptimized user experience. Furthermore, in situations where users feel emotional stress or anxiety, appropriate support or feedback is not provided, which can lead to a decrease in user satisfaction.

[0358] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for a user to input information using a terminal and send it to the server, means for the terminal to be equipped with an emotion engine that identifies the user's emotion and also send emotion data to the server, means for the server to store the received information and emotion data in a database, and means for the server to generate appropriate feedback and guidance based on the emotion data and provide it to the user. This makes it possible to provide feedback and guidance that takes the user's emotions into consideration, improving the overall user experience.

[0359] A "terminal" is an electronic device used by users or delivery personnel to input or receive information, such as a PC or smartphone.

[0360] "User" refers to a person who uses this system to reserve a locker or collect luggage.

[0361] "Server" refers to the central management system that receives and processes information sent by users and delivery companies.

[0362] An "emotion engine" refers to software or hardware technology that is installed on a device and identifies emotions from the facial expressions and voice of the user or delivery person.

[0363] A "database" is a system for recording and storing information managed by a server.

[0364] "Feedback and guidance" refers to information and instructions provided by the server to users and delivery agents, which are appropriately adjusted based on emotional data.

[0365] A "member ID" is an identifier generated by the server when a user registers, and is used to uniquely identify the user.

[0366] A "locker" is a storage device installed in a designated location such as a station, and is used to temporarily store luggage.

[0367] A "QR code" is a unique two-dimensional code generated by a server and used to unlock lockers and check information.

[0368] "Notification" means a message or email sent from the server to the user or delivery company.

[0369] "Delivery company" refers to a person or organization that transports packages and deposits them in lockers.

[0370] "Sender" refers to the person or organization that requests the delivery of a package.

[0371] "Recipient" refers to the person who receives the package from the locker.

[0372] The present invention optimizes the user experience by combining a system that uses train station lockers as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[0373] Hardware and software used

[0374] The system uses the following hardware and software:

[0375] 1. Terminal: An electronic device such as a PC or smartphone that allows users or delivery personnel to input and display information. The terminal is equipped with a camera, microphone, and QR code reader.

[0376] 2. Emotion engine: Software that analyzes the facial expressions and voices of users and delivery personnel to identify their emotions, thereby obtaining emotional data about the user.

[0377] 3. Server: A central management system that receives and processes information sent by users and couriers, stores the information in a database, and generates appropriate feedback and guidance.

[0378] 4. Database: A system for recording and storing information managed by a server.

[0379] Basic system configuration

[0380] 1. User Registration:

[0381] The user opens the system's user registration screen on their device (PC or smartphone). The device is equipped with an emotion engine that analyzes facial expressions and voice to obtain emotion data.

[0382] The user inputs necessary information such as name, address, phone number, email address, password, etc. The input information and emotion data are sent from the device to the server.

[0383] The server stores the received information in a database, generates appropriate feedback and guidance based on the emotion data, and provides it to the user. Finally, it generates a new member ID and sends a notification to the user that takes the emotion data into consideration.

[0384] 2. Locker reservation and QR code generation:

[0385] The delivery person opens the system's locker reservation screen from their own device, and the device's emotion engine identifies the delivery person's emotion.

[0386] The courier selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server. The server checks the availability of lockers and assigns an available locker. A unique QR code is generated and notified to the courier. The content of this notification is adjusted according to the courier's emotions.

[0387] 3. Baggage Drop-Off and Notification:

[0388] The courier goes to the designated coin locker at the station and scans the QR code using the QR code reader on the terminal, which then sends the scanned information to the server.

[0389] The server checks the received QR code, and if authentication is successful, it sends a signal to unlock the locker. The delivery person deposits the package in the locker and then relocks it.

[0390] The server records the successful delivery of the parcel in a database and sends a confirmation message to the courier, which is also tailored to take the courier's emotions into account.

[0391] 4. Pick up your package:

[0392] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion engine identifies the recipient's emotions and provides the necessary support.

[0393] The recipient scans the QR code and sends the information to the server. The server authenticates the received QR code, and if successful, sends a signal to unlock the locker. The recipient can then collect their package.

[0394] The server records the completion of the delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also determines the content of the notification based on the user's emotion.

[0395] Specific examples

[0396] For example, when a user registers with the system, if the emotion engine detects nervousness, the server can provide detailed and reassuring guidance. When a courier reserves a locker, if the emotion engine detects fatigue, the server can provide a simplified interface. Finally, when the recipient picks up the package, if the emotion engine detects impatience, the server can provide quick and easy-to-understand instructions.

[0397] Prompt Sentence Examples

[0398] When using a generative AI model, you can use prompts like the following:

[0399] "Users feel nervous when registering with the system. The system should provide detailed and reassuring guidance."

[0400] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0401] Steps in user registration

[0402] Step 1:

[0403] The user opens the user registration screen on the device. The device uses a camera and microphone to input the user's facial expressions and voice into the emotion engine. The emotion engine analyzes this and generates emotion data for the user.

[0404] Step 2:

[0405] The user inputs information such as their name, address, phone number, email address, and password. The device then transmits this input information and the generated emotion data to the server.

[0406] Step 3:

[0407] The server stores the received user information and emotion data in a database. It validates the user information and records it accurately in the database.

[0408] Step 4:

[0409] The server generates appropriate feedback and guidance based on the stored emotional data. The emotion engine creates relaxing messages and detailed guidance depending on the emotions detected.

[0410] Step 5:

[0411] The server generates a new member ID and creates a notification email containing that ID. The content of this email is tailored based on the emotional data to convey a sense of security and support. The email is then sent to the user.

[0412] Locker reservation and QR code generation process steps

[0413] Step 1:

[0414] The delivery person opens the system's locker reservation screen on their own device, where an emotion engine analyzes the delivery person's facial expressions and voice to generate emotion data.

[0415] Step 2:

[0416] The delivery person inputs the desired station and the desired number of lockers. The terminal then transmits this data and emotion data to the server.

[0417] Step 3:

[0418] The server checks the availability of lockers in the database based on the received station and number of lockers. If there are any available lockers, it allocates them. During this process, it also takes into account the courier's emotional data and proceeds to the next step.

[0419] Step 4:

[0420] The server generates available locker IDs and unique QR codes, stores them in a database, and notifies the courier with the details (locker ID and QR code), which are also tailored based on the emotion data.

[0421] Baggage drop-off processing steps

[0422] Step 1:

[0423] The courier takes the QR code they received and goes to the designated coin locker at the station, where they scan the QR code using the QR code reader on their device.

[0424] Step 2:

[0425] The device sends the scanned QR code information to the server.

[0426] Step 3:

[0427] The server checks the received QR code information against a database, and if authentication is successful, it sends a signal to unlock the locker. Upon receiving this signal, the locker opens.

[0428] Step 4:

[0429] The delivery person opens the locker, deposits the package, and then relocks it.

[0430] Step 5:

[0431] The server records the successful deposit in a database and sends a confirmation to the courier, which is also adjusted based on the emotion data.

[0432] Processing steps for receiving a package

[0433] Step 1:

[0434] The recipient arrives at the designated coin locker at the station and stands in front of the locker holding the QR code displayed on the terminal.

[0435] Step 2:

[0436] The device uses a QR code reader to scan the QR code and transmits the information to the server.

[0437] Step 3:

[0438] The server checks the received QR code information in a database, and if authentication is successful, it sends a signal to unlock the locker.

[0439] Step 4:

[0440] The recipient opens the locker and collects the package.

[0441] Step 5:

[0442] The server records the completion of the package in a database and sends a confirmation to the sender and the courier, which is also adjusted based on the emotion data.

[0443] (Application example 2)

[0444] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0445] In recent years, systems that utilize train station coin lockers as parcel lockers have been gaining attention. However, these systems fail to properly consider the user's emotions during the user registration, locker reservation, and baggage deposit and collection processes, which can cause stress and discomfort to users. Furthermore, there is a need for methods to reduce the workload of employees and ensure efficient operation. Given this background, the development of a system that can identify the emotions of users and employees and provide support based on these emotions is a challenge.

[0446] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input information using a terminal and send it to the server; a means for the server to store the received information in a database; a means for the server to generate a new member ID and notify the user; a means for a delivery company to reserve a locker using the terminal and send it to the server; a means for the server to check the availability of a locker, generate a unique QR code and notify the delivery company; a means for the delivery company to unlock the locker and deposit the package using the QR code; a means for the server to record the deposit of the package and notify the delivery company; a means for the delivery company to send the QR code to the sender; a means for a recipient to unlock the locker using the QR code and receive the package; a means for the server to record the receipt of the package and notify the sender and the delivery company; a means for identifying the user's emotion using emotion recognition technology installed in the terminal and sending the information to the server; and a means for the server to optimize the notification content and interface based on the emotion data received. This makes it possible to quickly recognize the user's emotions and provide optimal support based on them.

[0447] A "user" is an individual or corporation that uses the system, and is the entity that inputs information using a terminal and transmits it to the server.

[0448] A "terminal" is an electronic device such as a PC, smartphone, or tablet, which allows users to input and operate information.

[0449] A "server" is a computer system that stores and processes data over a network and provides various services.

[0450] A "database" is a system for organizing and storing information, and is used by a server to store information received.

[0451] "Member ID" is an identifier that uniquely identifies a user on the system.

[0452] "Courier" means an individual or legal entity that delivers, deposits, and receives packages.

[0453] A "locker" is a storage facility for temporarily storing luggage, and is usually installed at stations and public facilities.

[0454] A "QR code" is a type of two-dimensional barcode that is expressed as a pattern with unique identification information.

[0455] "Package" means an item that is being delivered or received.

[0456] "Emotion recognition technology" is a technology that uses cameras and voice input devices to identify emotions from human facial expressions and voice.

[0457] "Notification" refers to the act or means of transmitting information from the server to the user or delivery company.

[0458] An "interface" is an operation screen or operation method for exchanging information between a user and a system.

[0459] "Recipient" means an individual or legal entity that receives a package from a locker.

[0460] The present invention optimizes the user experience by combining a system that uses coin lockers at train stations as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[0461] User Registration

[0462] The user opens the system's user registration screen using their own device (PC or smartphone). The device is equipped with emotion recognition technology, which identifies emotions from the user's facial expressions and voice during the registration process. The user enters information such as their name, address, phone number, email address, and password. Both the registration information and emotion data are sent to the server.

[0463] The server stores the received information in a database. At the same time, it provides appropriate feedback and guidance based on the emotional data. The server generates a new member ID and notifies the user. The notification content is selected with consideration for the user's emotions. For example, if the user is feeling anxious, detailed and careful guidance will be included.

[0464] Locker reservation and QR code generation

[0465] The delivery person opens the system's locker reservation screen on their device. The device's emotion recognition technology identifies the delivery person's emotions and provides appropriate support as the task progresses. The delivery person selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server.

[0466] The server checks the availability of lockers and assigns an available locker. It generates a locker ID and a unique QR code and stores it in a database. The server then notifies the courier of the reservation details (locker ID and QR code). The content of this notification is also based on the courier's emotion.

[0467] Checked baggage

[0468] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the information to the server.

[0469] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[0470] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[0471] QR code notification

[0472] The courier will then send a QR code to the sender to notify them of the delivery, and the content and tone of the notification will be adjusted depending on the sender's emotions as detected by emotion recognition technology.

[0473] Picking up your luggage

[0474] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion recognition technology identifies the recipient's emotion and provides the necessary support. The recipient scans the QR code, and the terminal sends the information to the server.

[0475] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[0476] The server records the completion of delivery in a database and sends a notification to the sender and the courier company. Emotion recognition technology enables the content of the notification to be tailored to the recipient's emotion.

[0477] Hardware and software used

[0478] Hardware: Smartphones, PCs, lockers (luggage storage facilities)

[0479] Software: OpenCV (image processing library), dlib (face detection and landmark estimation library), emotion recognition model, server software

[0480] Specific examples

[0481] For example, if User A registers with the system and requests courier B to leave a package in a locker at a station, the emotion recognition technology will detect User A's nervousness and the server will provide detailed guidance that gives the impression of stability. When Courier B reserves the locker, the emotion recognition technology will detect fatigue and provide an interface that simplifies the process. Finally, when Recipient C receives the package, the emotion recognition technology will detect impatience and provide quick and easy-to-understand instructions.

[0482] Prompt Sentence Examples

[0483] 1. Example of a prompt for user registration:

[0484] Input prompt: "Capture facial expressions during user registration, recognize emotions, and send them to the server"

[0485] Sample output: "Analyzing your sentiment... Please enter your registration details."

[0486] 2. Example of prompt for locker reservation:

[0487] Input prompt: "Recognize ongoing emotions during locker booking and provide necessary support."

[0488] Example output: "You are showing signs of fatigue. We'll simplify the booking process... Please enter the station name and number of lockers."

[0489] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0490] Step 1:

[0491] The user enters information into the terminal and sends it to the server.

[0492] Input: A user enters information into a device, such as a name, address, phone number, email address, or password.

[0493] Processing: The device uses emotion recognition technology to analyze the user's facial expressions and voice input, generating emotional data. This registration information and emotional data are then sent to the server.

[0494] Output: Registration information and emotion data sent to the server.

[0495] Step 2:

[0496] The server stores the received information in a database

[0497] Input: Registration information and emotion data submitted in step 1.

[0498] Processing: The server stores this information in a database.

[0499] Output: User registration information and emotion data stored in a database.

[0500] Step 3:

[0501] The server generates a new member ID and notifies the user.

[0502] Input: User registration information stored in the database.

[0503] Action: The server generates a new member ID and optimizes the notification content based on the sentiment data, for example, including detailed and polite guidance if the user is feeling anxious.

[0504] Output: Notification of member ID according to sentiment towards the user.

[0505] Step 4:

[0506] The delivery company reserves a locker using a terminal and sends the reservation to the server.

[0507] Input: The delivery person enters the station they wish to use and the number of lockers they wish to use into the terminal.

[0508] Processing: The device uses emotion recognition technology to analyze the delivery person's emotions and generate emotion data. The device then sends the reservation information and emotion data to the server.

[0509] Output: Reservation information and emotion data sent to the server.

[0510] Step 5:

[0511] The server checks the availability of the locker, generates a unique QR code, and notifies the courier.

[0512] Input: Booking information and emotion data submitted in step 4.

[0513] Processing: The server checks the availability of lockers in the database, assigns an available locker, generates a unique QR code, and sends a notification to the courier, optimizing the notification content based on the emotion data.

[0514] Output: QR code notification depending on your sentiment towards the courier.

[0515] Step 6:

[0516] The delivery person uses the QR code to unlock the locker and deposit the package.

[0517] Input: The QR code sent in step 5.

[0518] Processing: The courier scans the QR code using the QR code reader on the device, and the device sends the information to the server.

[0519] Output: The QR code information sent to the server.

[0520] Step 7:

[0521] The server records the delivery of the package and notifies the courier.

[0522] Input: QR code information sent in step 6.

[0523] Processing: The server checks the QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. After the luggage is deposited, the information is recorded in the database and a confirmation notification is sent to the courier. The notification content is optimized based on the emotion data.

[0524] Output: Notification of successful deposit depending on your feelings towards the courier.

[0525] Step 8:

[0526] The courier will send a QR code to the sender

[0527] Input: QR code provided in step 7.

[0528] Processing: The courier sends a QR code to the sender, and emotion recognition technology identifies the sender's emotion and optimizes the notification content.

[0529] Output: QR code notification depending on your feelings towards the sender.

[0530] Step 9:

[0531] The recipient unlocks the locker using the QR code and collects the package.

[0532] Input: QR code received by the recipient.

[0533] Process: The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server. The server checks the QR code against the database, and if authentication is successful, it sends a signal to unlock the locker.

[0534] Output: Locker unlock signal to recipient.

[0535] Step 10:

[0536] The server records the receipt of the package and notifies the sender and the courier.

[0537] Input: QR code information sent in step 9.

[0538] Processing: The server records the parcel receipt in a database and sends a confirmation notification to the sender and the courier, which is also optimized based on the emotion data.

[0539] Output: Notification of successful delivery depending on feelings towards the sender and courier.

[0540] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0541] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0542] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0543] [Second embodiment]

[0544] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0545] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0546] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0547] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0548] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0549] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0550] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0551] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0552] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0553] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0554] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0555] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0556] The present invention relates to a system that uses coin lockers at stations as delivery boxes, and is implemented as follows.

[0557] User Registration

[0558] The user opens the system's user registration screen using their own device (PC or smartphone) and enters information such as their name, address, phone number, email address, and password. When the user clicks the "Register" button, the device sends the entered information to the server.

[0559] The server saves the received information in the database, generates a new member ID, and notifies the user of the generated member ID and the password for the first login by email.

[0560] Locker reservation and QR code generation

[0561] The delivery person opens the system's locker reservation screen on their device, selects the station they wish to use and the number of lockers they wish to use, and when they click the "Reserve" button, the device sends the selected information to the server.

[0562] The server checks the availability of lockers and allocates an available locker. It generates a locker ID and a unique QR code, which is stored in a database along with the respective locker ID. The server then notifies the courier of the reservation details (locker ID and QR code).

[0563] Checked baggage

[0564] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the scanned information to the server.

[0565] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[0566] The server records that the package has been deposited and sends a confirmation to the courier.

[0567] QR code notification

[0568] The delivery company will send a QR code to the sender along with a notification of the completion of the delivery, and the sender will then pass the received QR code on to the recipient.

[0569] Picking up your luggage

[0570] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The QR code is then scanned using the terminal's QR code reader.

[0571] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[0572] The server records that the package has been received and sends a notification of receipt to the sender and the delivery company.

[0573] Specific examples

[0574] For example, if User A registers with the system and requests delivery company B to leave a package in a locker at a station, the following process will occur: Delivery company B reserves a locker and receives a QR code. B leaves the package in the designated locker and sends the QR code to User A. User A then transmits the QR code to recipient C, who arrives at the designated locker and uses the QR code to retrieve the package.

[0575] In this way, the system of the present invention allows users to use lockers at designated stations as delivery boxes, facilitating smooth package collection.

[0576] The processing flow will be explained below.

[0577] Step 1:

[0578] The user uses a terminal to open the system's user registration screen and enters information such as name, address, telephone number, email address, and password.

[0579] Step 2:

[0580] The terminal transmits the input information to the server.

[0581] Step 3:

[0582] The server stores the received information in a database.

[0583] Step 4:

[0584] The server generates a new member ID and creates an email to notify the user.

[0585] Step 5:

[0586] The server will email the user a new member ID and initial login password.

[0587] Step 6:

[0588] Delivery workers open the system's locker reservation screen on their own devices and select the station they wish to use and the number of lockers they wish to use.

[0589] Step 7:

[0590] The terminal sends information about the selected station and the number of lockers to the server.

[0591] Step 8:

[0592] The server checks the availability of lockers and assigns an available locker.

[0593] Step 9:

[0594] The server generates a locker ID and a unique QR code and stores it in a database.

[0595] Step 10:

[0596] The server sends the locker ID and QR code details to the delivery company via email or in-system notification.

[0597] Step 11:

[0598] The delivery person goes to the coin locker at the designated station and displays the QR code on the terminal.

[0599] Step 12:

[0600] The delivery person scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[0601] Step 13:

[0602] The server checks the received QR code against its database.

[0603] Step 14:

[0604] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[0605] Step 15:

[0606] The delivery person opens the locker, deposits the package, and then locks it again.

[0607] Step 16:

[0608] The server records the completion of the package deposit in a database and sends a confirmation notice to the courier.

[0609] Step 17:

[0610] The delivery company will email the sender a QR code along with a notification that the delivery has been completed.

[0611] Step 18:

[0612] The sender transmits the received QR code to the recipient.

[0613] Step 19:

[0614] The recipient arrives at the coin locker at the designated station and displays the QR code they received on the terminal.

[0615] Step 20:

[0616] The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[0617] Step 21:

[0618] The server checks the received QR code against its database.

[0619] Step 22:

[0620] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[0621] Step 23:

[0622] The recipient opens the locker and collects the package.

[0623] Step 24:

[0624] The server records in the database that the parcel has been received, and sends a notification of the completion of the parcel to the sender and the delivery company.

[0625] Example 1

[0626] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0627] Conventional delivery systems have had problems with smooth delivery of goods when the user is absent or when receiving the goods takes time. There is also a need for a more efficient method of delivering and receiving goods. In addition, there is a need for a method to check the storage information of goods in real time and to safely deposit and receive goods.

[0628] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0629] In this invention, the server includes: a means for a user to input information using a terminal and send it to the server; a means for the server to store the received information in a database; a means for the server to generate a new identifier and notify the user; a means for a delivery company to reserve a storage account using a terminal and send it to the server; a means for the server to check the availability of the storage account, generate a unique identifier code and notify the delivery company; a means for the delivery company to unlock the storage account using the identifier code and deposit the item; a means for the server to record the deposit of the item and notify the delivery company; a means for the delivery company to send the identifier code to the item sender; a means for the customer to unlock the storage account using the identifier code and receive the item; a means for the server to record the receipt of the item and notify the item sender and the delivery company; and a means for displaying the status and facilitating processing using an AI model. This streamlines the process from depositing to receiving the item, enabling a home delivery system that is highly convenient for users and delivery companies to be realized.

[0630] A "user" is an entity that registers with the system and deposits and receives items.

[0631] A "terminal" is a device used by a user or delivery company to communicate with the system, including a PC or smartphone.

[0632] A "server" is a computer system that manages information at the center of the system and performs various processes.

[0633] An "identifier" is a unique number or code generated by the server to identify a user or item.

[0634] A "delivery company" is an entity that delivers goods and reserves a storage account and deposits goods via a terminal.

[0635] A "storage account" is a coin locker at a station or other storage facility, and is an account for the temporary storage of items.

[0636] A "unique identifier code" is an individual QR code or barcode generated to identify an item or storage account.

[0637] The "item sender" is the user who deposits the item.

[0638] A "customer" is a user who receives an item.

[0639] An "AI model" is an artificial intelligence algorithm that optimizes processes such as depositing and receiving items.

[0640] A "database" is a collection of information stored on the system's server, including user information and reservation information.

[0641] An "unlock signal" is an electronic instruction sent from the server to open a custodial account.

[0642] The present invention relates to a system that utilizes coin lockers at train stations and other storage facilities as delivery lockers, and is designed to allow users, delivery companies, and customers to efficiently deposit and receive items.

[0643] System configuration

[0644] The system is primarily comprised of the following elements: the devices (PCs and smartphones) used by users and delivery companies, the server that manages the information, the communication means for exchanging information between them, and the database that functions as the core of the system. It also uses an AI model to facilitate the deposit and receipt of goods.

[0645] Hardware and Software

[0646] Hardware:

[0647] Device: PC or smartphone used by the user or delivery company.

[0648] Storage Accounts: Coin lockers and other storage facilities at train stations.

[0649] software:

[0650] Server: Java Spring Framework and Node.js for storing and processing information.

[0651] Database: MySQL or MongoDB to manage user and reservation information.

[0652] QR Code Generation: Python qrcode library.

[0653] Notification: Send email using Python's smtplib.

[0654] AI models: Algorithms used to optimize information and streamline processes.

[0655] Program processing

[0656] The specific process of the system is as follows: the user registers with the system, the delivery company deposits the item, and the customer receives the item. This process is carried out smoothly. Specifically, the user registers as a user of the system using a terminal, and the server receives the information and stores it in a database. The server then generates a new identifier and notifies the user.

[0657] Adding specific examples

[0658] For example, if user A registers with the system and requests delivery company B to store a package in a storage account at a station, the following process takes place: Delivery company B reserves the storage account and receives a QR code. B stores the package in the specified storage account and sends the QR code to user A. User A transmits the QR code to recipient C, who arrives at the specified storage account and uses the QR code to collect the package. In this way, the system of the present invention allows users to use the specified station storage account as a delivery locker, facilitating a smooth package collection process.

[0659] Prompt Sentence Examples

[0660] For example, an explanatory text can be generated by inputting the following prompt text into the generative AI model:

[0661] "Please explain in detail the processing of a system that uses coin lockers at train stations as delivery boxes from the perspectives of the server, the terminal, and the user."

[0662] By entering this prompt, a detailed description of a system that uses coin lockers at train stations as delivery boxes will be generated.

[0663] As described above, the system of the present invention is designed to allow users to conveniently use coin lockers at train stations and other storage facilities as delivery lockers.

[0664] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0665] Step 1: User Registration

[0666] 1. The user opens the system's user registration screen using their own device (PC or smartphone).

[0667] 2. The user enters information such as name, address, phone number, email address, and password, and clicks the "Register" button.

[0668] Input: User's name, address, phone number, email address, password

[0669] Output: Send registration information to the server

[0670] 3. The device sends the entered information to the server in JSON format.

[0671] What it does: Converts form data to JSON format and sends it to the server as an HTTP POST request.

[0672] Step 2: Storing user information on the server and notifying users

[0673] 1. The server stores the received information in a database.

[0674] Input: User registration information sent from the device

[0675] Output: Registration information is saved in the database

[0676] Behavior: Makes a database connection and executes an INSERT statement to save the user information.

[0677] 2. The server generates a new member ID and password for the first login and notifies the user by email.

[0678] Operation: Runs the member ID generation algorithm and sends an email using Python's smtplib.

[0679] Step 3: Enter and submit your locker reservation information

[0680] 1. The delivery person opens the system's locker reservation screen on their own device.

[0681] 2. The delivery person selects the station they wish to use and the number of storage accounts they wish to use, and clicks the "Reserve" button.

[0682] Input: Station name, number of required storage accounts

[0683] Output: Send reservation information to the server

[0684] 3. The device sends the selection information to the server in JSON format.

[0685] What it does: Converts form data to JSON format and sends it to the server as an HTTP POST request.

[0686] Step 4: Locker assignment and notification on the server

[0687] 1. The server checks the availability of storage accounts and assigns an available storage account.

[0688] Input: Station name, number of required storage accounts

[0689] Output: Assigned custody account ID and QR code

[0690] What it does: Performs a database query to check availability, stores the assigned custodial account ID in the database, and generates a QR code.

[0691] 2. The server generates a unique QR code and stores it in the database along with the custodial account ID.

[0692] What it does: Generates QR codes using Python's qrcode library.

[0693] 3. The server notifies the delivery company of the reservation details (storage account ID and QR code) by email.

[0694] Operation: Sends email using Python's smtplib.

[0695] Step 5: Arrive at the locker and scan the QR code

[0696] 1. The courier goes to the designated station's storage account and uses the QR code they received.

[0697] 2. The courier scans the QR code using a QR code reader app on their device.

[0698] Input: QR code

[0699] Output: Send QR code information to the server

[0700] 3. The device sends the scanned QR code information to the server in JSON format.

[0701] What it does: It converts data obtained from a QR code reader app into JSON format and sends it to the server as an HTTP POST request.

[0702] Step 6: Authenticate with the server and unlock the locker

[0703] 1. The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker.

[0704] Input: QR code information

[0705] Output: Locker unlock signal

[0706] Operation: Searches for a corresponding record in the database, and if a match occurs, generates and sends an unlock signal.

[0707] 2. The courier opens the locker, deposits the item, and then locks it again.

[0708] How it works: After depositing the item in the locker, manually lock the locker.

[0709] Step 7: Baggage drop-off notification

[0710] 1. The server records in the database that the item has been deposited.

[0711] Input: Notification data

[0712] Output: Records in the database

[0713] 2. The server sends a confirmation email to the delivery company.

[0714] Operation: Sends email using Python's smtplib.

[0715] Step 8: QR Code Notification

[0716] 1. The delivery company will email the sender a QR code along with a notification that the item has been deposited.

[0717] Operation: Sends email using Python's smtplib.

[0718] 2. The sender of the item will send the received QR code to the customer.

[0719] How it works: Send a QR code via email or message.

[0720] Step 9: Arrive at the locker and scan the QR code

[0721] 1. The customer arrives at the designated station's storage account and displays the QR code received on the terminal.

[0722] 2. The customer uses the QR code reader on their device to scan the newly received QR code.

[0723] Input: QR code

[0724] Output: Send QR code information to the server

[0725] 3. The device sends the scanned QR code information to the server in JSON format.

[0726] What it does: It converts data obtained from a QR code reader app into JSON format and sends it to the server as an HTTP POST request.

[0727] Step 10: Authenticate with the server and unlock the locker

[0728] 1. The server reconfirms the received QR code in the database, and if authentication is successful, sends a signal to unlock the locker.

[0729] Input: QR code information

[0730] Output: Locker unlock signal

[0731] Operation: Searches for a corresponding record in the database, and if a match occurs, generates and sends an unlock signal.

[0732] 2. The customer opens the locker and collects the item.

[0733] Action: Unlocks locker and removes item.

[0734] Step 11: Notification of package receipt completion

[0735] 1. The server records in the database that the item has been received.

[0736] Input: Notification data

[0737] Output: Records in the database

[0738] 2. The server sends an email to the sender and delivery company notifying them of the completion of the delivery.

[0739] Operation: Sends email using Python's smtplib.

[0740] As described above, this system allows users to use coin lockers at stations and other storage facilities as delivery boxes, streamlining the process from depositing items to receiving them.

[0741] (Application example 1)

[0742] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0743] In modern logistics systems, the need for temporary storage of deliveries is increasing, but securing appropriate storage locations and prompt notification to recipients are becoming issues. Furthermore, the food delivery industry requires a system that can ensure that recipients receive their food reliably while maintaining the quality of the food. An effective method to deal with such situations is needed.

[0744] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0745] In this invention, the server includes a means for a user to input information using a terminal and send it to the server, a means for a delivery company to reserve a storage device using a terminal and send it to the server, and a means for the server to check the availability of the storage device, generate a unique QR code, and notify the delivery company. This allows for smooth temporary storage and receipt of deliveries and food, and particularly in food delivery, makes it possible for recipients to receive food reliably while maintaining the quality of the food.

[0746] "User" refers to any individual or legal entity that uses the Service.

[0747] "Terminal" refers to electronic devices such as personal computers and smartphones.

[0748] "Server" refers to a computer or similar device that performs central processing within a system.

[0749] A "database" is a system that organizes and stores information so that it can be retrieved as needed.

[0750] "Member ID" refers to a unique identification number generated by the server to identify a user.

[0751] "Delivery Company" refers to a company or individual engaged in the delivery of goods.

[0752] "Storage device" means a coin locker at a train station or similar device for temporary storage of items.

[0753] "Availability" refers to information indicating whether or not there is available space in the storage device.

[0754] "QR Code" refers to a two-dimensional barcode that visually represents information and can be read using a QR Code reader.

[0755] "Goods" refers to general items, including parcels for delivery and food for delivery.

[0756] "Provider" refers to the person who provides the QR code to the recipient and provides the item.

[0757] "Recipient" refers to a person who receives an item from a storage device using a QR code.

[0758] A "timestamp" refers to digital information that records the date and time that a particular event occurred.

[0759] "Reservation" refers to the act of reserving the use of a storage device in advance.

[0760] "Authentication unlocking" refers to the act of unlocking a storage device using authentication means such as a QR code.

[0761] This invention is a system that uses coin lockers at train stations as delivery boxes, enabling users, delivery companies, and recipients to work together to smoothly deliver goods. This specification details the specific system configuration and operation procedures.

[0762] First, a user accesses the system using a terminal and enters information such as their name, address, phone number, email address, and password. The information sent from the terminal is received by the server and stored in a database. The server then generates a new member ID and notifies the user by email.

[0763] Next, the delivery company opens the system's storage device reservation screen on their device and selects the station they wish to use and the number of storage devices they wish to use. The selection information is sent from the device to the server, which checks the availability of storage devices. An available storage device is assigned, a unique QR code is generated, and stored in a database along with the respective storage device ID. The server then notifies the delivery company of the reservation details (storage device ID and QR code).

[0764] The delivery person goes to the storage device at the designated station and unlocks it using the QR code they received. They scan the QR code using the QR code reader on their device, and the scanned information is sent to the server. The server checks the received QR code against its database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the delivery person to open the device and deposit the item.

[0765] Once the item has been deposited, the server records the details and sends a confirmation to the delivery company. The delivery company then emails the sender a QR code to notify them of the completion of the deposit, which the sender then passes on to the recipient.

[0766] The recipient arrives at the storage device at the designated station and displays the QR code they received on their terminal. It is scanned using a QR code reader, and the information is sent to the server. The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the recipient to open the storage device and collect the item.

[0767] The hardware used includes a personal computer, a smartphone, and a QR code reader. The software used includes the Flask framework and an SQLite database. The qrcode module is used to generate the QR code.

[0768] For example, when a user registers with the system using their smartphone, a new user ID is generated. Next, a delivery company reserves a storage device, and a unique QR code is generated. The delivery company deposits the item in the designated storage device and notifies the provider of the QR code by email. The provider then transmits the QR code to the recipient, who then unlocks the storage device and collects the item.

[0769] An example prompt for a generative AI model might look like this:

[0770] "Receive the user's registration information and store it in the database. Generate a new user ID and notify the user by email."

[0771] This prompt sentence allows the server to perform the appropriate data manipulations and ensures smooth functioning of the entire system.

[0772] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0773] Step 1:

[0774] A user accesses the system using a terminal and enters information such as name, address, phone number, email address, and password. This information is sent from the terminal to the server by pressing the send button. The server stores the received user information in a database. Input: Name, address, phone number, email address, password. Output: User information stored in the database.

[0775] Step 2:

[0776] The server generates a new member ID and notifies the user of that member ID. Specifically, the server generates a unique ID in the database and sends a notification email to the registered email address. This action allows the user to be recognized in the system. Input: User information. Output: Generation of a new member ID and email notification.

[0777] Step 3:

[0778] The delivery company uses a terminal to open the system's storage device reservation screen, select the station they wish to use and the number of storage devices they wish to use, and send the entered information to the server. The server confirms the received selection information and allocates available storage devices. Input: Station information, number of storage devices. Output: Allocated storage device ID and QR code.

[0779] Step 4:

[0780] The server generates a unique QR code and stores it in the database along with the respective storage device ID. Then the server notifies the delivery company of the reservation details (storage device ID and QR code). The qrcode module is used to generate the QR code. Input: Storage device ID. Output: Generated QR code and reservation details.

[0781] Step 5:

[0782] The delivery company goes to the storage device at the designated station and unlocks it using the QR code they received. The delivery company's terminal is equipped with a QR code reader, which they use to scan the QR code and send the information to the server. The server checks the received QR code in its database, and if authentication is successful, it sends a signal to unlock the storage device. Input: QR code. Output: Signal to unlock the storage device.

[0783] Step 6:

[0784] The delivery company opens the storage device and deposits the item. Then it locks it again. The server records that the item has been deposited and sends a confirmation to the delivery company. Input: Item deposit information. Output: Record and notification of deposit completion.

[0785] Step 7:

[0786] The delivery company will email the provider a QR code along with a notification that the item has been deposited. The provider will then pass the QR code on to the recipient, who will then display the QR code upon arriving at the designated station. Input: QR code. Output: Notification email sent to the provider.

[0787] Step 8:

[0788] The recipient arrives at the storage device at the designated station and displays the QR code they received on their terminal. They then scan the QR code using a QR code reader and send the information to the server. The server checks the received QR code against its database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the recipient to open the storage device and collect the item. Input: QR code. Output: Storage device unlock signal.

[0789] Step 9:

[0790] The server records the receipt of the item with a timestamp and notifies the donor and delivery company, including details such as the date and time of receipt. Input: Receipt information. Output: Record and notification of receipt details.

[0791] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0792] The present invention optimizes the user experience by combining a system that uses coin lockers at train stations as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[0793] User Registration

[0794] The user opens the system's user registration screen using their own device (PC or smartphone). The device is equipped with an emotion engine that identifies emotions from the user's facial expressions and voice during the registration process. The user enters information such as their name, address, phone number, email address, and password. Both the registration information and emotion data are sent to the server.

[0795] The server stores the received information in a database. At the same time, it provides appropriate feedback and guidance based on the emotional data. The server generates a new member ID and creates an email to notify the user. The content of the notification is chosen with consideration for the user's emotions. For example, if the user is feeling anxious, detailed and careful guidance will be included.

[0796] Locker reservation and QR code generation

[0797] The delivery person opens the system's locker reservation screen on their device. The device's emotion engine identifies the delivery person's emotion and provides appropriate support as the task progresses. The delivery person selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server.

[0798] The server checks the availability of lockers and assigns an available locker. It generates a locker ID and a unique QR code and stores it in a database. The server then notifies the courier of the reservation details (locker ID and QR code). The content of this notification is also based on the courier's emotion.

[0799] Checked baggage

[0800] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the information to the server.

[0801] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[0802] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[0803] QR code notification

[0804] The courier will then email the sender a QR code to notify them of the delivery, and the content and tone of the email will be adjusted based on the sender's emotions as detected by the emotion engine.

[0805] Picking up your luggage

[0806] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion engine identifies the recipient's emotion and provides the necessary support. The recipient scans the QR code, and the terminal sends the information to the server.

[0807] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[0808] The server records the completion of the delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also determines the content of the notification based on the user's emotion.

[0809] Specific examples

[0810] For example, if User A registers with the system and requests courier B to leave a package in a locker at a train station, the emotion engine will sense User A's nervousness and provide detailed guidance that gives the impression of stability. When Courier B reserves the locker, the emotion engine will sense his fatigue and provide an interface that simplifies the process. Finally, when Recipient C picks up the package, the emotion engine will sense the recipient's impatience and provide quick, easy-to-understand instructions.

[0811] In this way, the system of the present invention recognizes the user's emotions and provides optimal support accordingly, improving the overall user experience.

[0812] The processing flow will be explained below.

[0813] Step 1:

[0814] The user uses their own terminal to open the system's user registration screen and enters information such as their name, address, telephone number, email address, and password.

[0815] Step 2:

[0816] The device identifies the user's emotions using an emotion engine, which utilizes facial recognition cameras and voice analysis functions.

[0817] Step 3:

[0818] The terminal transmits the input information and the identified emotion data to the server.

[0819] Step 4:

[0820] The server stores the received information in a database and simultaneously provides appropriate feedback and guidance based on the emotional data.

[0821] Step 5:

[0822] The server generates a new member ID and creates an email to notify the user. At this time, the notification content is chosen taking into consideration the user's feelings.

[0823] Step 6:

[0824] The server will email the user a new member ID and initial login password.

[0825] Step 7:

[0826] Delivery workers open the system's locker reservation screen on their own devices and select the station they wish to use and the number of lockers they wish to use.

[0827] Step 8:

[0828] The device uses an emotion engine to identify the delivery person's emotions and provides appropriate support as the work progresses.

[0829] Step 9:

[0830] The terminal sends information about the selected station and the number of lockers to the server.

[0831] Step 10:

[0832] The server checks the availability of lockers and assigns an available locker.

[0833] Step 11:

[0834] The server generates a locker ID and a unique QR code and stores it in a database.

[0835] Step 12:

[0836] The server then sends the locker ID and QR code details to the delivery company via email or an in-system notification, which also depends on the delivery company's emotion.

[0837] Step 13:

[0838] The delivery person goes to the coin locker at the designated station and displays the QR code on the terminal.

[0839] Step 14:

[0840] The delivery person scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[0841] Step 15:

[0842] The server checks the received QR code against its database.

[0843] Step 16:

[0844] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[0845] Step 17:

[0846] The delivery person opens the locker, deposits the package, and then locks it again.

[0847] Step 18:

[0848] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[0849] Step 19:

[0850] The delivery company will email the sender a QR code along with a notification that the delivery has been completed.

[0851] Step 20:

[0852] The sender transmits the received QR code to the recipient.

[0853] Step 21:

[0854] The recipient arrives at the coin locker at the designated station and displays the QR code they received on the terminal.

[0855] Step 22:

[0856] The device's emotion engine identifies the recipient's emotions and provides the necessary support.

[0857] Step 23:

[0858] The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[0859] Step 24:

[0860] The server checks the received QR code against its database.

[0861] Step 25:

[0862] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[0863] Step 26:

[0864] The recipient opens the locker and collects the package.

[0865] Step 27:

[0866] The server records the completion of delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also adjusts the content of the notification to reflect the recipient's emotions.

[0867] Example 2

[0868] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0869] In modern society, there is a demand for services that take people's emotions into consideration. However, conventional systems lack the ability to identify the emotions of users and service providers, and can only respond uniformly, resulting in an underoptimized user experience. Furthermore, in situations where users feel emotional stress or anxiety, appropriate support or feedback is not provided, which can lead to a decrease in user satisfaction.

[0870] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for a user to input information using a terminal and send it to the server, means for the terminal to be equipped with an emotion engine that identifies the user's emotion and also send emotion data to the server, means for the server to store the received information and emotion data in a database, and means for the server to generate appropriate feedback and guidance based on the emotion data and provide it to the user. This makes it possible to provide feedback and guidance that takes the user's emotions into consideration, improving the overall user experience.

[0871] A "terminal" is an electronic device used by users or delivery personnel to input or receive information, such as a PC or smartphone.

[0872] "User" refers to a person who uses this system to reserve a locker or collect luggage.

[0873] "Server" refers to the central management system that receives and processes information sent by users and delivery companies.

[0874] An "emotion engine" refers to software or hardware technology that is installed on a device and identifies emotions from the facial expressions and voice of the user or delivery person.

[0875] A "database" is a system for recording and storing information managed by a server.

[0876] "Feedback and guidance" refers to information and instructions provided by the server to users and delivery agents, which are appropriately adjusted based on emotional data.

[0877] A "member ID" is an identifier generated by the server when a user registers, and is used to uniquely identify the user.

[0878] A "locker" is a storage device installed in a designated location such as a station, and is used to temporarily store luggage.

[0879] A "QR code" is a unique two-dimensional code generated by a server and used to unlock lockers and check information.

[0880] "Notification" means a message or email sent from the server to the user or delivery company.

[0881] "Delivery company" refers to a person or organization that transports packages and deposits them in lockers.

[0882] "Sender" refers to the person or organization that requests the delivery of a package.

[0883] "Recipient" refers to the person who receives the package from the locker.

[0884] The present invention optimizes the user experience by combining a system that uses train station lockers as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[0885] Hardware and software used

[0886] The system uses the following hardware and software:

[0887] 1. Terminal: An electronic device such as a PC or smartphone that allows users or delivery personnel to input and display information. The terminal is equipped with a camera, microphone, and QR code reader.

[0888] 2. Emotion engine: Software that analyzes the facial expressions and voices of users and delivery personnel to identify their emotions, thereby obtaining emotional data about the user.

[0889] 3. Server: A central management system that receives and processes information sent by users and couriers, stores the information in a database, and generates appropriate feedback and guidance.

[0890] 4. Database: A system for recording and storing information managed by a server.

[0891] Basic system configuration

[0892] 1. User Registration:

[0893] The user opens the system's user registration screen on their device (PC or smartphone). The device is equipped with an emotion engine that analyzes facial expressions and voice to obtain emotion data.

[0894] The user inputs necessary information such as name, address, phone number, email address, password, etc. The input information and emotion data are sent from the device to the server.

[0895] The server stores the received information in a database, generates appropriate feedback and guidance based on the emotion data, and provides it to the user. Finally, it generates a new member ID and sends a notification to the user that takes the emotion data into consideration.

[0896] 2. Locker reservation and QR code generation:

[0897] The delivery person opens the system's locker reservation screen from their own device, and the device's emotion engine identifies the delivery person's emotion.

[0898] The courier selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server. The server checks the availability of lockers and assigns an available locker. A unique QR code is generated and notified to the courier. The content of this notification is adjusted according to the courier's emotions.

[0899] 3. Baggage Drop-Off and Notification:

[0900] The courier goes to the designated coin locker at the station and scans the QR code using the QR code reader on the terminal, which then sends the scanned information to the server.

[0901] The server checks the received QR code, and if authentication is successful, it sends a signal to unlock the locker. The delivery person deposits the package in the locker and then relocks it.

[0902] The server records the successful delivery of the parcel in a database and sends a confirmation message to the courier, which is also tailored to take the courier's emotions into account.

[0903] 4. Pick up your package:

[0904] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion engine identifies the recipient's emotions and provides the necessary support.

[0905] The recipient scans the QR code and sends the information to the server. The server authenticates the received QR code, and if successful, sends a signal to unlock the locker. The recipient can then collect their package.

[0906] The server records the completion of the delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also determines the content of the notification based on the user's emotion.

[0907] Specific examples

[0908] For example, when a user registers with the system, if the emotion engine detects nervousness, the server can provide detailed and reassuring guidance. When a courier reserves a locker, if the emotion engine detects fatigue, the server can provide a simplified interface. Finally, when the recipient picks up the package, if the emotion engine detects impatience, the server can provide quick and easy-to-understand instructions.

[0909] Prompt Sentence Examples

[0910] When using a generative AI model, you can use prompts like the following:

[0911] "Users feel nervous when registering with the system. The system should provide detailed and reassuring guidance."

[0912] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0913] Steps in user registration

[0914] Step 1:

[0915] The user opens the user registration screen on the device. The device uses a camera and microphone to input the user's facial expressions and voice into the emotion engine. The emotion engine analyzes this and generates emotion data for the user.

[0916] Step 2:

[0917] The user inputs information such as their name, address, phone number, email address, and password. The device then transmits this input information and the generated emotion data to the server.

[0918] Step 3:

[0919] The server stores the received user information and emotion data in a database. It validates the user information and records it accurately in the database.

[0920] Step 4:

[0921] The server generates appropriate feedback and guidance based on the stored emotional data. The emotion engine creates relaxing messages and detailed guidance depending on the emotions detected.

[0922] Step 5:

[0923] The server generates a new member ID and creates a notification email containing that ID. The content of this email is tailored based on the emotional data to convey a sense of security and support. The email is then sent to the user.

[0924] Locker reservation and QR code generation process steps

[0925] Step 1:

[0926] The delivery person opens the system's locker reservation screen on their own device, where an emotion engine analyzes the delivery person's facial expressions and voice to generate emotion data.

[0927] Step 2:

[0928] The delivery person inputs the desired station and the desired number of lockers. The terminal then transmits this data and emotion data to the server.

[0929] Step 3:

[0930] The server checks the availability of lockers in the database based on the received station and number of lockers. If there are any available lockers, it allocates them. During this process, it also takes into account the courier's emotional data and proceeds to the next step.

[0931] Step 4:

[0932] The server generates available locker IDs and unique QR codes, stores them in a database, and notifies the courier with the details (locker ID and QR code), which are also tailored based on the emotion data.

[0933] Baggage drop-off processing steps

[0934] Step 1:

[0935] The courier takes the QR code they received and goes to the designated coin locker at the station, where they scan the QR code using the QR code reader on their device.

[0936] Step 2:

[0937] The device sends the scanned QR code information to the server.

[0938] Step 3:

[0939] The server checks the received QR code information against a database, and if authentication is successful, it sends a signal to unlock the locker. Upon receiving this signal, the locker opens.

[0940] Step 4:

[0941] The delivery person opens the locker, deposits the package, and then relocks it.

[0942] Step 5:

[0943] The server records the successful deposit in a database and sends a confirmation to the courier, which is also adjusted based on the emotion data.

[0944] Processing steps for receiving a package

[0945] Step 1:

[0946] The recipient arrives at the designated coin locker at the station and stands in front of the locker holding the QR code displayed on the terminal.

[0947] Step 2:

[0948] The device uses a QR code reader to scan the QR code and transmits the information to the server.

[0949] Step 3:

[0950] The server checks the received QR code information in a database, and if authentication is successful, it sends a signal to unlock the locker.

[0951] Step 4:

[0952] The recipient opens the locker and collects the package.

[0953] Step 5:

[0954] The server records the completion of the package in a database and sends a confirmation to the sender and the courier, which is also adjusted based on the emotion data.

[0955] (Application example 2)

[0956] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0957] In recent years, systems that utilize train station coin lockers as parcel lockers have been gaining attention. However, these systems fail to properly consider the user's emotions during the user registration, locker reservation, and baggage deposit and collection processes, which can cause stress and discomfort to users. Furthermore, there is a need for methods to reduce the workload of employees and ensure efficient operation. Given this background, the development of a system that can identify the emotions of users and employees and provide support based on these emotions is a challenge.

[0958] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input information using a terminal and send it to the server; a means for the server to store the received information in a database; a means for the server to generate a new member ID and notify the user; a means for a delivery company to reserve a locker using the terminal and send it to the server; a means for the server to check the availability of a locker, generate a unique QR code and notify the delivery company; a means for the delivery company to unlock the locker and deposit the package using the QR code; a means for the server to record the deposit of the package and notify the delivery company; a means for the delivery company to send the QR code to the sender; a means for a recipient to unlock the locker using the QR code and receive the package; a means for the server to record the receipt of the package and notify the sender and the delivery company; a means for identifying the user's emotion using emotion recognition technology installed in the terminal and sending the information to the server; and a means for the server to optimize the notification content and interface based on the emotion data received. This makes it possible to quickly recognize the user's emotions and provide optimal support based on them.

[0959] A "user" is an individual or corporation that uses the system, and is the entity that inputs information using a terminal and transmits it to the server.

[0960] A "terminal" is an electronic device such as a PC, smartphone, or tablet, which allows users to input and operate information.

[0961] A "server" is a computer system that stores and processes data over a network and provides various services.

[0962] A "database" is a system for organizing and storing information, and is used by a server to store information received.

[0963] "Member ID" is an identifier that uniquely identifies a user on the system.

[0964] "Courier" means an individual or legal entity that delivers, deposits, and receives packages.

[0965] A "locker" is a storage facility for temporarily storing luggage, and is usually installed at stations and public facilities.

[0966] A "QR code" is a type of two-dimensional barcode that is expressed as a pattern with unique identification information.

[0967] "Package" means an item that is being delivered or received.

[0968] "Emotion recognition technology" is a technology that uses cameras and voice input devices to identify emotions from human facial expressions and voice.

[0969] "Notification" refers to the act or means of transmitting information from the server to the user or delivery company.

[0970] An "interface" is an operation screen or operation method for exchanging information between a user and a system.

[0971] "Recipient" means an individual or legal entity that receives a package from a locker.

[0972] The present invention optimizes the user experience by combining a system that uses coin lockers at train stations as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[0973] User Registration

[0974] The user opens the system's user registration screen using their own device (PC or smartphone). The device is equipped with emotion recognition technology, which identifies emotions from the user's facial expressions and voice during the registration process. The user enters information such as their name, address, phone number, email address, and password. Both the registration information and emotion data are sent to the server.

[0975] The server stores the received information in a database. At the same time, it provides appropriate feedback and guidance based on the emotional data. The server generates a new member ID and notifies the user. The notification content is selected with consideration for the user's emotions. For example, if the user is feeling anxious, detailed and careful guidance will be included.

[0976] Locker reservation and QR code generation

[0977] The delivery person opens the system's locker reservation screen on their device. The device's emotion recognition technology identifies the delivery person's emotions and provides appropriate support as the task progresses. The delivery person selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server.

[0978] The server checks the availability of lockers and assigns an available locker. It generates a locker ID and a unique QR code and stores it in a database. The server then notifies the courier of the reservation details (locker ID and QR code). The content of this notification is also based on the courier's emotion.

[0979] Checked baggage

[0980] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the information to the server.

[0981] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[0982] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[0983] QR code notification

[0984] The courier will then send a QR code to the sender to notify them of the delivery, and the content and tone of the notification will be adjusted depending on the sender's emotions as detected by emotion recognition technology.

[0985] Picking up your luggage

[0986] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion recognition technology identifies the recipient's emotion and provides the necessary support. The recipient scans the QR code, and the terminal sends the information to the server.

[0987] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[0988] The server records the completion of delivery in a database and sends a notification to the sender and the courier company. Emotion recognition technology enables the content of the notification to be tailored to the recipient's emotion.

[0989] Hardware and software used

[0990] Hardware: Smartphones, PCs, lockers (luggage storage facilities)

[0991] Software: OpenCV (image processing library), dlib (face detection and landmark estimation library), emotion recognition model, server software

[0992] Specific examples

[0993] For example, if User A registers with the system and requests courier B to leave a package in a locker at a station, the emotion recognition technology will detect User A's nervousness and the server will provide detailed guidance that gives the impression of stability. When Courier B reserves the locker, the emotion recognition technology will detect fatigue and provide an interface that simplifies the process. Finally, when Recipient C receives the package, the emotion recognition technology will detect impatience and provide quick and easy-to-understand instructions.

[0994] Prompt Sentence Examples

[0995] 1. Example of a prompt for user registration:

[0996] Input prompt: "Capture facial expressions during user registration, recognize emotions, and send them to the server"

[0997] Sample output: "Analyzing your sentiment... Please enter your registration details."

[0998] 2. Example of prompt for locker reservation:

[0999] Input prompt: "Recognize ongoing emotions during locker booking and provide necessary support."

[1000] Example output: "You are showing signs of fatigue. We'll simplify the booking process... Please enter the station name and number of lockers."

[1001] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1002] Step 1:

[1003] The user enters information into the terminal and sends it to the server.

[1004] Input: A user enters information into a device, such as a name, address, phone number, email address, or password.

[1005] Processing: The device uses emotion recognition technology to analyze the user's facial expressions and voice input, generating emotional data. This registration information and emotional data are then sent to the server.

[1006] Output: Registration information and emotion data sent to the server.

[1007] Step 2:

[1008] The server stores the received information in a database

[1009] Input: Registration information and emotion data submitted in step 1.

[1010] Processing: The server stores this information in a database.

[1011] Output: User registration information and emotion data stored in a database.

[1012] Step 3:

[1013] The server generates a new member ID and notifies the user.

[1014] Input: User registration information stored in the database.

[1015] Action: The server generates a new member ID and optimizes the notification content based on the sentiment data, for example, including detailed and polite guidance if the user is feeling anxious.

[1016] Output: Notification of member ID according to sentiment towards the user.

[1017] Step 4:

[1018] The delivery company reserves a locker using a terminal and sends the reservation to the server.

[1019] Input: The delivery person enters the station they wish to use and the number of lockers they wish to use into the terminal.

[1020] Processing: The device uses emotion recognition technology to analyze the delivery person's emotions and generate emotion data. The device then sends the reservation information and emotion data to the server.

[1021] Output: Reservation information and emotion data sent to the server.

[1022] Step 5:

[1023] The server checks the availability of the locker, generates a unique QR code, and notifies the courier.

[1024] Input: Booking information and emotion data submitted in step 4.

[1025] Processing: The server checks the availability of lockers in the database, assigns an available locker, generates a unique QR code, and sends a notification to the courier, optimizing the notification content based on the emotion data.

[1026] Output: QR code notification depending on your sentiment towards the courier.

[1027] Step 6:

[1028] The delivery person uses the QR code to unlock the locker and deposit the package.

[1029] Input: The QR code sent in step 5.

[1030] Processing: The courier scans the QR code using the QR code reader on the device, and the device sends the information to the server.

[1031] Output: The QR code information sent to the server.

[1032] Step 7:

[1033] The server records the delivery of the package and notifies the courier.

[1034] Input: QR code information sent in step 6.

[1035] Processing: The server checks the QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. After the luggage is deposited, the information is recorded in the database and a confirmation notification is sent to the courier. The notification content is optimized based on the emotion data.

[1036] Output: Notification of successful deposit depending on your feelings towards the courier.

[1037] Step 8:

[1038] The courier will send a QR code to the sender

[1039] Input: QR code provided in step 7.

[1040] Processing: The courier sends a QR code to the sender, and emotion recognition technology identifies the sender's emotion and optimizes the notification content.

[1041] Output: QR code notification depending on your feelings towards the sender.

[1042] Step 9:

[1043] The recipient unlocks the locker using the QR code and collects the package.

[1044] Input: QR code received by the recipient.

[1045] Process: The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server. The server checks the QR code against the database, and if authentication is successful, it sends a signal to unlock the locker.

[1046] Output: Locker unlock signal to recipient.

[1047] Step 10:

[1048] The server records the receipt of the package and notifies the sender and the courier.

[1049] Input: QR code information sent in step 9.

[1050] Processing: The server records the parcel receipt in a database and sends a confirmation notification to the sender and the courier, which is also optimized based on the emotion data.

[1051] Output: Notification of successful delivery depending on feelings towards the sender and courier.

[1052] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1053] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1054] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1055] [Third embodiment]

[1056] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1057] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1058] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1059] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1060] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1061] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1062] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1063] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1064] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1065] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1066] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1067] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1068] The present invention relates to a system that uses coin lockers at stations as delivery boxes, and is implemented as follows.

[1069] User Registration

[1070] The user opens the system's user registration screen using their own device (PC or smartphone) and enters information such as their name, address, phone number, email address, and password. When the user clicks the "Register" button, the device sends the entered information to the server.

[1071] The server saves the received information in the database, generates a new member ID, and notifies the user of the generated member ID and the password for the first login by email.

[1072] Locker reservation and QR code generation

[1073] The delivery person opens the system's locker reservation screen on their device, selects the station they wish to use and the number of lockers they wish to use, and when they click the "Reserve" button, the device sends the selected information to the server.

[1074] The server checks the availability of lockers and allocates an available locker. It generates a locker ID and a unique QR code, which is stored in a database along with the respective locker ID. The server then notifies the courier of the reservation details (locker ID and QR code).

[1075] Checked baggage

[1076] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the scanned information to the server.

[1077] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[1078] The server records that the package has been deposited and sends a confirmation to the courier.

[1079] QR code notification

[1080] The delivery company will send a QR code to the sender along with a notification of the completion of the delivery, and the sender will then pass the received QR code on to the recipient.

[1081] Picking up your luggage

[1082] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The QR code is then scanned using the terminal's QR code reader.

[1083] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[1084] The server records that the package has been received and sends a notification of receipt to the sender and the delivery company.

[1085] Specific examples

[1086] For example, if User A registers with the system and requests delivery company B to leave a package in a locker at a station, the following process will occur: Delivery company B reserves a locker and receives a QR code. B leaves the package in the designated locker and sends the QR code to User A. User A then transmits the QR code to recipient C, who arrives at the designated locker and uses the QR code to retrieve the package.

[1087] In this way, the system of the present invention allows users to use lockers at designated stations as delivery boxes, facilitating smooth package collection.

[1088] The processing flow will be explained below.

[1089] Step 1:

[1090] The user uses a terminal to open the system's user registration screen and enters information such as name, address, telephone number, email address, and password.

[1091] Step 2:

[1092] The terminal transmits the input information to the server.

[1093] Step 3:

[1094] The server stores the received information in a database.

[1095] Step 4:

[1096] The server generates a new member ID and creates an email to notify the user.

[1097] Step 5:

[1098] The server will email the user a new member ID and initial login password.

[1099] Step 6:

[1100] Delivery workers open the system's locker reservation screen on their own devices and select the station they wish to use and the number of lockers they wish to use.

[1101] Step 7:

[1102] The terminal sends information about the selected station and the number of lockers to the server.

[1103] Step 8:

[1104] The server checks the availability of lockers and assigns an available locker.

[1105] Step 9:

[1106] The server generates a locker ID and a unique QR code and stores it in a database.

[1107] Step 10:

[1108] The server sends the locker ID and QR code details to the delivery company via email or in-system notification.

[1109] Step 11:

[1110] The delivery person goes to the coin locker at the designated station and displays the QR code on the terminal.

[1111] Step 12:

[1112] The delivery person scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[1113] Step 13:

[1114] The server checks the received QR code against its database.

[1115] Step 14:

[1116] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[1117] Step 15:

[1118] The delivery person opens the locker, deposits the package, and then locks it again.

[1119] Step 16:

[1120] The server records the completion of the package deposit in a database and sends a confirmation notice to the courier.

[1121] Step 17:

[1122] The delivery company will email the sender a QR code along with a notification that the delivery has been completed.

[1123] Step 18:

[1124] The sender transmits the received QR code to the recipient.

[1125] Step 19:

[1126] The recipient arrives at the coin locker at the designated station and displays the QR code they received on the terminal.

[1127] Step 20:

[1128] The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[1129] Step 21:

[1130] The server checks the received QR code against its database.

[1131] Step 22:

[1132] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[1133] Step 23:

[1134] The recipient opens the locker and collects the package.

[1135] Step 24:

[1136] The server records in the database that the parcel has been received, and sends a notification of the completion of the parcel to the sender and the delivery company.

[1137] Example 1

[1138] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1139] Conventional delivery systems have had problems with smooth delivery of goods when the user is absent or when receiving the goods takes time. There is also a need for a more efficient method of delivering and receiving goods. In addition, there is a need for a method to check the storage information of goods in real time and to safely deposit and receive goods.

[1140] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1141] In this invention, the server includes: a means for a user to input information using a terminal and send it to the server; a means for the server to store the received information in a database; a means for the server to generate a new identifier and notify the user; a means for a delivery company to reserve a storage account using a terminal and send it to the server; a means for the server to check the availability of the storage account, generate a unique identifier code and notify the delivery company; a means for the delivery company to unlock the storage account using the identifier code and deposit the item; a means for the server to record the deposit of the item and notify the delivery company; a means for the delivery company to send the identifier code to the item sender; a means for the customer to unlock the storage account using the identifier code and receive the item; a means for the server to record the receipt of the item and notify the item sender and the delivery company; and a means for displaying the status and facilitating processing using an AI model. This streamlines the process from depositing to receiving the item, enabling a home delivery system that is highly convenient for users and delivery companies to be realized.

[1142] A "user" is an entity that registers with the system and deposits and receives items.

[1143] A "terminal" is a device used by a user or delivery company to communicate with the system, including a PC or smartphone.

[1144] A "server" is a computer system that manages information at the center of the system and performs various processes.

[1145] An "identifier" is a unique number or code generated by the server to identify a user or item.

[1146] A "delivery company" is an entity that delivers goods and reserves a storage account and deposits goods via a terminal.

[1147] A "storage account" is a coin locker at a station or other storage facility, and is an account for the temporary storage of items.

[1148] A "unique identifier code" is an individual QR code or barcode generated to identify an item or storage account.

[1149] The "item sender" is the user who deposits the item.

[1150] A "customer" is a user who receives an item.

[1151] An "AI model" is an artificial intelligence algorithm that optimizes processes such as depositing and receiving items.

[1152] A "database" is a collection of information stored on the system's server, including user information and reservation information.

[1153] An "unlock signal" is an electronic instruction sent from the server to open a custodial account.

[1154] The present invention relates to a system that utilizes coin lockers at train stations and other storage facilities as delivery lockers, and is designed to allow users, delivery companies, and customers to efficiently deposit and receive items.

[1155] System configuration

[1156] The system is primarily comprised of the following elements: the devices (PCs and smartphones) used by users and delivery companies, the server that manages the information, the communication means for exchanging information between them, and the database that functions as the core of the system. It also uses an AI model to facilitate the deposit and receipt of goods.

[1157] Hardware and Software

[1158] Hardware:

[1159] Device: PC or smartphone used by the user or delivery company.

[1160] Storage Accounts: Coin lockers and other storage facilities at train stations.

[1161] software:

[1162] Server: Java Spring Framework and Node.js for storing and processing information.

[1163] Database: MySQL or MongoDB to manage user and reservation information.

[1164] QR Code Generation: Python qrcode library.

[1165] Notification: Send email using Python's smtplib.

[1166] AI models: Algorithms used to optimize information and streamline processes.

[1167] Program processing

[1168] The specific process of the system is as follows: the user registers with the system, the delivery company deposits the item, and the customer receives the item. This process is carried out smoothly. Specifically, the user registers as a user of the system using a terminal, and the server receives the information and stores it in a database. The server then generates a new identifier and notifies the user.

[1169] Adding specific examples

[1170] For example, if user A registers with the system and requests delivery company B to store a package in a storage account at a station, the following process takes place: Delivery company B reserves the storage account and receives a QR code. B stores the package in the specified storage account and sends the QR code to user A. User A transmits the QR code to recipient C, who arrives at the specified storage account and uses the QR code to collect the package. In this way, the system of the present invention allows users to use the specified station storage account as a delivery locker, facilitating a smooth package collection process.

[1171] Prompt Sentence Examples

[1172] For example, an explanatory text can be generated by inputting the following prompt text into the generative AI model:

[1173] "Please explain in detail the processing of a system that uses coin lockers at train stations as delivery boxes from the perspectives of the server, the terminal, and the user."

[1174] By entering this prompt, a detailed description of a system that uses coin lockers at train stations as delivery boxes will be generated.

[1175] As described above, the system of the present invention is designed to allow users to conveniently use coin lockers at train stations and other storage facilities as delivery lockers.

[1176] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1177] Step 1: User Registration

[1178] 1. The user opens the system's user registration screen using their own device (PC or smartphone).

[1179] 2. The user enters information such as name, address, phone number, email address, and password, and clicks the "Register" button.

[1180] Input: User's name, address, phone number, email address, password

[1181] Output: Send registration information to the server

[1182] 3. The device sends the entered information to the server in JSON format.

[1183] What it does: Converts form data to JSON format and sends it to the server as an HTTP POST request.

[1184] Step 2: Storing user information on the server and notifying users

[1185] 1. The server stores the received information in a database.

[1186] Input: User registration information sent from the device

[1187] Output: Registration information is saved in the database

[1188] Behavior: Makes a database connection and executes an INSERT statement to save the user information.

[1189] 2. The server generates a new member ID and password for the first login and notifies the user by email.

[1190] Operation: Runs the member ID generation algorithm and sends an email using Python's smtplib.

[1191] Step 3: Enter and submit your locker reservation information

[1192] 1. The delivery person opens the system's locker reservation screen on their own device.

[1193] 2. The delivery person selects the station they wish to use and the number of storage accounts they wish to use, and clicks the "Reserve" button.

[1194] Input: Station name, number of required storage accounts

[1195] Output: Send reservation information to the server

[1196] 3. The device sends the selection information to the server in JSON format.

[1197] What it does: Converts form data to JSON format and sends it to the server as an HTTP POST request.

[1198] Step 4: Locker assignment and notification on the server

[1199] 1. The server checks the availability of storage accounts and assigns an available storage account.

[1200] Input: Station name, number of required storage accounts

[1201] Output: Assigned custody account ID and QR code

[1202] What it does: Performs a database query to check availability, stores the assigned custodial account ID in the database, and generates a QR code.

[1203] 2. The server generates a unique QR code and stores it in the database along with the custodial account ID.

[1204] What it does: Generates QR codes using Python's qrcode library.

[1205] 3. The server notifies the delivery company of the reservation details (storage account ID and QR code) by email.

[1206] Operation: Sends email using Python's smtplib.

[1207] Step 5: Arrive at the locker and scan the QR code

[1208] 1. The courier goes to the designated station's storage account and uses the QR code they received.

[1209] 2. The courier scans the QR code using a QR code reader app on their device.

[1210] Input: QR code

[1211] Output: Send QR code information to the server

[1212] 3. The device sends the scanned QR code information to the server in JSON format.

[1213] What it does: It converts data obtained from a QR code reader app into JSON format and sends it to the server as an HTTP POST request.

[1214] Step 6: Authenticate with the server and unlock the locker

[1215] 1. The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker.

[1216] Input: QR code information

[1217] Output: Locker unlock signal

[1218] Operation: Searches for a corresponding record in the database, and if a match occurs, generates and sends an unlock signal.

[1219] 2. The courier opens the locker, deposits the item, and then locks it again.

[1220] How it works: After depositing the item in the locker, manually lock the locker.

[1221] Step 7: Baggage drop-off notification

[1222] 1. The server records in the database that the item has been deposited.

[1223] Input: Notification data

[1224] Output: Records in the database

[1225] 2. The server sends a confirmation email to the delivery company.

[1226] Operation: Sends email using Python's smtplib.

[1227] Step 8: QR Code Notification

[1228] 1. The delivery company will email the sender a QR code along with a notification that the item has been deposited.

[1229] Operation: Sends email using Python's smtplib.

[1230] 2. The sender of the item will send the received QR code to the customer.

[1231] How it works: Send a QR code via email or message.

[1232] Step 9: Arrive at the locker and scan the QR code

[1233] 1. The customer arrives at the designated station's storage account and displays the QR code received on the terminal.

[1234] 2. The customer uses the QR code reader on their device to scan the newly received QR code.

[1235] Input: QR code

[1236] Output: Send QR code information to the server

[1237] 3. The device sends the scanned QR code information to the server in JSON format.

[1238] What it does: It converts data obtained from a QR code reader app into JSON format and sends it to the server as an HTTP POST request.

[1239] Step 10: Authenticate with the server and unlock the locker

[1240] 1. The server reconfirms the received QR code in the database, and if authentication is successful, sends a signal to unlock the locker.

[1241] Input: QR code information

[1242] Output: Locker unlock signal

[1243] Operation: Searches for a corresponding record in the database, and if a match occurs, generates and sends an unlock signal.

[1244] 2. The customer opens the locker and collects the item.

[1245] Action: Unlocks locker and removes item.

[1246] Step 11: Notification of package receipt completion

[1247] 1. The server records in the database that the item has been received.

[1248] Input: Notification data

[1249] Output: Records in the database

[1250] 2. The server sends an email to the sender and delivery company notifying them of the completion of the delivery.

[1251] Operation: Sends email using Python's smtplib.

[1252] As described above, this system allows users to use coin lockers at stations and other storage facilities as delivery boxes, streamlining the process from depositing items to receiving them.

[1253] (Application example 1)

[1254] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1255] In modern logistics systems, the need for temporary storage of deliveries is increasing, but securing appropriate storage locations and prompt notification to recipients are becoming issues. Furthermore, the food delivery industry requires a system that can ensure that recipients receive their food reliably while maintaining the quality of the food. An effective method to deal with such situations is needed.

[1256] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1257] In this invention, the server includes a means for a user to input information using a terminal and send it to the server, a means for a delivery company to reserve a storage device using a terminal and send it to the server, and a means for the server to check the availability of the storage device, generate a unique QR code, and notify the delivery company. This allows for smooth temporary storage and receipt of deliveries and food, and particularly in food delivery, makes it possible for recipients to receive food reliably while maintaining the quality of the food.

[1258] "User" refers to any individual or legal entity that uses the Service.

[1259] "Terminal" refers to electronic devices such as personal computers and smartphones.

[1260] "Server" refers to a computer or similar device that performs central processing within a system.

[1261] A "database" is a system that organizes and stores information so that it can be retrieved as needed.

[1262] "Member ID" refers to a unique identification number generated by the server to identify a user.

[1263] "Delivery Company" refers to a company or individual engaged in the delivery of goods.

[1264] "Storage device" means a coin locker at a train station or similar device for temporary storage of items.

[1265] "Availability" refers to information indicating whether or not there is available space in the storage device.

[1266] "QR Code" refers to a two-dimensional barcode that visually represents information and can be read using a QR Code reader.

[1267] "Goods" refers to general items, including parcels for delivery and food for delivery.

[1268] "Provider" refers to the person who provides the QR code to the recipient and provides the item.

[1269] "Recipient" refers to a person who receives an item from a storage device using a QR code.

[1270] A "timestamp" refers to digital information that records the date and time that a particular event occurred.

[1271] "Reservation" refers to the act of reserving the use of a storage device in advance.

[1272] "Authentication unlocking" refers to the act of unlocking a storage device using authentication means such as a QR code.

[1273] This invention is a system that uses coin lockers at train stations as delivery boxes, enabling users, delivery companies, and recipients to work together to smoothly deliver goods. This specification details the specific system configuration and operation procedures.

[1274] First, a user accesses the system using a terminal and enters information such as their name, address, phone number, email address, and password. The information sent from the terminal is received by the server and stored in a database. The server then generates a new member ID and notifies the user by email.

[1275] Next, the delivery company opens the system's storage device reservation screen on their device and selects the station they wish to use and the number of storage devices they wish to use. The selection information is sent from the device to the server, which checks the availability of storage devices. An available storage device is assigned, a unique QR code is generated, and stored in a database along with the respective storage device ID. The server then notifies the delivery company of the reservation details (storage device ID and QR code).

[1276] The delivery person goes to the storage device at the designated station and unlocks it using the QR code they received. They scan the QR code using the QR code reader on their device, and the scanned information is sent to the server. The server checks the received QR code against its database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the delivery person to open the device and deposit the item.

[1277] Once the item has been deposited, the server records the details and sends a confirmation to the delivery company. The delivery company then emails the sender a QR code to notify them of the completion of the deposit, which the sender then passes on to the recipient.

[1278] The recipient arrives at the storage device at the designated station and displays the QR code they received on their terminal. It is scanned using a QR code reader, and the information is sent to the server. The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the recipient to open the storage device and collect the item.

[1279] The hardware used includes a personal computer, a smartphone, and a QR code reader. The software used includes the Flask framework and an SQLite database. The qrcode module is used to generate the QR code.

[1280] For example, when a user registers with the system using their smartphone, a new user ID is generated. Next, a delivery company reserves a storage device, and a unique QR code is generated. The delivery company deposits the item in the designated storage device and notifies the provider of the QR code by email. The provider then transmits the QR code to the recipient, who then unlocks the storage device and collects the item.

[1281] An example prompt for a generative AI model might look like this:

[1282] "Receive the user's registration information and store it in the database. Generate a new user ID and notify the user by email."

[1283] This prompt sentence allows the server to perform the appropriate data manipulations and ensures smooth functioning of the entire system.

[1284] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1285] Step 1:

[1286] A user accesses the system using a terminal and enters information such as name, address, phone number, email address, and password. This information is sent from the terminal to the server by pressing the send button. The server stores the received user information in a database. Input: Name, address, phone number, email address, password. Output: User information stored in the database.

[1287] Step 2:

[1288] The server generates a new member ID and notifies the user of that member ID. Specifically, the server generates a unique ID in the database and sends a notification email to the registered email address. This action allows the user to be recognized in the system. Input: User information. Output: Generation of a new member ID and email notification.

[1289] Step 3:

[1290] The delivery company uses a terminal to open the system's storage device reservation screen, select the station they wish to use and the number of storage devices they wish to use, and send the entered information to the server. The server confirms the received selection information and allocates available storage devices. Input: Station information, number of storage devices. Output: Allocated storage device ID and QR code.

[1291] Step 4:

[1292] The server generates a unique QR code and stores it in the database along with the respective storage device ID. Then the server notifies the delivery company of the reservation details (storage device ID and QR code). The qrcode module is used to generate the QR code. Input: Storage device ID. Output: Generated QR code and reservation details.

[1293] Step 5:

[1294] The delivery company goes to the storage device at the designated station and unlocks it using the QR code they received. The delivery company's terminal is equipped with a QR code reader, which they use to scan the QR code and send the information to the server. The server checks the received QR code in its database, and if authentication is successful, it sends a signal to unlock the storage device. Input: QR code. Output: Signal to unlock the storage device.

[1295] Step 6:

[1296] The delivery company opens the storage device and deposits the item. Then it locks it again. The server records that the item has been deposited and sends a confirmation to the delivery company. Input: Item deposit information. Output: Record and notification of deposit completion.

[1297] Step 7:

[1298] The delivery company will email the provider a QR code along with a notification that the item has been deposited. The provider will then pass the QR code on to the recipient, who will then display the QR code upon arriving at the designated station. Input: QR code. Output: Notification email sent to the provider.

[1299] Step 8:

[1300] The recipient arrives at the storage device at the designated station and displays the QR code they received on their terminal. They then scan the QR code using a QR code reader and send the information to the server. The server checks the received QR code against its database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the recipient to open the storage device and collect the item. Input: QR code. Output: Storage device unlock signal.

[1301] Step 9:

[1302] The server records the receipt of the item with a timestamp and notifies the donor and delivery company, including details such as the date and time of receipt. Input: Receipt information. Output: Record and notification of receipt details.

[1303] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1304] The present invention optimizes the user experience by combining a system that uses coin lockers at train stations as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[1305] User Registration

[1306] The user opens the system's user registration screen using their own device (PC or smartphone). The device is equipped with an emotion engine that identifies emotions from the user's facial expressions and voice during the registration process. The user enters information such as their name, address, phone number, email address, and password. Both the registration information and emotion data are sent to the server.

[1307] The server stores the received information in a database. At the same time, it provides appropriate feedback and guidance based on the emotional data. The server generates a new member ID and creates an email to notify the user. The content of the notification is chosen with consideration for the user's emotions. For example, if the user is feeling anxious, detailed and careful guidance will be included.

[1308] Locker reservation and QR code generation

[1309] The delivery person opens the system's locker reservation screen on their device. The device's emotion engine identifies the delivery person's emotion and provides appropriate support as the task progresses. The delivery person selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server.

[1310] The server checks the availability of lockers and assigns an available locker. It generates a locker ID and a unique QR code and stores it in a database. The server then notifies the courier of the reservation details (locker ID and QR code). The content of this notification is also based on the courier's emotion.

[1311] Checked baggage

[1312] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the information to the server.

[1313] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[1314] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[1315] QR code notification

[1316] The courier will then email the sender a QR code to notify them of the delivery, and the content and tone of the email will be adjusted based on the sender's emotions as detected by the emotion engine.

[1317] Picking up your luggage

[1318] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion engine identifies the recipient's emotion and provides the necessary support. The recipient scans the QR code, and the terminal sends the information to the server.

[1319] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[1320] The server records the completion of the delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also determines the content of the notification based on the user's emotion.

[1321] Specific examples

[1322] For example, if User A registers with the system and requests courier B to leave a package in a locker at a train station, the emotion engine will sense User A's nervousness and provide detailed guidance that gives the impression of stability. When Courier B reserves the locker, the emotion engine will sense his fatigue and provide an interface that simplifies the process. Finally, when Recipient C picks up the package, the emotion engine will sense the recipient's impatience and provide quick, easy-to-understand instructions.

[1323] In this way, the system of the present invention recognizes the user's emotions and provides optimal support accordingly, improving the overall user experience.

[1324] The processing flow will be explained below.

[1325] Step 1:

[1326] The user uses their own terminal to open the system's user registration screen and enters information such as their name, address, telephone number, email address, and password.

[1327] Step 2:

[1328] The device identifies the user's emotions using an emotion engine, which utilizes facial recognition cameras and voice analysis functions.

[1329] Step 3:

[1330] The terminal transmits the input information and the identified emotion data to the server.

[1331] Step 4:

[1332] The server stores the received information in a database and simultaneously provides appropriate feedback and guidance based on the emotional data.

[1333] Step 5:

[1334] The server generates a new member ID and creates an email to notify the user. At this time, the notification content is chosen taking into consideration the user's feelings.

[1335] Step 6:

[1336] The server will email the user a new member ID and initial login password.

[1337] Step 7:

[1338] Delivery workers open the system's locker reservation screen on their own devices and select the station they wish to use and the number of lockers they wish to use.

[1339] Step 8:

[1340] The device uses an emotion engine to identify the delivery person's emotions and provides appropriate support as the work progresses.

[1341] Step 9:

[1342] The terminal sends information about the selected station and the number of lockers to the server.

[1343] Step 10:

[1344] The server checks the availability of lockers and assigns an available locker.

[1345] Step 11:

[1346] The server generates a locker ID and a unique QR code and stores it in a database.

[1347] Step 12:

[1348] The server then sends the locker ID and QR code details to the delivery company via email or an in-system notification, which also depends on the delivery company's emotion.

[1349] Step 13:

[1350] The delivery person goes to the coin locker at the designated station and displays the QR code on the terminal.

[1351] Step 14:

[1352] The delivery person scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[1353] Step 15:

[1354] The server checks the received QR code against its database.

[1355] Step 16:

[1356] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[1357] Step 17:

[1358] The delivery person opens the locker, deposits the package, and then locks it again.

[1359] Step 18:

[1360] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[1361] Step 19:

[1362] The delivery company will email the sender a QR code along with a notification that the delivery has been completed.

[1363] Step 20:

[1364] The sender transmits the received QR code to the recipient.

[1365] Step 21:

[1366] The recipient arrives at the coin locker at the designated station and displays the QR code they received on the terminal.

[1367] Step 22:

[1368] The device's emotion engine identifies the recipient's emotions and provides the necessary support.

[1369] Step 23:

[1370] The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[1371] Step 24:

[1372] The server checks the received QR code against its database.

[1373] Step 25:

[1374] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[1375] Step 26:

[1376] The recipient opens the locker and collects the package.

[1377] Step 27:

[1378] The server records the completion of delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also adjusts the content of the notification to reflect the recipient's emotions.

[1379] Example 2

[1380] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1381] In modern society, there is a demand for services that take people's emotions into consideration. However, conventional systems lack the ability to identify the emotions of users and service providers, and can only respond uniformly, resulting in an underoptimized user experience. Furthermore, in situations where users feel emotional stress or anxiety, appropriate support or feedback is not provided, which can lead to a decrease in user satisfaction.

[1382] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for a user to input information using a terminal and send it to the server, means for the terminal to be equipped with an emotion engine that identifies the user's emotion and also send emotion data to the server, means for the server to store the received information and emotion data in a database, and means for the server to generate appropriate feedback and guidance based on the emotion data and provide it to the user. This makes it possible to provide feedback and guidance that takes the user's emotions into consideration, improving the overall user experience.

[1383] A "terminal" is an electronic device used by users or delivery personnel to input or receive information, such as a PC or smartphone.

[1384] "User" refers to a person who uses this system to reserve a locker or collect luggage.

[1385] "Server" refers to the central management system that receives and processes information sent by users and delivery companies.

[1386] An "emotion engine" refers to software or hardware technology that is installed on a device and identifies emotions from the facial expressions and voice of the user or delivery person.

[1387] A "database" is a system for recording and storing information managed by a server.

[1388] "Feedback and guidance" refers to information and instructions provided by the server to users and delivery agents, which are appropriately adjusted based on emotional data.

[1389] A "member ID" is an identifier generated by the server when a user registers, and is used to uniquely identify the user.

[1390] A "locker" is a storage device installed in a designated location such as a station, and is used to temporarily store luggage.

[1391] A "QR code" is a unique two-dimensional code generated by a server and used to unlock lockers and check information.

[1392] "Notification" means a message or email sent from the server to the user or delivery company.

[1393] "Delivery company" refers to a person or organization that transports packages and deposits them in lockers.

[1394] "Sender" refers to the person or organization that requests the delivery of a package.

[1395] "Recipient" refers to the person who receives the package from the locker.

[1396] The present invention optimizes the user experience by combining a system that uses train station lockers as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[1397] Hardware and software used

[1398] The system uses the following hardware and software:

[1399] 1. Terminal: An electronic device such as a PC or smartphone that allows users or delivery personnel to input and display information. The terminal is equipped with a camera, microphone, and QR code reader.

[1400] 2. Emotion engine: Software that analyzes the facial expressions and voices of users and delivery personnel to identify their emotions, thereby obtaining emotional data about the user.

[1401] 3. Server: A central management system that receives and processes information sent by users and couriers, stores the information in a database, and generates appropriate feedback and guidance.

[1402] 4. Database: A system for recording and storing information managed by a server.

[1403] Basic system configuration

[1404] 1. User Registration:

[1405] The user opens the system's user registration screen on their device (PC or smartphone). The device is equipped with an emotion engine that analyzes facial expressions and voice to obtain emotion data.

[1406] The user inputs necessary information such as name, address, phone number, email address, password, etc. The input information and emotion data are sent from the device to the server.

[1407] The server stores the received information in a database, generates appropriate feedback and guidance based on the emotion data, and provides it to the user. Finally, it generates a new member ID and sends a notification to the user that takes the emotion data into consideration.

[1408] 2. Locker reservation and QR code generation:

[1409] The delivery person opens the system's locker reservation screen from their own device, and the device's emotion engine identifies the delivery person's emotion.

[1410] The courier selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server. The server checks the availability of lockers and assigns an available locker. A unique QR code is generated and notified to the courier. The content of this notification is adjusted according to the courier's emotions.

[1411] 3. Baggage Drop-Off and Notification:

[1412] The courier goes to the designated coin locker at the station and scans the QR code using the QR code reader on the terminal, which then sends the scanned information to the server.

[1413] The server checks the received QR code, and if authentication is successful, it sends a signal to unlock the locker. The delivery person deposits the package in the locker and then relocks it.

[1414] The server records the successful delivery of the parcel in a database and sends a confirmation message to the courier, which is also tailored to take the courier's emotions into account.

[1415] 4. Pick up your package:

[1416] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion engine identifies the recipient's emotions and provides the necessary support.

[1417] The recipient scans the QR code and sends the information to the server. The server authenticates the received QR code, and if successful, sends a signal to unlock the locker. The recipient can then collect their package.

[1418] The server records the completion of the delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also determines the content of the notification based on the user's emotion.

[1419] Specific examples

[1420] For example, when a user registers with the system, if the emotion engine detects nervousness, the server can provide detailed and reassuring guidance. When a courier reserves a locker, if the emotion engine detects fatigue, the server can provide a simplified interface. Finally, when the recipient picks up the package, if the emotion engine detects impatience, the server can provide quick and easy-to-understand instructions.

[1421] Prompt Sentence Examples

[1422] When using a generative AI model, you can use prompts like the following:

[1423] "Users feel nervous when registering with the system. The system should provide detailed and reassuring guidance."

[1424] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1425] Steps in user registration

[1426] Step 1:

[1427] The user opens the user registration screen on the device. The device uses a camera and microphone to input the user's facial expressions and voice into the emotion engine. The emotion engine analyzes this and generates emotion data for the user.

[1428] Step 2:

[1429] The user inputs information such as their name, address, phone number, email address, and password. The device then transmits this input information and the generated emotion data to the server.

[1430] Step 3:

[1431] The server stores the received user information and emotion data in a database. It validates the user information and records it accurately in the database.

[1432] Step 4:

[1433] The server generates appropriate feedback and guidance based on the stored emotional data. The emotion engine creates relaxing messages and detailed guidance depending on the emotions detected.

[1434] Step 5:

[1435] The server generates a new member ID and creates a notification email containing that ID. The content of this email is tailored based on the emotional data to convey a sense of security and support. The email is then sent to the user.

[1436] Locker reservation and QR code generation process steps

[1437] Step 1:

[1438] The delivery person opens the system's locker reservation screen on their own device, where an emotion engine analyzes the delivery person's facial expressions and voice to generate emotion data.

[1439] Step 2:

[1440] The delivery person inputs the desired station and the desired number of lockers. The terminal then transmits this data and emotion data to the server.

[1441] Step 3:

[1442] The server checks the availability of lockers in the database based on the received station and number of lockers. If there are any available lockers, it allocates them. During this process, it also takes into account the courier's emotional data and proceeds to the next step.

[1443] Step 4:

[1444] The server generates available locker IDs and unique QR codes, stores them in a database, and notifies the courier with the details (locker ID and QR code), which are also tailored based on the emotion data.

[1445] Baggage drop-off processing steps

[1446] Step 1:

[1447] The courier takes the QR code they received and goes to the designated coin locker at the station, where they scan the QR code using the QR code reader on their device.

[1448] Step 2:

[1449] The device sends the scanned QR code information to the server.

[1450] Step 3:

[1451] The server checks the received QR code information against a database, and if authentication is successful, it sends a signal to unlock the locker. Upon receiving this signal, the locker opens.

[1452] Step 4:

[1453] The delivery person opens the locker, deposits the package, and then relocks it.

[1454] Step 5:

[1455] The server records the successful deposit in a database and sends a confirmation to the courier, which is also adjusted based on the emotion data.

[1456] Processing steps for receiving a package

[1457] Step 1:

[1458] The recipient arrives at the designated coin locker at the station and stands in front of the locker holding the QR code displayed on the terminal.

[1459] Step 2:

[1460] The device uses a QR code reader to scan the QR code and transmits the information to the server.

[1461] Step 3:

[1462] The server checks the received QR code information in a database, and if authentication is successful, it sends a signal to unlock the locker.

[1463] Step 4:

[1464] The recipient opens the locker and collects the package.

[1465] Step 5:

[1466] The server records the completion of the package in a database and sends a confirmation to the sender and the courier, which is also adjusted based on the emotion data.

[1467] (Application example 2)

[1468] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1469] In recent years, systems that utilize train station coin lockers as parcel lockers have been gaining attention. However, these systems fail to properly consider the user's emotions during the user registration, locker reservation, and baggage deposit and collection processes, which can cause stress and discomfort to users. Furthermore, there is a need for methods to reduce the workload of employees and ensure efficient operation. Given this background, the development of a system that can identify the emotions of users and employees and provide support based on these emotions is a challenge.

[1470] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input information using a terminal and send it to the server; a means for the server to store the received information in a database; a means for the server to generate a new member ID and notify the user; a means for a delivery company to reserve a locker using the terminal and send it to the server; a means for the server to check the availability of a locker, generate a unique QR code and notify the delivery company; a means for the delivery company to unlock the locker and deposit the package using the QR code; a means for the server to record the deposit of the package and notify the delivery company; a means for the delivery company to send the QR code to the sender; a means for a recipient to unlock the locker using the QR code and receive the package; a means for the server to record the receipt of the package and notify the sender and the delivery company; a means for identifying the user's emotion using emotion recognition technology installed in the terminal and sending the information to the server; and a means for the server to optimize the notification content and interface based on the emotion data received. This makes it possible to quickly recognize the user's emotions and provide optimal support based on them.

[1471] A "user" is an individual or corporation that uses the system, and is the entity that inputs information using a terminal and transmits it to the server.

[1472] A "terminal" is an electronic device such as a PC, smartphone, or tablet, which allows users to input and operate information.

[1473] A "server" is a computer system that stores and processes data over a network and provides various services.

[1474] A "database" is a system for organizing and storing information, and is used by a server to store information received.

[1475] "Member ID" is an identifier that uniquely identifies a user on the system.

[1476] "Courier" means an individual or legal entity that delivers, deposits, and receives packages.

[1477] A "locker" is a storage facility for temporarily storing luggage, and is usually installed at stations and public facilities.

[1478] A "QR code" is a type of two-dimensional barcode that is expressed as a pattern with unique identification information.

[1479] "Package" means an item that is being delivered or received.

[1480] "Emotion recognition technology" is a technology that uses cameras and voice input devices to identify emotions from human facial expressions and voice.

[1481] "Notification" refers to the act or means of transmitting information from the server to the user or delivery company.

[1482] An "interface" is an operation screen or operation method for exchanging information between a user and a system.

[1483] "Recipient" means an individual or legal entity that receives a package from a locker.

[1484] The present invention optimizes the user experience by combining a system that uses coin lockers at train stations as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[1485] User Registration

[1486] The user opens the system's user registration screen using their own device (PC or smartphone). The device is equipped with emotion recognition technology, which identifies emotions from the user's facial expressions and voice during the registration process. The user enters information such as their name, address, phone number, email address, and password. Both the registration information and emotion data are sent to the server.

[1487] The server stores the received information in a database. At the same time, it provides appropriate feedback and guidance based on the emotional data. The server generates a new member ID and notifies the user. The notification content is selected with consideration for the user's emotions. For example, if the user is feeling anxious, detailed and careful guidance will be included.

[1488] Locker reservation and QR code generation

[1489] The delivery person opens the system's locker reservation screen on their device. The device's emotion recognition technology identifies the delivery person's emotions and provides appropriate support as the task progresses. The delivery person selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server.

[1490] The server checks the availability of lockers and assigns an available locker. It generates a locker ID and a unique QR code and stores it in a database. The server then notifies the courier of the reservation details (locker ID and QR code). The content of this notification is also based on the courier's emotion.

[1491] Checked baggage

[1492] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the information to the server.

[1493] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[1494] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[1495] QR code notification

[1496] The courier will then send a QR code to the sender to notify them of the delivery, and the content and tone of the notification will be adjusted depending on the sender's emotions as detected by emotion recognition technology.

[1497] Picking up your luggage

[1498] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion recognition technology identifies the recipient's emotion and provides the necessary support. The recipient scans the QR code, and the terminal sends the information to the server.

[1499] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[1500] The server records the completion of delivery in a database and sends a notification to the sender and the courier company. Emotion recognition technology enables the content of the notification to be tailored to the recipient's emotion.

[1501] Hardware and software used

[1502] Hardware: Smartphones, PCs, lockers (luggage storage facilities)

[1503] Software: OpenCV (image processing library), dlib (face detection and landmark estimation library), emotion recognition model, server software

[1504] Specific examples

[1505] For example, if User A registers with the system and requests courier B to leave a package in a locker at a station, the emotion recognition technology will detect User A's nervousness and the server will provide detailed guidance that gives the impression of stability. When Courier B reserves the locker, the emotion recognition technology will detect fatigue and provide an interface that simplifies the process. Finally, when Recipient C receives the package, the emotion recognition technology will detect impatience and provide quick and easy-to-understand instructions.

[1506] Prompt Sentence Examples

[1507] 1. Example of a prompt for user registration:

[1508] Input prompt: "Capture facial expressions during user registration, recognize emotions, and send them to the server"

[1509] Sample output: "Analyzing your sentiment... Please enter your registration details."

[1510] 2. Example of prompt for locker reservation:

[1511] Input prompt: "Recognize ongoing emotions during locker booking and provide necessary support."

[1512] Example output: "You are showing signs of fatigue. We'll simplify the booking process... Please enter the station name and number of lockers."

[1513] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1514] Step 1:

[1515] The user enters information into the terminal and sends it to the server.

[1516] Input: A user enters information into a device, such as a name, address, phone number, email address, or password.

[1517] Processing: The device uses emotion recognition technology to analyze the user's facial expressions and voice input, generating emotional data. This registration information and emotional data are then sent to the server.

[1518] Output: Registration information and emotion data sent to the server.

[1519] Step 2:

[1520] The server stores the received information in a database

[1521] Input: Registration information and emotion data submitted in step 1.

[1522] Processing: The server stores this information in a database.

[1523] Output: User registration information and emotion data stored in a database.

[1524] Step 3:

[1525] The server generates a new member ID and notifies the user.

[1526] Input: User registration information stored in the database.

[1527] Action: The server generates a new member ID and optimizes the notification content based on the sentiment data, for example, including detailed and polite guidance if the user is feeling anxious.

[1528] Output: Notification of member ID according to sentiment towards the user.

[1529] Step 4:

[1530] The delivery company reserves a locker using a terminal and sends the reservation to the server.

[1531] Input: The delivery person enters the station they wish to use and the number of lockers they wish to use into the terminal.

[1532] Processing: The device uses emotion recognition technology to analyze the delivery person's emotions and generate emotion data. The device then sends the reservation information and emotion data to the server.

[1533] Output: Reservation information and emotion data sent to the server.

[1534] Step 5:

[1535] The server checks the availability of the locker, generates a unique QR code, and notifies the courier.

[1536] Input: Booking information and emotion data submitted in step 4.

[1537] Processing: The server checks the availability of lockers in the database, assigns an available locker, generates a unique QR code, and sends a notification to the courier, optimizing the notification content based on the emotion data.

[1538] Output: QR code notification depending on your sentiment towards the courier.

[1539] Step 6:

[1540] The delivery person uses the QR code to unlock the locker and deposit the package.

[1541] Input: The QR code sent in step 5.

[1542] Processing: The courier scans the QR code using the QR code reader on the device, and the device sends the information to the server.

[1543] Output: The QR code information sent to the server.

[1544] Step 7:

[1545] The server records the delivery of the package and notifies the courier.

[1546] Input: QR code information sent in step 6.

[1547] Processing: The server checks the QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. After the luggage is deposited, the information is recorded in the database and a confirmation notification is sent to the courier. The notification content is optimized based on the emotion data.

[1548] Output: Notification of successful deposit depending on your feelings towards the courier.

[1549] Step 8:

[1550] The courier will send a QR code to the sender

[1551] Input: QR code provided in step 7.

[1552] Processing: The courier sends a QR code to the sender, and emotion recognition technology identifies the sender's emotion and optimizes the notification content.

[1553] Output: QR code notification depending on your feelings towards the sender.

[1554] Step 9:

[1555] The recipient unlocks the locker using the QR code and collects the package.

[1556] Input: QR code received by the recipient.

[1557] Process: The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server. The server checks the QR code against the database, and if authentication is successful, it sends a signal to unlock the locker.

[1558] Output: Locker unlock signal to recipient.

[1559] Step 10:

[1560] The server records the receipt of the package and notifies the sender and the courier.

[1561] Input: QR code information sent in step 9.

[1562] Processing: The server records the parcel receipt in a database and sends a confirmation notification to the sender and the courier, which is also optimized based on the emotion data.

[1563] Output: Notification of successful delivery depending on feelings towards the sender and courier.

[1564] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1565] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1566] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1567] [Fourth embodiment]

[1568] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1569] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1570] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1571] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1572] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1573] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1574] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1575] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1576] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1577] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1578] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1579] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1580] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1581] The present invention relates to a system that uses coin lockers at stations as delivery boxes, and is implemented as follows.

[1582] User Registration

[1583] The user opens the system's user registration screen using their own device (PC or smartphone) and enters information such as their name, address, phone number, email address, and password. When the user clicks the "Register" button, the device sends the entered information to the server.

[1584] The server saves the received information in the database, generates a new member ID, and notifies the user of the generated member ID and the password for the first login by email.

[1585] Locker reservation and QR code generation

[1586] The delivery person opens the system's locker reservation screen on their device, selects the station they wish to use and the number of lockers they wish to use, and when they click the "Reserve" button, the device sends the selected information to the server.

[1587] The server checks the availability of lockers and allocates an available locker. It generates a locker ID and a unique QR code, which is stored in a database along with the respective locker ID. The server then notifies the courier of the reservation details (locker ID and QR code).

[1588] Checked baggage

[1589] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the scanned information to the server.

[1590] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[1591] The server records that the package has been deposited and sends a confirmation to the courier.

[1592] QR code notification

[1593] The delivery company will send a QR code to the sender along with a notification of the completion of the delivery, and the sender will then pass the received QR code on to the recipient.

[1594] Picking up your luggage

[1595] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The QR code is then scanned using the terminal's QR code reader.

[1596] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[1597] The server records that the package has been received and sends a notification of receipt to the sender and the delivery company.

[1598] Specific examples

[1599] For example, if User A registers with the system and requests delivery company B to leave a package in a locker at a station, the following process will occur: Delivery company B reserves a locker and receives a QR code. B leaves the package in the designated locker and sends the QR code to User A. User A then transmits the QR code to recipient C, who arrives at the designated locker and uses the QR code to retrieve the package.

[1600] In this way, the system of the present invention allows users to use lockers at designated stations as delivery boxes, facilitating smooth package collection.

[1601] The processing flow will be explained below.

[1602] Step 1:

[1603] The user uses a terminal to open the system's user registration screen and enters information such as name, address, telephone number, email address, and password.

[1604] Step 2:

[1605] The terminal transmits the input information to the server.

[1606] Step 3:

[1607] The server stores the received information in a database.

[1608] Step 4:

[1609] The server generates a new member ID and creates an email to notify the user.

[1610] Step 5:

[1611] The server will email the user a new member ID and initial login password.

[1612] Step 6:

[1613] Delivery workers open the system's locker reservation screen on their own devices and select the station they wish to use and the number of lockers they wish to use.

[1614] Step 7:

[1615] The terminal sends information about the selected station and the number of lockers to the server.

[1616] Step 8:

[1617] The server checks the availability of lockers and assigns an available locker.

[1618] Step 9:

[1619] The server generates a locker ID and a unique QR code and stores it in a database.

[1620] Step 10:

[1621] The server sends the locker ID and QR code details to the delivery company via email or in-system notification.

[1622] Step 11:

[1623] The delivery person goes to the coin locker at the designated station and displays the QR code on the terminal.

[1624] Step 12:

[1625] The delivery person scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[1626] Step 13:

[1627] The server checks the received QR code against its database.

[1628] Step 14:

[1629] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[1630] Step 15:

[1631] The delivery person opens the locker, deposits the package, and then locks it again.

[1632] Step 16:

[1633] The server records the completion of the package deposit in a database and sends a confirmation notice to the courier.

[1634] Step 17:

[1635] The delivery company will email the sender a QR code along with a notification that the delivery has been completed.

[1636] Step 18:

[1637] The sender transmits the received QR code to the recipient.

[1638] Step 19:

[1639] The recipient arrives at the coin locker at the designated station and displays the QR code they received on the terminal.

[1640] Step 20:

[1641] The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[1642] Step 21:

[1643] The server checks the received QR code against its database.

[1644] Step 22:

[1645] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[1646] Step 23:

[1647] The recipient opens the locker and collects the package.

[1648] Step 24:

[1649] The server records in the database that the parcel has been received, and sends a notification of the completion of the parcel to the sender and the delivery company.

[1650] Example 1

[1651] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1652] Conventional delivery systems have had problems with smooth delivery of goods when the user is absent or when receiving the goods takes time. There is also a need for a more efficient method of delivering and receiving goods. In addition, there is a need for a method to check the storage information of goods in real time and to safely deposit and receive goods.

[1653] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1654] In this invention, the server includes: a means for a user to input information using a terminal and send it to the server; a means for the server to store the received information in a database; a means for the server to generate a new identifier and notify the user; a means for a delivery company to reserve a storage account using a terminal and send it to the server; a means for the server to check the availability of the storage account, generate a unique identifier code and notify the delivery company; a means for the delivery company to unlock the storage account using the identifier code and deposit the item; a means for the server to record the deposit of the item and notify the delivery company; a means for the delivery company to send the identifier code to the item sender; a means for the customer to unlock the storage account using the identifier code and receive the item; a means for the server to record the receipt of the item and notify the item sender and the delivery company; and a means for displaying the status and facilitating processing using an AI model. This streamlines the process from depositing to receiving the item, enabling a home delivery system that is highly convenient for users and delivery companies to be realized.

[1655] A "user" is an entity that registers with the system and deposits and receives items.

[1656] A "terminal" is a device used by a user or delivery company to communicate with the system, including a PC or smartphone.

[1657] A "server" is a computer system that manages information at the center of the system and performs various processes.

[1658] An "identifier" is a unique number or code generated by the server to identify a user or item.

[1659] A "delivery company" is an entity that delivers goods and reserves a storage account and deposits goods via a terminal.

[1660] A "storage account" is a coin locker at a station or other storage facility, and is an account for the temporary storage of items.

[1661] A "unique identifier code" is an individual QR code or barcode generated to identify an item or storage account.

[1662] The "item sender" is the user who deposits the item.

[1663] A "customer" is a user who receives an item.

[1664] An "AI model" is an artificial intelligence algorithm that optimizes processes such as depositing and receiving items.

[1665] A "database" is a collection of information stored on the system's server, including user information and reservation information.

[1666] An "unlock signal" is an electronic instruction sent from the server to open a custodial account.

[1667] The present invention relates to a system that utilizes coin lockers at train stations and other storage facilities as delivery lockers, and is designed to allow users, delivery companies, and customers to efficiently deposit and receive items.

[1668] System configuration

[1669] The system is primarily comprised of the following elements: the devices (PCs and smartphones) used by users and delivery companies, the server that manages the information, the communication means for exchanging information between them, and the database that functions as the core of the system. It also uses an AI model to facilitate the deposit and receipt of goods.

[1670] Hardware and Software

[1671] Hardware:

[1672] Device: PC or smartphone used by the user or delivery company.

[1673] Storage Accounts: Coin lockers and other storage facilities at train stations.

[1674] software:

[1675] Server: Java Spring Framework and Node.js for storing and processing information.

[1676] Database: MySQL or MongoDB to manage user and reservation information.

[1677] QR Code Generation: Python qrcode library.

[1678] Notification: Send email using Python's smtplib.

[1679] AI models: Algorithms used to optimize information and streamline processes.

[1680] Program processing

[1681] The specific process of the system is as follows: the user registers with the system, the delivery company deposits the item, and the customer receives the item. This process is carried out smoothly. Specifically, the user registers as a user of the system using a terminal, and the server receives the information and stores it in a database. The server then generates a new identifier and notifies the user.

[1682] Adding specific examples

[1683] For example, if user A registers with the system and requests delivery company B to store a package in a storage account at a station, the following process takes place: Delivery company B reserves the storage account and receives a QR code. B stores the package in the specified storage account and sends the QR code to user A. User A transmits the QR code to recipient C, who arrives at the specified storage account and uses the QR code to collect the package. In this way, the system of the present invention allows users to use the specified station storage account as a delivery locker, facilitating a smooth package collection process.

[1684] Prompt Sentence Examples

[1685] For example, an explanatory text can be generated by inputting the following prompt text into the generative AI model:

[1686] "Please explain in detail the processing of a system that uses coin lockers at train stations as delivery boxes from the perspectives of the server, the terminal, and the user."

[1687] By entering this prompt, a detailed description of a system that uses coin lockers at train stations as delivery boxes will be generated.

[1688] As described above, the system of the present invention is designed to allow users to conveniently use coin lockers at train stations and other storage facilities as delivery lockers.

[1689] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1690] Step 1: User Registration

[1691] 1. The user opens the system's user registration screen using their own device (PC or smartphone).

[1692] 2. The user enters information such as name, address, phone number, email address, and password, and clicks the "Register" button.

[1693] Input: User's name, address, phone number, email address, password

[1694] Output: Send registration information to the server

[1695] 3. The device sends the entered information to the server in JSON format.

[1696] What it does: Converts form data to JSON format and sends it to the server as an HTTP POST request.

[1697] Step 2: Storing user information on the server and notifying users

[1698] 1. The server stores the received information in a database.

[1699] Input: User registration information sent from the device

[1700] Output: Registration information is saved in the database

[1701] Behavior: Makes a database connection and executes an INSERT statement to save the user information.

[1702] 2. The server generates a new member ID and password for the first login and notifies the user by email.

[1703] Operation: Runs the member ID generation algorithm and sends an email using Python's smtplib.

[1704] Step 3: Enter and submit your locker reservation information

[1705] 1. The delivery person opens the system's locker reservation screen on their own device.

[1706] 2. The delivery person selects the station they wish to use and the number of storage accounts they wish to use, and clicks the "Reserve" button.

[1707] Input: Station name, number of required storage accounts

[1708] Output: Send reservation information to the server

[1709] 3. The device sends the selection information to the server in JSON format.

[1710] What it does: Converts form data to JSON format and sends it to the server as an HTTP POST request.

[1711] Step 4: Locker assignment and notification on the server

[1712] 1. The server checks the availability of storage accounts and assigns an available storage account.

[1713] Input: Station name, number of required storage accounts

[1714] Output: Assigned custody account ID and QR code

[1715] What it does: Performs a database query to check availability, stores the assigned custodial account ID in the database, and generates a QR code.

[1716] 2. The server generates a unique QR code and stores it in the database along with the custodial account ID.

[1717] What it does: Generates QR codes using Python's qrcode library.

[1718] 3. The server notifies the delivery company of the reservation details (storage account ID and QR code) by email.

[1719] Operation: Sends email using Python's smtplib.

[1720] Step 5: Arrive at the locker and scan the QR code

[1721] 1. The courier goes to the designated station's storage account and uses the QR code they received.

[1722] 2. The courier scans the QR code using a QR code reader app on their device.

[1723] Input: QR code

[1724] Output: Send QR code information to the server

[1725] 3. The device sends the scanned QR code information to the server in JSON format.

[1726] What it does: It converts data obtained from a QR code reader app into JSON format and sends it to the server as an HTTP POST request.

[1727] Step 6: Authenticate with the server and unlock the locker

[1728] 1. The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker.

[1729] Input: QR code information

[1730] Output: Locker unlock signal

[1731] Operation: Searches for a corresponding record in the database, and if a match occurs, generates and sends an unlock signal.

[1732] 2. The courier opens the locker, deposits the item, and then locks it again.

[1733] How it works: After depositing the item in the locker, manually lock the locker.

[1734] Step 7: Baggage drop-off notification

[1735] 1. The server records in the database that the item has been deposited.

[1736] Input: Notification data

[1737] Output: Records in the database

[1738] 2. The server sends a confirmation email to the delivery company.

[1739] Operation: Sends email using Python's smtplib.

[1740] Step 8: QR Code Notification

[1741] 1. The delivery company will email the sender a QR code along with a notification that the item has been deposited.

[1742] Operation: Sends email using Python's smtplib.

[1743] 2. The sender of the item will send the received QR code to the customer.

[1744] How it works: Send a QR code via email or message.

[1745] Step 9: Arrive at the locker and scan the QR code

[1746] 1. The customer arrives at the designated station's storage account and displays the QR code received on the terminal.

[1747] 2. The customer uses the QR code reader on their device to scan the newly received QR code.

[1748] Input: QR code

[1749] Output: Send QR code information to the server

[1750] 3. The device sends the scanned QR code information to the server in JSON format.

[1751] What it does: It converts data obtained from a QR code reader app into JSON format and sends it to the server as an HTTP POST request.

[1752] Step 10: Authenticate with the server and unlock the locker

[1753] 1. The server reconfirms the received QR code in the database, and if authentication is successful, sends a signal to unlock the locker.

[1754] Input: QR code information

[1755] Output: Locker unlock signal

[1756] Operation: Searches for a corresponding record in the database, and if a match occurs, generates and sends an unlock signal.

[1757] 2. The customer opens the locker and collects the item.

[1758] Action: Unlocks locker and removes item.

[1759] Step 11: Notification of package receipt completion

[1760] 1. The server records in the database that the item has been received.

[1761] Input: Notification data

[1762] Output: Records in the database

[1763] 2. The server sends an email to the sender and delivery company notifying them of the completion of the delivery.

[1764] Operation: Sends email using Python's smtplib.

[1765] As described above, this system allows users to use coin lockers at stations and other storage facilities as delivery boxes, streamlining the process from depositing items to receiving them.

[1766] (Application example 1)

[1767] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1768] In modern logistics systems, the need for temporary storage of deliveries is increasing, but securing appropriate storage locations and prompt notification to recipients are becoming issues. Furthermore, the food delivery industry requires a system that can ensure that recipients receive their food reliably while maintaining the quality of the food. An effective method to deal with such situations is needed.

[1769] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1770] In this invention, the server includes a means for a user to input information using a terminal and send it to the server, a means for a delivery company to reserve a storage device using a terminal and send it to the server, and a means for the server to check the availability of the storage device, generate a unique QR code, and notify the delivery company. This allows for smooth temporary storage and receipt of deliveries and food, and particularly in food delivery, makes it possible for recipients to receive food reliably while maintaining the quality of the food.

[1771] "User" refers to any individual or legal entity that uses the Service.

[1772] "Terminal" refers to electronic devices such as personal computers and smartphones.

[1773] "Server" refers to a computer or similar device that performs central processing within a system.

[1774] A "database" is a system that organizes and stores information so that it can be retrieved as needed.

[1775] "Member ID" refers to a unique identification number generated by the server to identify a user.

[1776] "Delivery Company" refers to a company or individual engaged in the delivery of goods.

[1777] "Storage device" means a coin locker at a train station or similar device for temporary storage of items.

[1778] "Availability" refers to information indicating whether or not there is available space in the storage device.

[1779] "QR Code" refers to a two-dimensional barcode that visually represents information and can be read using a QR Code reader.

[1780] "Goods" refers to general items, including parcels for delivery and food for delivery.

[1781] "Provider" refers to the person who provides the QR code to the recipient and provides the item.

[1782] "Recipient" refers to a person who receives an item from a storage device using a QR code.

[1783] A "timestamp" refers to digital information that records the date and time that a particular event occurred.

[1784] "Reservation" refers to the act of reserving the use of a storage device in advance.

[1785] "Authentication unlocking" refers to the act of unlocking a storage device using authentication means such as a QR code.

[1786] This invention is a system that uses coin lockers at train stations as delivery boxes, enabling users, delivery companies, and recipients to work together to smoothly deliver goods. This specification details the specific system configuration and operation procedures.

[1787] First, a user accesses the system using a terminal and enters information such as their name, address, phone number, email address, and password. The information sent from the terminal is received by the server and stored in a database. The server then generates a new member ID and notifies the user by email.

[1788] Next, the delivery company opens the system's storage device reservation screen on their device and selects the station they wish to use and the number of storage devices they wish to use. The selection information is sent from the device to the server, which checks the availability of storage devices. An available storage device is assigned, a unique QR code is generated, and stored in a database along with the respective storage device ID. The server then notifies the delivery company of the reservation details (storage device ID and QR code).

[1789] The delivery person goes to the storage device at the designated station and unlocks it using the QR code they received. They scan the QR code using the QR code reader on their device, and the scanned information is sent to the server. The server checks the received QR code against its database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the delivery person to open the device and deposit the item.

[1790] Once the item has been deposited, the server records the details and sends a confirmation to the delivery company. The delivery company then emails the sender a QR code to notify them of the completion of the deposit, which the sender then passes on to the recipient.

[1791] The recipient arrives at the storage device at the designated station and displays the QR code they received on their terminal. It is scanned using a QR code reader, and the information is sent to the server. The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the recipient to open the storage device and collect the item.

[1792] The hardware used includes a personal computer, a smartphone, and a QR code reader. The software used includes the Flask framework and an SQLite database. The qrcode module is used to generate the QR code.

[1793] For example, when a user registers with the system using their smartphone, a new user ID is generated. Next, a delivery company reserves a storage device, and a unique QR code is generated. The delivery company deposits the item in the designated storage device and notifies the provider of the QR code by email. The provider then transmits the QR code to the recipient, who then unlocks the storage device and collects the item.

[1794] An example prompt for a generative AI model might look like this:

[1795] "Receive the user's registration information and store it in the database. Generate a new user ID and notify the user by email."

[1796] This prompt sentence allows the server to perform the appropriate data manipulations and ensures smooth functioning of the entire system.

[1797] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1798] Step 1:

[1799] A user accesses the system using a terminal and enters information such as name, address, phone number, email address, and password. This information is sent from the terminal to the server by pressing the send button. The server stores the received user information in a database. Input: Name, address, phone number, email address, password. Output: User information stored in the database.

[1800] Step 2:

[1801] The server generates a new member ID and notifies the user of that member ID. Specifically, the server generates a unique ID in the database and sends a notification email to the registered email address. This action allows the user to be recognized in the system. Input: User information. Output: Generation of a new member ID and email notification.

[1802] Step 3:

[1803] The delivery company uses a terminal to open the system's storage device reservation screen, select the station they wish to use and the number of storage devices they wish to use, and send the entered information to the server. The server confirms the received selection information and allocates available storage devices. Input: Station information, number of storage devices. Output: Allocated storage device ID and QR code.

[1804] Step 4:

[1805] The server generates a unique QR code and stores it in the database along with the respective storage device ID. Then the server notifies the delivery company of the reservation details (storage device ID and QR code). The qrcode module is used to generate the QR code. Input: Storage device ID. Output: Generated QR code and reservation details.

[1806] Step 5:

[1807] The delivery company goes to the storage device at the designated station and unlocks it using the QR code they received. The delivery company's terminal is equipped with a QR code reader, which they use to scan the QR code and send the information to the server. The server checks the received QR code in its database, and if authentication is successful, it sends a signal to unlock the storage device. Input: QR code. Output: Signal to unlock the storage device.

[1808] Step 6:

[1809] The delivery company opens the storage device and deposits the item. Then it locks it again. The server records that the item has been deposited and sends a confirmation to the delivery company. Input: Item deposit information. Output: Record and notification of deposit completion.

[1810] Step 7:

[1811] The delivery company will email the provider a QR code along with a notification that the item has been deposited. The provider will then pass the QR code on to the recipient, who will then display the QR code upon arriving at the designated station. Input: QR code. Output: Notification email sent to the provider.

[1812] Step 8:

[1813] The recipient arrives at the storage device at the designated station and displays the QR code they received on their terminal. They then scan the QR code using a QR code reader and send the information to the server. The server checks the received QR code against its database, and if authentication is successful, it sends a signal to unlock the storage device, allowing the recipient to open the storage device and collect the item. Input: QR code. Output: Storage device unlock signal.

[1814] Step 9:

[1815] The server records the receipt of the item with a timestamp and notifies the donor and delivery company, including details such as the date and time of receipt. Input: Receipt information. Output: Record and notification of receipt details.

[1816] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1817] The present invention optimizes the user experience by combining a system that uses coin lockers at train stations as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[1818] User Registration

[1819] The user opens the system's user registration screen using their own device (PC or smartphone). The device is equipped with an emotion engine that identifies emotions from the user's facial expressions and voice during the registration process. The user enters information such as their name, address, phone number, email address, and password. Both the registration information and emotion data are sent to the server.

[1820] The server stores the received information in a database. At the same time, it provides appropriate feedback and guidance based on the emotional data. The server generates a new member ID and creates an email to notify the user. The content of the notification is chosen with consideration for the user's emotions. For example, if the user is feeling anxious, detailed and careful guidance will be included.

[1821] Locker reservation and QR code generation

[1822] The delivery person opens the system's locker reservation screen on their device. The device's emotion engine identifies the delivery person's emotion and provides appropriate support as the task progresses. The delivery person selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server.

[1823] The server checks the availability of lockers and assigns an available locker. It generates a locker ID and a unique QR code and stores it in a database. The server then notifies the courier of the reservation details (locker ID and QR code). The content of this notification is also based on the courier's emotion.

[1824] Checked baggage

[1825] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the information to the server.

[1826] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[1827] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[1828] QR code notification

[1829] The courier will then email the sender a QR code to notify them of the delivery, and the content and tone of the email will be adjusted based on the sender's emotions as detected by the emotion engine.

[1830] Picking up your luggage

[1831] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion engine identifies the recipient's emotion and provides the necessary support. The recipient scans the QR code, and the terminal sends the information to the server.

[1832] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[1833] The server records the completion of the delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also determines the content of the notification based on the user's emotion.

[1834] Specific examples

[1835] For example, if User A registers with the system and requests courier B to leave a package in a locker at a train station, the emotion engine will sense User A's nervousness and provide detailed guidance that gives the impression of stability. When Courier B reserves the locker, the emotion engine will sense his fatigue and provide an interface that simplifies the process. Finally, when Recipient C picks up the package, the emotion engine will sense the recipient's impatience and provide quick, easy-to-understand instructions.

[1836] In this way, the system of the present invention recognizes the user's emotions and provides optimal support accordingly, improving the overall user experience.

[1837] The processing flow will be explained below.

[1838] Step 1:

[1839] The user uses their own terminal to open the system's user registration screen and enters information such as their name, address, telephone number, email address, and password.

[1840] Step 2:

[1841] The device identifies the user's emotions using an emotion engine, which utilizes facial recognition cameras and voice analysis functions.

[1842] Step 3:

[1843] The terminal transmits the input information and the identified emotion data to the server.

[1844] Step 4:

[1845] The server stores the received information in a database and simultaneously provides appropriate feedback and guidance based on the emotional data.

[1846] Step 5:

[1847] The server generates a new member ID and creates an email to notify the user. At this time, the notification content is chosen taking into consideration the user's feelings.

[1848] Step 6:

[1849] The server will email the user a new member ID and initial login password.

[1850] Step 7:

[1851] Delivery workers open the system's locker reservation screen on their own devices and select the station they wish to use and the number of lockers they wish to use.

[1852] Step 8:

[1853] The device uses an emotion engine to identify the delivery person's emotions and provides appropriate support as the work progresses.

[1854] Step 9:

[1855] The terminal sends information about the selected station and the number of lockers to the server.

[1856] Step 10:

[1857] The server checks the availability of lockers and assigns an available locker.

[1858] Step 11:

[1859] The server generates a locker ID and a unique QR code and stores it in a database.

[1860] Step 12:

[1861] The server then sends the locker ID and QR code details to the delivery company via email or an in-system notification, which also depends on the delivery company's emotion.

[1862] Step 13:

[1863] The delivery person goes to the coin locker at the designated station and displays the QR code on the terminal.

[1864] Step 14:

[1865] The delivery person scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[1866] Step 15:

[1867] The server checks the received QR code against its database.

[1868] Step 16:

[1869] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[1870] Step 17:

[1871] The delivery person opens the locker, deposits the package, and then locks it again.

[1872] Step 18:

[1873] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[1874] Step 19:

[1875] The delivery company will email the sender a QR code along with a notification that the delivery has been completed.

[1876] Step 20:

[1877] The sender transmits the received QR code to the recipient.

[1878] Step 21:

[1879] The recipient arrives at the coin locker at the designated station and displays the QR code they received on the terminal.

[1880] Step 22:

[1881] The device's emotion engine identifies the recipient's emotions and provides the necessary support.

[1882] Step 23:

[1883] The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server.

[1884] Step 24:

[1885] The server checks the received QR code against its database.

[1886] Step 25:

[1887] If the server can authenticate the QR code as valid, it sends a signal to unlock the locker.

[1888] Step 26:

[1889] The recipient opens the locker and collects the package.

[1890] Step 27:

[1891] The server records the completion of delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also adjusts the content of the notification to reflect the recipient's emotions.

[1892] Example 2

[1893] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1894] In modern society, there is a demand for services that take people's emotions into consideration. However, conventional systems lack the ability to identify the emotions of users and service providers, and can only respond uniformly, resulting in an underoptimized user experience. Furthermore, in situations where users feel emotional stress or anxiety, appropriate support or feedback is not provided, which can lead to a decrease in user satisfaction.

[1895] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for a user to input information using a terminal and send it to the server, means for the terminal to be equipped with an emotion engine that identifies the user's emotion and also send emotion data to the server, means for the server to store the received information and emotion data in a database, and means for the server to generate appropriate feedback and guidance based on the emotion data and provide it to the user. This makes it possible to provide feedback and guidance that takes the user's emotions into consideration, improving the overall user experience.

[1896] A "terminal" is an electronic device used by users or delivery personnel to input or receive information, such as a PC or smartphone.

[1897] "User" refers to a person who uses this system to reserve a locker or collect luggage.

[1898] "Server" refers to the central management system that receives and processes information sent by users and delivery companies.

[1899] An "emotion engine" refers to software or hardware technology that is installed on a device and identifies emotions from the facial expressions and voice of the user or delivery person.

[1900] A "database" is a system for recording and storing information managed by a server.

[1901] "Feedback and guidance" refers to information and instructions provided by the server to users and delivery agents, which are appropriately adjusted based on emotional data.

[1902] A "member ID" is an identifier generated by the server when a user registers, and is used to uniquely identify the user.

[1903] A "locker" is a storage device installed in a designated location such as a station, and is used to temporarily store luggage.

[1904] A "QR code" is a unique two-dimensional code generated by a server and used to unlock lockers and check information.

[1905] "Notification" means a message or email sent from the server to the user or delivery company.

[1906] "Delivery company" refers to a person or organization that transports packages and deposits them in lockers.

[1907] "Sender" refers to the person or organization that requests the delivery of a package.

[1908] "Recipient" refers to the person who receives the package from the locker.

[1909] The present invention optimizes the user experience by combining a system that uses train station lockers as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[1910] Hardware and software used

[1911] The system uses the following hardware and software:

[1912] 1. Terminal: An electronic device such as a PC or smartphone that allows users or delivery personnel to input and display information. The terminal is equipped with a camera, microphone, and QR code reader.

[1913] 2. Emotion engine: Software that analyzes the facial expressions and voices of users and delivery personnel to identify their emotions, thereby obtaining emotional data about the user.

[1914] 3. Server: A central management system that receives and processes information sent by users and couriers, stores the information in a database, and generates appropriate feedback and guidance.

[1915] 4. Database: A system for recording and storing information managed by a server.

[1916] Basic system configuration

[1917] 1. User Registration:

[1918] The user opens the system's user registration screen on their device (PC or smartphone). The device is equipped with an emotion engine that analyzes facial expressions and voice to obtain emotion data.

[1919] The user inputs necessary information such as name, address, phone number, email address, password, etc. The input information and emotion data are sent from the device to the server.

[1920] The server stores the received information in a database, generates appropriate feedback and guidance based on the emotion data, and provides it to the user. Finally, it generates a new member ID and sends a notification to the user that takes the emotion data into consideration.

[1921] 2. Locker reservation and QR code generation:

[1922] The delivery person opens the system's locker reservation screen from their own device, and the device's emotion engine identifies the delivery person's emotion.

[1923] The courier selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server. The server checks the availability of lockers and assigns an available locker. A unique QR code is generated and notified to the courier. The content of this notification is adjusted according to the courier's emotions.

[1924] 3. Baggage Drop-Off and Notification:

[1925] The courier goes to the designated coin locker at the station and scans the QR code using the QR code reader on the terminal, which then sends the scanned information to the server.

[1926] The server checks the received QR code, and if authentication is successful, it sends a signal to unlock the locker. The delivery person deposits the package in the locker and then relocks it.

[1927] The server records the successful delivery of the parcel in a database and sends a confirmation message to the courier, which is also tailored to take the courier's emotions into account.

[1928] 4. Pick up your package:

[1929] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion engine identifies the recipient's emotions and provides the necessary support.

[1930] The recipient scans the QR code and sends the information to the server. The server authenticates the received QR code, and if successful, sends a signal to unlock the locker. The recipient can then collect their package.

[1931] The server records the completion of the delivery in a database and sends a notification to the sender and the delivery company. The emotion engine also determines the content of the notification based on the user's emotion.

[1932] Specific examples

[1933] For example, when a user registers with the system, if the emotion engine detects nervousness, the server can provide detailed and reassuring guidance. When a courier reserves a locker, if the emotion engine detects fatigue, the server can provide a simplified interface. Finally, when the recipient picks up the package, if the emotion engine detects impatience, the server can provide quick and easy-to-understand instructions.

[1934] Prompt Sentence Examples

[1935] When using a generative AI model, you can use prompts like the following:

[1936] "Users feel nervous when registering with the system. The system should provide detailed and reassuring guidance."

[1937] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1938] Steps in user registration

[1939] Step 1:

[1940] The user opens the user registration screen on the device. The device uses a camera and microphone to input the user's facial expressions and voice into the emotion engine. The emotion engine analyzes this and generates emotion data for the user.

[1941] Step 2:

[1942] The user inputs information such as their name, address, phone number, email address, and password. The device then transmits this input information and the generated emotion data to the server.

[1943] Step 3:

[1944] The server stores the received user information and emotion data in a database. It validates the user information and records it accurately in the database.

[1945] Step 4:

[1946] The server generates appropriate feedback and guidance based on the stored emotional data. The emotion engine creates relaxing messages and detailed guidance depending on the emotions detected.

[1947] Step 5:

[1948] The server generates a new member ID and creates a notification email containing that ID. The content of this email is tailored based on the emotional data to convey a sense of security and support. The email is then sent to the user.

[1949] Locker reservation and QR code generation process steps

[1950] Step 1:

[1951] The delivery person opens the system's locker reservation screen on their own device, where an emotion engine analyzes the delivery person's facial expressions and voice to generate emotion data.

[1952] Step 2:

[1953] The delivery person inputs the desired station and the desired number of lockers. The terminal then transmits this data and emotion data to the server.

[1954] Step 3:

[1955] The server checks the availability of lockers in the database based on the received station and number of lockers. If there are any available lockers, it allocates them. During this process, it also takes into account the courier's emotional data and proceeds to the next step.

[1956] Step 4:

[1957] The server generates available locker IDs and unique QR codes, stores them in a database, and notifies the courier with the details (locker ID and QR code), which are also tailored based on the emotion data.

[1958] Baggage drop-off processing steps

[1959] Step 1:

[1960] The courier takes the QR code they received and goes to the designated coin locker at the station, where they scan the QR code using the QR code reader on their device.

[1961] Step 2:

[1962] The device sends the scanned QR code information to the server.

[1963] Step 3:

[1964] The server checks the received QR code information against a database, and if authentication is successful, it sends a signal to unlock the locker. Upon receiving this signal, the locker opens.

[1965] Step 4:

[1966] The delivery person opens the locker, deposits the package, and then relocks it.

[1967] Step 5:

[1968] The server records the successful deposit in a database and sends a confirmation to the courier, which is also adjusted based on the emotion data.

[1969] Processing steps for receiving a package

[1970] Step 1:

[1971] The recipient arrives at the designated coin locker at the station and stands in front of the locker holding the QR code displayed on the terminal.

[1972] Step 2:

[1973] The device uses a QR code reader to scan the QR code and transmits the information to the server.

[1974] Step 3:

[1975] The server checks the received QR code information in a database, and if authentication is successful, it sends a signal to unlock the locker.

[1976] Step 4:

[1977] The recipient opens the locker and collects the package.

[1978] Step 5:

[1979] The server records the completion of the package in a database and sends a confirmation to the sender and the courier, which is also adjusted based on the emotion data.

[1980] (Application example 2)

[1981] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1982] In recent years, systems that utilize train station coin lockers as parcel lockers have been gaining attention. However, these systems fail to properly consider the user's emotions during the user registration, locker reservation, and baggage deposit and collection processes, which can cause stress and discomfort to users. Furthermore, there is a need for methods to reduce the workload of employees and ensure efficient operation. Given this background, the development of a system that can identify the emotions of users and employees and provide support based on these emotions is a challenge.

[1983] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input information using a terminal and send it to the server; a means for the server to store the received information in a database; a means for the server to generate a new member ID and notify the user; a means for a delivery company to reserve a locker using the terminal and send it to the server; a means for the server to check the availability of a locker, generate a unique QR code and notify the delivery company; a means for the delivery company to unlock the locker and deposit the package using the QR code; a means for the server to record the deposit of the package and notify the delivery company; a means for the delivery company to send the QR code to the sender; a means for a recipient to unlock the locker using the QR code and receive the package; a means for the server to record the receipt of the package and notify the sender and the delivery company; a means for identifying the user's emotion using emotion recognition technology installed in the terminal and sending the information to the server; and a means for the server to optimize the notification content and interface based on the emotion data received. This makes it possible to quickly recognize the user's emotions and provide optimal support based on them.

[1984] A "user" is an individual or corporation that uses the system, and is the entity that inputs information using a terminal and transmits it to the server.

[1985] A "terminal" is an electronic device such as a PC, smartphone, or tablet, which allows users to input and operate information.

[1986] A "server" is a computer system that stores and processes data over a network and provides various services.

[1987] A "database" is a system for organizing and storing information, and is used by a server to store information received.

[1988] "Member ID" is an identifier that uniquely identifies a user on the system.

[1989] "Courier" means an individual or legal entity that delivers, deposits, and receives packages.

[1990] A "locker" is a storage facility for temporarily storing luggage, and is usually installed at stations and public facilities.

[1991] A "QR code" is a type of two-dimensional barcode that is expressed as a pattern with unique identification information.

[1992] "Package" means an item that is being delivered or received.

[1993] "Emotion recognition technology" is a technology that uses cameras and voice input devices to identify emotions from human facial expressions and voice.

[1994] "Notification" refers to the act or means of transmitting information from the server to the user or delivery company.

[1995] An "interface" is an operation screen or operation method for exchanging information between a user and a system.

[1996] "Recipient" means an individual or legal entity that receives a package from a locker.

[1997] The present invention optimizes the user experience by combining a system that uses coin lockers at train stations as delivery boxes with an emotion engine that recognizes the user's emotions. Specific embodiments of this system are described below.

[1998] User Registration

[1999] The user opens the system's user registration screen using their own device (PC or smartphone). The device is equipped with emotion recognition technology, which identifies emotions from the user's facial expressions and voice during the registration process. The user enters information such as their name, address, phone number, email address, and password. Both the registration information and emotion data are sent to the server.

[2000] The server stores the received information in a database. At the same time, it provides appropriate feedback and guidance based on the emotional data. The server generates a new member ID and notifies the user. The notification content is selected with consideration for the user's emotions. For example, if the user is feeling anxious, detailed and careful guidance will be included.

[2001] Locker reservation and QR code generation

[2002] The delivery person opens the system's locker reservation screen on their device. The device's emotion recognition technology identifies the delivery person's emotions and provides appropriate support as the task progresses. The delivery person selects the station they wish to use and the number of lockers they wish to use, and sends that information to the server.

[2003] The server checks the availability of lockers and assigns an available locker. It generates a locker ID and a unique QR code and stores it in a database. The server then notifies the courier of the reservation details (locker ID and QR code). The content of this notification is also based on the courier's emotion.

[2004] Checked baggage

[2005] The courier goes to the designated coin locker at the station and unlocks the locker using the QR code they received. They then scan the QR code using the QR code reader on their device, which then sends the information to the server.

[2006] The server checks the received QR code against a database, and if authentication is successful, it sends a signal to unlock the locker. The delivery person opens the locker, deposits the package, and then locks it again.

[2007] The server records the completion of the package deposit in the database and sends a confirmation to the courier. Again, the confirmation message is generated taking into account the courier's feelings.

[2008] QR code notification

[2009] The courier will then send a QR code to the sender to notify them of the delivery, and the content and tone of the notification will be adjusted depending on the sender's emotions as detected by emotion recognition technology.

[2010] Picking up your luggage

[2011] The recipient arrives at the designated coin locker at the station and displays the QR code they received on the terminal. The terminal's emotion recognition technology identifies the recipient's emotion and provides the necessary support. The recipient scans the QR code, and the terminal sends the information to the server.

[2012] The server checks the received QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. The recipient then opens the locker and collects the package.

[2013] The server records the completion of delivery in a database and sends a notification to the sender and the courier company. Emotion recognition technology enables the content of the notification to be tailored to the recipient's emotion.

[2014] Hardware and software used

[2015] Hardware: Smartphones, PCs, lockers (luggage storage facilities)

[2016] Software: OpenCV (image processing library), dlib (face detection and landmark estimation library), emotion recognition model, server software

[2017] Specific examples

[2018] For example, if User A registers with the system and requests courier B to leave a package in a locker at a station, the emotion recognition technology will detect User A's nervousness and the server will provide detailed guidance that gives the impression of stability. When Courier B reserves the locker, the emotion recognition technology will detect fatigue and provide an interface that simplifies the process. Finally, when Recipient C receives the package, the emotion recognition technology will detect impatience and provide quick and easy-to-understand instructions.

[2019] Prompt Sentence Examples

[2020] 1. Example of a prompt for user registration:

[2021] Input prompt: "Capture facial expressions during user registration, recognize emotions, and send them to the server"

[2022] Sample output: "Analyzing your sentiment... Please enter your registration details."

[2023] 2. Example of prompt for locker reservation:

[2024] Input prompt: "Recognize ongoing emotions during locker booking and provide necessary support."

[2025] Example output: "You are showing signs of fatigue. We'll simplify the booking process... Please enter the station name and number of lockers."

[2026] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2027] Step 1:

[2028] The user enters information into the terminal and sends it to the server.

[2029] Input: A user enters information into a device, such as a name, address, phone number, email address, or password.

[2030] Processing: The device uses emotion recognition technology to analyze the user's facial expressions and voice input, generating emotional data. This registration information and emotional data are then sent to the server.

[2031] Output: Registration information and emotion data sent to the server.

[2032] Step 2:

[2033] The server stores the received information in a database

[2034] Input: Registration information and emotion data submitted in step 1.

[2035] Processing: The server stores this information in a database.

[2036] Output: User registration information and emotion data stored in a database.

[2037] Step 3:

[2038] The server generates a new member ID and notifies the user.

[2039] Input: User registration information stored in the database.

[2040] Action: The server generates a new member ID and optimizes the notification content based on the sentiment data, for example, including detailed and polite guidance if the user is feeling anxious.

[2041] Output: Notification of member ID according to sentiment towards the user.

[2042] Step 4:

[2043] The delivery company reserves a locker using a terminal and sends the reservation to the server.

[2044] Input: The delivery person enters the station they wish to use and the number of lockers they wish to use into the terminal.

[2045] Processing: The device uses emotion recognition technology to analyze the delivery person's emotions and generate emotion data. The device then sends the reservation information and emotion data to the server.

[2046] Output: Reservation information and emotion data sent to the server.

[2047] Step 5:

[2048] The server checks the availability of the locker, generates a unique QR code, and notifies the courier.

[2049] Input: Booking information and emotion data submitted in step 4.

[2050] Processing: The server checks the availability of lockers in the database, assigns an available locker, generates a unique QR code, and sends a notification to the courier, optimizing the notification content based on the emotion data.

[2051] Output: QR code notification depending on your sentiment towards the courier.

[2052] Step 6:

[2053] The delivery person uses the QR code to unlock the locker and deposit the package.

[2054] Input: The QR code sent in step 5.

[2055] Processing: The courier scans the QR code using the QR code reader on the device, and the device sends the information to the server.

[2056] Output: The QR code information sent to the server.

[2057] Step 7:

[2058] The server records the delivery of the package and notifies the courier.

[2059] Input: QR code information sent in step 6.

[2060] Processing: The server checks the QR code against the database, and if authentication is successful, it sends a signal to unlock the locker. After the luggage is deposited, the information is recorded in the database and a confirmation notification is sent to the courier. The notification content is optimized based on the emotion data.

[2061] Output: Notification of successful deposit depending on your feelings towards the courier.

[2062] Step 8:

[2063] The courier will send a QR code to the sender

[2064] Input: QR code provided in step 7.

[2065] Processing: The courier sends a QR code to the sender, and emotion recognition technology identifies the sender's emotion and optimizes the notification content.

[2066] Output: QR code notification depending on your feelings towards the sender.

[2067] Step 9:

[2068] The recipient unlocks the locker using the QR code and collects the package.

[2069] Input: QR code received by the recipient.

[2070] Process: The recipient scans the QR code using the QR code reader on their device, and the device sends the information to the server. The server checks the QR code against the database, and if authentication is successful, it sends a signal to unlock the locker.

[2071] Output: Locker unlock signal to recipient.

[2072] Step 10:

[2073] The server records the receipt of the package and notifies the sender and the courier.

[2074] Input: QR code information sent in step 9.

[2075] Processing: The server records the parcel receipt in a database and sends a confirmation notification to the sender and the courier, which is also optimized based on the emotion data.

[2076] Output: Notification of successful delivery depending on feelings towards the sender and courier.

[2077] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2078] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2079] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2080] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2081] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2082] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2083] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2084] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and E...

Claims

1. A means for a user to input information using a terminal and transmit the information to a server; means for the server to store the received information in a database; A means for the server to generate a new member ID and notify the user; A means for a delivery company to reserve a locker using a terminal and transmit the reservation to a server; The server checks the availability of the locker, generates a unique QR code, and notifies the courier. A courier can use the QR code to unlock the locker and leave the package. a means for the server to record the deposit of the package and notify the courier; A means for the delivery company to send a QR code to the sender, The recipient unlocks the locker using a QR code and receives the package. a means by which the server records receipt of the package and notifies the sender and the courier; A system including:

2. 2. The system according to claim 1, wherein the server includes means for checking availability of lockers.

3. 10. The system of claim 1, wherein the terminal includes means for reading a QR code.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A