system
The QR code-based delivery system addresses personal information leakage and delivery errors by encrypting recipient data and integrating emotional feedback, ensuring secure and efficient delivery verification.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SOFTBANK GROUP CORP
- Filing Date
- 2024-10-21
- Publication Date
- 2026-05-07
AI Technical Summary
Conventional delivery systems face risks of personal information leakage and delivery errors due to the need for manual entry of recipient information, which can be maliciously used or incorrectly entered.
A system using a QR code containing encrypted receipt information on a package label, verified by a server to ensure accurate delivery and prevent personal information leakage, with a terminal for scanning and verification, and a server for managing delivery status and storing receipt history.
Ensures secure and accurate delivery verification while protecting personal information, reducing errors and enhancing delivery efficiency through real-time tracking and emotional feedback integration.
Smart Images

Figure 2026074885000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In a conventional delivery system, it is necessary to describe the personal information of the recipient on the package, and there is a risk of leakage of personal information because the information may be maliciously used. Also, even when the delivery destination is incorrect, delivery mistakes may occur because it is difficult to confirm. There is a need for a new system to solve these problems.
Means for Solving the Problems
[0005] This invention provides a system that uses a QR code (registered trademark) containing encrypted receipt information on a label attached to a package, and verifies the information with a server to ensure accurate delivery address confirmation and prevent leakage of personal information. The terminal reads the QR code upon receipt and transmits it to the server. The server verifies the delivery information based on this data and approves the legitimacy of the receipt. Information on completed receipts is stored in the terminal and can be referenced as a history as needed.
[0006] A "package label" is a piece of paper or sheet attached to a package containing information, and generally indicates the recipient's address and name.
[0007] "Distribution destination information" refers to information about the place or recipient where the delivered item should be received, and includes data that can identify the recipient, such as address and name.
[0008] "Encryption" is a technology that converts information into a special format so that it cannot be understood by third parties, and is a method used to protect data and ensure privacy.
[0009] A "QR code" is a special type of barcode that records information in a grid pattern in two dimensions, and can be easily read by a camera-equipped device.
[0010] A "server system" refers to a computer system or network service that performs information processing and is responsible for managing and processing data.
[0011] "Terminal means" refers to devices such as computers and smart devices that perform input and display, and is a combination of hardware and software that users can directly operate.
[0012] "Verifying data" refers to the process of comparing the provided information with other data to determine its accuracy and consistency.
[0013] "Verification" is the process of comparing two or more data sets to determine if they match, and is primarily performed to verify the validity of the data.
[0014] "Saving history" means keeping a record of past data and operations so that they can be referenced or analyzed at a later date. [Brief explanation of the drawing]
[0015] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.
Mode for Carrying Out the Invention
[0016] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.
[0017] First, the terms used in the following description will be explained.
[0018] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.
[0019] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.
[0020] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined. In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.
[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).
[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0023] [First Embodiment]
[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0036] This invention provides a device and method for a parcel delivery system that ensures accurate delivery while preventing the leakage of recipients' personal information. Specifically, each parcel is affixed with a label using an individual QR code, and the recipient's information is encrypted within this QR code. The system is implemented using three main components: a server, a terminal, and a user.
[0037] server
[0038] The server generates an encrypted QR code based on the order information. This QR code is printed as a shipping label on the package and used by the delivery company. The server also manages status information from the delivery company and updates it in real time, allowing for tracking of the delivery status. When the recipient scans the QR code, the server receives the data and performs verification and matching.
[0039] terminal
[0040] The terminal is the user's smartphone or tablet, with a dedicated application installed. When receiving a package, the recipient uses the terminal to scan the QR code on the label. The scanned information is sent to a server and verified against the delivery information. The result is sent back to the terminal, and once the legitimate receipt is confirmed, a receipt completion message is displayed on the terminal. In addition, the receipt history is saved in the app and can be referenced at a later date.
[0041] User
[0042] The user is the one receiving the package through the system, operating a terminal to scan a QR code. By scanning the QR code, the user can instantly confirm whether the package they are receiving has arrived correctly. As a result, security is improved and the risk of personal information leakage is reduced.
[0043] As a concrete example, when a user orders a product from an online shop and a shipping instruction is received by the server, the server generates a QR code and attaches this code as a label to the package. When the delivery person delivers the package to the specified address, the recipient (the user) scans the QR code with their device and communicates with the server to confirm that the package has been received correctly. This creates a system that reduces the risk of delivery errors and information leaks.
[0044] The following describes the processing flow.
[0045] Step 1:
[0046] The server receives order information from the user. This order information includes details about the recipient, such as the delivery address.
[0047] Step 2:
[0048] The server generates a unique QR code based on the received order information. This QR code contains encrypted recipient information.
[0049] Step 3:
[0050] The server converts the generated QR code into a label, sends it to the printer as shipping label data, and the printed label is affixed to the package.
[0051] Step 4:
[0052] A delivery person delivers the package to the specified address. The user launches the app installed on their device when receiving the package.
[0053] Step 5:
[0054] The user's device uses its camera to scan the QR code attached to the package. This action reads the information contained in the QR code.
[0055] Step 6:
[0056] The device sends the QR code data obtained as a scan result to the server. The transmitted data includes encrypted recipient information.
[0057] Step 7:
[0058] The server searches the database based on the received data and compares it with the order information. If the information matches, the server verifies the legitimacy of the receipt.
[0059] Step 8:
[0060] The server sends a confirmation result to the device, and the device displays a notification to the user that the package has been received. This allows the user to confirm that the package has been delivered correctly.
[0061] Step 9:
[0062] The device saves information about successful receipt as a history within the system. Users can refer to this history within the app as needed.
[0063] This series of steps ensures efficient verification of the delivery address and protection of personal information during shipping.
[0064] (Example 1)
[0065] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0066] In recent years, the risk of personal information leakage during the delivery process has increased, while there is a growing demand for accurate and prompt delivery. Therefore, securely managing personal information during the delivery process while ensuring reliable delivery to recipients has become a crucial challenge. Furthermore, efficient tracking of delivery information and delivery confirmation processes are necessary to prevent delivery errors and fraudulent receipt.
[0067] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0068] In this invention, the server includes information processing means for encrypting and generating identification information of packages, information processing means for managing and updating the status of the delivery process, and information processing means for receiving identification information transmitted from the operating device and performing data verification and matching verification. This enables secure management of personal information, accurate package delivery, and efficient delivery tracking and receipt confirmation.
[0069] "Information processing means" refers to technical elements for encrypting package identification information, managing and updating the status of the delivery process, and verifying and matching information.
[0070] "Operating device" refers to a device used by the user to read and acquire identification information such as QR codes and to communicate with the server.
[0071] "Identification information" refers to information used to identify a package, and is generated by the server using encryption technology to protect personal information.
[0072] "Data verification" is the process by which the server verifies the validity of data based on identification information transmitted from the operating device.
[0073] "Match verification" refers to the process of comparing the identification information received by the server with the registered data to confirm whether the information matches.
[0074] "Delivery status" refers to information indicating each stage a package is in from preparation for delivery to receipt.
[0075] "Receipt history" refers to a list of information about packages previously received, which can be recorded and viewed by the user on the operating device.
[0076] This invention aims to achieve a high level of personal information protection and efficiency in delivery systems. Specific embodiments for carrying out the invention are described below.
[0077] server
[0078] Upon receiving a package order, the server automatically encrypts the personal information and generates a QR code. This encryption can utilize strong algorithms such as AES-256. The generated QR code is printed as a physical label and attached to the package. The server also manages status information from the delivery company in real time, updating this data to provide a centralized overview of the delivery process.
[0079] terminal
[0080] The terminal is a smartphone or tablet used by the user, with a dedicated application installed. This application uses the camera function to scan QR codes and sends the data directly to the server. The scanned QR code information is encrypted, ensuring security. The received QR code information is verified on the server, and based on the result, a notification of receipt completion is displayed on the terminal. The terminal also has a function to save the receipt history, making it easy to refer to past transactions.
[0081] User
[0082] The user takes on the role of ensuring the package is received correctly by operating a terminal and scanning a QR code. This allows the user to instantly verify whether the package they ordered has arrived properly. This prevents delivery errors and fraudulent receipt, and minimizes the risk of personal information leakage.
[0083] Specific example
[0084] For example, when a user orders a product from an online shop, the server generates a QR code based on that information and attaches it to the shipping label. When the delivery person delivers the package to the specified address, the recipient (the user) scans the QR code using a smartphone app. The server receives and verifies this data, and if it confirms that the user is the legitimate recipient, it sends a completion notification.
[0085] Example of a prompt
[0086] "Please explain how this package delivery system uses QR codes to protect recipient information."
[0087] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0088] Step 1:
[0089] The server receives order information from users via online shopping sites as input. This order information includes the recipient's personal information and shipping address. Based on the received information, the server encrypts the personal information and generates a QR code containing it. This QR code is converted into a label and output to the shipping company in a printed form. Specifically, the information is protected using the AES-256 encryption algorithm, and a QR code generator is used to create a visual code.
[0090] Step 2:
[0091] The server receives status information from the delivery company as input during the delivery process and manages and updates the delivery status in real time. Status information includes shipped, in transit, delivered, etc. This allows the server to understand the progress of the delivery and prepare to notify the user as needed. At this stage, a delivery management system is used, and a database is utilized for updating information.
[0092] Step 3:
[0093] When receiving a package, the user launches the terminal app and scans the printed QR code using the camera function. This process captures the QR code as input and sends the encrypted data to the server. The scanned data is immediately transferred to the server.
[0094] Step 4:
[0095] The server receives QR code information transmitted from the terminal as input and compares it with delivery information in the company's database. Specifically, it decrypts the encrypted delivery information based on the identification information extracted from the QR code and compares it with existing data. If a match is found, the server determines that the delivery is legitimate and outputs the result.
[0096] Step 5:
[0097] Based on the results received from the server, the device sends a notification to the user confirming receipt. The app updates the receipt history and records this information. This allows the user to review past transactions at any time. This process utilizes the device's data storage capabilities.
[0098] (Application Example 1)
[0099] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0100] In logistics and delivery processes, there is a need to improve the efficiency of delivery operations while enhancing package identification and security. Furthermore, there is a demand for systems that prevent the leakage of recipients' personal information and ensure accurate delivery. In addition, there is a need for systems that enable smart delivery management by utilizing augmented reality technology to visually manage the location of items and facilitating integration with generative AI models.
[0101] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0102] In this invention, the server includes an information processing device that encrypts and generates identification information of packages, a portable information terminal device equipped with an optical scanning device for reading the identification information, and an information processing device that confirms the content of the identification information transmitted from the portable information terminal device and performs a matching operation. This improves the efficiency of the delivery process, reduces misdelivery of packages, and prevents the leakage of recipients' personal information. Furthermore, by utilizing augmented reality technology to visually display the location information of items in real time and enabling cooperation with a generating AI model, the accuracy and efficiency of delivery management are further enhanced.
[0103] "Package identification information" refers to information used to identify and track individual packages, and is encrypted and represented as a QR code or similar.
[0104] An "information processing device" is a device that receives, processes, and outputs data, and plays a central role in logistics and delivery processes.
[0105] An "optical scanning device" is a device that uses light to read QR codes and other identifiers and convert them into digital information.
[0106] A "portable information terminal device" is a portable electronic device equipped with functions for scanning and sending and receiving information.
[0107] Augmented reality technology is a technology that enhances the visual experience by overlaying digital information onto the real-world environment.
[0108] A "generative AI model" is an artificial intelligence algorithm model designed to generate new information or results based on given data.
[0109] A system for carrying out this invention includes an information processing device for encrypting and storing package identification information, a portable information terminal device equipped with an optical scanning device for reading the identification information, and a method for verifying the information. The server generates package identification information based on the order and delivery instructions, encrypts it as a QR code, and makes it into a label. The QR code is used at each stage of delivery and is particularly important for recipient verification.
[0110] The device, specifically a smartphone or smart glasses, is equipped with an optical scanning device for reading QR codes. The scanned data is sent to a server, where it is decrypted and then compared with delivery information. The server then accurately checks the delivery status and, if necessary, sends that information to the device in real time.
[0111] Users can verify that their package is correct by scanning a QR code with their mobile device upon arrival. This process saves the delivery history to the device and improves transparency and security in the delivery process.
[0112] Furthermore, by using augmented reality technology, the location information of packages within the logistics center and at the pickup location can be visually displayed. This makes it easy for users to understand the current location and status of their packages.
[0113] Furthermore, by inputting data into generative AI models, it is possible to improve delivery processes and enhance prediction intelligence. For example, real-time data could be used to suggest routes in order to optimize the movement of delivery personnel. By combining these technologies, the overall efficiency of logistics monitoring and management can be increased.
[0114] As a concrete example, imagine a scenario where a worker at a logistics center scans a QR code with an eyewear device, and the message "New arrival: Ready for shipment" is displayed. From there, the worker can accurately guide the package to its designated shipping location based on AI recommendations.
[0115] Example of a prompt:
[0116] "Please describe the app's workflow for scanning a QR code, displaying the delivery status, and allowing users to confirm receipt and save the delivery history."
[0117] In this way, the present invention enables significant improvements in both efficiency and security in a variety of logistics and delivery scenarios.
[0118] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0119] Step 1:
[0120] The server receives order information and generates identification information for the package. This identification information is encrypted and printed as a QR code on the label. The input is order information, and the output is a QR code. The server checks the corresponding shipping instructions and encrypts the information using its own algorithm.
[0121] Step 2:
[0122] The terminal scans the QR code. The input is the QR code on the label, and the output is the data content of the QR code. The terminal uses an optical scanner to read the information and prepares to send the data to the server.
[0123] Step 3:
[0124] The server decrypts the QR code data received from the terminal and verifies it against the delivery information. The input is the scanned data, and the output is the verification result. The server refers to the database to confirm that the decrypted information is correct and updates the delivery status.
[0125] Step 4:
[0126] The terminal receives the matching results from the server and displays the delivery status to the user. The input is the matching results from the server, and the output is the delivery status displayed on the terminal screen. The terminal utilizes notification functions to provide the user with visual and audible alerts.
[0127] Step 5:
[0128] By scanning a QR code with their device, users can confirm that they have received their package correctly, and this information is saved as part of their history. The input at this time is an action to confirm receipt, and the output is the updated receipt history. The device records this operation in a history database and saves it in a format that can be referenced later.
[0129] Step 6:
[0130] Augmented reality technology is used to visualize the location information of luggage. Users can use their devices to check the location of luggage in their surroundings. The input for this step is location data, and the output is visual information on an AR display. The device drives the AR engine and displays the information overlaid on the camera view.
[0131] Step 7:
[0132] The server inputs delivery data into a generated AI model, which then proposes the optimal delivery route and schedule. The input is real-time delivery data, and the output is an optimized delivery plan. The server uses an AI algorithm to analyze the data and generate a plan to propose to the delivery personnel.
[0133] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0134] This invention relates to a system that combines emotion recognition functionality with the receiving procedure in package delivery. The system consists of a server, a terminal, and a user, with the terminal incorporating an emotion engine. This aims to improve not only the package receiving procedure but also the overall customer experience. A detailed embodiment of this system is described below.
[0135] server
[0136] The server receives order information and generates individually encrypted QR codes, which are used as package labels. The server also manages delivery status and allows for real-time information updates. Furthermore, it receives data from QR codes sent from terminals to verify the legitimacy of receipt. The server also updates and manages a database that integrates emotional information.
[0137] terminal
[0138] The device is the recipient user's smartphone or tablet, which has an application with a built-in emotion engine installed. The device scans the QR code on the label with its camera and sends the information to the server. At this time, the emotion engine analyzes emotion data from the user's facial expressions and voice and sends this along with the receipt information to the server.
[0139] User
[0140] Users use a terminal to complete the package pickup process. By scanning a QR code using the terminal's camera upon pickup, the system not only receives the package but also reflects the user's emotions at that time. For example, if a user is dissatisfied with the delivery, the system can sense that emotion and use it to improve future services.
[0141] As a concrete example, when a user orders a product from an online shopping site and it is shipped, the server generates a QR code to be used as the package label. When the user receives the package, they scan the QR code using a device, and the emotional data from that scan is also analyzed by the device's emotion engine. This information is then sent to the server to verify that the order information matches. The receipt information and emotional data are recorded and used for customer support as needed.
[0142] This system allows us to simultaneously improve delivery services, protect personal information, and enhance the quality of the customer experience.
[0143] The following describes the processing flow.
[0144] Step 1:
[0145] The server receives user order information from online shops. This includes basic information such as the shipping address.
[0146] Step 2:
[0147] The server generates an encrypted QR code based on the received shipping address information. This QR code is used as a shipping label and affixed to the package.
[0148] Step 3:
[0149] The delivery person delivers the package to its destination. The user uses a terminal to prepare to receive the package.
[0150] Step 4:
[0151] The user's device launches the app and scans the QR code printed on the package label using its camera function. At this stage, the emotion engine built into the device simultaneously captures the user's facial expressions and voice.
[0152] Step 5:
[0153] The device sends the scanned QR code data and the emotion data acquired by the emotion engine to the server.
[0154] Step 6:
[0155] The server compares the received QR code data with the order information in the database to check if they match.
[0156] Step 7:
[0157] The server sends the matching results back to the terminal. If a match is confirmed, the server notifies the terminal of its acceptance and records a new set of information, including sentiment data, in the database.
[0158] Step 8:
[0159] The device notifies the user that the receipt has been approved. A delivery completion message is displayed on the screen. Additionally, sentiment data associated with the receipt event is saved for later reference.
[0160] Step 9:
[0161] Sentimental data from users who have problems or complaints is stored on the server and may be used to improve future services. This will improve the overall delivery service.
[0162] (Example 2)
[0163] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0164] Traditional parcel delivery systems struggled to simultaneously verify the legitimacy of the receiving process and improve customer satisfaction. Furthermore, effectively utilizing customer emotional information to enhance services was difficult. As a result, the collection of feedback for improving the quality of the customer experience and services was insufficient.
[0165] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0166] In this invention, the server includes information processing means for generating a code on a package label that encrypts the recipient information and delivery information; terminal means for identifying the code and analyzing image and audio data to acquire emotional information; and information processing means for integrating the code and emotional data transmitted from the terminal means and performing a matching operation. This makes it possible to simultaneously achieve accurate confirmation of the receiving procedure and utilization of customer emotional information, thereby improving the quality of delivery services.
[0167] "Information processing means" refers to a technological configuration that handles digital data and performs calculations and operations necessary to achieve a specific purpose or function.
[0168] "Terminal means" refers to electronic devices that allow users to directly operate and input / output information.
[0169] A "code" is a set of symbols or digital information used to encrypt or encode and display specific information.
[0170] "Emotional information" refers to numerical data or data that indicates an emotional state, analyzed based on the user's facial expressions and voice data.
[0171] A "database" is a collection of digital information that enables the systematic and efficient organization, storage, retrieval, and management of information.
[0172] The following describes embodiments for carrying out the invention.
[0173] The system of this invention consists primarily of a server, a terminal, and a user. A particularly important technology is that the server uses information processing means to oversee the cargo delivery process. Specifically, it receives order information and generates encrypted codes containing delivery and distribution information. This code generation is performed by executing a programmed algorithm within the server.
[0174] Meanwhile, the device functions as the user's smartphone or tablet and is equipped with a dedicated application. This device uses hardware such as a camera and microphone to scan codes and acquire emotional information. The emotional information is analyzed by a built-in emotion engine, and the user's emotional state is determined from facial expression and voice data. The acquired input data is also immediately transmitted to the server.
[0175] During the pickup process, users use a terminal to scan a code on the label of their delivered package. This integrates delivery information and sentiment data with a server. The server then verifies the accuracy of the delivery and records the sentiment information in a database. This information is used to analyze and improve the customer experience, contributing to service enhancement.
[0176] As a concrete example, consider a case where a user purchases an item on an online marketplace. At this time, the server generates a code related to the item, and the shipping process begins. When the package arrives, the user scans the code with their device, and emotional information is also analyzed. This allows for feedback on the quality of the shipping service.
[0177] As an example of a prompt, it is possible to request the generative AI model to "suggest service improvement ideas based on the user's emotional data recorded in the system when receiving a package." In this way, the entire system works together to proactively improve the customer experience.
[0178] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0179] Step 1:
[0180] The server receives the user's order information. This input includes the product name, quantity, and shipping address. Based on this, the server generates an encrypted code. The generated code is output in digital format for printing on the shipping label.
[0181] Step 2:
[0182] The server manages delivery status and updates related information in real time. It receives status update information from delivery companies as input. The server processes this information and outputs the delivery progress (e.g., "Preparing for Shipment," "In Transit," "Delivered"), notifying the user as needed.
[0183] Step 3:
[0184] When receiving a package, the user uses a terminal to scan a code printed on the label with its camera. The input is visual information captured through the camera. The terminal converts this data into a code and sends it to the server. The output is the identified code information.
[0185] Step 4:
[0186] The device activates its built-in emotion engine to acquire emotion data from the user's facial expressions and voice. Input includes data from the user's facial expressions and voice obtained via the camera and microphone. This data is analyzed by the emotion engine and converted into emotion information. This converted emotion information is then prepared as output data for transmission to the server.
[0187] Step 5:
[0188] The server receives codes and sentiment data transmitted from the terminal. These data are the inputs, and the server compares the code information with the order information to verify the legitimacy of the receipt. This process results in the output of integrated receipt confirmation information and sentiment information, which is recorded on the server side.
[0189] Step 6:
[0190] The server inputs recorded emotional information into a generative AI model, attempting to gain insights for service improvement. The input data consists of accumulated customer emotional profiles. The generative AI model analyzes this data and outputs specific improvement measures and suggestions. This output is used in future service improvement plans.
[0191] (Application Example 2)
[0192] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".
[0193] Traditional parcel delivery systems have the problem of difficulty in accurately assessing customer satisfaction at the time of delivery. In particular, there is a need to analyze customer emotions at the time of delivery in real time and use this information to improve services, but this is currently difficult to achieve.
[0194] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0195] In this invention, the server includes a computing device that generates a code encrypting the destination information on the package label, an information terminal equipped with a reader for identifying the code, a computing device that checks the code data and performs verification work, an emotion analysis engine that analyzes the emotions at the time of receipt, and means for integrating the emotion data into a database. This makes it possible to have a system that can analyze the customer's emotions at the time of receipt in real time and use it to improve services.
[0196] A "package" refers to an object, such as a product or item, that is to be delivered to a consumer.
[0197] A "label" is an information sheet or sticker attached to a package, which includes delivery address information and identification codes.
[0198] "Recipient information" refers to data that shows the location and address of the recipient to whom the package should be delivered.
[0199] "Encryption" is a technology that transforms data into a different format based on certain rules to ensure the confidentiality of information.
[0200] "Code" refers to symbols used to represent information, in this context, to formats such as QR codes.
[0201] A "processing unit" is a device that has data processing and calculation functions, such as a server.
[0202] A "reader" refers to a device used to read codes or information optically or electronically.
[0203] An "information terminal" is an electronic device operated by a user, and primarily includes smartphones and tablets.
[0204] An "emotion analysis engine" is software or a system that analyzes a user's emotional state from their facial expressions and voice.
[0205] A "database" is a digital system designed for the efficient storage and retrieval of information.
[0206] This system combines emotion recognition with the process of receiving delivered goods to improve the customer experience in delivery services. An embodiment of this system is described below.
[0207] The server receives order information and generates an encrypted code containing delivery information based on it. This code is affixed as a package label. The server also manages the delivery status and has the ability to update information in real time. Furthermore, the server receives code data and sentiment data transmitted from information terminals and integrates them into a database.
[0208] The information terminal is the recipient's smartphone or tablet. This terminal has an application installed that incorporates an emotion analysis engine. It uses the terminal's camera to scan a code and sends the resulting information to the server. Simultaneously, the emotion analysis engine analyzes the user's facial expressions and voice, generating and transmitting emotion data.
[0209] Users receive their packages using their own information terminals. When receiving a package, they scan a code with the terminal's camera, and the emotions expressed at that time are also reflected in the system. For example, if a user expresses dissatisfaction because the delivery time was inappropriate, the emotion analysis engine will detect this and use it to improve future services.
[0210] As a concrete example, suppose a user places an order through online shopping and the goods are delivered. The server generates a code based on the order details and attaches it as a label to the package. When the user receives the package, they scan the code using an information terminal, and emotional data is also analyzed. This information is sent to the server to verify the legitimacy of the delivery, and the emotional data is recorded in a database to help improve the quality of service.
[0211] An example of a prompt to input into a generative AI model is: "My application analyzes emotional data when a user scans a QR code upon receiving their food. How can I improve the quality of the delivery experience by analyzing emotional information obtained from facial expressions and voice in real time?"
[0212] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0213] Step 1:
[0214] The server receives the user's order information. The input is the order information submitted by the user, and based on this, the server encrypts the distribution information and generates a code. The generated code is printed on a label as output and attached to the product. The server records this information in a database and prepares for delivery status management.
[0215] Step 2:
[0216] After delivery, when the user receives the package, they use their personal information terminal to scan the code attached to the label with their camera. The input is the code recognized by the camera, and the output is the data of the scanned code. The terminal's application sends this data to the server.
[0217] Step 3:
[0218] Simultaneously, the information terminal uses its built-in emotion analysis engine to analyze the user's facial expressions and voice. The input is the user's facial image and voice data, and the analyzed emotion data is output. This emotion data is also sent to the server.
[0219] Step 4:
[0220] The server receives code data transmitted from the information terminal. The input consists of scanned code data and sentiment data. Based on this, the server compares it with existing order information and verifies the match. Once the matching is complete, it sends an output confirming the legitimacy of the receipt to the information terminal.
[0221] Step 5:
[0222] The server also receives emotional data and integrates it into the database. The input is emotional data sent from the emotional analysis engine. This allows for the accumulation of data indicating customer satisfaction, resulting in output that provides insights for service improvement. The data is also used as prompts for subsequent generative AI models.
[0223] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0224] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0225] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0226] [Second Embodiment]
[0227] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0228] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0229] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0230] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0231] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0232] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0233] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0234] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0235] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0236] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0237] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0238] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0239] This invention provides a device and method for a parcel delivery system that ensures accurate delivery while preventing the leakage of recipients' personal information. Specifically, each parcel is affixed with a label using an individual QR code, and the recipient's information is encrypted within this QR code. The system is implemented using three main components: a server, a terminal, and a user.
[0240] server
[0241] The server generates an encrypted QR code based on the order information. This QR code is printed as a shipping label on the package and used by the delivery company. The server also manages status information from the delivery company and updates it in real time, allowing for tracking of the delivery status. When the recipient scans the QR code, the server receives the data and performs verification and matching.
[0242] terminal
[0243] The terminal is the user's smartphone or tablet, with a dedicated application installed. When receiving a package, the recipient uses the terminal to scan the QR code on the label. The scanned information is sent to a server and verified against the delivery information. The result is sent back to the terminal, and once the legitimate receipt is confirmed, a receipt completion message is displayed on the terminal. In addition, the receipt history is saved in the app and can be referenced at a later date.
[0244] User
[0245] The user is the one receiving the package through the system, operating a terminal to scan a QR code. By scanning the QR code, the user can instantly confirm whether the package they are receiving has arrived correctly. As a result, security is improved and the risk of personal information leakage is reduced.
[0246] As a concrete example, when a user orders a product from an online shop and a shipping instruction is received by the server, the server generates a QR code and attaches this code as a label to the package. When the delivery person delivers the package to the specified address, the recipient (the user) scans the QR code with their device and communicates with the server to confirm that the package has been received correctly. This creates a system that reduces the risk of delivery errors and information leaks.
[0247] The following describes the processing flow.
[0248] Step 1:
[0249] The server receives order information from the user. This order information includes details about the recipient, such as the delivery address.
[0250] Step 2:
[0251] The server generates a unique QR code based on the received order information. This QR code contains encrypted recipient information.
[0252] Step 3:
[0253] The server converts the generated QR code into a label, sends it to the printer as shipping label data, and the printed label is affixed to the package.
[0254] Step 4:
[0255] A delivery person delivers the package to the specified address. The user launches the app installed on their device when receiving the package.
[0256] Step 5:
[0257] The user's device uses its camera to scan the QR code attached to the package. This action reads the information contained in the QR code.
[0258] Step 6:
[0259] The device sends the QR code data obtained as a scan result to the server. The transmitted data includes encrypted recipient information.
[0260] Step 7:
[0261] The server searches the database based on the received data and compares it with the order information. If the information matches, the server verifies the legitimacy of the receipt.
[0262] Step 8:
[0263] The server sends a confirmation result to the device, and the device displays a notification to the user that the package has been received. This allows the user to confirm that the package has been delivered correctly.
[0264] Step 9:
[0265] The device saves information about successful receipt as a history within the system. Users can refer to this history within the app as needed.
[0266] This series of steps ensures efficient verification of the delivery address and protection of personal information during shipping.
[0267] (Example 1)
[0268] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0269] In recent years, the risk of personal information leakage during the delivery process has increased, while there is a growing demand for accurate and prompt delivery. Therefore, securely managing personal information during the delivery process while ensuring reliable delivery to recipients has become a crucial challenge. Furthermore, efficient tracking of delivery information and delivery confirmation processes are necessary to prevent delivery errors and fraudulent receipt.
[0270] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0271] In this invention, the server includes information processing means for encrypting and generating identification information of packages, information processing means for managing and updating the status of the delivery process, and information processing means for receiving identification information transmitted from the operating device and performing data verification and matching verification. This enables secure management of personal information, accurate package delivery, and efficient delivery tracking and receipt confirmation.
[0272] "Information processing means" refers to technical elements for encrypting package identification information, managing and updating the status of the delivery process, and verifying and matching information.
[0273] "Operating device" refers to a device used by the user to read and acquire identification information such as QR codes and to communicate with the server.
[0274] "Identification information" refers to information used to identify a package, and is generated by the server using encryption technology to protect personal information.
[0275] "Data verification" is the process by which the server verifies the validity of data based on identification information transmitted from the operating device.
[0276] "Match verification" refers to the process of comparing the identification information received by the server with the registered data to confirm whether the information matches.
[0277] "Delivery status" refers to information indicating each stage a package is in from preparation for delivery to receipt.
[0278] "Receipt history" refers to a list of information about packages previously received, which can be recorded and viewed by the user on the operating device.
[0279] This invention aims to achieve a high level of personal information protection and efficiency in delivery systems. Specific embodiments for carrying out the invention are described below.
[0280] server
[0281] When the server receives the order information of the package, it automatically encrypts the personal information and generates a QR code. For this encryption, a strong encryption algorithm such as AES-256 can be used. The generated QR code is printed as a physical label and attached to the package. The server also manages the status information from the delivery company in real time and plays a role in comprehensively grasping the situation during the delivery process by updating the data.
[0282] Terminal
[0283] The terminal is a smartphone or tablet used by the user, and a dedicated application is installed. This application utilizes the camera function to scan the QR code and directly transmits the data to the server. Since the scanned QR code information is encrypted, security is ensured. The received QR code information is verified by the server, and a receipt completion notification is displayed on the terminal based on the result. Also, the terminal has a function to save the receipt history, enabling easy reference to past transactions.
[0284] User
[0285] The user is responsible for ensuring that the package is accurately received and operates the terminal to scan the QR code. This allows the user to immediately confirm whether the package they ordered has arrived properly. This prevents delivery errors and unauthorized receipt and minimizes the risk of personal information leakage.
[0286] Specific Example
[0287] For example, when a user places an order for a product on an online store, the server generates a QR code based on that information and attaches it to the invoice. When the delivery person delivers the package to the specified address, the user, who is the recipient, scans the QR code using the application on the smartphone. The server receives and verifies this data and sends a completion notification if it confirms that the user is a legitimate recipient.
[0288] Example of a prompt
[0289] "Please explain how this package delivery system uses QR codes to protect recipient information."
[0290] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0291] Step 1:
[0292] The server receives order information from users via online shopping sites as input. This order information includes the recipient's personal information and shipping address. Based on the received information, the server encrypts the personal information and generates a QR code containing it. This QR code is converted into a label and output to the shipping company in a printed form. Specifically, the information is protected using the AES-256 encryption algorithm, and a QR code generator is used to create a visual code.
[0293] Step 2:
[0294] The server receives status information from the delivery company as input during the delivery process and manages and updates the delivery status in real time. Status information includes shipped, in transit, delivered, etc. This allows the server to understand the progress of the delivery and prepare to notify the user as needed. At this stage, a delivery management system is used, and a database is utilized for updating information.
[0295] Step 3:
[0296] When receiving a package, the user launches the terminal app and scans the printed QR code using the camera function. This process captures the QR code as input and sends the encrypted data to the server. The scanned data is immediately transferred to the server.
[0297] Step 4:
[0298] The server receives QR code information transmitted from the terminal as input and compares it with delivery information in the company's database. Specifically, it decrypts the encrypted delivery information based on the identification information extracted from the QR code and compares it with existing data. If a match is found, the server determines that the delivery is legitimate and outputs the result.
[0299] Step 5:
[0300] Based on the results received from the server, the device sends a notification to the user confirming receipt. The app updates the receipt history and records this information. This allows the user to review past transactions at any time. This process utilizes the device's data storage capabilities.
[0301] (Application Example 1)
[0302] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0303] In logistics and delivery processes, there is a need to improve the efficiency of delivery operations while enhancing package identification and security. Furthermore, there is a demand for systems that prevent the leakage of recipients' personal information and ensure accurate delivery. In addition, there is a need for systems that enable smart delivery management by utilizing augmented reality technology to visually manage the location of items and facilitating integration with generative AI models.
[0304] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0305] In this invention, the server includes an information processing device that encrypts and generates identification information of a package, a portable information terminal device equipped with an optical scanning device for reading the identification information, and an information processing device that checks the content of the identification information transmitted from the portable information terminal device and performs verification operations. As a result, the efficiency of the delivery process is improved, misdelivery of packages is reduced, and leakage of personal information of the recipient can be prevented. In addition, by utilizing augmented reality technology to visually present the location information of an item in real time and enabling cooperation with a generative AI model, the accuracy and efficiency of delivery management can be further enhanced.
[0306] The "identification information of a package" is information used to identify and track individual packages, which is encrypted and represented by a QR code or the like.
[0307] An "information processing device" is a device that receives, processes data, and performs specific outputs, and plays a central role in the process of logistics and delivery.
[0308] An "optical scanning device" is a device that uses light to read a QR code or other identifier and convert it into digital information.
[0309] A "portable information terminal device" is a portable electronic device equipped with functions for scanning and transmitting / receiving information.
[0310] "Augmented reality technology" is a technology that overlays and displays digital information based on the real-world environment to expand the experience of visual information.
[0311] A "generative AI model" is an artificial intelligence algorithm model designed to generate new information and results based on given data.
[0312] A system for carrying out this invention includes an information processing device for encrypting and storing package identification information, a portable information terminal device equipped with an optical scanning device for reading the identification information, and a method for verifying the information. The server generates package identification information based on the order and delivery instructions, encrypts it as a QR code, and makes it into a label. The QR code is used at each stage of delivery and is particularly important for recipient verification.
[0313] The device, specifically a smartphone or smart glasses, is equipped with an optical scanning device for reading QR codes. The scanned data is sent to a server, where it is decrypted and then compared with delivery information. The server then accurately checks the delivery status and, if necessary, sends that information to the device in real time.
[0314] Users can verify that their package is correct by scanning a QR code with their mobile device upon arrival. This process saves the delivery history to the device and improves transparency and security in the delivery process.
[0315] Furthermore, by using augmented reality technology, the location information of packages within the logistics center and at the pickup location can be visually displayed. This makes it easy for users to understand the current location and status of their packages.
[0316] Furthermore, by inputting data into generative AI models, it is possible to improve delivery processes and enhance prediction intelligence. For example, real-time data could be used to suggest routes in order to optimize the movement of delivery personnel. By combining these technologies, the overall efficiency of logistics monitoring and management can be increased.
[0317] As a concrete example, imagine a scenario where a worker at a logistics center scans a QR code with an eyewear device, and the message "New arrival: Ready for shipment" is displayed. From there, the worker can accurately guide the package to its designated shipping location based on AI recommendations.
[0318] Example of a prompt:
[0319] "Please describe the app's workflow for scanning a QR code, displaying the delivery status, and allowing users to confirm receipt and save the delivery history."
[0320] In this way, the present invention enables significant improvements in both efficiency and security in a variety of logistics and delivery scenarios.
[0321] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0322] Step 1:
[0323] The server receives order information and generates identification information for the package. This identification information is encrypted and printed as a QR code on the label. The input is order information, and the output is a QR code. The server checks the corresponding shipping instructions and encrypts the information using its own algorithm.
[0324] Step 2:
[0325] The terminal scans the QR code. The input is the QR code on the label, and the output is the data content of the QR code. The terminal uses an optical scanner to read the information and prepares to send the data to the server.
[0326] Step 3:
[0327] The server decrypts the QR code data received from the terminal and verifies it against the delivery information. The input is the scanned data, and the output is the verification result. The server refers to the database to confirm that the decrypted information is correct and updates the delivery status.
[0328] Step 4:
[0329] The terminal receives the matching results from the server and displays the delivery status to the user. The input is the matching results from the server, and the output is the delivery status displayed on the terminal screen. The terminal utilizes notification functions to provide the user with visual and audible alerts.
[0330] Step 5:
[0331] By scanning a QR code with their device, users can confirm that they have received their package correctly, and this information is saved as part of their history. The input at this time is an action to confirm receipt, and the output is the updated receipt history. The device records this operation in a history database and saves it in a format that can be referenced later.
[0332] Step 6:
[0333] Augmented reality technology is used to visualize the location information of luggage. Users can use their devices to check the location of luggage in their surroundings. The input for this step is location data, and the output is visual information on an AR display. The device drives the AR engine and displays the information overlaid on the camera view.
[0334] Step 7:
[0335] The server inputs delivery data into a generated AI model, which then proposes the optimal delivery route and schedule. The input is real-time delivery data, and the output is an optimized delivery plan. The server uses an AI algorithm to analyze the data and generate a plan to propose to the delivery personnel.
[0336] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0337] This invention relates to a system that combines emotion recognition functionality with the receiving procedure in package delivery. The system consists of a server, a terminal, and a user, with the terminal incorporating an emotion engine. This aims to improve not only the package receiving procedure but also the overall customer experience. A detailed embodiment of this system is described below.
[0338] server
[0339] The server receives order information and generates individually encrypted QR codes, which are used as package labels. The server also manages delivery status and allows for real-time information updates. Furthermore, it receives data from QR codes sent from terminals to verify the legitimacy of receipt. The server also updates and manages a database that integrates emotional information.
[0340] terminal
[0341] The device is the recipient user's smartphone or tablet, which has an application with a built-in emotion engine installed. The device scans the QR code on the label with its camera and sends the information to the server. At this time, the emotion engine analyzes emotion data from the user's facial expressions and voice and sends this along with the receipt information to the server.
[0342] User
[0343] Users use a terminal to complete the package pickup process. By scanning a QR code using the terminal's camera upon pickup, the system not only receives the package but also reflects the user's emotions at that time. For example, if a user is dissatisfied with the delivery, the system can sense that emotion and use it to improve future services.
[0344] As a concrete example, when a user orders a product from an online shopping site and it is shipped, the server generates a QR code to be used as the package label. When the user receives the package, they scan the QR code using a device, and the emotional data from that scan is also analyzed by the device's emotion engine. This information is then sent to the server to verify that the order information matches. The receipt information and emotional data are recorded and used for customer support as needed.
[0345] This system allows us to simultaneously improve delivery services, protect personal information, and enhance the quality of the customer experience.
[0346] The following describes the processing flow.
[0347] Step 1:
[0348] The server receives user order information from online shops. This includes basic information such as the shipping address.
[0349] Step 2:
[0350] The server generates an encrypted QR code based on the received shipping address information. This QR code is used as a shipping label and affixed to the package.
[0351] Step 3:
[0352] The delivery person delivers the package to its destination. The user uses a terminal to prepare to receive the package.
[0353] Step 4:
[0354] The user's device launches the app and scans the QR code printed on the package label using its camera function. At this stage, the emotion engine built into the device simultaneously captures the user's facial expressions and voice.
[0355] Step 5:
[0356] The device sends the scanned QR code data and the emotion data acquired by the emotion engine to the server.
[0357] Step 6:
[0358] The server compares the received QR code data with the order information in the database to check if they match.
[0359] Step 7:
[0360] The server sends the matching results back to the terminal. If a match is confirmed, the server notifies the terminal of its acceptance and records a new set of information, including sentiment data, in the database.
[0361] Step 8:
[0362] The device notifies the user that the receipt has been approved. A delivery completion message is displayed on the screen. Additionally, sentiment data associated with the receipt event is saved for later reference.
[0363] Step 9:
[0364] Sentimental data from users who have problems or complaints is stored on the server and may be used to improve future services. This will improve the overall delivery service.
[0365] (Example 2)
[0366] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0367] Traditional parcel delivery systems struggled to simultaneously verify the legitimacy of the receiving process and improve customer satisfaction. Furthermore, effectively utilizing customer emotional information to enhance services was difficult. As a result, the collection of feedback for improving the quality of the customer experience and services was insufficient.
[0368] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0369] In this invention, the server includes information processing means for generating a code on a package label that encrypts the recipient information and delivery information; terminal means for identifying the code and analyzing image and audio data to acquire emotional information; and information processing means for integrating the code and emotional data transmitted from the terminal means and performing a matching operation. This makes it possible to simultaneously achieve accurate confirmation of the receiving procedure and utilization of customer emotional information, thereby improving the quality of delivery services.
[0370] "Information processing means" refers to a technological configuration that handles digital data and performs calculations and operations necessary to achieve a specific purpose or function.
[0371] "Terminal means" refers to electronic devices that allow users to directly operate and input / output information.
[0372] A "code" is a set of symbols or digital information used to encrypt or encode and display specific information.
[0373] "Emotional information" refers to numerical data or data that indicates an emotional state, analyzed based on the user's facial expressions and voice data.
[0374] A "database" is a collection of digital information that enables the systematic and efficient organization, storage, retrieval, and management of information.
[0375] The following describes embodiments for carrying out the invention.
[0376] The system of this invention consists primarily of a server, a terminal, and a user. A particularly important technology is that the server uses information processing means to oversee the cargo delivery process. Specifically, it receives order information and generates encrypted codes containing delivery and distribution information. This code generation is performed by executing a programmed algorithm within the server.
[0377] Meanwhile, the device functions as the user's smartphone or tablet and is equipped with a dedicated application. This device uses hardware such as a camera and microphone to scan codes and acquire emotional information. The emotional information is analyzed by a built-in emotion engine, and the user's emotional state is determined from facial expression and voice data. The acquired input data is also immediately transmitted to the server.
[0378] During the pickup process, users use a terminal to scan a code on the label of their delivered package. This integrates delivery information and sentiment data with a server. The server then verifies the accuracy of the delivery and records the sentiment information in a database. This information is used to analyze and improve the customer experience, contributing to service enhancement.
[0379] As a concrete example, consider a case where a user purchases an item on an online marketplace. At this time, the server generates a code related to the item, and the shipping process begins. When the package arrives, the user scans the code with their device, and emotional information is also analyzed. This allows for feedback on the quality of the shipping service.
[0380] As an example of a prompt, it is possible to request the generative AI model to "suggest service improvement ideas based on the user's emotional data recorded in the system when receiving a package." In this way, the entire system works together to proactively improve the customer experience.
[0381] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0382] Step 1:
[0383] The server receives the user's order information. This input includes the product name, quantity, and shipping address. Based on this, the server generates an encrypted code. The generated code is output in digital format for printing on the shipping label.
[0384] Step 2:
[0385] The server manages delivery status and updates related information in real time. It receives status update information from delivery companies as input. The server processes this information and outputs the delivery progress (e.g., "Preparing for Shipment," "In Transit," "Delivered"), notifying the user as needed.
[0386] Step 3:
[0387] When receiving a package, the user uses a terminal to scan a code printed on the label with its camera. The input is visual information captured through the camera. The terminal converts this data into a code and sends it to the server. The output is the identified code information.
[0388] Step 4:
[0389] The device activates its built-in emotion engine to acquire emotion data from the user's facial expressions and voice. Input includes data from the user's facial expressions and voice obtained via the camera and microphone. This data is analyzed by the emotion engine and converted into emotion information. This converted emotion information is then prepared as output data for transmission to the server.
[0390] Step 5:
[0391] The server receives codes and sentiment data transmitted from the terminal. These data are the inputs, and the server compares the code information with the order information to verify the legitimacy of the receipt. This process results in the output of integrated receipt confirmation information and sentiment information, which is recorded on the server side.
[0392] Step 6:
[0393] The server inputs recorded emotional information into a generative AI model, attempting to gain insights for service improvement. The input data consists of accumulated customer emotional profiles. The generative AI model analyzes this data and outputs specific improvement measures and suggestions. This output is used in future service improvement plans.
[0394] (Application Example 2)
[0395] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0396] Traditional parcel delivery systems have the problem of difficulty in accurately assessing customer satisfaction at the time of delivery. In particular, there is a need to analyze customer emotions at the time of delivery in real time and use this information to improve services, but this is currently difficult to achieve.
[0397] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0398] In this invention, the server includes a computing device that generates a code encrypting the destination information on the package label, an information terminal equipped with a reader for identifying the code, a computing device that checks the code data and performs verification work, an emotion analysis engine that analyzes the emotions at the time of receipt, and means for integrating the emotion data into a database. This makes it possible to have a system that can analyze the customer's emotions at the time of receipt in real time and use it to improve services.
[0399] A "package" refers to an object, such as a product or item, that is to be delivered to a consumer.
[0400] A "label" is an information sheet or sticker attached to a package, which includes delivery address information and identification codes.
[0401] "Recipient information" refers to data that shows the location and address of the recipient to whom the package should be delivered.
[0402] "Encryption" is a technology that transforms data into a different format based on certain rules to ensure the confidentiality of information.
[0403] "Code" refers to symbols used to represent information, in this context, to formats such as QR codes.
[0404] A "processing unit" is a device that has data processing and calculation functions, such as a server.
[0405] A "reader" refers to a device used to read codes or information optically or electronically.
[0406] An "information terminal" is an electronic device operated by a user, and primarily includes smartphones and tablets.
[0407] An "emotion analysis engine" is software or a system that analyzes a user's emotional state from their facial expressions and voice.
[0408] A "database" is a digital system designed for the efficient storage and retrieval of information.
[0409] This system combines emotion recognition with the process of receiving delivered goods to improve the customer experience in delivery services. An embodiment of this system is described below.
[0410] The server receives order information and generates an encrypted code containing delivery information based on it. This code is affixed as a package label. The server also manages the delivery status and has the ability to update information in real time. Furthermore, the server receives code data and sentiment data transmitted from information terminals and integrates them into a database.
[0411] The information terminal is the recipient's smartphone or tablet. This terminal has an application installed that incorporates an emotion analysis engine. It uses the terminal's camera to scan a code and sends the resulting information to the server. Simultaneously, the emotion analysis engine analyzes the user's facial expressions and voice, generating and transmitting emotion data.
[0412] Users receive their packages using their own information terminals. When receiving a package, they scan a code with the terminal's camera, and the emotions expressed at that time are also reflected in the system. For example, if a user expresses dissatisfaction because the delivery time was inappropriate, the emotion analysis engine will detect this and use it to improve future services.
[0413] As a concrete example, suppose a user places an order through online shopping and the goods are delivered. The server generates a code based on the order details and attaches it as a label to the package. When the user receives the package, they scan the code using an information terminal, and emotional data is also analyzed. This information is sent to the server to verify the legitimacy of the delivery, and the emotional data is recorded in a database to help improve the quality of service.
[0414] An example of a prompt to input into a generative AI model is: "My application analyzes emotional data when a user scans a QR code upon receiving their food. How can I improve the quality of the delivery experience by analyzing emotional information obtained from facial expressions and voice in real time?"
[0415] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0416] Step 1:
[0417] The server receives the user's order information. The input is the order information submitted by the user, and based on this, the server encrypts the distribution information and generates a code. The generated code is printed on a label as output and attached to the product. The server records this information in a database and prepares for delivery status management.
[0418] Step 2:
[0419] After delivery, when the user receives the package, they use their personal information terminal to scan the code attached to the label with their camera. The input is the code recognized by the camera, and the output is the data of the scanned code. The terminal's application sends this data to the server.
[0420] Step 3:
[0421] Simultaneously, the information terminal uses its built-in emotion analysis engine to analyze the user's facial expressions and voice. The input is the user's facial image and voice data, and the analyzed emotion data is output. This emotion data is also sent to the server.
[0422] Step 4:
[0423] The server receives code data transmitted from the information terminal. The input consists of scanned code data and sentiment data. Based on this, the server compares it with existing order information and verifies the match. Once the matching is complete, it sends an output confirming the legitimacy of the receipt to the information terminal.
[0424] Step 5:
[0425] The server also receives emotional data and integrates it into the database. The input is emotional data sent from the emotional analysis engine. This allows for the accumulation of data indicating customer satisfaction, resulting in output that provides insights for service improvement. The data is also used as prompts for subsequent generative AI models.
[0426] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0427] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0428] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0429] [Third Embodiment]
[0430] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0431] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0432] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0433] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0434] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0435] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0436] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0437] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0438] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0439] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0440] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0441] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[0442] This invention provides a device and method for a parcel delivery system that ensures accurate delivery while preventing the leakage of recipients' personal information. Specifically, each parcel is affixed with a label using an individual QR code, and the recipient's information is encrypted within this QR code. The system is implemented using three main components: a server, a terminal, and a user.
[0443] server
[0444] The server generates an encrypted QR code based on the order information. This QR code is printed as a shipping label on the package and used by the delivery company. The server also manages status information from the delivery company and updates it in real time, allowing for tracking of the delivery status. When the recipient scans the QR code, the server receives the data and performs verification and matching.
[0445] terminal
[0446] The terminal is the user's smartphone or tablet, with a dedicated application installed. When receiving a package, the recipient uses the terminal to scan the QR code on the label. The scanned information is sent to a server and verified against the delivery information. The result is sent back to the terminal, and once the legitimate receipt is confirmed, a receipt completion message is displayed on the terminal. In addition, the receipt history is saved in the app and can be referenced at a later date.
[0447] User
[0448] The user is the one receiving the package through the system, operating a terminal to scan a QR code. By scanning the QR code, the user can instantly confirm whether the package they are receiving has arrived correctly. As a result, security is improved and the risk of personal information leakage is reduced.
[0449] As a concrete example, when a user orders a product from an online shop and a shipping instruction is received by the server, the server generates a QR code and attaches this code as a label to the package. When the delivery person delivers the package to the specified address, the recipient (the user) scans the QR code with their device and communicates with the server to confirm that the package has been received correctly. This creates a system that reduces the risk of delivery errors and information leaks.
[0450] The following describes the processing flow.
[0451] Step 1:
[0452] The server receives order information from the user. This order information includes details about the recipient, such as the delivery address.
[0453] Step 2:
[0454] The server generates a unique QR code based on the received order information. This QR code contains encrypted recipient information.
[0455] Step 3:
[0456] The server converts the generated QR code into a label, sends it to the printer as shipping label data, and the printed label is affixed to the package.
[0457] Step 4:
[0458] A delivery person delivers the package to the specified address. The user launches the app installed on their device when receiving the package.
[0459] Step 5:
[0460] The user's device uses its camera to scan the QR code attached to the package. This action reads the information contained in the QR code.
[0461] Step 6:
[0462] The device sends the QR code data obtained as a scan result to the server. The transmitted data includes encrypted recipient information.
[0463] Step 7:
[0464] The server searches the database based on the received data and compares it with the order information. If the information matches, the server verifies the legitimacy of the receipt.
[0465] Step 8:
[0466] The server sends a confirmation result to the device, and the device displays a notification to the user that the package has been received. This allows the user to confirm that the package has been delivered correctly.
[0467] Step 9:
[0468] The device saves information about successful receipt as a history within the system. Users can refer to this history within the app as needed.
[0469] This series of steps ensures efficient verification of the delivery address and protection of personal information during shipping.
[0470] (Example 1)
[0471] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0472] In recent years, the risk of personal information leakage during the delivery process has increased, while there is a growing demand for accurate and prompt delivery. Therefore, securely managing personal information during the delivery process while ensuring reliable delivery to recipients has become a crucial challenge. Furthermore, efficient tracking of delivery information and delivery confirmation processes are necessary to prevent delivery errors and fraudulent receipt.
[0473] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0474] In this invention, the server includes information processing means for encrypting and generating identification information of packages, information processing means for managing and updating the status of the delivery process, and information processing means for receiving identification information transmitted from the operating device and performing data verification and matching verification. This enables secure management of personal information, accurate package delivery, and efficient delivery tracking and receipt confirmation.
[0475] "Information processing means" refers to technical elements for encrypting package identification information, managing and updating the status of the delivery process, and verifying and matching information.
[0476] "Operating device" refers to a device used by the user to read and acquire identification information such as QR codes and to communicate with the server.
[0477] "Identification information" refers to information used to identify a package, and is generated by the server using encryption technology to protect personal information.
[0478] "Data verification" is the process by which the server verifies the validity of data based on identification information transmitted from the operating device.
[0479] "Match verification" refers to the process of comparing the identification information received by the server with the registered data to confirm whether the information matches.
[0480] "Delivery status" refers to information indicating each stage a package is in from preparation for delivery to receipt.
[0481] "Receipt history" refers to a list of information about packages previously received, which can be recorded and viewed by the user on the operating device.
[0482] This invention aims to achieve a high level of personal information protection and efficiency in delivery systems. Specific embodiments for carrying out the invention are described below.
[0483] server
[0484] Upon receiving a package order, the server automatically encrypts the personal information and generates a QR code. This encryption can utilize strong algorithms such as AES-256. The generated QR code is printed as a physical label and attached to the package. The server also manages status information from the delivery company in real time, updating this data to provide a centralized overview of the delivery process.
[0485] terminal
[0486] The terminal is a smartphone or tablet used by the user, with a dedicated application installed. This application uses the camera function to scan QR codes and sends the data directly to the server. The scanned QR code information is encrypted, ensuring security. The received QR code information is verified on the server, and based on the result, a notification of receipt completion is displayed on the terminal. The terminal also has a function to save the receipt history, making it easy to refer to past transactions.
[0487] User
[0488] The user takes on the role of ensuring the package is received correctly by operating a terminal and scanning a QR code. This allows the user to instantly verify whether the package they ordered has arrived properly. This prevents delivery errors and fraudulent receipt, and minimizes the risk of personal information leakage.
[0489] Specific example
[0490] For example, when a user orders a product from an online shop, the server generates a QR code based on that information and attaches it to the shipping label. When the delivery person delivers the package to the specified address, the recipient (the user) scans the QR code using a smartphone app. The server receives and verifies this data, and if it confirms that the user is the legitimate recipient, it sends a completion notification.
[0491] Example of a prompt
[0492] "Please explain how this package delivery system uses QR codes to protect recipient information."
[0493] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0494] Step 1:
[0495] The server receives order information from users via online shopping sites as input. This order information includes the recipient's personal information and shipping address. Based on the received information, the server encrypts the personal information and generates a QR code containing it. This QR code is converted into a label and output to the shipping company in a printed form. Specifically, the information is protected using the AES-256 encryption algorithm, and a QR code generator is used to create a visual code.
[0496] Step 2:
[0497] The server receives status information from the delivery company as input during the delivery process and manages and updates the delivery status in real time. Status information includes shipped, in transit, delivered, etc. This allows the server to understand the progress of the delivery and prepare to notify the user as needed. At this stage, a delivery management system is used, and a database is utilized for updating information.
[0498] Step 3:
[0499] When receiving a package, the user launches the terminal app and scans the printed QR code using the camera function. This process captures the QR code as input and sends the encrypted data to the server. The scanned data is immediately transferred to the server.
[0500] Step 4:
[0501] The server receives QR code information transmitted from the terminal as input and compares it with delivery information in the company's database. Specifically, it decrypts the encrypted delivery information based on the identification information extracted from the QR code and compares it with existing data. If a match is found, the server determines that the delivery is legitimate and outputs the result.
[0502] Step 5:
[0503] Based on the results received from the server, the device sends a notification to the user confirming receipt. The app updates the receipt history and records this information. This allows the user to review past transactions at any time. This process utilizes the device's data storage capabilities.
[0504] (Application Example 1)
[0505] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0506] In logistics and delivery processes, there is a need to improve the efficiency of delivery operations while enhancing package identification and security. Furthermore, there is a demand for systems that prevent the leakage of recipients' personal information and ensure accurate delivery. In addition, there is a need for systems that enable smart delivery management by utilizing augmented reality technology to visually manage the location of items and facilitating integration with generative AI models.
[0507] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0508] In this invention, the server includes an information processing device that encrypts and generates identification information of packages, a portable information terminal device equipped with an optical scanning device for reading the identification information, and an information processing device that confirms the content of the identification information transmitted from the portable information terminal device and performs a matching operation. This improves the efficiency of the delivery process, reduces misdelivery of packages, and prevents the leakage of recipients' personal information. Furthermore, by utilizing augmented reality technology to visually display the location information of items in real time and enabling cooperation with a generating AI model, the accuracy and efficiency of delivery management are further enhanced.
[0509] "Package identification information" refers to information used to identify and track individual packages, and is encrypted and represented as a QR code or similar.
[0510] An "information processing device" is a device that receives, processes, and outputs data, and plays a central role in logistics and delivery processes.
[0511] An "optical scanning device" is a device that uses light to read QR codes and other identifiers and convert them into digital information.
[0512] A "portable information terminal device" is a portable electronic device equipped with functions for scanning and sending and receiving information.
[0513] Augmented reality technology is a technology that enhances the visual experience by overlaying digital information onto the real-world environment.
[0514] A "generative AI model" is an artificial intelligence algorithm model designed to generate new information or results based on given data.
[0515] A system for carrying out this invention includes an information processing device for encrypting and storing package identification information, a portable information terminal device equipped with an optical scanning device for reading the identification information, and a method for verifying the information. The server generates package identification information based on the order and delivery instructions, encrypts it as a QR code, and makes it into a label. The QR code is used at each stage of delivery and is particularly important for recipient verification.
[0516] The device, specifically a smartphone or smart glasses, is equipped with an optical scanning device for reading QR codes. The scanned data is sent to a server, where it is decrypted and then compared with delivery information. The server then accurately checks the delivery status and, if necessary, sends that information to the device in real time.
[0517] Users can verify that their package is correct by scanning a QR code with their mobile device upon arrival. This process saves the delivery history to the device and improves transparency and security in the delivery process.
[0518] Furthermore, by using augmented reality technology, the location information of packages within the logistics center and at the pickup location can be visually displayed. This makes it easy for users to understand the current location and status of their packages.
[0519] Furthermore, by inputting data into generative AI models, it is possible to improve delivery processes and enhance prediction intelligence. For example, real-time data could be used to suggest routes in order to optimize the movement of delivery personnel. By combining these technologies, the overall efficiency of logistics monitoring and management can be increased.
[0520] As a concrete example, imagine a scenario where a worker at a logistics center scans a QR code with an eyewear device, and the message "New arrival: Ready for shipment" is displayed. From there, the worker can accurately guide the package to its designated shipping location based on AI recommendations.
[0521] Example of a prompt:
[0522] "Please describe the app's workflow for scanning a QR code, displaying the delivery status, and allowing users to confirm receipt and save the delivery history."
[0523] In this way, the present invention enables significant improvements in both efficiency and security in a variety of logistics and delivery scenarios.
[0524] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0525] Step 1:
[0526] The server receives order information and generates identification information for the package. This identification information is encrypted and printed as a QR code on the label. The input is order information, and the output is a QR code. The server checks the corresponding shipping instructions and encrypts the information using its own algorithm.
[0527] Step 2:
[0528] The terminal scans the QR code. The input is the QR code on the label, and the output is the data content of the QR code. The terminal uses an optical scanner to read the information and prepares to send the data to the server.
[0529] Step 3:
[0530] The server decrypts the QR code data received from the terminal and verifies it against the delivery information. The input is the scanned data, and the output is the verification result. The server refers to the database to confirm that the decrypted information is correct and updates the delivery status.
[0531] Step 4:
[0532] The terminal receives the matching results from the server and displays the delivery status to the user. The input is the matching results from the server, and the output is the delivery status displayed on the terminal screen. The terminal utilizes notification functions to provide the user with visual and audible alerts.
[0533] Step 5:
[0534] By scanning a QR code with their device, users can confirm that they have received their package correctly, and this information is saved as part of their history. The input at this time is an action to confirm receipt, and the output is the updated receipt history. The device records this operation in a history database and saves it in a format that can be referenced later.
[0535] Step 6:
[0536] Augmented reality technology is used to visualize the location information of luggage. Users can use their devices to check the location of luggage in their surroundings. The input for this step is location data, and the output is visual information on an AR display. The device drives the AR engine and displays the information overlaid on the camera view.
[0537] Step 7:
[0538] The server inputs delivery data into a generated AI model, which then proposes the optimal delivery route and schedule. The input is real-time delivery data, and the output is an optimized delivery plan. The server uses an AI algorithm to analyze the data and generate a plan to propose to the delivery personnel.
[0539] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0540] This invention relates to a system that combines emotion recognition functionality with the receiving procedure in package delivery. The system consists of a server, a terminal, and a user, with the terminal incorporating an emotion engine. This aims to improve not only the package receiving procedure but also the overall customer experience. A detailed embodiment of this system is described below.
[0541] server
[0542] The server receives order information and generates individually encrypted QR codes, which are used as package labels. The server also manages delivery status and allows for real-time information updates. Furthermore, it receives data from QR codes sent from terminals to verify the legitimacy of receipt. The server also updates and manages a database that integrates emotional information.
[0543] terminal
[0544] The device is the recipient user's smartphone or tablet, which has an application with a built-in emotion engine installed. The device scans the QR code on the label with its camera and sends the information to the server. At this time, the emotion engine analyzes emotion data from the user's facial expressions and voice and sends this along with the receipt information to the server.
[0545] User
[0546] Users use a terminal to complete the package pickup process. By scanning a QR code using the terminal's camera upon pickup, the system not only receives the package but also reflects the user's emotions at that time. For example, if a user is dissatisfied with the delivery, the system can sense that emotion and use it to improve future services.
[0547] As a concrete example, when a user orders a product from an online shopping site and it is shipped, the server generates a QR code to be used as the package label. When the user receives the package, they scan the QR code using a device, and the emotional data from that scan is also analyzed by the device's emotion engine. This information is then sent to the server to verify that the order information matches. The receipt information and emotional data are recorded and used for customer support as needed.
[0548] This system allows us to simultaneously improve delivery services, protect personal information, and enhance the quality of the customer experience.
[0549] The following describes the processing flow.
[0550] Step 1:
[0551] The server receives user order information from online shops. This includes basic information such as the shipping address.
[0552] Step 2:
[0553] The server generates an encrypted QR code based on the received shipping address information. This QR code is used as a shipping label and affixed to the package.
[0554] Step 3:
[0555] The delivery person delivers the package to its destination. The user uses a terminal to prepare to receive the package.
[0556] Step 4:
[0557] The user's device launches the app and scans the QR code printed on the package label using its camera function. At this stage, the emotion engine built into the device simultaneously captures the user's facial expressions and voice.
[0558] Step 5:
[0559] The device sends the scanned QR code data and the emotion data acquired by the emotion engine to the server.
[0560] Step 6:
[0561] The server compares the received QR code data with the order information in the database to check if they match.
[0562] Step 7:
[0563] The server sends the matching results back to the terminal. If a match is confirmed, the server notifies the terminal of its acceptance and records a new set of information, including sentiment data, in the database.
[0564] Step 8:
[0565] The device notifies the user that the receipt has been approved. A delivery completion message is displayed on the screen. Additionally, sentiment data associated with the receipt event is saved for later reference.
[0566] Step 9:
[0567] Sentimental data from users who have problems or complaints is stored on the server and may be used to improve future services. This will improve the overall delivery service.
[0568] (Example 2)
[0569] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0570] Traditional parcel delivery systems struggled to simultaneously verify the legitimacy of the receiving process and improve customer satisfaction. Furthermore, effectively utilizing customer emotional information to enhance services was difficult. As a result, the collection of feedback for improving the quality of the customer experience and services was insufficient.
[0571] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0572] In this invention, the server includes information processing means for generating a code on a package label that encrypts the recipient information and delivery information; terminal means for identifying the code and analyzing image and audio data to acquire emotional information; and information processing means for integrating the code and emotional data transmitted from the terminal means and performing a matching operation. This makes it possible to simultaneously achieve accurate confirmation of the receiving procedure and utilization of customer emotional information, thereby improving the quality of delivery services.
[0573] "Information processing means" refers to a technological configuration that handles digital data and performs calculations and operations necessary to achieve a specific purpose or function.
[0574] "Terminal means" refers to electronic devices that allow users to directly operate and input / output information.
[0575] A "code" is a set of symbols or digital information used to encrypt or encode and display specific information.
[0576] "Emotional information" refers to numerical data or data that indicates an emotional state, analyzed based on the user's facial expressions and voice data.
[0577] A "database" is a collection of digital information that enables the systematic and efficient organization, storage, retrieval, and management of information.
[0578] The following describes embodiments for carrying out the invention.
[0579] The system of this invention consists primarily of a server, a terminal, and a user. A particularly important technology is that the server uses information processing means to oversee the cargo delivery process. Specifically, it receives order information and generates encrypted codes containing delivery and distribution information. This code generation is performed by executing a programmed algorithm within the server.
[0580] Meanwhile, the device functions as the user's smartphone or tablet and is equipped with a dedicated application. This device uses hardware such as a camera and microphone to scan codes and acquire emotional information. The emotional information is analyzed by a built-in emotion engine, and the user's emotional state is determined from facial expression and voice data. The acquired input data is also immediately transmitted to the server.
[0581] During the pickup process, users use a terminal to scan a code on the label of their delivered package. This integrates delivery information and sentiment data with a server. The server then verifies the accuracy of the delivery and records the sentiment information in a database. This information is used to analyze and improve the customer experience, contributing to service enhancement.
[0582] As a concrete example, consider a case where a user purchases an item on an online marketplace. At this time, the server generates a code related to the item, and the shipping process begins. When the package arrives, the user scans the code with their device, and emotional information is also analyzed. This allows for feedback on the quality of the shipping service.
[0583] As an example of a prompt, it is possible to request the generative AI model to "suggest service improvement ideas based on the user's emotional data recorded in the system when receiving a package." In this way, the entire system works together to proactively improve the customer experience.
[0584] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0585] Step 1:
[0586] The server receives the user's order information. This input includes the product name, quantity, and shipping address. Based on this, the server generates an encrypted code. The generated code is output in digital format for printing on the shipping label.
[0587] Step 2:
[0588] The server manages delivery status and updates related information in real time. It receives status update information from delivery companies as input. The server processes this information and outputs the delivery progress (e.g., "Preparing for Shipment," "In Transit," "Delivered"), notifying the user as needed.
[0589] Step 3:
[0590] When receiving a package, the user uses a terminal to scan a code printed on the label with its camera. The input is visual information captured through the camera. The terminal converts this data into a code and sends it to the server. The output is the identified code information.
[0591] Step 4:
[0592] The device activates its built-in emotion engine to acquire emotion data from the user's facial expressions and voice. Input includes data from the user's facial expressions and voice obtained via the camera and microphone. This data is analyzed by the emotion engine and converted into emotion information. This converted emotion information is then prepared as output data for transmission to the server.
[0593] Step 5:
[0594] The server receives codes and sentiment data transmitted from the terminal. These data are the inputs, and the server compares the code information with the order information to verify the legitimacy of the receipt. This process results in the output of integrated receipt confirmation information and sentiment information, which is recorded on the server side.
[0595] Step 6:
[0596] The server inputs recorded emotional information into a generative AI model, attempting to gain insights for service improvement. The input data consists of accumulated customer emotional profiles. The generative AI model analyzes this data and outputs specific improvement measures and suggestions. This output is used in future service improvement plans.
[0597] (Application Example 2)
[0598] Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0599] Traditional parcel delivery systems have the problem of difficulty in accurately assessing customer satisfaction at the time of delivery. In particular, there is a need to analyze customer emotions at the time of delivery in real time and use this information to improve services, but this is currently difficult to achieve.
[0600] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0601] In this invention, the server includes a computing device that generates a code encrypting the destination information on the package label, an information terminal equipped with a reader for identifying the code, a computing device that checks the code data and performs verification work, an emotion analysis engine that analyzes the emotions at the time of receipt, and means for integrating the emotion data into a database. This makes it possible to have a system that can analyze the customer's emotions at the time of receipt in real time and use it to improve services.
[0602] A "package" refers to an object, such as a product or item, that is to be delivered to a consumer.
[0603] A "label" is an information sheet or sticker attached to a package, which includes delivery address information and identification codes.
[0604] "Recipient information" refers to data that shows the location and address of the recipient to whom the package should be delivered.
[0605] "Encryption" is a technology that transforms data into a different format based on certain rules to ensure the confidentiality of information.
[0606] "Code" refers to symbols used to represent information, in this context, to formats such as QR codes.
[0607] A "processing unit" is a device that has data processing and calculation functions, such as a server.
[0608] A "reader" refers to a device used to read codes or information optically or electronically.
[0609] An "information terminal" is an electronic device operated by a user, and primarily includes smartphones and tablets.
[0610] An "emotion analysis engine" is software or a system that analyzes a user's emotional state from their facial expressions and voice.
[0611] A "database" is a digital system designed for the efficient storage and retrieval of information.
[0612] This system combines emotion recognition with the process of receiving delivered goods to improve the customer experience in delivery services. An embodiment of this system is described below.
[0613] The server receives order information and generates an encrypted code containing delivery information based on it. This code is affixed as a package label. The server also manages the delivery status and has the ability to update information in real time. Furthermore, the server receives code data and sentiment data transmitted from information terminals and integrates them into a database.
[0614] The information terminal is the recipient's smartphone or tablet. This terminal has an application installed that incorporates an emotion analysis engine. It uses the terminal's camera to scan a code and sends the resulting information to the server. Simultaneously, the emotion analysis engine analyzes the user's facial expressions and voice, generating and transmitting emotion data.
[0615] Users receive their packages using their own information terminals. When receiving a package, they scan a code with the terminal's camera, and the emotions expressed at that time are also reflected in the system. For example, if a user expresses dissatisfaction because the delivery time was inappropriate, the emotion analysis engine will detect this and use it to improve future services.
[0616] As a concrete example, suppose a user places an order through online shopping and the goods are delivered. The server generates a code based on the order details and attaches it as a label to the package. When the user receives the package, they scan the code using an information terminal, and emotional data is also analyzed. This information is sent to the server to verify the legitimacy of the delivery, and the emotional data is recorded in a database to help improve the quality of service.
[0617] An example of a prompt to input into a generative AI model is: "My application analyzes emotional data when a user scans a QR code upon receiving their food. How can I improve the quality of the delivery experience by analyzing emotional information obtained from facial expressions and voice in real time?"
[0618] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0619] Step 1:
[0620] The server receives the user's order information. The input is the order information submitted by the user, and based on this, the server encrypts the distribution information and generates a code. The generated code is printed on a label as output and attached to the product. The server records this information in a database and prepares for delivery status management.
[0621] Step 2:
[0622] After delivery, when the user receives the package, they use their personal information terminal to scan the code attached to the label with their camera. The input is the code recognized by the camera, and the output is the data of the scanned code. The terminal's application sends this data to the server.
[0623] Step 3:
[0624] Simultaneously, the information terminal uses its built-in emotion analysis engine to analyze the user's facial expressions and voice. The input is the user's facial image and voice data, and the analyzed emotion data is output. This emotion data is also sent to the server.
[0625] Step 4:
[0626] The server receives code data transmitted from the information terminal. The input consists of scanned code data and sentiment data. Based on this, the server compares it with existing order information and verifies the match. Once the matching is complete, it sends an output confirming the legitimacy of the receipt to the information terminal.
[0627] Step 5:
[0628] The server also receives emotional data and integrates it into the database. The input is emotional data sent from the emotional analysis engine. This allows for the accumulation of data indicating customer satisfaction, resulting in output that provides insights for service improvement. The data is also used as prompts for subsequent generative AI models.
[0629] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0630] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0631] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[0632] [Fourth Embodiment]
[0633] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[0634] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[0635] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0636] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[0637] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0638] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0639] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0640] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[0641] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0642] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0643] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0644] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0645] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0646] This invention provides a device and method for a parcel delivery system that ensures accurate delivery while preventing the leakage of recipients' personal information. Specifically, each parcel is affixed with a label using an individual QR code, and the recipient's information is encrypted within this QR code. The system is implemented using three main components: a server, a terminal, and a user.
[0647] server
[0648] The server generates an encrypted QR code based on the order information. This QR code is printed as a shipping label on the package and used by the delivery company. The server also manages status information from the delivery company and updates it in real time, allowing for tracking of the delivery status. When the recipient scans the QR code, the server receives the data and performs verification and matching.
[0649] terminal
[0650] The terminal is the user's smartphone or tablet, with a dedicated application installed. When receiving a package, the recipient uses the terminal to scan the QR code on the label. The scanned information is sent to a server and verified against the delivery information. The result is sent back to the terminal, and once the legitimate receipt is confirmed, a receipt completion message is displayed on the terminal. In addition, the receipt history is saved in the app and can be referenced at a later date.
[0651] User
[0652] The user is the one receiving the package through the system, operating a terminal to scan a QR code. By scanning the QR code, the user can instantly confirm whether the package they are receiving has arrived correctly. As a result, security is improved and the risk of personal information leakage is reduced.
[0653] As a concrete example, when a user orders a product from an online shop and a shipping instruction is received by the server, the server generates a QR code and attaches this code as a label to the package. When the delivery person delivers the package to the specified address, the recipient (the user) scans the QR code with their device and communicates with the server to confirm that the package has been received correctly. This creates a system that reduces the risk of delivery errors and information leaks.
[0654] The following describes the processing flow.
[0655] Step 1:
[0656] The server receives order information from the user. This order information includes details about the recipient, such as the delivery address.
[0657] Step 2:
[0658] The server generates a unique QR code based on the received order information. This QR code contains encrypted recipient information.
[0659] Step 3:
[0660] The server converts the generated QR code into a label, sends it to the printer as shipping label data, and the printed label is affixed to the package.
[0661] Step 4:
[0662] A delivery person delivers the package to the specified address. The user launches the app installed on their device when receiving the package.
[0663] Step 5:
[0664] The user's device uses its camera to scan the QR code attached to the package. This action reads the information contained in the QR code.
[0665] Step 6:
[0666] The device sends the QR code data obtained as a scan result to the server. The transmitted data includes encrypted recipient information.
[0667] Step 7:
[0668] The server searches the database based on the received data and compares it with the order information. If the information matches, the server verifies the legitimacy of the receipt.
[0669] Step 8:
[0670] The server sends a confirmation result to the device, and the device displays a notification to the user that the package has been received. This allows the user to confirm that the package has been delivered correctly.
[0671] Step 9:
[0672] The device saves information about successful receipt as a history within the system. Users can refer to this history within the app as needed.
[0673] This series of steps ensures efficient verification of the delivery address and protection of personal information during shipping.
[0674] (Example 1)
[0675] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0676] In recent years, the risk of personal information leakage during the delivery process has increased, while there is a growing demand for accurate and prompt delivery. Therefore, securely managing personal information during the delivery process while ensuring reliable delivery to recipients has become a crucial challenge. Furthermore, efficient tracking of delivery information and delivery confirmation processes are necessary to prevent delivery errors and fraudulent receipt.
[0677] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0678] In this invention, the server includes information processing means for encrypting and generating identification information of packages, information processing means for managing and updating the status of the delivery process, and information processing means for receiving identification information transmitted from the operating device and performing data verification and matching verification. This enables secure management of personal information, accurate package delivery, and efficient delivery tracking and receipt confirmation.
[0679] "Information processing means" refers to technical elements for encrypting package identification information, managing and updating the status of the delivery process, and verifying and matching information.
[0680] "Operating device" refers to a device used by the user to read and acquire identification information such as QR codes and to communicate with the server.
[0681] "Identification information" refers to information used to identify a package, and is generated by the server using encryption technology to protect personal information.
[0682] "Data verification" is the process by which the server verifies the validity of data based on identification information transmitted from the operating device.
[0683] "Match verification" refers to the process of comparing the identification information received by the server with the registered data to confirm whether the information matches.
[0684] "Delivery status" refers to information indicating each stage a package is in from preparation for delivery to receipt.
[0685] "Receipt history" refers to a list of information about packages previously received, which can be recorded and viewed by the user on the operating device.
[0686] This invention aims to achieve a high level of personal information protection and efficiency in delivery systems. Specific embodiments for carrying out the invention are described below.
[0687] server
[0688] Upon receiving a package order, the server automatically encrypts the personal information and generates a QR code. This encryption can utilize strong algorithms such as AES-256. The generated QR code is printed as a physical label and attached to the package. The server also manages status information from the delivery company in real time, updating this data to provide a centralized overview of the delivery process.
[0689] terminal
[0690] The terminal is a smartphone or tablet used by the user, with a dedicated application installed. This application uses the camera function to scan QR codes and sends the data directly to the server. The scanned QR code information is encrypted, ensuring security. The received QR code information is verified on the server, and based on the result, a notification of receipt completion is displayed on the terminal. The terminal also has a function to save the receipt history, making it easy to refer to past transactions.
[0691] User
[0692] The user takes on the role of ensuring the package is received correctly by operating a terminal and scanning a QR code. This allows the user to instantly verify whether the package they ordered has arrived properly. This prevents delivery errors and fraudulent receipt, and minimizes the risk of personal information leakage.
[0693] Specific example
[0694] For example, when a user orders a product from an online shop, the server generates a QR code based on that information and attaches it to the shipping label. When the delivery person delivers the package to the specified address, the recipient (the user) scans the QR code using a smartphone app. The server receives and verifies this data, and if it confirms that the user is the legitimate recipient, it sends a completion notification.
[0695] Example of a prompt
[0696] "Please explain how this package delivery system uses QR codes to protect recipient information."
[0697] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0698] Step 1:
[0699] The server receives order information from users via online shopping sites as input. This order information includes the recipient's personal information and shipping address. Based on the received information, the server encrypts the personal information and generates a QR code containing it. This QR code is converted into a label and output to the shipping company in a printed form. Specifically, the information is protected using the AES-256 encryption algorithm, and a QR code generator is used to create a visual code.
[0700] Step 2:
[0701] The server receives status information from the delivery company as input during the delivery process and manages and updates the delivery status in real time. Status information includes shipped, in transit, delivered, etc. This allows the server to understand the progress of the delivery and prepare to notify the user as needed. At this stage, a delivery management system is used, and a database is utilized for updating information.
[0702] Step 3:
[0703] When receiving a package, the user launches the terminal app and scans the printed QR code using the camera function. This process captures the QR code as input and sends the encrypted data to the server. The scanned data is immediately transferred to the server.
[0704] Step 4:
[0705] The server receives QR code information transmitted from the terminal as input and compares it with delivery information in the company's database. Specifically, it decrypts the encrypted delivery information based on the identification information extracted from the QR code and compares it with existing data. If a match is found, the server determines that the delivery is legitimate and outputs the result.
[0706] Step 5:
[0707] Based on the results received from the server, the device sends a notification to the user confirming receipt. The app updates the receipt history and records this information. This allows the user to review past transactions at any time. This process utilizes the device's data storage capabilities.
[0708] (Application Example 1)
[0709] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0710] In logistics and delivery processes, there is a need to improve the efficiency of delivery operations while enhancing package identification and security. Furthermore, there is a demand for systems that prevent the leakage of recipients' personal information and ensure accurate delivery. In addition, there is a need for systems that enable smart delivery management by utilizing augmented reality technology to visually manage the location of items and facilitating integration with generative AI models.
[0711] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0712] In this invention, the server includes an information processing device that encrypts and generates identification information of packages, a portable information terminal device equipped with an optical scanning device for reading the identification information, and an information processing device that confirms the content of the identification information transmitted from the portable information terminal device and performs a matching operation. This improves the efficiency of the delivery process, reduces misdelivery of packages, and prevents the leakage of recipients' personal information. Furthermore, by utilizing augmented reality technology to visually display the location information of items in real time and enabling cooperation with a generating AI model, the accuracy and efficiency of delivery management are further enhanced.
[0713] "Package identification information" refers to information used to identify and track individual packages, and is encrypted and represented as a QR code or similar.
[0714] An "information processing device" is a device that receives, processes, and outputs data, and plays a central role in logistics and delivery processes.
[0715] An "optical scanning device" is a device that uses light to read QR codes and other identifiers and convert them into digital information.
[0716] A "portable information terminal device" is a portable electronic device equipped with functions for scanning and sending and receiving information.
[0717] Augmented reality technology is a technology that enhances the visual experience by overlaying digital information onto the real-world environment.
[0718] A "generative AI model" is an artificial intelligence algorithm model designed to generate new information or results based on given data.
[0719] A system for carrying out this invention includes an information processing device for encrypting and storing package identification information, a portable information terminal device equipped with an optical scanning device for reading the identification information, and a method for verifying the information. The server generates package identification information based on the order and delivery instructions, encrypts it as a QR code, and makes it into a label. The QR code is used at each stage of delivery and is particularly important for recipient verification.
[0720] The device, specifically a smartphone or smart glasses, is equipped with an optical scanning device for reading QR codes. The scanned data is sent to a server, where it is decrypted and then compared with delivery information. The server then accurately checks the delivery status and, if necessary, sends that information to the device in real time.
[0721] Users can verify that their package is correct by scanning a QR code with their mobile device upon arrival. This process saves the delivery history to the device and improves transparency and security in the delivery process.
[0722] Furthermore, by using augmented reality technology, the location information of packages within the logistics center and at the pickup location can be visually displayed. This makes it easy for users to understand the current location and status of their packages.
[0723] Furthermore, by inputting data into generative AI models, it is possible to improve delivery processes and enhance prediction intelligence. For example, real-time data could be used to suggest routes in order to optimize the movement of delivery personnel. By combining these technologies, the overall efficiency of logistics monitoring and management can be increased.
[0724] As a concrete example, imagine a scenario where a worker at a logistics center scans a QR code with an eyewear device, and the message "New arrival: Ready for shipment" is displayed. From there, the worker can accurately guide the package to its designated shipping location based on AI recommendations.
[0725] Example of a prompt:
[0726] "Please describe the app's workflow for scanning a QR code, displaying the delivery status, and allowing users to confirm receipt and save the delivery history."
[0727] In this way, the present invention enables significant improvements in both efficiency and security in a variety of logistics and delivery scenarios.
[0728] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0729] Step 1:
[0730] The server receives order information and generates identification information for the package. This identification information is encrypted and printed as a QR code on the label. The input is order information, and the output is a QR code. The server checks the corresponding shipping instructions and encrypts the information using its own algorithm.
[0731] Step 2:
[0732] The terminal scans the QR code. The input is the QR code on the label, and the output is the data content of the QR code. The terminal uses an optical scanner to read the information and prepares to send the data to the server.
[0733] Step 3:
[0734] The server decrypts the QR code data received from the terminal and verifies it against the delivery information. The input is the scanned data, and the output is the verification result. The server refers to the database to confirm that the decrypted information is correct and updates the delivery status.
[0735] Step 4:
[0736] The terminal receives the matching results from the server and displays the delivery status to the user. The input is the matching results from the server, and the output is the delivery status displayed on the terminal screen. The terminal utilizes notification functions to provide the user with visual and audible alerts.
[0737] Step 5:
[0738] By scanning a QR code with their device, users can confirm that they have received their package correctly, and this information is saved as part of their history. The input at this time is an action to confirm receipt, and the output is the updated receipt history. The device records this operation in a history database and saves it in a format that can be referenced later.
[0739] Step 6:
[0740] Augmented reality technology is used to visualize the location information of luggage. Users can use their devices to check the location of luggage in their surroundings. The input for this step is location data, and the output is visual information on an AR display. The device drives the AR engine and displays the information overlaid on the camera view.
[0741] Step 7:
[0742] The server inputs delivery data into a generated AI model, which then proposes the optimal delivery route and schedule. The input is real-time delivery data, and the output is an optimized delivery plan. The server uses an AI algorithm to analyze the data and generate a plan to propose to the delivery personnel.
[0743] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0744] This invention relates to a system that combines emotion recognition functionality with the receiving procedure in package delivery. The system consists of a server, a terminal, and a user, with the terminal incorporating an emotion engine. This aims to improve not only the package receiving procedure but also the overall customer experience. A detailed embodiment of this system is described below.
[0745] server
[0746] The server receives order information and generates individually encrypted QR codes, which are used as package labels. The server also manages delivery status and allows for real-time information updates. Furthermore, it receives data from QR codes sent from terminals to verify the legitimacy of receipt. The server also updates and manages a database that integrates emotional information.
[0747] terminal
[0748] The device is the recipient user's smartphone or tablet, which has an application with a built-in emotion engine installed. The device scans the QR code on the label with its camera and sends the information to the server. At this time, the emotion engine analyzes emotion data from the user's facial expressions and voice and sends this along with the receipt information to the server.
[0749] User
[0750] Users use a terminal to complete the package pickup process. By scanning a QR code using the terminal's camera upon pickup, the system not only receives the package but also reflects the user's emotions at that time. For example, if a user is dissatisfied with the delivery, the system can sense that emotion and use it to improve future services.
[0751] As a concrete example, when a user orders a product from an online shopping site and it is shipped, the server generates a QR code to be used as the package label. When the user receives the package, they scan the QR code using a device, and the emotional data from that scan is also analyzed by the device's emotion engine. This information is then sent to the server to verify that the order information matches. The receipt information and emotional data are recorded and used for customer support as needed.
[0752] This system allows us to simultaneously improve delivery services, protect personal information, and enhance the quality of the customer experience.
[0753] The following describes the processing flow.
[0754] Step 1:
[0755] The server receives user order information from online shops. This includes basic information such as the shipping address.
[0756] Step 2:
[0757] The server generates an encrypted QR code based on the received shipping address information. This QR code is used as a shipping label and affixed to the package.
[0758] Step 3:
[0759] The delivery person delivers the package to its destination. The user uses a terminal to prepare to receive the package.
[0760] Step 4:
[0761] The user's device launches the app and scans the QR code printed on the package label using its camera function. At this stage, the emotion engine built into the device simultaneously captures the user's facial expressions and voice.
[0762] Step 5:
[0763] The device sends the scanned QR code data and the emotion data acquired by the emotion engine to the server.
[0764] Step 6:
[0765] The server compares the received QR code data with the order information in the database to check if they match.
[0766] Step 7:
[0767] The server sends the matching results back to the terminal. If a match is confirmed, the server notifies the terminal of its acceptance and records a new set of information, including sentiment data, in the database.
[0768] Step 8:
[0769] The device notifies the user that the receipt has been approved. A delivery completion message is displayed on the screen. Additionally, sentiment data associated with the receipt event is saved for later reference.
[0770] Step 9:
[0771] Sentimental data from users who have problems or complaints is stored on the server and may be used to improve future services. This will improve the overall delivery service.
[0772] (Example 2)
[0773] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0774] Traditional parcel delivery systems struggled to simultaneously verify the legitimacy of the receiving process and improve customer satisfaction. Furthermore, effectively utilizing customer emotional information to enhance services was difficult. As a result, the collection of feedback for improving the quality of the customer experience and services was insufficient.
[0775] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0776] In this invention, the server includes information processing means for generating a code on a package label that encrypts the recipient information and delivery information; terminal means for identifying the code and analyzing image and audio data to acquire emotional information; and information processing means for integrating the code and emotional data transmitted from the terminal means and performing a matching operation. This makes it possible to simultaneously achieve accurate confirmation of the receiving procedure and utilization of customer emotional information, thereby improving the quality of delivery services.
[0777] "Information processing means" refers to a technological configuration that handles digital data and performs calculations and operations necessary to achieve a specific purpose or function.
[0778] "Terminal means" refers to electronic devices that allow users to directly operate and input / output information.
[0779] A "code" is a set of symbols or digital information used to encrypt or encode and display specific information.
[0780] "Emotional information" refers to numerical data or data that indicates an emotional state, analyzed based on the user's facial expressions and voice data.
[0781] A "database" is a collection of digital information that enables the systematic and efficient organization, storage, retrieval, and management of information.
[0782] The following describes embodiments for carrying out the invention.
[0783] The system of this invention consists primarily of a server, a terminal, and a user. A particularly important technology is that the server uses information processing means to oversee the cargo delivery process. Specifically, it receives order information and generates encrypted codes containing delivery and distribution information. This code generation is performed by executing a programmed algorithm within the server.
[0784] Meanwhile, the device functions as the user's smartphone or tablet and is equipped with a dedicated application. This device uses hardware such as a camera and microphone to scan codes and acquire emotional information. The emotional information is analyzed by a built-in emotion engine, and the user's emotional state is determined from facial expression and voice data. The acquired input data is also immediately transmitted to the server.
[0785] During the pickup process, users use a terminal to scan a code on the label of their delivered package. This integrates delivery information and sentiment data with a server. The server then verifies the accuracy of the delivery and records the sentiment information in a database. This information is used to analyze and improve the customer experience, contributing to service enhancement.
[0786] As a concrete example, consider a case where a user purchases an item on an online marketplace. At this time, the server generates a code related to the item, and the shipping process begins. When the package arrives, the user scans the code with their device, and emotional information is also analyzed. This allows for feedback on the quality of the shipping service.
[0787] As an example of a prompt, it is possible to request the generative AI model to "suggest service improvement ideas based on the user's emotional data recorded in the system when receiving a package." In this way, the entire system works together to proactively improve the customer experience.
[0788] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0789] Step 1:
[0790] The server receives the user's order information. This input includes the product name, quantity, and shipping address. Based on this, the server generates an encrypted code. The generated code is output in digital format for printing on the shipping label.
[0791] Step 2:
[0792] The server manages delivery status and updates related information in real time. It receives status update information from delivery companies as input. The server processes this information and outputs the delivery progress (e.g., "Preparing for Shipment," "In Transit," "Delivered"), notifying the user as needed.
[0793] Step 3:
[0794] When receiving a package, the user uses a terminal to scan a code printed on the label with its camera. The input is visual information captured through the camera. The terminal converts this data into a code and sends it to the server. The output is the identified code information.
[0795] Step 4:
[0796] The device activates its built-in emotion engine to acquire emotion data from the user's facial expressions and voice. Input includes data from the user's facial expressions and voice obtained via the camera and microphone. This data is analyzed by the emotion engine and converted into emotion information. This converted emotion information is then prepared as output data for transmission to the server.
[0797] Step 5:
[0798] The server receives codes and sentiment data transmitted from the terminal. These data are the inputs, and the server compares the code information with the order information to verify the legitimacy of the receipt. This process results in the output of integrated receipt confirmation information and sentiment information, which is recorded on the server side.
[0799] Step 6:
[0800] The server inputs recorded emotional information into a generative AI model, attempting to gain insights for service improvement. The input data consists of accumulated customer emotional profiles. The generative AI model analyzes this data and outputs specific improvement measures and suggestions. This output is used in future service improvement plans.
[0801] (Application Example 2)
[0802] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0803] Traditional parcel delivery systems have the problem of difficulty in accurately assessing customer satisfaction at the time of delivery. In particular, there is a need to analyze customer emotions at the time of delivery in real time and use this information to improve services, but this is currently difficult to achieve.
[0804] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0805] In this invention, the server includes a computing device that generates a code encrypting the destination information on the package label, an information terminal equipped with a reader for identifying the code, a computing device that checks the code data and performs verification work, an emotion analysis engine that analyzes the emotions at the time of receipt, and means for integrating the emotion data into a database. This makes it possible to have a system that can analyze the customer's emotions at the time of receipt in real time and use it to improve services.
[0806] A "package" refers to an object, such as a product or item, that is to be delivered to a consumer.
[0807] A "label" is an information sheet or sticker attached to a package, which includes delivery address information and identification codes.
[0808] "Recipient information" refers to data that shows the location and address of the recipient to whom the package should be delivered.
[0809] "Encryption" is a technology that transforms data into a different format based on certain rules to ensure the confidentiality of information.
[0810] "Code" refers to symbols used to represent information, in this context, to formats such as QR codes.
[0811] A "processing unit" is a device that has data processing and calculation functions, such as a server.
[0812] A "reader" refers to a device used to read codes or information optically or electronically.
[0813] An "information terminal" is an electronic device operated by a user, and primarily includes smartphones and tablets.
[0814] An "emotion analysis engine" is software or a system that analyzes a user's emotional state from their facial expressions and voice.
[0815] A "database" is a digital system designed for the efficient storage and retrieval of information.
[0816] This system combines emotion recognition with the process of receiving delivered goods to improve the customer experience in delivery services. An embodiment of this system is described below.
[0817] The server receives order information and generates an encrypted code containing delivery information based on it. This code is affixed as a package label. The server also manages the delivery status and has the ability to update information in real time. Furthermore, the server receives code data and sentiment data transmitted from information terminals and integrates them into a database.
[0818] The information terminal is the recipient's smartphone or tablet. This terminal has an application installed that incorporates an emotion analysis engine. It uses the terminal's camera to scan a code and sends the resulting information to the server. Simultaneously, the emotion analysis engine analyzes the user's facial expressions and voice, generating and transmitting emotion data.
[0819] Users receive their packages using their own information terminals. When receiving a package, they scan a code with the terminal's camera, and the emotions expressed at that time are also reflected in the system. For example, if a user expresses dissatisfaction because the delivery time was inappropriate, the emotion analysis engine will detect this and use it to improve future services.
[0820] As a concrete example, suppose a user places an order through online shopping and the goods are delivered. The server generates a code based on the order details and attaches it as a label to the package. When the user receives the package, they scan the code using an information terminal, and emotional data is also analyzed. This information is sent to the server to verify the legitimacy of the delivery, and the emotional data is recorded in a database to help improve the quality of service.
[0821] An example of a prompt to input into a generative AI model is: "My application analyzes emotional data when a user scans a QR code upon receiving their food. How can I improve the quality of the delivery experience by analyzing emotional information obtained from facial expressions and voice in real time?"
[0822] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0823] Step 1:
[0824] The server receives the user's order information. The input is the order information submitted by the user, and based on this, the server encrypts the distribution information and generates a code. The generated code is printed on a label as output and attached to the product. The server records this information in a database and prepares for delivery status management.
[0825] Step 2:
[0826] After delivery, when the user receives the package, they use their personal information terminal to scan the code attached to the label with their camera. The input is the code recognized by the camera, and the output is the data of the scanned code. The terminal's application sends this data to the server.
[0827] Step 3:
[0828] Simultaneously, the information terminal uses its built-in emotion analysis engine to analyze the user's facial expressions and voice. The input is the user's facial image and voice data, and the analyzed emotion data is output. This emotion data is also sent to the server.
[0829] Step 4:
[0830] The server receives code data transmitted from the information terminal. The input consists of scanned code data and sentiment data. Based on this, the server compares it with existing order information and verifies the match. Once the matching is complete, it sends an output confirming the legitimacy of the receipt to the information terminal.
[0831] Step 5:
[0832] The server also receives emotional data and integrates it into the database. The input is emotional data sent from the emotional analysis engine. This allows for the accumulation of data indicating customer satisfaction, resulting in output that provides insights for service improvement. The data is also used as prompts for subsequent generative AI models.
[0833] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0834] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0835] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.
[0836] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[0837] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.
[0838] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.
[0839] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.
[0840] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.
[0841] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."
[0842] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.
[0843] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.
[0844] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.
[0845] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.
[0846] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[0847] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.
[0848] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.
[0849] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.
[0850] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.
[0851] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.
[0852] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.
[0853] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.
[0854] The following is further disclosed regarding the embodiments described above.
[0855] (Claim 1)
[0856] A server that generates a QR code containing encrypted recipient information on the package label,
[0857] A terminal means equipped with a reading device for identifying the aforementioned QR code,
[0858] A server means that checks the data of the QR code transmitted from the terminal means and performs verification work,
[0859] A terminal device that authorizes receipt when a match is confirmed,
[0860] A system that includes this.
[0861] (Claim 2)
[0862] The system according to claim 1, wherein the QR code affixed to the label includes a server means for listing delivery information.
[0863] (Claim 3)
[0864] The system according to claim 1, wherein the terminal means has means for storing a history of received information.
[0865] "Example 1"
[0866] (Claim 1)
[0867] Information processing means for generating encrypted identification information for packages,
[0868] An operating device having a reading means for acquiring the aforementioned identification information,
[0869] Information processing means that receives identification information transmitted from the aforementioned operating device and performs data verification and matching verification work,
[0870] An operating device that approves receipt and issues a notification when a match is confirmed,
[0871] Information processing means for managing and updating the status of the delivery process,
[0872] A system that includes this.
[0873] (Claim 2)
[0874] The system according to claim 1, wherein the identification information has a function to list information about the delivery process and optimize the receiving process.
[0875] (Claim 3)
[0876] The system according to claim 1, wherein the operating device has a function of recording and displaying the history of receipts.
[0877] "Application Example 1"
[0878] (Claim 1)
[0879] An information processing device that encrypts and generates identification information for packages,
[0880] A portable information terminal device equipped with an optical scanning device for reading the aforementioned identification information,
[0881] An information processing device that confirms the content of identification information transmitted from the aforementioned mobile information terminal device and performs verification work,
[0882] A portable information terminal device that approves receipt when a match is confirmed and saves the history thereof,
[0883] A means of displaying the delivery status in real time,
[0884] A system that includes this.
[0885] (Claim 2)
[0886] The system according to claim 1, wherein the portable information terminal device visually presents location information of an item using augmented reality technology.
[0887] (Claim 3)
[0888] The system according to claim 1, wherein the portable information terminal device provides instructions for inputting electronic information into an AI model.
[0889] "Example 2 of combining an emotion engine"
[0890] (Claim 1)
[0891] Information processing means for generating an encrypted code containing recipient information and delivery information on a package label,
[0892] A terminal means that identifies the aforementioned code and analyzes image and audio data to obtain emotional information,
[0893] Information processing means that integrates the code and emotion data transmitted from the terminal means and performs a matching operation,
[0894] An information processing means that approves receipt when a match is confirmed and records emotional information in a database,
[0895] A system that includes this.
[0896] (Claim 2)
[0897] The system according to claim 1, wherein the code affixed to the label includes information processing means for listing delivery information and managing the delivery process.
[0898] (Claim 3)
[0899] The system according to claim 1, wherein the terminal means has means for storing a history of received and emotional information.
[0900] "Application example 2 when combining with an emotional engine"
[0901] (Claim 1)
[0902] A computing device that generates a code containing encrypted distribution information on the package label,
[0903] An information terminal equipped with a reader for identifying the aforementioned code,
[0904] A computing device that checks and verifies the code data transmitted from the aforementioned information terminal,
[0905] An information terminal that authorizes receipt when a match is confirmed,
[0906] An emotion analysis engine that analyzes emotions at the time of receipt,
[0907] A means for integrating the emotional data analyzed by the aforementioned emotional analysis engine into a database,
[0908] A system that includes this.
[0909] (Claim 2)
[0910] The system according to claim 1, wherein the code affixed to the label includes a computing device that lists delivery information.
[0911] (Claim 3)
[0912] The system according to claim 1, wherein the information terminal has means for storing a history of received information and emotion data. [Explanation of Symbols]
[0913] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>
Claims
1. A server means for generating a QR code containing encrypted distribution information on the package label, A terminal means equipped with a reading device for identifying the aforementioned QR code, A server means that checks the data of the QR code transmitted from the terminal means and performs verification work, A terminal device that authorizes receipt when a match is confirmed, A system that includes this.
2. The system according to claim 1, wherein the QR code affixed to the label includes a server means for listing delivery information.
3. The system according to claim 1, wherein the terminal means has means for storing a history of received information.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A