System

Abstract

A system is provided.SOLUTION: Receiving a goods order from a user, validating and storing the order, sending a goods pick-up instruction to an automatic warehouse system, planning an optimal delivery route according to a delivery address, sending delivery route information to automatic driving mobility terminals and monitoring running of the automatic driving mobility terminals, running the automatic driving mobility terminals loaded with the goods along a specified route, a AI driver transporting the goods at the delivery address and making a payment, and a sensor and alarm system for preventing accidents.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The current logistics and transportation industry is facing a serious driver shortage. Labor shortages are particularly pronounced in depopulated areas and due to an aging population. In conventional logistics systems, manual product pickup, delivery, and transportation are heavy labor, resulting in low efficiency and a high risk of accidents. Furthermore, additional tasks such as payment at delivery destinations are analog and time-consuming, reducing overall operational efficiency. The present invention aims to provide a new logistics system that utilizes autonomous driving technology and AI to solve these problems. [Means for solving the problem]

[0005] The present invention solves the above problems by the following means.

[0006] The system includes a means for accepting product orders from users, a means for validating and storing order data, a means for sending product pickup instructions to an automated warehouse system, a means for planning the optimal delivery route based on delivery destination address data, a means for sending delivery route information to an autonomous mobility terminal and monitoring operation, a means for an autonomous mobility terminal loaded with products to operate along a specified route, a means for an AI driver to transport the products and process payments at the delivery destination, and a means equipped with sensors and an alarm system for preventing accidents.

[0007] This system allows for efficient pickup of designated goods from automated warehouses at logistics terminals and delivery by autonomous mobility. Furthermore, by having AI drivers transport goods and handle payments, labor shortages and the risk of accidents are significantly reduced. It can also accommodate deliveries to depopulated areas, improving overall logistics efficiency.

[0008] "User" means any individual or entity that uses the System to order and receive deliveries of Products.

[0009] "Goods" refers to goods delivered by order from a logistics terminal.

[0010] "Order" refers to the act of a user requesting delivery of a specific product.

[0011] An "automated warehouse system" refers to a system that automatically picks up, stores, and ships goods within a logistics terminal.

[0012] "Pickup instruction" refers to data that instructs an automated warehouse system to retrieve a particular item from a specified location.

[0013] "Delivery route" refers to the route an autonomous mobility vehicle will take to transport goods to the delivery destination.

[0014] "Autonomous mobility" refers to vehicles that operate autonomously and deliver goods with the assistance of an AI driver.

[0015] "AI Driver" refers to a robot or system equipped with artificial intelligence that loads and transports goods and handles payments at the delivery destination.

[0016] "Validation" refers to the process of verifying that order data is accurate and complete.

[0017] "Storage" refers to the act of recording order data in a storage device such as a database.

[0018] "Monitoring operations" refers to tracking the location and status of autonomous mobility vehicles in real time and taking control or adjustments as necessary.

[0019] "Transportation" refers to the act of an AI driver physically moving goods to the delivery destination.

[0020] "Payment" refers to the act of a user paying for a product when receiving it.

[0021] "Sensor and alarm systems for accident prevention" refers to devices that detect obstacles and provide warnings necessary for the safe operation of autonomous mobility vehicles. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] The present invention relates to a system for automating the transportation of goods from a logistics terminal to a delivery destination. This system is designed to consistently automate the entire process from order acceptance to product pickup, delivery, handover, and payment. Specific embodiments of the system are described below.

[0044] server

[0045] 1. Order acceptance

[0046] The server accepts product orders from users via a web interface or mobile app. Order information includes product ID, quantity, delivery address, and payment information.

[0047] When the order data reaches the server, the server performs validation to check the format of the input data and any missing fields, thereby ensuring that the data is accurate.

[0048] If validation is successful, the order data is saved to the database, after which an order confirmation notification is sent to the user.

[0049] 2. Product Pickup Instructions

[0050] The server sends product pickup instructions to the automated warehouse system based on the order information. The server generates an API request including the product ID, quantity, and location information within the warehouse, and sends it to the automated warehouse system.

[0051] 3. Delivery route planning

[0052] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS), which then transmits the planned route information to the autonomous mobility terminal.

[0053] 4. Operation management

[0054] The server monitors the location information of the autonomous driving mobility in real time and issues driving instructions as necessary. If an obstacle (such as traffic congestion or an accident) occurs, the server calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[0055] Terminal (autonomous driving mobility)

[0056] 1. Product loading

[0057] The terminal receives instructions from the server and communicates with an AI driver in the logistics terminal, who then picks up the specified items and accurately loads them onto the autonomous mobility vehicle.

[0058] Using sensors and cameras, it checks whether the items have been loaded correctly and notifies the server that loading is complete.

[0059] 2. Start of autonomous driving

[0060] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[0061] 3. Safety management

[0062] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[0063] 4. Delivery and Payment

[0064] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the goods and hands them over to the recipient.

[0065] The recipient enters payment information on the terminal, which then processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a notification of delivery completion to the server.

[0066] User

[0067] 1. Order Entry

[0068] Users order products through the system's web interface or a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[0069] The user confirms the order confirmation screen and presses the final order button to confirm the order. The order information is sent to the server, where it is validated and saved.

[0070] 2. Receiving notifications

[0071] The user receives order confirmation notifications from the server, as well as notifications about delivery progress and estimated arrival times.

[0072] 3. Receipt confirmation and payment

[0073] The user prepares to receive the goods at the specified delivery time, and when the AI ​​driver delivers the goods, the user confirms receipt.

[0074] Upon receiving the item, enter your payment information into the terminal if necessary to complete the payment. If the payment is successful, you will receive a confirmation notification and the order will be recorded in your order history.

[0075] Specific examples

[0076] For example, if a user orders a product from location A using a dedicated app, the system operates in the following steps:

[0077] The user enters order information (product ID, quantity, delivery address, payment information) through the app and makes a final confirmation.

[0078] The server receives this order information, performs validation, and then sends product pickup instructions to the automated warehouse system at the logistics terminal.

[0079] Based on instructions from the server, the terminal will have an AI driver pick up the goods and load them into the self-driving mobility vehicle.

[0080] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[0081] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[0082] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the product to the recipient. The user then pays on the device and the delivery is complete.

[0083] This invention can effectively solve problems such as driver shortages and declining logistics efficiency. This system can also be used in depopulated areas, realizing efficient logistics over a wide area.

[0084] The processing flow will be explained below.

[0085] server

[0086] Order acceptance

[0087] Step 1:

[0088] The server receives an HTTP request sent by the user, which includes the product ID, quantity, delivery address, and payment information.

[0089] Step 2:

[0090] The server checks the format of the received order information and validates that there are no missing fields.

[0091] Step 3:

[0092] If validation is successful, the server saves the order information to the database.

[0093] Step 4:

[0094] After the order information has been saved, the server sends a confirmation notice to the user terminal.

[0095] Product Pickup Instructions

[0096] Step 1:

[0097] Based on the order information, the server generates product pickup instructions for the automated warehouse system at the logistics terminal.

[0098] Step 2:

[0099] The server sends an API request to the automated warehouse system, which includes the product ID, warehouse location, and quantity.

[0100] Step 3:

[0101] The automated warehouse system notifies the server that the product has been picked up.

[0102] Delivery route planning

[0103] Step 1:

[0104] The server parses the delivery address data.

[0105] Step 2:

[0106] The server uses a geographic information system (GIS) to plan the optimal delivery route.

[0107] Step 3:

[0108] Planned delivery route information is sent to the autonomous mobility device.

[0109] Operation management

[0110] Step 1:

[0111] The server monitors the location information of autonomous vehicles in real time.

[0112] Step 2:

[0113] When an obstacle (such as traffic jam or accident) occurs, the server calculates a new route and sends instructions to the terminal.

[0114] Step 3:

[0115] Continue monitoring and supervision until delivery is complete.

[0116] Terminal (autonomous driving mobility)

[0117] Product loading

[0118] Step 1:

[0119] The terminal receives instructions from the server.

[0120] Step 2:

[0121] The terminal works in conjunction with an AI driver in the logistics terminal to pick up the specified items.

[0122] Step 3:

[0123] The terminal uses sensors and cameras to verify that the goods have been loaded correctly.

[0124] Step 4:

[0125] Once loading is complete, the terminal sends a notification to the server.

[0126] Automatic operation begins

[0127] Step 1:

[0128] The terminal receives delivery route information from the server.

[0129] Step 2:

[0130] The device will then begin autonomous driving according to the specified route.

[0131] Step 3:

[0132] While in operation, the device uses sensors and cameras to monitor its surroundings.

[0133] safety management

[0134] Step 1:

[0135] The device detects obstacles and abnormalities based on sensor and camera data.

[0136] Step 2:

[0137] If an obstacle is detected, the device will automatically slow down or stop.

[0138] Step 3:

[0139] Once conditions are deemed safe, the terminal will resume operation.

[0140] Delivery and payment

[0141] Step 1:

[0142] When the terminal arrives at the delivery destination, it sends an arrival notification to the server.

[0143] Step 2:

[0144] The AI ​​driver transports the goods and delivers them to the recipient.

[0145] Step 3:

[0146] The terminal receives payment information from the recipient and works with the payment system to process the payment.

[0147] Step 4:

[0148] After the payment is completed, the terminal sends a notification of delivery completion to the server.

[0149] User

[0150] Order Entry

[0151] Step 1:

[0152] Users select products through a web interface or mobile app.

[0153] Step 2:

[0154] The user enters the delivery address and payment information.

[0155] Step 3:

[0156] The user checks the order confirmation screen and makes a final confirmation.

[0157] Step 4:

[0158] The user presses the order button and sends the order information to the server.

[0159] Receive notifications

[0160] Step 1:

[0161] The user receives an order confirmation notice sent from the server.

[0162] Step 2:

[0163] Users will receive notifications regarding delivery progress and estimated arrival times.

[0164] Receipt confirmation and payment

[0165] Step 1:

[0166] The user prepares to receive the product at the scheduled delivery time.

[0167] Step 2:

[0168] When receiving the item, the user enters payment information on the terminal and completes the payment.

[0169] Step 3:

[0170] The user confirms receipt on the terminal and the delivery is completed.

[0171] Example 1

[0172] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0173] In conventional logistics systems, driver shortages and declining delivery efficiency are serious problems. Furthermore, because the entire process, from order acceptance to product pickup, delivery, handover, and payment, is done manually, human error and time loss are likely to occur. Furthermore, it is difficult to accommodate depopulated areas, making it necessary to improve the efficiency of logistics.

[0174] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0175] In this invention, the server includes means for accepting product orders from users, means for validating and saving order data, means for sending product pickup instructions to an automated warehouse system, means for planning an optimal delivery route based on delivery destination address data, means for sending delivery route information to an autonomous mobility terminal and monitoring operation, means for an autonomous mobility terminal loaded with products to operate along a specified route, means for an AI driver to transport the products and process payments at the delivery destination, means for providing sensors and an alarm system to prevent accidents, means for monitoring the location information of the autonomous mobility terminal in real time and issuing operation instructions, means for an autonomous mobility terminal that has arrived at the delivery destination to send an arrival notification, and means for the recipient to input payment information on the autonomous mobility terminal and process the payment. This enables the automation and efficiency of the entire logistics process.

[0176] "Means for accepting product orders" refers to a function that receives product ID, quantity, delivery address, and payment information from users via a web interface or mobile app.

[0177] The "means for validating and saving order data" is a function that checks the format of received order data and any missing fields, confirms the accuracy of the data, and then saves it in the database.

[0178] The "means for sending product pickup instructions" is a function that generates an API request containing the product ID, quantity, and location information within the warehouse based on order information, and sends it to the automated warehouse system.

[0179] The "means for planning the optimal delivery route" is a function that analyzes address data of the delivery destination and calculates the shortest route using a geographic information system (GIS).

[0180] "Means for transmitting delivery route information and monitoring operation" refers to a function that transmits planned delivery route information to an autonomous driving mobility terminal and monitors and manages its operation status in real time.

[0181] "Means for operating along a specified route" refers to the function of an autonomous mobility terminal to operate along a specified delivery route based on instructions from a server.

[0182] "Means of transporting goods and making payments" refers to the function in which an AI driver delivers goods to the recipient at the delivery destination, and the recipient enters payment information on the terminal to complete the payment.

[0183] "Means equipped with sensors and alarm systems to prevent accidents" refers to a function that ensures safe operation by equipping the vehicle with sensors to detect obstacles or abnormalities and alarm systems that issue warnings.

[0184] "Means for monitoring location information in real time and issuing driving instructions" refers to a function that uses the GPS of the autonomous driving mobility terminal to monitor location information in real time and issue driving instructions as necessary.

[0185] The "means for sending an arrival notification" is a function that sends a notification to the server when the autonomous driving mobility terminal arrives at the delivery destination.

[0186] "Means for inputting payment information and processing payment" refers to a function in which the recipient inputs payment information on the terminal and links that information with the payment system to complete the payment.

[0187] This invention relates to a system that automates the transportation of goods from a logistics terminal to a delivery destination. This system consists of three main components: a server, a terminal (autonomous driving mobility), and a user. This section explains how each component works together and what specific processing they perform.

[0188] server

[0189] The server plays a central role in the system, managing various data and issuing instructions. First, the server accepts a product order from the user. At this time, the product ID, quantity, delivery address, and payment information are entered via a web interface or mobile app. The server checks the format of the received order data and any missing fields, and performs validation. If validation is successful, the order data is saved in the database and an order confirmation notification is sent to the user.

[0190] Next, the server generates an API request based on the stored order information, including the product ID, quantity, and location information within the warehouse, and sends a product pickup instruction to the automated warehouse system. The specified product is then picked up. The server also analyzes the delivery address data and uses a geographic information system (GIS) to plan the optimal delivery route, and sends the planned delivery route information to the autonomous mobility device.

[0191] The server uses the autonomous mobility's GPS to monitor its location in real time and issues driving instructions as needed. For example, if there is information about a traffic jam, accident, or other obstacle, the server calculates a new optimal route and issues driving instructions to the autonomous mobility device. This management continues until all deliveries are completed.

[0192] Terminal (autonomous driving mobility)

[0193] The terminal operates autonomously based on instructions sent from the server. First, when goods are loaded, the terminal works in conjunction with an AI driver in the logistics terminal to load the specified goods onto the autonomous mobility vehicle. Using sensors and cameras, the terminal checks whether the goods have been loaded correctly and notifies the server once the process is complete.

[0194] The device receives delivery route information sent from the server and begins autonomous driving. During operation, it uses sensors and cameras to monitor the surroundings and ensures safe driving. The AI ​​driver analyzes data obtained from the sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device automatically slows down or stops, and resumes driving once safety is confirmed.

[0195] Upon arriving at the delivery destination, the terminal sends an arrival notification to the server. The AI ​​driver transports the goods and hands them over to the recipient. The recipient enters payment information on the terminal, and the terminal works with the payment system to process the payment. After payment is complete, a delivery completion notification is sent to the server.

[0196] User

[0197] The user enters the product ID, quantity, delivery address, and payment information through a dedicated app or web interface. After checking the order confirmation screen, the user confirms the order by pressing the final order button, and the data is sent to the server. The user then receives an order confirmation notification, delivery progress notification, and estimated arrival time notification from the server.

[0198] At the specified delivery time, the user prepares to receive the product and waits for the terminal to arrive at the delivery address. When the AI ​​driver delivers the product, the user receives the product and checks it. If necessary, they enter payment information into the terminal to complete the payment. This records the order history and completes the entire process.

[0199] Specific examples

[0200] For example, if a user orders a product from point A using a dedicated app, the system operates in the following steps: The user enters order information (product ID, quantity, delivery address, and payment information) through the app and makes a final confirmation. The server receives this order information, validates it, and then sends a product pickup instruction to the automated warehouse system at the logistics terminal. Based on the server's instructions, the terminal has an AI driver pick up the product and load it onto the autonomous mobility vehicle. The server analyzes the delivery address data, plans the optimal delivery route, and sends the route information to the terminal, which then begins autonomous driving. During operation, the terminal constantly monitors its surroundings, performs safety management, and automatically slows down or stops if an obstacle is detected. Upon arriving at the delivery destination, the terminal sends an arrival notification to the server, and the AI ​​driver hands over the product to the recipient. The user then makes the payment on the terminal, completing the delivery. This system automates and streamlines the entire logistics process, effectively resolving issues such as driver shortages and declining logistics efficiency.

[0201] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0202] Step 1: Receiving order data

[0203] The server receives product order data from the user. Input is made via a dedicated app or web interface and includes product ID, quantity, delivery address, and payment information. This allows the server to import the order data from the user into the system. Data processing involves converting this information into an internal data format and storing it.

[0204] Step 2: Data Validation

[0205] The server checks the format of the received order data and any missing fields, and performs validation. The input is the order data received in step 1. During the validation process, for example, it verifies the existence of the product ID, the validity of the quantity, and the validity of the payment information. If the validation is successful, a flag is set and saved in the database. The validation result is generated as output.

[0206] Step 3: Save order data

[0207] The server saves the order data that has been validated successfully in the database. The input is the order data that has passed validation. In this process, the order ID, user ID, product information, delivery address information etc. are saved in the database. As an output, a save successful flag is generated and an order confirmation notification is sent after saving is complete.

[0208] Step 4: Generate and send product pickup instructions

[0209] The server generates an API request based on the order information stored in the database, including the product ID, quantity, and location within the warehouse. The input is the stored order data. This API request is sent to the automated warehouse system and used as a product pickup instruction. The output is a pickup instruction sent to the automated warehouse system.

[0210] Step 5: Plan the optimal delivery route

[0211] The server analyzes the delivery address data contained in the order information and uses a geographic information system (GIS) to plan the optimal delivery route. The input is the delivery address data. The GIS is used to select the shortest route, taking into account factors such as distance and traffic conditions. The output is the planned delivery route information.

[0212] Step 6: Sending route information

[0213] The server sends the planned delivery route information to the autonomous mobility terminal. The input is the optimal delivery route information. The terminal starts the delivery work based on the sent route information. The output is a notification that the route information has been sent.

[0214] Step 7: Check product load

[0215] The terminal works in conjunction with an AI driver in the logistics terminal to load specified products onto the autonomous mobility vehicle. The input is a pickup instruction from the server. Sensors and cameras are used to confirm that the products have been loaded correctly. The output is a notification of loading completion sent to the server.

[0216] Step 8: Start Autonomous Driving

[0217] The terminal receives delivery route information sent from the server and begins autonomous driving. The input is delivery route information. During operation, the terminal monitors the surrounding situation using sensors and cameras to maintain a safe state. The output is a notification that autonomous driving has begun.

[0218] Step 9: Safety Management

[0219] The device analyzes data from sensors and cameras to detect obstacles and abnormalities. The input is real-time sensor and camera data. If an abnormality is detected, the device automatically slows down or stops. If the situation is deemed safe, it resumes operation. As an output, a safety notification is sent to the server.

[0220] Step 10: Making the delivery

[0221] Upon arriving at the delivery destination, the device sends an arrival notification to the server. The input is GPS location information. The AI ​​driver transports the goods and hands them over to the recipient. The output is a delivery completion notification sent to the server.

[0222] Step 11: Making a payment

[0223] The recipient enters payment information on the terminal, and the terminal processes the payment in conjunction with the payment system. The input is the payment information entered by the recipient. When payment is complete, a notification is generated and a delivery completion notification is sent to the server. The output is a payment completion notification.

[0224] The above are the specific processing steps in the present invention. Each step functions in conjunction with each other to realize automation and efficiency of the entire system.

[0225] (Application example 1)

[0226] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0227] Conventional logistics systems and food delivery services are required to improve delivery efficiency and resolve labor shortages. Furthermore, they often lack systems for smoothly accepting orders from customers and accurately delivering products and meals. In particular, there are still challenges to be overcome in terms of improving delivery efficiency and safety measures using systems that utilize autonomous driving technology.

[0228] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0229] In this invention, the server includes: means for accepting product orders from users; means for validating and storing order data; means for sending product pickup instructions to an automated warehouse system; means for planning an optimal delivery route based on delivery destination address data; means for sending delivery route information to an autonomous mobility terminal and monitoring operation; means for an autonomous mobility terminal loaded with products to operate along a specified route; means for an AI driver to transport the products and process payment at the delivery destination; means for providing sensors and an alarm system to prevent accidents; means for ordering food from a restaurant menu and processing payment; means for calculating the optimal route to the food delivery destination and transmitting this to a robot; means for monitoring the delivery process in real time and correcting the route as necessary; and means for delivering food to customers and receiving payment in cash or electronically depending on the situation. This enables the efficiency and automation of logistics and food delivery.

[0230] "User" means the end user who orders and receives goods and services.

[0231] "Means for accepting product orders" refers to an interface or device for receiving product or food orders from users.

[0232] "Order data" is a collection of information about an order, such as product or dish ID, quantity, delivery address, and payment information.

[0233] "Validation" refers to the process of checking whether input data is accurate.

[0234] "Means of storage" refers to methods and devices for recording and retaining information in a database, etc.

[0235] An "automated warehouse system" is a system for automatically organizing, managing, and retrieving goods within a warehouse.

[0236] The "item pickup instruction" is an instruction to pick up the ordered item from a specified location.

[0237] "Delivery address data" refers to the address information of the destination to which the product or meal is to be delivered.

[0238] The "optimal delivery route" is the most efficient route for efficiently delivering goods or food.

[0239] "Planning means" refers to a method or device for calculating and setting delivery routes.

[0240] An "autonomous mobility terminal" is a robot or vehicle that uses sensors and AI to operate autonomously and make deliveries.

[0241] "Means for monitoring operations" means a system or method for checking the current location and status of an autonomous mobility terminal in real time.

[0242] "AI Driver" refers to an artificial intelligence-based driving system installed in autonomous mobility devices.

[0243] "Payment" refers to the payment process when receiving goods or food.

[0244] A "sensor" is a device that detects a physical quantity and converts it into an electrical signal.

[0245] An "alarm system" is a warning device that alerts you to abnormalities or dangers.

[0246] A "restaurant menu" is a list of the food and drinks offered by a restaurant.

[0247] "Cash or electronic payment" refers to various forms of payment, such as cash payment, credit card payment, and electronic money.

[0248] The present invention relates to a system for automated delivery from restaurants to customers. This system is designed to consistently automate the entire process, from receiving orders to picking up food, delivering it, delivering it, and making payments. Specific embodiments of the system are described below.

[0249] server

[0250] 1. Order acceptance

[0251] The server accepts food orders from users via a dedicated application or web interface. Order information includes the food ID, quantity, delivery address, and payment information.

[0252] When the order data reaches the server, the server performs validation to check the format of the input data and any missing fields, thereby ensuring that the data is accurate.

[0253] If validation is successful, the order data is saved to the database, after which an order confirmation notification is sent to the user.

[0254] 2. Product Pickup Instructions

[0255] The server sends a pickup instruction to the restaurant based on the order information. The server generates an API request including the dish ID, quantity, and location information within the restaurant, and sends it to the restaurant.

[0256] 3. Delivery route planning

[0257] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS), which then transmits the planned route information to the autonomous mobility terminal.

[0258] 4. Operation management

[0259] The server monitors the location information of the autonomous driving mobility in real time and issues driving instructions as necessary. If an obstacle (such as traffic congestion or an accident) occurs, the server calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[0260] Autonomous driving mobility terminal

[0261] 1. Food loading

[0262] The device receives instructions from the server and communicates with the restaurant's AI driver, who then picks up the specified dishes and accurately loads them onto the autonomous mobility vehicle.

[0263] Using sensors and cameras, it checks whether the food has been loaded correctly and notifies the server when loading is complete.

[0264] 2. Start of autonomous driving

[0265] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[0266] 3. Safety management

[0267] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[0268] 4. Delivery and Payment

[0269] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the food to the recipient.

[0270] The recipient enters payment information on the terminal, which then processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a notification of delivery completion to the server.

[0271] User

[0272] 1. Order Entry

[0273] Users order food through the system's web interface or a dedicated app. Order information includes the food ID, quantity, delivery address, and payment information.

[0274] The user confirms the order confirmation screen and presses the final order button to confirm the order. The order information is sent to the server, where it is validated and saved.

[0275] 2. Receiving notifications

[0276] The user receives order confirmation notifications from the server, as well as notifications about delivery progress and estimated arrival times.

[0277] 3. Receipt confirmation and payment

[0278] The user prepares to receive the food at the specified delivery time, and when the AI ​​driver delivers the food, the user confirms receipt.

[0279] Upon receiving the item, enter your payment information into the terminal if necessary to complete the payment. If the payment is successful, you will receive a confirmation notification and the order will be recorded in your order history.

[0280] Specific examples

[0281] For example, when a user orders food from a restaurant using a dedicated app, the system operates in the following steps:

[0282] Users enter order information (food ID, quantity, delivery address, payment information) through the app and make a final confirmation.

[0283] The server receives this order information, performs validation, and then sends a food pickup instruction to the restaurant's automated warehouse system.

[0284] Based on instructions from the server, the terminal's AI driver will pick up the food and load it into the self-driving mobility vehicle.

[0285] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[0286] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[0287] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the food to the recipient. The user then pays on the device and the delivery is complete.

[0288] Examples of prompts to input to the AI ​​model:

[0289] "Please explain the order-taking function of a food delivery system."

[0290] "Please explain what algorithms are used to plan delivery routes using autonomous mobility."

[0291] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0292] Step 1:

[0293] The user enters an order

[0294] The user enters food order information through a dedicated application or web interface. The order information includes the food ID, quantity, delivery address, and payment information. The user checks the order confirmation screen and presses the final order button to confirm the order, and this data is sent to the server. The input data reaches the server and proceeds to the next validation step.

[0295] Step 2:

[0296] The server validates and saves the order data

[0297] The server validates the received order information to check that the input data format is correct and that all fields are complete. If validation is successful, the server saves the order information in the database and sends an order confirmation notification to the user. In this step, the accuracy of the data is maintained by verifying the input data and saving it in the database.

[0298] Step 3:

[0299] The server sends a pickup instruction to the restaurant

[0300] The server sends a pickup instruction to the restaurant based on the validated and saved order information. The server generates an API request including the dish ID, quantity, and location information within the restaurant, and sends it to the restaurant. The restaurant's system receives this instruction and prepares the specified dish.

[0301] Step 4:

[0302] The server plans the optimal delivery route based on the delivery destination address data.

[0303] The server uses a geographic information system (GIS) to plan the optimal delivery route based on the address data of the delivery destination. The delivery route information is sent to the autonomous driving mobility terminal. In this step, the route is calculated using the input address data, and an efficient delivery plan is created.

[0304] Step 5:

[0305] The server sends delivery route information to the autonomous mobility device and monitors its operation.

[0306] The server sends planned delivery route information to the autonomous mobility device and monitors the operation in real time. If an obstacle such as a traffic jam or accident occurs, it calculates a new optimal route and sends instructions to the device.

[0307] Step 6:

[0308] The device loads the food

[0309] The device receives instructions from the server, works with the restaurant's AI driver to pick up the specified dishes, and loads them accurately onto the autonomous mobility vehicle. Using sensors and cameras, the device checks whether the dishes have been loaded correctly and notifies the server when loading is complete.

[0310] Step 7:

[0311] The device begins autonomous driving

[0312] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[0313] Step 8:

[0314] The device manages safety

[0315] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[0316] Step 9:

[0317] The terminal handles delivery and payment

[0318] When the delivery arrives at the destination, the device sends a notification of arrival to the server. The AI ​​driver then carries the food and hands it over to the recipient. The recipient then enters payment information on the device, which then connects to the payment system to process the payment. After payment is complete, the device sends a notification of delivery completion to the server.

[0319] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0320] The present invention relates to a system that automates the transportation of goods from a logistics terminal to a delivery destination and combines it with an emotion engine that recognizes user emotions. Specific embodiments of the system will be described below.

[0321] server

[0322] 1. Order acceptance

[0323] The server accepts product orders from users via a web interface or mobile app. Order information includes product ID, quantity, delivery address, and payment information.

[0324] When the order data reaches the server, the server performs validation to check the format of the input data and any missing fields, thereby ensuring that the data is accurate.

[0325] If validation is successful, the server saves the order information to the database, after which an order confirmation notification is sent to the user.

[0326] 2. Product Pickup Instructions

[0327] The server sends product pickup instructions to the automated warehouse system based on the order information. The server generates an API request including the product ID, quantity, and location information within the warehouse, and sends it to the automated warehouse system.

[0328] 3. Delivery route planning

[0329] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS), which then transmits the planned route information to the autonomous mobility terminal.

[0330] 4. Operation management

[0331] The server monitors the location information of the autonomous driving mobility in real time and issues driving instructions as necessary. If an obstacle (such as traffic congestion or an accident) occurs, the server calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[0332] 5. Emotion Engine

[0333] The server uses an emotion engine to collect data to recognize the user's emotions, which are then fed back during the ordering process and when sending notifications.

[0334] The emotion engine dynamically adjusts notification content based on the user's emotional state, improving the user experience.

[0335] Terminal (autonomous driving mobility)

[0336] 1. Product loading

[0337] The terminal receives instructions from the server and communicates with an AI driver in the logistics terminal, who then picks up the specified items and accurately loads them onto the autonomous mobility vehicle.

[0338] Using sensors and cameras, it checks whether the items have been loaded correctly and notifies the server that loading is complete.

[0339] 2. Start of autonomous driving

[0340] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[0341] 3. Safety management

[0342] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[0343] 4. Delivery and Payment

[0344] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the goods and hands them over to the recipient.

[0345] The recipient enters payment information on the terminal, which then processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a notification of delivery completion to the server.

[0346] User

[0347] 1. Order Entry

[0348] Users order products through the system's web interface or a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[0349] The user confirms the order confirmation screen and presses the final order button to confirm the order. The order information is sent to the server, where it is validated and saved.

[0350] 2. Receiving notifications

[0351] The user receives order confirmation notifications from the server, as well as notifications about delivery progress and estimated arrival times.

[0352] 3. Receipt confirmation and payment

[0353] The user prepares to receive the goods at the specified delivery time, and when the AI ​​driver delivers the goods, the user confirms receipt.

[0354] Upon receiving the item, enter your payment information into the terminal if necessary to complete the payment. If the payment is successful, you will receive a confirmation notification and the order will be recorded in your order history.

[0355] 4. Emotional Data

[0356] Through the emotion engine, users can provide their own emotional data during the ordering process, and the server will dynamically adjust the notification and service content accordingly.

[0357] Specific examples

[0358] For example, if a user orders a product from location A using a dedicated app, the system operates in the following steps:

[0359] The user enters order information (product ID, quantity, delivery address, payment information) through the app and makes a final confirmation.

[0360] The server receives this order information, performs validation, and then sends product pickup instructions to the automated warehouse system at the logistics terminal.

[0361] Based on instructions from the server, the terminal will have an AI driver pick up the goods and load them into the self-driving mobility vehicle.

[0362] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[0363] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[0364] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the product to the recipient. The user then pays on the device and the delivery is complete.

[0365] Furthermore, the emotion engine recognizes the user's emotions and collects feedback during delivery and after receipt, allowing the server to improve the service content for the next time.

[0366] This invention can effectively solve problems such as driver shortages and declining logistics efficiency. In addition, the use of an emotion engine can improve the user experience and increase customer satisfaction.

[0367] The processing flow will be explained below.

[0368] server

[0369] Order acceptance

[0370] Step 1:

[0371] The server receives an HTTP request sent by the user, which includes the product ID, quantity, delivery address, and payment information.

[0372] Step 2:

[0373] The server checks the format of the received order information and validates that there are no missing fields.

[0374] Step 3:

[0375] If validation is successful, the server saves the order information to the database.

[0376] Step 4:

[0377] After the order information has been saved, the server sends a confirmation notice to the user terminal.

[0378] Product Pickup Instructions

[0379] Step 1:

[0380] Based on the order information, the server generates product pickup instructions for the automated warehouse system at the logistics terminal.

[0381] Step 2:

[0382] The server sends an API request to the automated warehouse system, which includes the product ID, warehouse location, and quantity.

[0383] Step 3:

[0384] The automated warehouse system notifies the server that the product has been picked up.

[0385] Delivery route planning

[0386] Step 1:

[0387] The server parses the delivery address data.

[0388] Step 2:

[0389] The server uses a geographic information system (GIS) to plan the optimal delivery route.

[0390] Step 3:

[0391] Planned delivery route information is sent to the autonomous mobility device.

[0392] Operation management

[0393] Step 1:

[0394] The server monitors the location information of autonomous vehicles in real time.

[0395] Step 2:

[0396] When an obstacle (such as traffic jam or accident) occurs, the server calculates a new route and sends instructions to the terminal.

[0397] Step 3:

[0398] Continue monitoring and supervision until delivery is complete.

[0399] Emotion Engine

[0400] Step 1:

[0401] The server uses an emotion engine to collect emotion data from users.

[0402] Step 2:

[0403] The collected emotional data is analyzed to identify the user's emotional state.

[0404] Step 3:

[0405] Based on the analysis results, notification content and service content are dynamically adjusted.

[0406] Step 4:

[0407] Emotional data is accumulated to improve services and reflected in future service content.

[0408] Terminal (autonomous driving mobility)

[0409] Product loading

[0410] Step 1:

[0411] The terminal receives instructions from the server.

[0412] Step 2:

[0413] The terminal works in conjunction with an AI driver in the logistics terminal to pick up the specified items.

[0414] Step 3:

[0415] The terminal uses sensors and cameras to verify that the goods have been loaded correctly.

[0416] Step 4:

[0417] Once loading is complete, the terminal sends a notification to the server.

[0418] Automatic operation begins

[0419] Step 1:

[0420] The terminal receives delivery route information from the server.

[0421] Step 2:

[0422] The device will then begin autonomous driving according to the specified route.

[0423] Step 3:

[0424] While in operation, the device uses sensors and cameras to monitor its surroundings.

[0425] safety management

[0426] Step 1:

[0427] The device detects obstacles and abnormalities based on sensor and camera data.

[0428] Step 2:

[0429] If an obstacle is detected, the device will automatically slow down or stop.

[0430] Step 3:

[0431] Once conditions are deemed safe, the terminal will resume operation.

[0432] Delivery and payment

[0433] Step 1:

[0434] When the terminal arrives at the delivery destination, it sends an arrival notification to the server.

[0435] Step 2:

[0436] The AI ​​driver transports the goods and delivers them to the recipient.

[0437] Step 3:

[0438] The terminal receives payment information from the recipient and works with the payment system to process the payment.

[0439] Step 4:

[0440] After the payment is completed, the terminal sends a notification of delivery completion to the server.

[0441] User

[0442] Order Entry

[0443] Step 1:

[0444] Users select products through a web interface or mobile app.

[0445] Step 2:

[0446] The user enters the delivery address and payment information.

[0447] Step 3:

[0448] The user checks the order confirmation screen and makes a final confirmation.

[0449] Step 4:

[0450] The user presses the order button and sends the order information to the server.

[0451] Receive notifications

[0452] Step 1:

[0453] The user receives an order confirmation notice sent from the server.

[0454] Step 2:

[0455] Users will receive notifications regarding delivery progress and estimated arrival times.

[0456] Receipt confirmation and payment

[0457] Step 1:

[0458] The user prepares to receive the product at the scheduled delivery time.

[0459] Step 2:

[0460] When receiving the item, the user enters payment information on the terminal and completes the payment.

[0461] Step 3:

[0462] The user confirms receipt on the terminal and the delivery is completed.

[0463] Emotional Data Feedback

[0464] Step 1:

[0465] The user inputs or provides their emotional data during the ordering process.

[0466] Step 2:

[0467] The user receives feedback through the emotion engine.

[0468] Step 3:

[0469] The server analyzes the user's emotional data and improves the content of the service next time.

[0470] Specific examples

[0471] For example, if a user orders a product from location A using a dedicated app, the system operates in the following steps:

[0472] The user enters order information (product ID, quantity, delivery address, payment information) through the app and makes a final confirmation.

[0473] The server receives this order information, performs validation, and then sends product pickup instructions to the automated warehouse system at the logistics terminal.

[0474] Based on instructions from the server, the terminal will have an AI driver pick up the goods and load them into the self-driving mobility vehicle.

[0475] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[0476] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[0477] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the product to the recipient. The user then pays on the device and the delivery is complete.

[0478] Furthermore, the emotion engine recognizes the user's emotions and collects feedback during delivery and after receipt, allowing the server to improve the service content for the next time.

[0479] This invention can effectively solve problems such as driver shortages and declining logistics efficiency. In addition, the use of an emotion engine can improve the user experience and increase customer satisfaction.

[0480] Example 2

[0481] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0482] Conventional logistics systems face issues such as labor shortages and declining efficiency, and there is a demand for improved user experience. This invention aims to solve these issues and further increase customer satisfaction by recognizing user emotions and dynamically adjusting service content.

[0483] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0484] In this invention, the server includes means for accepting product orders from users, means for validating and storing order data, means for sending product pickup instructions to an automated storage system, means for planning an optimal delivery route based on delivery destination address data, means for sending delivery route information to an autonomous mobile device and monitoring operation, means for an autonomous mobile device carrying products to operate along a specified route, means for the autonomous mobile device to transport the products at the delivery destination and process payments with the recipient, means for providing sensors and alarm devices to prevent accidents, and means for collecting user emotion data and dynamically adjusting notification content. This can address issues such as labor shortages and logistics efficiency, and by utilizing an emotion engine, it is possible to improve the user experience.

[0485] "User" means a person or organization that uses the System to order and receive delivery of Goods.

[0486] "Means for accepting product orders" refers to the part that provides a function for receiving product order information from users via a web interface or mobile application.

[0487] "Means for validating and storing order data" refers to the part that provides a function for checking the format and incompleteness of order information received from a user and storing accurate data in a database.

[0488] "Automated storage system" refers to warehouse management equipment and related systems that automatically store and retrieve goods.

[0489] The "means for sending product pickup instructions" refers to a part that provides a function for sending product pickup instructions to the automated storage system based on order information.

[0490] "Means for planning the optimal delivery route from the address data of the delivery destination" refers to the part that provides the function of analyzing the address information of the delivery destination and calculating the optimal delivery route using a geographic information system (GIS).

[0491] "Autonomous mobile terminal" refers to a mobility device that automatically delivers goods.

[0492] "Means for transmitting delivery route information and monitoring operation" refers to the part that provides the function of transmitting planned delivery route information to an autonomous mobile terminal and monitoring the location information and status of the terminal in real time while it is in operation.

[0493] "Means for an autonomous mobile terminal carrying goods to travel along a designated route" refers to the part that provides the function for an autonomous mobile terminal to travel along a planned delivery route carrying goods.

[0494] "Means for an autonomous mobile terminal to transport goods at the delivery destination and settle payments with the recipient" refers to the part that provides the function for an autonomous mobile terminal that arrives at the delivery destination to hand over goods to the recipient and for the recipient to enter payment information and complete payment.

[0495] "Sensors and alarm devices for preventing accidents" refers to sensors for detecting obstacles installed to ensure the safe operation of autonomous mobile devices, and devices that issue alarms in the event of an abnormality.

[0496] An "emotion engine" refers to a system that recognizes a user's emotions and dynamically adjusts notification content and service content based on collected emotional data.

[0497] The present invention relates to a system that automates the transportation of goods from a logistics terminal to a delivery destination and combines it with an emotion engine that recognizes user emotions. An embodiment of the system will be described below.

[0498] server

[0499] The server runs using the following hardware and software:

[0500] Hardware: High-performance processor (e.g., Intel Xeon), large memory capacity (e.g., 64GB or more RAM), high-speed storage (e.g., SSD)

[0501] Software: Operating system (e.g., Linux), database management system (e.g., MySQL), web server (e.g., Apache)

[0502] The server accepts product orders from users. Users enter order information via a web interface or mobile app. This order information includes product ID, quantity, delivery address, and payment information. The server performs validation to check the format of the order data and for missing fields to ensure the data is accurate. If validation is successful, the order information is saved to the database and an order confirmation notification is sent to the user. The server then sends a product pickup instruction to the automated storage system based on the order information. This API request includes the product ID, quantity, and location within the warehouse.

[0503] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS). The planned route information is sent to the autonomous mobile terminal. The server monitors the location information of the autonomous mobile terminal in real time and issues driving instructions as necessary. If an obstacle information (traffic jam, accident, etc.) occurs, it calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[0504] Furthermore, the server uses an emotion engine to recognize the user's emotions, which dynamically adjusts the notification content based on the user's emotional state to improve the user experience.

[0505] Terminal (autonomous driving vehicle)

[0506] The terminal is implemented using the following hardware and software:

[0507] Hardware: Processors (e.g., NVIDIA Jetson), sensors (e.g., LiDAR, cameras), and communication modules (e.g., 5G modules) that support autonomous driving technology

[0508] Software: Autonomous driving software platform (e.g., Autoware), real-time operating system (RTOS)

[0509] The terminal receives instructions from the server and connects to the automated storage system. The AI ​​driver picks up the specified items and loads them onto the autonomous vehicle. Using sensors and cameras, the terminal checks whether the items have been loaded correctly and notifies the server of completion.

[0510] The autonomous vehicle receives delivery route information sent from the server and begins autonomous driving. During operation, it uses sensors and cameras to monitor the surroundings and maintain safe conditions. The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume operation.

[0511] When the delivery arrives at the destination, the terminal sends an arrival notification to the server. The AI ​​driver transports the goods and hands them over to the recipient. The recipient enters payment information on the terminal, and the terminal processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a delivery completion notification to the server.

[0512] User

[0513] The user uses the service in the following way:

[0514] Order entry: A user orders a product through the system's web interface or a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[0515] For example, enter "Product ID 12345, Quantity 2, Delivery address Shibuya-ku, Tokyo, Payment method Credit card."

[0516] Receive notifications: The user receives order confirmation notifications sent by the server, as well as notifications about delivery progress and estimated arrival times.

[0517] Example: "Your order has been placed. The estimated delivery date is ____."

[0518] Confirmation of receipt and payment: The user prepares to receive the product at the specified delivery time. When the AI ​​driver delivers the product, the user confirms receipt. Upon receipt, the user enters payment information into the terminal to complete the payment.

[0519] For example: "Enter your credit card information and complete the payment."

[0520] Emotion data provision: Users provide their own emotional data through the emotion engine during the ordering process and delivery. The server dynamically adjusts the notification content and service content based on the collected emotional data, improving the next service.

[0521] For example: Providing feedback such as "I felt good when I placed my order."

[0522] An example of a prompt for the generative AI model could be, "Please explain in detail the entire process from when a user orders a product through a dedicated app to when it is delivered and when it is received."

[0523] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0524] Step 1:

[0525] User enters order for product

[0526] The user enters order information (product ID, quantity, delivery address, payment information) through the system's web interface or app.

[0527] Input: Product ID, quantity, delivery address, payment information

[0528] Output: Send order data to the server

[0529] Specific operation: For example, the user enters "Product ID: 12345, Quantity: 2, Delivery address: Shibuya-ku, Tokyo, Payment information: Credit card" and presses the final confirmation button. The system sends the order information to the server.

[0530] Step 2:

[0531] The server receives the order data, validates it, and saves it.

[0532] The server receives the order data, validates the data format and checks for any missing fields, and if successful, saves it in the database and sends an order confirmation to the user.

[0533] Input: Order data from the user

[0534] Output: Save to database, send order confirmation

[0535] Specific operation: The server receives the order information "Product ID: 12345, Quantity: 2, Delivery address: Shibuya-ku, Tokyo, Payment information: Credit card" and checks whether there are any missing fields. If confirmed, it saves it in the database and sends a notification to the user that "The order has been confirmed."

[0536] Step 3:

[0537] The server sends product pickup instructions to the automated storage system

[0538] The server sends product pickup instructions to the automated storage system based on the order information.

[0539] Input: Order data stored on the server

[0540] Output: Product pickup instructions to the automated storage system

[0541] Specific operation: The server sends a pickup instruction for "item ID: 12345, quantity: 2, location A3" to the automated storage system, which then begins preparing to retrieve the item.

[0542] Step 4:

[0543] Autonomous mobile terminal picks up and loads products

[0544] The terminal receives instructions from the server and works with the automated storage system to pick up the products. Sensors and cameras check that the products are loaded correctly.

[0545] Input: Pickup instructions from the server

[0546] Output: Product loading completion notification

[0547] Specific operation: The AI ​​driver picks up "Product ID: 12345, Quantity: 2" and loads it onto the autonomous vehicle. It checks with sensors and cameras and notifies the server that loading is complete.

[0548] Step 5:

[0549] The server plans the delivery route and sends the information

[0550] The server analyzes the delivery address data to plan the optimal delivery route and transmits the route information to the autonomous mobile terminal.

[0551] Input: Delivery address data, Geographic Information System (GIS) data

[0552] Output: Sending route information

[0553] Specific operation: The server uses GIS to calculate the route from "Shibuya-ku, Tokyo" to "Minato-ku, Tokyo" and sends the "shortest route" to the autonomous driving vehicle.

[0554] Step 6:

[0555] Autonomous driving mobile devices start driving autonomously

[0556] The device receives route information sent from the server and begins autonomous driving, while monitoring the surroundings using sensors and cameras.

[0557] Input: Route information, sensor data

[0558] Output: Maintaining safe operation

[0559] Specific operation: The autonomous driving mobile device begins autonomous driving from "Shibuya Ward, Tokyo" to "Minato Ward, Tokyo," and monitors the surrounding situation in real time using sensors and cameras.

[0560] Step 7:

[0561] The server monitors the operation and issues instructions

[0562] The server monitors the location information of autonomous mobile devices in real time and issues driving instructions as necessary.

[0563] Input: Location information of autonomous driving mobile terminal, obstacle information

[0564] Output: Send instruction information

[0565] Specific operation: Using a telemetry system, the autonomous vehicle sends information such as "Current location: Shibuya Ward, no obstacles, continuing operation" to a server, and the server issues instructions for a "new optimal route" as necessary.

[0566] Step 8:

[0567] An autonomous mobile device arrives at the delivery destination, delivers the product, and takes payment.

[0568] Upon arriving at the delivery destination, the AI ​​driver hands over the product to the recipient, who then enters payment information on the terminal to complete the payment.

[0569] Input: Delivery information, payment information

[0570] Output: Product delivery and payment completion notification

[0571] Specific operation: The autonomous mobile device "arrives at the delivery destination and hands over the product," and the recipient "enters payment information and completes payment." At the same time, a "delivery completion notification" is sent to the server.

[0572] Step 9:

[0573] The server uses an emotion engine to collect and analyze user emotions.

[0574] The server uses an emotion engine to collect user emotion data and dynamically adjust the notification content.

[0575] Input: User emotion data

[0576] Output: Adjusted notification content

[0577] Specific operation: The server analyzes the user's "emotional data (e.g., facial expression data and voice data)" during the ordering process or when sending notifications, and sends "appropriate feedback notifications" to the user.

[0578] Step 10:

[0579] Users provide emotional data and receive feedback

[0580] The user provides their own emotional data through the emotion engine, and the server provides service content based on that data.

[0581] Input: User emotion data

[0582] Output: Feedback notification based on emotion

[0583] Specific operation: The user inputs "mood and emotional data for the day," and the server sends "feedback notifications to improve the next service content."

[0584] (Application example 2)

[0585] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0586] Conventional food delivery systems have not sufficiently improved efficiency and customer satisfaction during the delivery process. Furthermore, there is a need for systems that can flexibly respond to obstacles and changes in traffic conditions during delivery. Furthermore, there is a lack of systems that can collect customer sentiment and feedback in real time and dynamically adjust services based on that information. This invention aims to solve these issues and provide an efficient food delivery service with high customer satisfaction.

[0587] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0588] In this invention, the server includes means for accepting product and service orders from users, means for validating and storing order data, means for sending product pickup instructions to an automated warehouse system, means for planning an optimal delivery route based on delivery destination address data, means for sending delivery route information to an autonomous driving terminal and monitoring operation, means for an autonomous driving terminal loaded with products and services to operate along a specified route, means for an AI operator to transport the products and services and process payments at the delivery destination, means for providing sensors and alarm systems to prevent accidents, and means for using an emotion engine to analyze user emotions and dynamically adjust notifications, thereby enabling the efficiency of the delivery process and improving customer satisfaction.

[0589] "User" means any person or entity that uses the System to place orders for goods and services.

[0590] "Means for accepting product and service orders" refers to the overall interface and associated processes by which a user can enter an order for a product or service and have it accepted by the system.

[0591] "Validation" is a process of checking entered order data to ensure it is accurate and complete.

[0592] "Means for storing" refers to a method for accumulating user order information and other related data in storage such as a database.

[0593] An "automated warehouse system" is a system that uses robotics and AI to automatically manage and pick up goods.

[0594] "Means for sending a pickup instruction" refers to a method for sending an instruction from the server to the automated warehouse system to pick up a specific product.

[0595] "Address Data" refers to information about delivery addresses and is used to plan delivery routes.

[0596] "Means for planning delivery routes" refers to systems or algorithms for calculating and determining optimal delivery routes based on delivery address data and geographic information.

[0597] An "autonomous driving terminal" refers to a mobility device that uses robotics technology to operate autonomously and deliver goods and services.

[0598] "Means for monitoring operations" refers to a system that monitors the location and operating status of autonomous driving terminals in real time and issues instructions as necessary.

[0599] "AI pilot" is a technology that uses artificial intelligence to control and operate autonomous driving devices.

[0600] A "payment method" is a system for processing payments from customers when receiving goods or services.

[0601] "Sensor and alarm system for accident prevention" refers to a device that detects obstacles and abnormalities to ensure safe operation of an autonomous driving device and issues warnings as necessary.

[0602] The "Emotion Engine" is an artificial intelligence-based system for recognizing and analyzing user emotions and dynamically adjusting the content of services and notifications.

[0603] The present invention is a food delivery system that applies autonomous driving technology and dynamically adjusts services using user emotion data to achieve efficient delivery with high customer satisfaction. Specific embodiments for implementing the present invention are described below.

[0604] server

[0605] The server has the following functions:

[0606] 1. A means of accepting orders for products and services from users

[0607] Orders are accepted from users through a web interface or mobile application. Order information includes product ID, quantity, delivery address, and payment information.

[0608] For example, a user orders a "Margherita pizza" through a smartphone app and enters the delivery address.

[0609] 2. A way to validate and store order data

[0610] Check the format of the received order information and any missing fields to confirm the accuracy of the data.

[0611] If validation is successful, save the order information to the database and send an order confirmation notification to the user.

[0612] 3. Means of sending product pickup instructions to the automated warehouse system

[0613] The server generates an API request containing the product ID, quantity, and location within the warehouse and sends it to the automated warehouse system.

[0614] 4. A means to plan optimal delivery routes based on delivery address data

[0615] Using a geographic information system (GIS), the optimal delivery route is calculated based on the delivery destination address data.

[0616] The planned route information is sent to the autonomous driving terminal.

[0617] 5. Means of monitoring operations

[0618] The location information of the autonomous driving device is monitored in real time and driving instructions are issued as necessary.

[0619] If congestion or an obstacle is detected, a new optimal route is calculated and sent to the device.

[0620] 6. A method to analyze user emotions and dynamically adjust notifications using an emotion engine

[0621] Collect and analyze user sentiment data during delivery and after delivery, and dynamically adjust notifications and service content based on the analysis results to improve the user experience.

[0622] For example, if a delivery is delayed, the system can sense the user's stress and send a notification offering a coupon.

[0623] Terminal (autonomous driving terminal)

[0624] The terminal has the following functions:

[0625] 1. A means of transporting goods and services along designated routes by automated driving devices.

[0626] It will begin autonomous driving along the designated route, and will constantly monitor the surrounding conditions using sensors and cameras while in operation.

[0627] For example, if the device detects an obstacle on the road during a delivery, it will automatically take a detour.

[0628] 2. AI-operated delivery of goods and services and payment at the destination

[0629] When the self-driving device arrives at the delivery destination, the AI ​​operator transports the goods and hands them over to the user.

[0630] The user enters payment information on the terminal and makes the payment.

[0631] 3. Means equipped with sensors and alarm systems to prevent accidents

[0632] It analyzes sensor and camera data to detect obstacles and abnormalities, and if an abnormality is detected, the device will automatically slow down or stop.

[0633] User

[0634] The user performs the following operations:

[0635] 1. Entering Goods and Services Orders

[0636] Order products through a web interface or a dedicated app, and enter your delivery address and payment information.

[0637] For example, order a "Margherita Pizza" and enter your home address.

[0638] 2. Receiving Notifications

[0639] Receive notifications from the server regarding order confirmation, delivery progress, and estimated arrival time.

[0640] For example, a notification like "Your pizza order is currently being delivered."

[0641] 3. Receipt confirmation and payment

[0642] Receive the product at the delivery address, enter payment information if necessary, and complete the payment.

[0643] 4. Providing Emotion Data

[0644] Through the emotion engine, customers provide their own emotional data during the ordering process, and the server dynamically adjusts notifications and service content based on this data.

[0645] Examples and prompts

[0646] Examples:

[0647] A user orders a Margherita pizza through the app and enters their delivery address and payment information.

[0648] The server validates the order information, stores it in the database, and sends a pickup instruction to the automated warehouse system.

[0649] The self-driving terminal picks up the goods and begins delivery along the designated route.

[0650] Detects obstacles on the route and automatically detours around them.

[0651] Once the delivery arrives, the AI ​​operator delivers the goods, and the user completes the payment.

[0652] The server uses an emotion engine to collect feedback during delivery and improve the next service.

[0653] Example prompt sentence:

[0654] "Deliver Margherita pizza to 4-2-8 Shibakoen, Minato-ku, Tokyo for order ID 12345. Calculate and submit the optimal route."

[0655] "Analyze customer feedback and tailor your notifications based on sentiment data."

[0656] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0657] Step 1:

[0658] The server accepts the order

[0659] Input: The user inputs product and service order information through a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[0660] Specific Operations: The server receives the order information via a web interface or mobile application.

[0661] Output: The order information is sent to the server.

[0662] Step 2:

[0663] The server validates and saves the order data

[0664] Input: Received order information.

[0665] Specific behavior: The server checks the order information for format and missing fields to ensure the data is accurate. If validation is successful, it saves the order information to the database and sends an order confirmation notification to the user.

[0666] Output: Validated order information and confirmation notice.

[0667] Step 3:

[0668] The server sends product pickup instructions to the automated warehouse system

[0669] Input: Validated order information (item ID, quantity, warehouse location).

[0670] Specific operation: The server generates an API request containing the product ID, quantity, and location information within the warehouse and sends it to the automated warehouse system.

[0671] Output: Pickup instructions to the automated warehouse system.

[0672] Step 4:

[0673] The server plans the optimal delivery route based on the delivery destination address data.

[0674] Input: Delivery address data.

[0675] Specific operation: The server uses a geographic information system (GIS) to calculate the optimal delivery route based on the delivery destination address data.

[0676] Output: Optimal delivery route information.

[0677] Step 5:

[0678] The server sends delivery route information to the autonomous driving terminal and monitors operation.

[0679] Input: Optimal delivery route information.

[0680] Specific operation: The server sends the planned route information to the autonomous driving terminal, monitors the location information in real time, and issues driving instructions according to the situation.

[0681] Output: Route information and instructions to the autonomous driving terminal.

[0682] Step 6:

[0683] The terminal is loaded with goods and services and begins operation.

[0684] Input: Delivery route information and product loading status from the server.

[0685] Specific operation: The autonomous driving device starts driving along the designated route, and while driving, it monitors the surroundings using sensors and cameras.

[0686] Output: Surroundings data and driving notifications.

[0687] Step 7:

[0688] The terminal delivers goods and services to the destination, where an AI operator delivers them and makes payments.

[0689] Input: Shipping address and product information.

[0690] Specific operation: When the autonomous driving terminal arrives at the delivery destination, the AI ​​operator carries the goods and delivers them to the user, who then enters payment information on the terminal and makes the payment.

[0691] Output: Receipt notification and payment completion notification.

[0692] Step 8:

[0693] The server monitors the sensor and alarm systems to prevent accidents.

[0694] Input: Sensor data from the autonomous driving device.

[0695] Specific operation: The server analyzes sensor and camera data, and if it detects an obstacle or abnormality, it instructs the device to slow down or stop. When it determines that the situation is safe, it resumes operation.

[0696] Output: Anomaly detection notification and operation instructions.

[0697] Step 9:

[0698] The server uses an emotion engine to analyze the user's emotions and dynamically adjust notifications.

[0699] Input: Feedback messages and sentiment data from users.

[0700] Specific operation: The server uses an emotion engine to analyze the user's emotions and dynamically adjusts the notification content and service content based on the feedback results.

[0701] Output: Dynamically adjusted notifications and service offerings.

[0702] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0703] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0704] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0705] [Second embodiment]

[0706] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0707] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0708] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0709] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0710] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0711] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0712] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0713] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0714] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0715] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0716] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0717] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0718] The present invention relates to a system for automating the transportation of goods from a logistics terminal to a delivery destination. This system is designed to consistently automate the entire process from order acceptance to product pickup, delivery, handover, and payment. Specific embodiments of the system are described below.

[0719] server

[0720] 1. Order acceptance

[0721] The server accepts product orders from users via a web interface or mobile app. Order information includes product ID, quantity, delivery address, and payment information.

[0722] When the order data reaches the server, the server performs validation to check the format of the input data and any missing fields, thereby ensuring that the data is accurate.

[0723] If validation is successful, the order data is saved to the database, after which an order confirmation notification is sent to the user.

[0724] 2. Product Pickup Instructions

[0725] The server sends product pickup instructions to the automated warehouse system based on the order information. The server generates an API request including the product ID, quantity, and location information within the warehouse, and sends it to the automated warehouse system.

[0726] 3. Delivery route planning

[0727] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS), which then transmits the planned route information to the autonomous mobility terminal.

[0728] 4. Operation management

[0729] The server monitors the location information of the autonomous driving mobility in real time and issues driving instructions as necessary. If an obstacle (such as traffic congestion or an accident) occurs, the server calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[0730] Terminal (autonomous driving mobility)

[0731] 1. Product loading

[0732] The terminal receives instructions from the server and communicates with an AI driver in the logistics terminal, who then picks up the specified items and accurately loads them onto the autonomous mobility vehicle.

[0733] Using sensors and cameras, it checks whether the items have been loaded correctly and notifies the server that loading is complete.

[0734] 2. Start of autonomous driving

[0735] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[0736] 3. Safety management

[0737] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[0738] 4. Delivery and Payment

[0739] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the goods and hands them over to the recipient.

[0740] The recipient enters payment information on the terminal, which then processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a notification of delivery completion to the server.

[0741] User

[0742] 1. Order Entry

[0743] Users order products through the system's web interface or a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[0744] The user confirms the order confirmation screen and presses the final order button to confirm the order. The order information is sent to the server, where it is validated and saved.

[0745] 2. Receiving notifications

[0746] The user receives order confirmation notifications from the server, as well as notifications about delivery progress and estimated arrival times.

[0747] 3. Receipt confirmation and payment

[0748] The user prepares to receive the goods at the specified delivery time, and when the AI ​​driver delivers the goods, the user confirms receipt.

[0749] Upon receiving the item, enter your payment information into the terminal if necessary to complete the payment. If the payment is successful, you will receive a confirmation notification and the order will be recorded in your order history.

[0750] Specific examples

[0751] For example, if a user orders a product from location A using a dedicated app, the system operates in the following steps:

[0752] The user enters order information (product ID, quantity, delivery address, payment information) through the app and makes a final confirmation.

[0753] The server receives this order information, performs validation, and then sends product pickup instructions to the automated warehouse system at the logistics terminal.

[0754] Based on instructions from the server, the terminal will have an AI driver pick up the goods and load them into the self-driving mobility vehicle.

[0755] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[0756] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[0757] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the product to the recipient. The user then pays on the device and the delivery is complete.

[0758] This invention can effectively solve problems such as driver shortages and declining logistics efficiency. This system can also be used in depopulated areas, realizing efficient logistics over a wide area.

[0759] The processing flow will be explained below.

[0760] server

[0761] Order acceptance

[0762] Step 1:

[0763] The server receives an HTTP request sent by the user, which includes the product ID, quantity, delivery address, and payment information.

[0764] Step 2:

[0765] The server checks the format of the received order information and validates that there are no missing fields.

[0766] Step 3:

[0767] If validation is successful, the server saves the order information to the database.

[0768] Step 4:

[0769] After the order information has been saved, the server sends a confirmation notice to the user terminal.

[0770] Product Pickup Instructions

[0771] Step 1:

[0772] Based on the order information, the server generates product pickup instructions for the automated warehouse system at the logistics terminal.

[0773] Step 2:

[0774] The server sends an API request to the automated warehouse system, which includes the product ID, warehouse location, and quantity.

[0775] Step 3:

[0776] The automated warehouse system notifies the server that the product has been picked up.

[0777] Delivery route planning

[0778] Step 1:

[0779] The server parses the delivery address data.

[0780] Step 2:

[0781] The server uses a geographic information system (GIS) to plan the optimal delivery route.

[0782] Step 3:

[0783] Planned delivery route information is sent to the autonomous mobility device.

[0784] Operation management

[0785] Step 1:

[0786] The server monitors the location information of autonomous vehicles in real time.

[0787] Step 2:

[0788] When an obstacle (such as traffic jam or accident) occurs, the server calculates a new route and sends instructions to the terminal.

[0789] Step 3:

[0790] Continue monitoring and supervision until delivery is complete.

[0791] Terminal (autonomous driving mobility)

[0792] Product loading

[0793] Step 1:

[0794] The terminal receives instructions from the server.

[0795] Step 2:

[0796] The terminal works in conjunction with an AI driver in the logistics terminal to pick up the specified items.

[0797] Step 3:

[0798] The terminal uses sensors and cameras to verify that the goods have been loaded correctly.

[0799] Step 4:

[0800] Once loading is complete, the terminal sends a notification to the server.

[0801] Automatic operation begins

[0802] Step 1:

[0803] The terminal receives delivery route information from the server.

[0804] Step 2:

[0805] The device will then begin autonomous driving according to the specified route.

[0806] Step 3:

[0807] While in operation, the device uses sensors and cameras to monitor its surroundings.

[0808] safety management

[0809] Step 1:

[0810] The device detects obstacles and abnormalities based on sensor and camera data.

[0811] Step 2:

[0812] If an obstacle is detected, the device will automatically slow down or stop.

[0813] Step 3:

[0814] Once conditions are deemed safe, the terminal will resume operation.

[0815] Delivery and payment

[0816] Step 1:

[0817] When the terminal arrives at the delivery destination, it sends an arrival notification to the server.

[0818] Step 2:

[0819] The AI ​​driver transports the goods and delivers them to the recipient.

[0820] Step 3:

[0821] The terminal receives payment information from the recipient and works with the payment system to process the payment.

[0822] Step 4:

[0823] After the payment is completed, the terminal sends a notification of delivery completion to the server.

[0824] User

[0825] Order Entry

[0826] Step 1:

[0827] Users select products through a web interface or mobile app.

[0828] Step 2:

[0829] The user enters the delivery address and payment information.

[0830] Step 3:

[0831] The user checks the order confirmation screen and makes a final confirmation.

[0832] Step 4:

[0833] The user presses the order button and sends the order information to the server.

[0834] Receive notifications

[0835] Step 1:

[0836] The user receives an order confirmation notice sent from the server.

[0837] Step 2:

[0838] Users will receive notifications regarding delivery progress and estimated arrival times.

[0839] Receipt confirmation and payment

[0840] Step 1:

[0841] The user prepares to receive the product at the scheduled delivery time.

[0842] Step 2:

[0843] When receiving the item, the user enters payment information on the terminal and completes the payment.

[0844] Step 3:

[0845] The user confirms receipt on the terminal and the delivery is completed.

[0846] Example 1

[0847] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0848] In conventional logistics systems, driver shortages and declining delivery efficiency are serious problems. Furthermore, because the entire process, from order acceptance to product pickup, delivery, handover, and payment, is done manually, human error and time loss are likely to occur. Furthermore, it is difficult to accommodate depopulated areas, making it necessary to improve the efficiency of logistics.

[0849] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0850] In this invention, the server includes means for accepting product orders from users, means for validating and saving order data, means for sending product pickup instructions to an automated warehouse system, means for planning an optimal delivery route based on delivery destination address data, means for sending delivery route information to an autonomous mobility terminal and monitoring operation, means for an autonomous mobility terminal loaded with products to operate along a specified route, means for an AI driver to transport the products and process payments at the delivery destination, means for providing sensors and an alarm system to prevent accidents, means for monitoring the location information of the autonomous mobility terminal in real time and issuing operation instructions, means for an autonomous mobility terminal that has arrived at the delivery destination to send an arrival notification, and means for the recipient to input payment information on the autonomous mobility terminal and process the payment. This enables the automation and efficiency of the entire logistics process.

[0851] "Means for accepting product orders" refers to a function that receives product ID, quantity, delivery address, and payment information from users via a web interface or mobile app.

[0852] The "means for validating and saving order data" is a function that checks the format of received order data and any missing fields, confirms the accuracy of the data, and then saves it in the database.

[0853] The "means for sending product pickup instructions" is a function that generates an API request containing the product ID, quantity, and location information within the warehouse based on order information, and sends it to the automated warehouse system.

[0854] The "means for planning the optimal delivery route" is a function that analyzes address data of the delivery destination and calculates the shortest route using a geographic information system (GIS).

[0855] "Means for transmitting delivery route information and monitoring operation" refers to a function that transmits planned delivery route information to an autonomous driving mobility terminal and monitors and manages its operation status in real time.

[0856] "Means for operating along a specified route" refers to the function of an autonomous mobility terminal to operate along a specified delivery route based on instructions from a server.

[0857] "Means of transporting goods and making payments" refers to the function in which an AI driver delivers goods to the recipient at the delivery destination, and the recipient enters payment information on the terminal to complete the payment.

[0858] "Means equipped with sensors and alarm systems to prevent accidents" refers to a function that ensures safe operation by equipping the vehicle with sensors to detect obstacles or abnormalities and alarm systems that issue warnings.

[0859] "Means for monitoring location information in real time and issuing driving instructions" refers to a function that uses the GPS of the autonomous driving mobility terminal to monitor location information in real time and issue driving instructions as necessary.

[0860] The "means for sending an arrival notification" is a function that sends a notification to the server when the autonomous driving mobility terminal arrives at the delivery destination.

[0861] "Means for inputting payment information and processing payment" refers to a function in which the recipient inputs payment information on the terminal and links that information with the payment system to complete the payment.

[0862] This invention relates to a system that automates the transportation of goods from a logistics terminal to a delivery destination. This system consists of three main components: a server, a terminal (autonomous driving mobility), and a user. This section explains how each component works together and what specific processing they perform.

[0863] server

[0864] The server plays a central role in the system, managing various data and issuing instructions. First, the server accepts a product order from the user. At this time, the product ID, quantity, delivery address, and payment information are entered via a web interface or mobile app. The server checks the format of the received order data and any missing fields, and performs validation. If validation is successful, the order data is saved in the database and an order confirmation notification is sent to the user.

[0865] Next, the server generates an API request based on the stored order information, including the product ID, quantity, and location information within the warehouse, and sends a product pickup instruction to the automated warehouse system. The specified product is then picked up. The server also analyzes the delivery address data and uses a geographic information system (GIS) to plan the optimal delivery route, and sends the planned delivery route information to the autonomous mobility device.

[0866] The server uses the autonomous mobility's GPS to monitor its location in real time and issues driving instructions as needed. For example, if there is information about a traffic jam, accident, or other obstacle, the server calculates a new optimal route and issues driving instructions to the autonomous mobility device. This management continues until all deliveries are completed.

[0867] Terminal (autonomous driving mobility)

[0868] The terminal operates autonomously based on instructions sent from the server. First, when goods are loaded, the terminal works in conjunction with an AI driver in the logistics terminal to load the specified goods onto the autonomous mobility vehicle. Using sensors and cameras, the terminal checks whether the goods have been loaded correctly and notifies the server once the process is complete.

[0869] The device receives delivery route information sent from the server and begins autonomous driving. During operation, it uses sensors and cameras to monitor the surroundings and ensures safe driving. The AI ​​driver analyzes data obtained from the sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device automatically slows down or stops, and resumes driving once safety is confirmed.

[0870] Upon arriving at the delivery destination, the terminal sends an arrival notification to the server. The AI ​​driver transports the goods and hands them over to the recipient. The recipient enters payment information on the terminal, and the terminal works with the payment system to process the payment. After payment is complete, a delivery completion notification is sent to the server.

[0871] User

[0872] The user enters the product ID, quantity, delivery address, and payment information through a dedicated app or web interface. After checking the order confirmation screen, the user confirms the order by pressing the final order button, and the data is sent to the server. The user then receives an order confirmation notification, delivery progress notification, and estimated arrival time notification from the server.

[0873] At the specified delivery time, the user prepares to receive the product and waits for the terminal to arrive at the delivery address. When the AI ​​driver delivers the product, the user receives the product and checks it. If necessary, they enter payment information into the terminal to complete the payment. This records the order history and completes the entire process.

[0874] Specific examples

[0875] For example, if a user orders a product from point A using a dedicated app, the system operates in the following steps: The user enters order information (product ID, quantity, delivery address, and payment information) through the app and makes a final confirmation. The server receives this order information, validates it, and then sends a product pickup instruction to the automated warehouse system at the logistics terminal. Based on the server's instructions, the terminal has an AI driver pick up the product and load it onto the autonomous mobility vehicle. The server analyzes the delivery address data, plans the optimal delivery route, and sends the route information to the terminal, which then begins autonomous driving. During operation, the terminal constantly monitors its surroundings, performs safety management, and automatically slows down or stops if an obstacle is detected. Upon arriving at the delivery destination, the terminal sends an arrival notification to the server, and the AI ​​driver hands over the product to the recipient. The user then makes the payment on the terminal, completing the delivery. This system automates and streamlines the entire logistics process, effectively resolving issues such as driver shortages and declining logistics efficiency.

[0876] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0877] Step 1: Receiving order data

[0878] The server receives product order data from the user. Input is made via a dedicated app or web interface and includes product ID, quantity, delivery address, and payment information. This allows the server to import the order data from the user into the system. Data processing involves converting this information into an internal data format and storing it.

[0879] Step 2: Data Validation

[0880] The server checks the format of the received order data and any missing fields, and performs validation. The input is the order data received in step 1. During the validation process, for example, it verifies the existence of the product ID, the validity of the quantity, and the validity of the payment information. If the validation is successful, a flag is set and saved in the database. The validation result is generated as output.

[0881] Step 3: Save order data

[0882] The server saves the order data that has been validated successfully in the database. The input is the order data that has passed validation. In this process, the order ID, user ID, product information, delivery address information etc. are saved in the database. As an output, a save successful flag is generated and an order confirmation notification is sent after saving is complete.

[0883] Step 4: Generate and send product pickup instructions

[0884] The server generates an API request based on the order information stored in the database, including the product ID, quantity, and location within the warehouse. The input is the stored order data. This API request is sent to the automated warehouse system and used as a product pickup instruction. The output is a pickup instruction sent to the automated warehouse system.

[0885] Step 5: Plan the optimal delivery route

[0886] The server analyzes the delivery address data contained in the order information and uses a geographic information system (GIS) to plan the optimal delivery route. The input is the delivery address data. The GIS is used to select the shortest route, taking into account factors such as distance and traffic conditions. The output is the planned delivery route information.

[0887] Step 6: Sending route information

[0888] The server sends the planned delivery route information to the autonomous mobility terminal. The input is the optimal delivery route information. The terminal starts the delivery work based on the sent route information. The output is a notification that the route information has been sent.

[0889] Step 7: Check product load

[0890] The terminal works in conjunction with an AI driver in the logistics terminal to load specified products onto the autonomous mobility vehicle. The input is a pickup instruction from the server. Sensors and cameras are used to confirm that the products have been loaded correctly. The output is a notification of loading completion sent to the server.

[0891] Step 8: Start Autonomous Driving

[0892] The terminal receives delivery route information sent from the server and begins autonomous driving. The input is delivery route information. During operation, the terminal monitors the surrounding situation using sensors and cameras to maintain a safe state. The output is a notification that autonomous driving has begun.

[0893] Step 9: Safety Management

[0894] The device analyzes data from sensors and cameras to detect obstacles and abnormalities. The input is real-time sensor and camera data. If an abnormality is detected, the device automatically slows down or stops. If the situation is deemed safe, it resumes operation. As an output, a safety notification is sent to the server.

[0895] Step 10: Making the delivery

[0896] Upon arriving at the delivery destination, the device sends an arrival notification to the server. The input is GPS location information. The AI ​​driver transports the goods and hands them over to the recipient. The output is a delivery completion notification sent to the server.

[0897] Step 11: Making a payment

[0898] The recipient enters payment information on the terminal, and the terminal processes the payment in conjunction with the payment system. The input is the payment information entered by the recipient. When payment is complete, a notification is generated and a delivery completion notification is sent to the server. The output is a payment completion notification.

[0899] The above are the specific processing steps in the present invention. Each step functions in conjunction with each other to realize automation and efficiency of the entire system.

[0900] (Application example 1)

[0901] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0902] Conventional logistics systems and food delivery services are required to improve delivery efficiency and resolve labor shortages. Furthermore, they often lack systems for smoothly accepting orders from customers and accurately delivering products and meals. In particular, there are still challenges to be overcome in terms of improving delivery efficiency and safety measures using systems that utilize autonomous driving technology.

[0903] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0904] In this invention, the server includes: means for accepting product orders from users; means for validating and storing order data; means for sending product pickup instructions to an automated warehouse system; means for planning an optimal delivery route based on delivery destination address data; means for sending delivery route information to an autonomous mobility terminal and monitoring operation; means for an autonomous mobility terminal loaded with products to operate along a specified route; means for an AI driver to transport the products and process payment at the delivery destination; means for providing sensors and an alarm system to prevent accidents; means for ordering food from a restaurant menu and processing payment; means for calculating the optimal route to the food delivery destination and transmitting this to a robot; means for monitoring the delivery process in real time and correcting the route as necessary; and means for delivering food to customers and receiving payment in cash or electronically depending on the situation. This enables the efficiency and automation of logistics and food delivery.

[0905] "User" means the end user who orders and receives goods and services.

[0906] "Means for accepting product orders" refers to an interface or device for receiving product or food orders from users.

[0907] "Order data" is a collection of information about an order, such as product or dish ID, quantity, delivery address, and payment information.

[0908] "Validation" refers to the process of checking whether input data is accurate.

[0909] "Means of storage" refers to methods and devices for recording and retaining information in a database, etc.

[0910] An "automated warehouse system" is a system for automatically organizing, managing, and retrieving goods within a warehouse.

[0911] The "item pickup instruction" is an instruction to pick up the ordered item from a specified location.

[0912] "Delivery address data" refers to the address information of the destination to which the product or meal is to be delivered.

[0913] The "optimal delivery route" is the most efficient route for efficiently delivering goods or food.

[0914] "Planning means" refers to a method or device for calculating and setting delivery routes.

[0915] An "autonomous mobility terminal" is a robot or vehicle that uses sensors and AI to operate autonomously and make deliveries.

[0916] "Means for monitoring operations" means a system or method for checking the current location and status of an autonomous mobility terminal in real time.

[0917] "AI Driver" refers to an artificial intelligence-based driving system installed in autonomous mobility devices.

[0918] "Payment" refers to the payment process when receiving goods or food.

[0919] A "sensor" is a device that detects a physical quantity and converts it into an electrical signal.

[0920] An "alarm system" is a warning device that alerts you to abnormalities or dangers.

[0921] A "restaurant menu" is a list of the food and drinks offered by a restaurant.

[0922] "Cash or electronic payment" refers to various forms of payment, such as cash payment, credit card payment, and electronic money.

[0923] The present invention relates to a system for automated delivery from restaurants to customers. This system is designed to consistently automate the entire process, from receiving orders to picking up food, delivering it, delivering it, and making payments. Specific embodiments of the system are described below.

[0924] server

[0925] 1. Order acceptance

[0926] The server accepts food orders from users via a dedicated application or web interface. Order information includes the food ID, quantity, delivery address, and payment information.

[0927] When the order data reaches the server, the server performs validation to check the format of the input data and any missing fields, thereby ensuring that the data is accurate.

[0928] If validation is successful, the order data is saved to the database, after which an order confirmation notification is sent to the user.

[0929] 2. Product Pickup Instructions

[0930] The server sends a pickup instruction to the restaurant based on the order information. The server generates an API request including the dish ID, quantity, and location information within the restaurant, and sends it to the restaurant.

[0931] 3. Delivery route planning

[0932] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS), which then transmits the planned route information to the autonomous mobility terminal.

[0933] 4. Operation management

[0934] The server monitors the location information of the autonomous driving mobility in real time and issues driving instructions as necessary. If an obstacle (such as traffic congestion or an accident) occurs, the server calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[0935] Autonomous driving mobility terminal

[0936] 1. Food loading

[0937] The device receives instructions from the server and communicates with the restaurant's AI driver, who then picks up the specified dishes and accurately loads them onto the autonomous mobility vehicle.

[0938] Using sensors and cameras, it checks whether the food has been loaded correctly and notifies the server when loading is complete.

[0939] 2. Start of autonomous driving

[0940] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[0941] 3. Safety management

[0942] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[0943] 4. Delivery and Payment

[0944] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the food to the recipient.

[0945] The recipient enters payment information on the terminal, which then processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a notification of delivery completion to the server.

[0946] User

[0947] 1. Order Entry

[0948] Users order food through the system's web interface or a dedicated app. Order information includes the food ID, quantity, delivery address, and payment information.

[0949] The user confirms the order confirmation screen and presses the final order button to confirm the order. The order information is sent to the server, where it is validated and saved.

[0950] 2. Receiving notifications

[0951] The user receives order confirmation notifications from the server, as well as notifications about delivery progress and estimated arrival times.

[0952] 3. Receipt confirmation and payment

[0953] The user prepares to receive the food at the specified delivery time, and when the AI ​​driver delivers the food, the user confirms receipt.

[0954] Upon receiving the item, enter your payment information into the terminal if necessary to complete the payment. If the payment is successful, you will receive a confirmation notification and the order will be recorded in your order history.

[0955] Specific examples

[0956] For example, when a user orders food from a restaurant using a dedicated app, the system operates in the following steps:

[0957] Users enter order information (food ID, quantity, delivery address, payment information) through the app and make a final confirmation.

[0958] The server receives this order information, performs validation, and then sends a food pickup instruction to the restaurant's automated warehouse system.

[0959] Based on instructions from the server, the terminal's AI driver will pick up the food and load it into the self-driving mobility vehicle.

[0960] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[0961] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[0962] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the food to the recipient. The user then pays on the device and the delivery is complete.

[0963] Examples of prompts to input to the AI ​​model:

[0964] "Please explain the order-taking function of a food delivery system."

[0965] "Please explain what algorithms are used to plan delivery routes using autonomous mobility."

[0966] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0967] Step 1:

[0968] The user enters an order

[0969] The user enters food order information through a dedicated application or web interface. The order information includes the food ID, quantity, delivery address, and payment information. The user checks the order confirmation screen and presses the final order button to confirm the order, and this data is sent to the server. The input data reaches the server and proceeds to the next validation step.

[0970] Step 2:

[0971] The server validates and saves the order data

[0972] The server validates the received order information to check that the input data format is correct and that all fields are complete. If validation is successful, the server saves the order information in the database and sends an order confirmation notification to the user. In this step, the accuracy of the data is maintained by verifying the input data and saving it in the database.

[0973] Step 3:

[0974] The server sends a pickup instruction to the restaurant

[0975] The server sends a pickup instruction to the restaurant based on the validated and saved order information. The server generates an API request including the dish ID, quantity, and location information within the restaurant, and sends it to the restaurant. The restaurant's system receives this instruction and prepares the specified dish.

[0976] Step 4:

[0977] The server plans the optimal delivery route based on the delivery destination address data.

[0978] The server uses a geographic information system (GIS) to plan the optimal delivery route based on the address data of the delivery destination. The delivery route information is sent to the autonomous driving mobility terminal. In this step, the route is calculated using the input address data, and an efficient delivery plan is created.

[0979] Step 5:

[0980] The server sends delivery route information to the autonomous mobility device and monitors its operation.

[0981] The server sends planned delivery route information to the autonomous mobility device and monitors the operation in real time. If an obstacle such as a traffic jam or accident occurs, it calculates a new optimal route and sends instructions to the device.

[0982] Step 6:

[0983] The device loads the food

[0984] The device receives instructions from the server, works with the restaurant's AI driver to pick up the specified dishes, and loads them accurately onto the autonomous mobility vehicle. Using sensors and cameras, the device checks whether the dishes have been loaded correctly and notifies the server when loading is complete.

[0985] Step 7:

[0986] The device begins autonomous driving

[0987] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[0988] Step 8:

[0989] The device manages safety

[0990] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[0991] Step 9:

[0992] The terminal handles delivery and payment

[0993] When the delivery arrives at the destination, the device sends a notification of arrival to the server. The AI ​​driver then carries the food and hands it over to the recipient. The recipient then enters payment information on the device, which then connects to the payment system to process the payment. After payment is complete, the device sends a notification of delivery completion to the server.

[0994] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0995] The present invention relates to a system that automates the transportation of goods from a logistics terminal to a delivery destination and combines it with an emotion engine that recognizes user emotions. Specific embodiments of the system will be described below.

[0996] server

[0997] 1. Order acceptance

[0998] The server accepts product orders from users via a web interface or mobile app. Order information includes product ID, quantity, delivery address, and payment information.

[0999] When the order data reaches the server, the server performs validation to check the format of the input data and any missing fields, thereby ensuring that the data is accurate.

[1000] If validation is successful, the server saves the order information to the database, after which an order confirmation notification is sent to the user.

[1001] 2. Product Pickup Instructions

[1002] The server sends product pickup instructions to the automated warehouse system based on the order information. The server generates an API request including the product ID, quantity, and location information within the warehouse, and sends it to the automated warehouse system.

[1003] 3. Delivery route planning

[1004] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS), which then transmits the planned route information to the autonomous mobility terminal.

[1005] 4. Operation management

[1006] The server monitors the location information of the autonomous driving mobility in real time and issues driving instructions as necessary. If an obstacle (such as traffic congestion or an accident) occurs, the server calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[1007] 5. Emotion Engine

[1008] The server uses an emotion engine to collect data to recognize the user's emotions, which are then fed back during the ordering process and when sending notifications.

[1009] The emotion engine dynamically adjusts notification content based on the user's emotional state, improving the user experience.

[1010] Terminal (autonomous driving mobility)

[1011] 1. Product loading

[1012] The terminal receives instructions from the server and communicates with an AI driver in the logistics terminal, who then picks up the specified items and accurately loads them onto the autonomous mobility vehicle.

[1013] Using sensors and cameras, it checks whether the items have been loaded correctly and notifies the server that loading is complete.

[1014] 2. Start of autonomous driving

[1015] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[1016] 3. Safety management

[1017] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[1018] 4. Delivery and Payment

[1019] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the goods and hands them over to the recipient.

[1020] The recipient enters payment information on the terminal, which then processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a notification of delivery completion to the server.

[1021] User

[1022] 1. Order Entry

[1023] Users order products through the system's web interface or a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[1024] The user confirms the order confirmation screen and presses the final order button to confirm the order. The order information is sent to the server, where it is validated and saved.

[1025] 2. Receiving notifications

[1026] The user receives order confirmation notifications from the server, as well as notifications about delivery progress and estimated arrival times.

[1027] 3. Receipt confirmation and payment

[1028] The user prepares to receive the goods at the specified delivery time, and when the AI ​​driver delivers the goods, the user confirms receipt.

[1029] Upon receiving the item, enter your payment information into the terminal if necessary to complete the payment. If the payment is successful, you will receive a confirmation notification and the order will be recorded in your order history.

[1030] 4. Emotional Data

[1031] Through the emotion engine, users can provide their own emotional data during the ordering process, and the server will dynamically adjust the notification and service content accordingly.

[1032] Specific examples

[1033] For example, if a user orders a product from location A using a dedicated app, the system operates in the following steps:

[1034] The user enters order information (product ID, quantity, delivery address, payment information) through the app and makes a final confirmation.

[1035] The server receives this order information, performs validation, and then sends product pickup instructions to the automated warehouse system at the logistics terminal.

[1036] Based on instructions from the server, the terminal will have an AI driver pick up the goods and load them into the self-driving mobility vehicle.

[1037] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[1038] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[1039] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the product to the recipient. The user then pays on the device and the delivery is complete.

[1040] Furthermore, the emotion engine recognizes the user's emotions and collects feedback during delivery and after receipt, allowing the server to improve the service content for the next time.

[1041] This invention can effectively solve problems such as driver shortages and declining logistics efficiency. In addition, the use of an emotion engine can improve the user experience and increase customer satisfaction.

[1042] The processing flow will be explained below.

[1043] server

[1044] Order acceptance

[1045] Step 1:

[1046] The server receives an HTTP request sent by the user, which includes the product ID, quantity, delivery address, and payment information.

[1047] Step 2:

[1048] The server checks the format of the received order information and validates that there are no missing fields.

[1049] Step 3:

[1050] If validation is successful, the server saves the order information to the database.

[1051] Step 4:

[1052] After the order information has been saved, the server sends a confirmation notice to the user terminal.

[1053] Product Pickup Instructions

[1054] Step 1:

[1055] Based on the order information, the server generates product pickup instructions for the automated warehouse system at the logistics terminal.

[1056] Step 2:

[1057] The server sends an API request to the automated warehouse system, which includes the product ID, warehouse location, and quantity.

[1058] Step 3:

[1059] The automated warehouse system notifies the server that the product has been picked up.

[1060] Delivery route planning

[1061] Step 1:

[1062] The server parses the delivery address data.

[1063] Step 2:

[1064] The server uses a geographic information system (GIS) to plan the optimal delivery route.

[1065] Step 3:

[1066] Planned delivery route information is sent to the autonomous mobility device.

[1067] Operation management

[1068] Step 1:

[1069] The server monitors the location information of autonomous vehicles in real time.

[1070] Step 2:

[1071] When an obstacle (such as traffic jam or accident) occurs, the server calculates a new route and sends instructions to the terminal.

[1072] Step 3:

[1073] Continue monitoring and supervision until delivery is complete.

[1074] Emotion Engine

[1075] Step 1:

[1076] The server uses an emotion engine to collect emotion data from users.

[1077] Step 2:

[1078] The collected emotional data is analyzed to identify the user's emotional state.

[1079] Step 3:

[1080] Based on the analysis results, notification content and service content are dynamically adjusted.

[1081] Step 4:

[1082] Emotional data is accumulated to improve services and reflected in future service content.

[1083] Terminal (autonomous driving mobility)

[1084] Product loading

[1085] Step 1:

[1086] The terminal receives instructions from the server.

[1087] Step 2:

[1088] The terminal works in conjunction with an AI driver in the logistics terminal to pick up the specified items.

[1089] Step 3:

[1090] The terminal uses sensors and cameras to verify that the goods have been loaded correctly.

[1091] Step 4:

[1092] Once loading is complete, the terminal sends a notification to the server.

[1093] Automatic operation begins

[1094] Step 1:

[1095] The terminal receives delivery route information from the server.

[1096] Step 2:

[1097] The device will then begin autonomous driving according to the specified route.

[1098] Step 3:

[1099] While in operation, the device uses sensors and cameras to monitor its surroundings.

[1100] safety management

[1101] Step 1:

[1102] The device detects obstacles and abnormalities based on sensor and camera data.

[1103] Step 2:

[1104] If an obstacle is detected, the device will automatically slow down or stop.

[1105] Step 3:

[1106] Once conditions are deemed safe, the terminal will resume operation.

[1107] Delivery and payment

[1108] Step 1:

[1109] When the terminal arrives at the delivery destination, it sends an arrival notification to the server.

[1110] Step 2:

[1111] The AI ​​driver transports the goods and delivers them to the recipient.

[1112] Step 3:

[1113] The terminal receives payment information from the recipient and works with the payment system to process the payment.

[1114] Step 4:

[1115] After the payment is completed, the terminal sends a notification of delivery completion to the server.

[1116] User

[1117] Order Entry

[1118] Step 1:

[1119] Users select products through a web interface or mobile app.

[1120] Step 2:

[1121] The user enters the delivery address and payment information.

[1122] Step 3:

[1123] The user checks the order confirmation screen and makes a final confirmation.

[1124] Step 4:

[1125] The user presses the order button and sends the order information to the server.

[1126] Receive notifications

[1127] Step 1:

[1128] The user receives an order confirmation notice sent from the server.

[1129] Step 2:

[1130] Users will receive notifications regarding delivery progress and estimated arrival times.

[1131] Receipt confirmation and payment

[1132] Step 1:

[1133] The user prepares to receive the product at the scheduled delivery time.

[1134] Step 2:

[1135] When receiving the item, the user enters payment information on the terminal and completes the payment.

[1136] Step 3:

[1137] The user confirms receipt on the terminal and the delivery is completed.

[1138] Emotional Data Feedback

[1139] Step 1:

[1140] The user inputs or provides their emotional data during the ordering process.

[1141] Step 2:

[1142] The user receives feedback through the emotion engine.

[1143] Step 3:

[1144] The server analyzes the user's emotional data and improves the content of the service next time.

[1145] Specific examples

[1146] For example, if a user orders a product from location A using a dedicated app, the system operates in the following steps:

[1147] The user enters order information (product ID, quantity, delivery address, payment information) through the app and makes a final confirmation.

[1148] The server receives this order information, performs validation, and then sends product pickup instructions to the automated warehouse system at the logistics terminal.

[1149] Based on instructions from the server, the terminal will have an AI driver pick up the goods and load them into the self-driving mobility vehicle.

[1150] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[1151] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[1152] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the product to the recipient. The user then pays on the device and the delivery is complete.

[1153] Furthermore, the emotion engine recognizes the user's emotions and collects feedback during delivery and after receipt, allowing the server to improve the service content for the next time.

[1154] This invention can effectively solve problems such as driver shortages and declining logistics efficiency. In addition, the use of an emotion engine can improve the user experience and increase customer satisfaction.

[1155] Example 2

[1156] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1157] Conventional logistics systems face issues such as labor shortages and declining efficiency, and there is a demand for improved user experience. This invention aims to solve these issues and further increase customer satisfaction by recognizing user emotions and dynamically adjusting service content.

[1158] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1159] In this invention, the server includes means for accepting product orders from users, means for validating and storing order data, means for sending product pickup instructions to an automated storage system, means for planning an optimal delivery route based on delivery destination address data, means for sending delivery route information to an autonomous mobile device and monitoring operation, means for an autonomous mobile device carrying products to operate along a specified route, means for the autonomous mobile device to transport the products at the delivery destination and process payments with the recipient, means for providing sensors and alarm devices to prevent accidents, and means for collecting user emotion data and dynamically adjusting notification content. This can address issues such as labor shortages and logistics efficiency, and by utilizing an emotion engine, it is possible to improve the user experience.

[1160] "User" means a person or organization that uses the System to order and receive delivery of Goods.

[1161] "Means for accepting product orders" refers to the part that provides a function for receiving product order information from users via a web interface or mobile application.

[1162] "Means for validating and storing order data" refers to the part that provides a function for checking the format and incompleteness of order information received from a user and storing accurate data in a database.

[1163] "Automated storage system" refers to warehouse management equipment and related systems that automatically store and retrieve goods.

[1164] The "means for sending product pickup instructions" refers to a part that provides a function for sending product pickup instructions to the automated storage system based on order information.

[1165] "Means for planning the optimal delivery route from the address data of the delivery destination" refers to the part that provides the function of analyzing the address information of the delivery destination and calculating the optimal delivery route using a geographic information system (GIS).

[1166] "Autonomous mobile terminal" refers to a mobility device that automatically delivers goods.

[1167] "Means for transmitting delivery route information and monitoring operation" refers to the part that provides the function of transmitting planned delivery route information to an autonomous mobile terminal and monitoring the location information and status of the terminal in real time while it is in operation.

[1168] "Means for an autonomous mobile terminal carrying goods to travel along a designated route" refers to the part that provides the function for an autonomous mobile terminal to travel along a planned delivery route carrying goods.

[1169] "Means for an autonomous mobile terminal to transport goods at the delivery destination and settle payments with the recipient" refers to the part that provides the function for an autonomous mobile terminal that arrives at the delivery destination to hand over goods to the recipient and for the recipient to enter payment information and complete payment.

[1170] "Sensors and alarm devices for preventing accidents" refers to sensors for detecting obstacles installed to ensure the safe operation of autonomous mobile devices, and devices that issue alarms in the event of an abnormality.

[1171] An "emotion engine" refers to a system that recognizes a user's emotions and dynamically adjusts notification content and service content based on collected emotional data.

[1172] The present invention relates to a system that automates the transportation of goods from a logistics terminal to a delivery destination and combines it with an emotion engine that recognizes user emotions. An embodiment of the system will be described below.

[1173] server

[1174] The server runs using the following hardware and software:

[1175] Hardware: High-performance processor (e.g., Intel Xeon), large memory capacity (e.g., 64GB or more RAM), high-speed storage (e.g., SSD)

[1176] Software: Operating system (e.g., Linux), database management system (e.g., MySQL), web server (e.g., Apache)

[1177] The server accepts product orders from users. Users enter order information via a web interface or mobile app. This order information includes product ID, quantity, delivery address, and payment information. The server performs validation to check the format of the order data and for missing fields to ensure the data is accurate. If validation is successful, the order information is saved to the database and an order confirmation notification is sent to the user. The server then sends a product pickup instruction to the automated storage system based on the order information. This API request includes the product ID, quantity, and location within the warehouse.

[1178] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS). The planned route information is sent to the autonomous mobile terminal. The server monitors the location information of the autonomous mobile terminal in real time and issues driving instructions as necessary. If an obstacle information (traffic jam, accident, etc.) occurs, it calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[1179] Furthermore, the server uses an emotion engine to recognize the user's emotions, which dynamically adjusts the notification content based on the user's emotional state to improve the user experience.

[1180] Terminal (autonomous driving vehicle)

[1181] The terminal is implemented using the following hardware and software:

[1182] Hardware: Processors (e.g., NVIDIA Jetson), sensors (e.g., LiDAR, cameras), and communication modules (e.g., 5G modules) that support autonomous driving technology

[1183] Software: Autonomous driving software platform (e.g., Autoware), real-time operating system (RTOS)

[1184] The terminal receives instructions from the server and connects to the automated storage system. The AI ​​driver picks up the specified items and loads them onto the autonomous vehicle. Using sensors and cameras, the terminal checks whether the items have been loaded correctly and notifies the server of completion.

[1185] The autonomous vehicle receives delivery route information sent from the server and begins autonomous driving. During operation, it uses sensors and cameras to monitor the surroundings and maintain safe conditions. The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume operation.

[1186] When the delivery arrives at the destination, the terminal sends an arrival notification to the server. The AI ​​driver transports the goods and hands them over to the recipient. The recipient enters payment information on the terminal, and the terminal processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a delivery completion notification to the server.

[1187] User

[1188] The user uses the service in the following way:

[1189] Order entry: A user orders a product through the system's web interface or a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[1190] For example, enter "Product ID 12345, Quantity 2, Delivery address Shibuya-ku, Tokyo, Payment method Credit card."

[1191] Receive notifications: The user receives order confirmation notifications sent by the server, as well as notifications about delivery progress and estimated arrival times.

[1192] Example: "Your order has been placed. The estimated delivery date is ____."

[1193] Confirmation of receipt and payment: The user prepares to receive the product at the specified delivery time. When the AI ​​driver delivers the product, the user confirms receipt. Upon receipt, the user enters payment information into the terminal to complete the payment.

[1194] For example: "Enter your credit card information and complete the payment."

[1195] Emotion data provision: Users provide their own emotional data through the emotion engine during the ordering process and delivery. The server dynamically adjusts the notification content and service content based on the collected emotional data, improving the next service.

[1196] For example: Providing feedback such as "I felt good when I placed my order."

[1197] An example of a prompt for the generative AI model could be, "Please explain in detail the entire process from when a user orders a product through a dedicated app to when it is delivered and when it is received."

[1198] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1199] Step 1:

[1200] User enters order for product

[1201] The user enters order information (product ID, quantity, delivery address, payment information) through the system's web interface or app.

[1202] Input: Product ID, quantity, delivery address, payment information

[1203] Output: Send order data to the server

[1204] Specific operation: For example, the user enters "Product ID: 12345, Quantity: 2, Delivery address: Shibuya-ku, Tokyo, Payment information: Credit card" and presses the final confirmation button. The system sends the order information to the server.

[1205] Step 2:

[1206] The server receives the order data, validates it, and saves it.

[1207] The server receives the order data, validates the data format and checks for any missing fields, and if successful, saves it in the database and sends an order confirmation to the user.

[1208] Input: Order data from the user

[1209] Output: Save to database, send order confirmation

[1210] Specific operation: The server receives the order information "Product ID: 12345, Quantity: 2, Delivery address: Shibuya-ku, Tokyo, Payment information: Credit card" and checks whether there are any missing fields. If confirmed, it saves it in the database and sends a notification to the user that "The order has been confirmed."

[1211] Step 3:

[1212] The server sends product pickup instructions to the automated storage system

[1213] The server sends product pickup instructions to the automated storage system based on the order information.

[1214] Input: Order data stored on the server

[1215] Output: Product pickup instructions to the automated storage system

[1216] Specific operation: The server sends a pickup instruction for "item ID: 12345, quantity: 2, location A3" to the automated storage system, which then begins preparing to retrieve the item.

[1217] Step 4:

[1218] Autonomous mobile terminal picks up and loads products

[1219] The terminal receives instructions from the server and works with the automated storage system to pick up the products. Sensors and cameras check that the products are loaded correctly.

[1220] Input: Pickup instructions from the server

[1221] Output: Product loading completion notification

[1222] Specific operation: The AI ​​driver picks up "Product ID: 12345, Quantity: 2" and loads it onto the autonomous vehicle. It checks with sensors and cameras and notifies the server that loading is complete.

[1223] Step 5:

[1224] The server plans the delivery route and sends the information

[1225] The server analyzes the delivery address data to plan the optimal delivery route and transmits the route information to the autonomous mobile terminal.

[1226] Input: Delivery address data, Geographic Information System (GIS) data

[1227] Output: Sending route information

[1228] Specific operation: The server uses GIS to calculate the route from "Shibuya-ku, Tokyo" to "Minato-ku, Tokyo" and sends the "shortest route" to the autonomous driving vehicle.

[1229] Step 6:

[1230] Autonomous driving mobile devices start driving autonomously

[1231] The device receives route information sent from the server and begins autonomous driving, while monitoring the surroundings using sensors and cameras.

[1232] Input: Route information, sensor data

[1233] Output: Maintaining safe operation

[1234] Specific operation: The autonomous driving mobile device begins autonomous driving from "Shibuya Ward, Tokyo" to "Minato Ward, Tokyo," and monitors the surrounding situation in real time using sensors and cameras.

[1235] Step 7:

[1236] The server monitors the operation and issues instructions

[1237] The server monitors the location information of autonomous mobile devices in real time and issues driving instructions as necessary.

[1238] Input: Location information of autonomous driving mobile terminal, obstacle information

[1239] Output: Send instruction information

[1240] Specific operation: Using a telemetry system, the autonomous vehicle sends information such as "Current location: Shibuya Ward, no obstacles, continuing operation" to a server, and the server issues instructions for a "new optimal route" as necessary.

[1241] Step 8:

[1242] An autonomous mobile device arrives at the delivery destination, delivers the product, and takes payment.

[1243] Upon arriving at the delivery destination, the AI ​​driver hands over the product to the recipient, who then enters payment information on the terminal to complete the payment.

[1244] Input: Delivery information, payment information

[1245] Output: Product delivery and payment completion notification

[1246] Specific operation: The autonomous mobile device "arrives at the delivery destination and hands over the product," and the recipient "enters payment information and completes payment." At the same time, a "delivery completion notification" is sent to the server.

[1247] Step 9:

[1248] The server uses an emotion engine to collect and analyze user emotions.

[1249] The server uses an emotion engine to collect user emotion data and dynamically adjust the notification content.

[1250] Input: User emotion data

[1251] Output: Adjusted notification content

[1252] Specific operation: The server analyzes the user's "emotional data (e.g., facial expression data and voice data)" during the ordering process or when sending notifications, and sends "appropriate feedback notifications" to the user.

[1253] Step 10:

[1254] Users provide emotional data and receive feedback

[1255] The user provides their own emotional data through the emotion engine, and the server provides service content based on that data.

[1256] Input: User emotion data

[1257] Output: Feedback notification based on emotion

[1258] Specific operation: The user inputs "mood and emotional data for the day," and the server sends "feedback notifications to improve the next service content."

[1259] (Application example 2)

[1260] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1261] Conventional food delivery systems have not sufficiently improved efficiency and customer satisfaction during the delivery process. Furthermore, there is a need for systems that can flexibly respond to obstacles and changes in traffic conditions during delivery. Furthermore, there is a lack of systems that can collect customer sentiment and feedback in real time and dynamically adjust services based on that information. This invention aims to solve these issues and provide an efficient food delivery service with high customer satisfaction.

[1262] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1263] In this invention, the server includes means for accepting product and service orders from users, means for validating and storing order data, means for sending product pickup instructions to an automated warehouse system, means for planning an optimal delivery route based on delivery destination address data, means for sending delivery route information to an autonomous driving terminal and monitoring operation, means for an autonomous driving terminal loaded with products and services to operate along a specified route, means for an AI operator to transport the products and services and process payments at the delivery destination, means for providing sensors and alarm systems to prevent accidents, and means for using an emotion engine to analyze user emotions and dynamically adjust notifications, thereby enabling the efficiency of the delivery process and improving customer satisfaction.

[1264] "User" means any person or entity that uses the System to place orders for goods and services.

[1265] "Means for accepting product and service orders" refers to the overall interface and associated processes by which a user can enter an order for a product or service and have it accepted by the system.

[1266] "Validation" is a process of checking entered order data to ensure it is accurate and complete.

[1267] "Means for storing" refers to a method for accumulating user order information and other related data in storage such as a database.

[1268] An "automated warehouse system" is a system that uses robotics and AI to automatically manage and pick up goods.

[1269] "Means for sending a pickup instruction" refers to a method for sending an instruction from the server to the automated warehouse system to pick up a specific product.

[1270] "Address Data" refers to information about delivery addresses and is used to plan delivery routes.

[1271] "Means for planning delivery routes" refers to systems or algorithms for calculating and determining optimal delivery routes based on delivery address data and geographic information.

[1272] An "autonomous driving terminal" refers to a mobility device that uses robotics technology to operate autonomously and deliver goods and services.

[1273] "Means for monitoring operations" refers to a system that monitors the location and operating status of autonomous driving terminals in real time and issues instructions as necessary.

[1274] "AI pilot" is a technology that uses artificial intelligence to control and operate autonomous driving devices.

[1275] A "payment method" is a system for processing payments from customers when receiving goods or services.

[1276] "Sensor and alarm system for accident prevention" refers to a device that detects obstacles and abnormalities to ensure safe operation of an autonomous driving device and issues warnings as necessary.

[1277] The "Emotion Engine" is an artificial intelligence-based system for recognizing and analyzing user emotions and dynamically adjusting the content of services and notifications.

[1278] The present invention is a food delivery system that applies autonomous driving technology and dynamically adjusts services using user emotion data to achieve efficient delivery with high customer satisfaction. Specific embodiments for implementing the present invention are described below.

[1279] server

[1280] The server has the following functions:

[1281] 1. A means of accepting orders for products and services from users

[1282] Orders are accepted from users through a web interface or mobile application. Order information includes product ID, quantity, delivery address, and payment information.

[1283] For example, a user orders a "Margherita pizza" through a smartphone app and enters the delivery address.

[1284] 2. A way to validate and store order data

[1285] Check the format of the received order information and any missing fields to confirm the accuracy of the data.

[1286] If validation is successful, save the order information to the database and send an order confirmation notification to the user.

[1287] 3. Means of sending product pickup instructions to the automated warehouse system

[1288] The server generates an API request containing the product ID, quantity, and location within the warehouse and sends it to the automated warehouse system.

[1289] 4. A means to plan optimal delivery routes based on delivery address data

[1290] Using a geographic information system (GIS), the optimal delivery route is calculated based on the delivery destination address data.

[1291] The planned route information is sent to the autonomous driving terminal.

[1292] 5. Means of monitoring operations

[1293] The location information of the autonomous driving device is monitored in real time and driving instructions are issued as necessary.

[1294] If congestion or an obstacle is detected, a new optimal route is calculated and sent to the device.

[1295] 6. A method to analyze user emotions and dynamically adjust notifications using an emotion engine

[1296] Collect and analyze user sentiment data during delivery and after delivery, and dynamically adjust notifications and service content based on the analysis results to improve the user experience.

[1297] For example, if a delivery is delayed, the system can sense the user's stress and send a notification offering a coupon.

[1298] Terminal (autonomous driving terminal)

[1299] The terminal has the following functions:

[1300] 1. A means of transporting goods and services along designated routes by automated driving devices.

[1301] It will begin autonomous driving along the designated route, and will constantly monitor the surrounding conditions using sensors and cameras while in operation.

[1302] For example, if the device detects an obstacle on the road during a delivery, it will automatically take a detour.

[1303] 2. AI-operated delivery of goods and services and payment at the destination

[1304] When the self-driving device arrives at the delivery destination, the AI ​​operator transports the goods and hands them over to the user.

[1305] The user enters payment information on the terminal and makes the payment.

[1306] 3. Means equipped with sensors and alarm systems to prevent accidents

[1307] It analyzes sensor and camera data to detect obstacles and abnormalities, and if an abnormality is detected, the device will automatically slow down or stop.

[1308] User

[1309] The user performs the following operations:

[1310] 1. Entering Goods and Services Orders

[1311] Order products through a web interface or a dedicated app, and enter your delivery address and payment information.

[1312] For example, order a "Margherita Pizza" and enter your home address.

[1313] 2. Receiving Notifications

[1314] Receive notifications from the server regarding order confirmation, delivery progress, and estimated arrival time.

[1315] For example, a notification like "Your pizza order is currently being delivered."

[1316] 3. Receipt confirmation and payment

[1317] Receive the product at the delivery address, enter payment information if necessary, and complete the payment.

[1318] 4. Providing Emotion Data

[1319] Through the emotion engine, customers provide their own emotional data during the ordering process, and the server dynamically adjusts notifications and service content based on this data.

[1320] Examples and prompts

[1321] Examples:

[1322] A user orders a Margherita pizza through the app and enters their delivery address and payment information.

[1323] The server validates the order information, stores it in the database, and sends a pickup instruction to the automated warehouse system.

[1324] The self-driving terminal picks up the goods and begins delivery along the designated route.

[1325] Detects obstacles on the route and automatically detours around them.

[1326] Once the delivery arrives, the AI ​​operator delivers the goods, and the user completes the payment.

[1327] The server uses an emotion engine to collect feedback during delivery and improve the next service.

[1328] Example prompt sentence:

[1329] "Deliver Margherita pizza to 4-2-8 Shibakoen, Minato-ku, Tokyo for order ID 12345. Calculate and submit the optimal route."

[1330] "Analyze customer feedback and tailor your notifications based on sentiment data."

[1331] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1332] Step 1:

[1333] The server accepts the order

[1334] Input: The user inputs product and service order information through a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[1335] Specific Operations: The server receives the order information via a web interface or mobile application.

[1336] Output: The order information is sent to the server.

[1337] Step 2:

[1338] The server validates and saves the order data

[1339] Input: Received order information.

[1340] Specific behavior: The server checks the order information for format and missing fields to ensure the data is accurate. If validation is successful, it saves the order information to the database and sends an order confirmation notification to the user.

[1341] Output: Validated order information and confirmation notice.

[1342] Step 3:

[1343] The server sends product pickup instructions to the automated warehouse system

[1344] Input: Validated order information (item ID, quantity, warehouse location).

[1345] Specific operation: The server generates an API request containing the product ID, quantity, and location information within the warehouse and sends it to the automated warehouse system.

[1346] Output: Pickup instructions to the automated warehouse system.

[1347] Step 4:

[1348] The server plans the optimal delivery route based on the delivery destination address data.

[1349] Input: Delivery address data.

[1350] Specific operation: The server uses a geographic information system (GIS) to calculate the optimal delivery route based on the delivery destination address data.

[1351] Output: Optimal delivery route information.

[1352] Step 5:

[1353] The server sends delivery route information to the autonomous driving terminal and monitors operation.

[1354] Input: Optimal delivery route information.

[1355] Specific operation: The server sends the planned route information to the autonomous driving terminal, monitors the location information in real time, and issues driving instructions according to the situation.

[1356] Output: Route information and instructions to the autonomous driving terminal.

[1357] Step 6:

[1358] The terminal is loaded with goods and services and begins operation.

[1359] Input: Delivery route information and product loading status from the server.

[1360] Specific operation: The autonomous driving device starts driving along the designated route, and while driving, it monitors the surroundings using sensors and cameras.

[1361] Output: Surroundings data and driving notifications.

[1362] Step 7:

[1363] The terminal delivers goods and services to the destination, where an AI operator delivers them and makes payments.

[1364] Input: Shipping address and product information.

[1365] Specific operation: When the autonomous driving terminal arrives at the delivery destination, the AI ​​operator carries the goods and delivers them to the user, who then enters payment information on the terminal and makes the payment.

[1366] Output: Receipt notification and payment completion notification.

[1367] Step 8:

[1368] The server monitors the sensor and alarm systems to prevent accidents.

[1369] Input: Sensor data from the autonomous driving device.

[1370] Specific operation: The server analyzes sensor and camera data, and if it detects an obstacle or abnormality, it instructs the device to slow down or stop. When it determines that the situation is safe, it resumes operation.

[1371] Output: Anomaly detection notification and operation instructions.

[1372] Step 9:

[1373] The server uses an emotion engine to analyze the user's emotions and dynamically adjust notifications.

[1374] Input: Feedback messages and sentiment data from users.

[1375] Specific operation: The server uses an emotion engine to analyze the user's emotions and dynamically adjusts the notification content and service content based on the feedback results.

[1376] Output: Dynamically adjusted notifications and service offerings.

[1377] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1378] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1379] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1380] [Third embodiment]

[1381] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1382] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1383] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1384] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1385] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1386] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1387] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1388] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1389] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1390] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1391] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1392] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1393] The present invention relates to a system for automating the transportation of goods from a logistics terminal to a delivery destination. This system is designed to consistently automate the entire process from order acceptance to product pickup, delivery, handover, and payment. Specific embodiments of the system are described below.

[1394] server

[1395] 1. Order acceptance

[1396] The server accepts product orders from users via a web interface or mobile app. Order information includes product ID, quantity, delivery address, and payment information.

[1397] When the order data reaches the server, the server performs validation to check the format of the input data and any missing fields, thereby ensuring that the data is accurate.

[1398] If validation is successful, the order data is saved to the database, after which an order confirmation notification is sent to the user.

[1399] 2. Product Pickup Instructions

[1400] The server sends product pickup instructions to the automated warehouse system based on the order information. The server generates an API request including the product ID, quantity, and location information within the warehouse, and sends it to the automated warehouse system.

[1401] 3. Delivery route planning

[1402] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS), which then transmits the planned route information to the autonomous mobility terminal.

[1403] 4. Operation management

[1404] The server monitors the location information of the autonomous driving mobility in real time and issues driving instructions as necessary. If an obstacle (such as traffic congestion or an accident) occurs, the server calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[1405] Terminal (autonomous driving mobility)

[1406] 1. Product loading

[1407] The terminal receives instructions from the server and communicates with an AI driver in the logistics terminal, who then picks up the specified items and accurately loads them onto the autonomous mobility vehicle.

[1408] Using sensors and cameras, it checks whether the items have been loaded correctly and notifies the server that loading is complete.

[1409] 2. Start of autonomous driving

[1410] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[1411] 3. Safety management

[1412] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[1413] 4. Delivery and Payment

[1414] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the goods and hands them over to the recipient.

[1415] The recipient enters payment information on the terminal, which then processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a notification of delivery completion to the server.

[1416] User

[1417] 1. Order Entry

[1418] Users order products through the system's web interface or a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[1419] The user confirms the order confirmation screen and presses the final order button to confirm the order. The order information is sent to the server, where it is validated and saved.

[1420] 2. Receiving notifications

[1421] The user receives order confirmation notifications from the server, as well as notifications about delivery progress and estimated arrival times.

[1422] 3. Receipt confirmation and payment

[1423] The user prepares to receive the goods at the specified delivery time, and when the AI ​​driver delivers the goods, the user confirms receipt.

[1424] Upon receiving the item, enter your payment information into the terminal if necessary to complete the payment. If the payment is successful, you will receive a confirmation notification and the order will be recorded in your order history.

[1425] Specific examples

[1426] For example, if a user orders a product from location A using a dedicated app, the system operates in the following steps:

[1427] The user enters order information (product ID, quantity, delivery address, payment information) through the app and makes a final confirmation.

[1428] The server receives this order information, performs validation, and then sends product pickup instructions to the automated warehouse system at the logistics terminal.

[1429] Based on instructions from the server, the terminal will have an AI driver pick up the goods and load them into the self-driving mobility vehicle.

[1430] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[1431] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[1432] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the product to the recipient. The user then pays on the device and the delivery is complete.

[1433] This invention can effectively solve problems such as driver shortages and declining logistics efficiency. This system can also be used in depopulated areas, realizing efficient logistics over a wide area.

[1434] The processing flow will be explained below.

[1435] server

[1436] Order acceptance

[1437] Step 1:

[1438] The server receives an HTTP request sent by the user, which includes the product ID, quantity, delivery address, and payment information.

[1439] Step 2:

[1440] The server checks the format of the received order information and validates that there are no missing fields.

[1441] Step 3:

[1442] If validation is successful, the server saves the order information to the database.

[1443] Step 4:

[1444] After the order information has been saved, the server sends a confirmation notice to the user terminal.

[1445] Product Pickup Instructions

[1446] Step 1:

[1447] Based on the order information, the server generates product pickup instructions for the automated warehouse system at the logistics terminal.

[1448] Step 2:

[1449] The server sends an API request to the automated warehouse system, which includes the product ID, warehouse location, and quantity.

[1450] Step 3:

[1451] The automated warehouse system notifies the server that the product has been picked up.

[1452] Delivery route planning

[1453] Step 1:

[1454] The server parses the delivery address data.

[1455] Step 2:

[1456] The server uses a geographic information system (GIS) to plan the optimal delivery route.

[1457] Step 3:

[1458] Planned delivery route information is sent to the autonomous mobility device.

[1459] Operation management

[1460] Step 1:

[1461] The server monitors the location information of autonomous vehicles in real time.

[1462] Step 2:

[1463] When an obstacle (such as traffic jam or accident) occurs, the server calculates a new route and sends instructions to the terminal.

[1464] Step 3:

[1465] Continue monitoring and supervision until delivery is complete.

[1466] Terminal (autonomous driving mobility)

[1467] Product loading

[1468] Step 1:

[1469] The terminal receives instructions from the server.

[1470] Step 2:

[1471] The terminal works in conjunction with an AI driver in the logistics terminal to pick up the specified items.

[1472] Step 3:

[1473] The terminal uses sensors and cameras to verify that the goods have been loaded correctly.

[1474] Step 4:

[1475] Once loading is complete, the terminal sends a notification to the server.

[1476] Automatic operation begins

[1477] Step 1:

[1478] The terminal receives delivery route information from the server.

[1479] Step 2:

[1480] The device will then begin autonomous driving according to the specified route.

[1481] Step 3:

[1482] While in operation, the device uses sensors and cameras to monitor its surroundings.

[1483] safety management

[1484] Step 1:

[1485] The device detects obstacles and abnormalities based on sensor and camera data.

[1486] Step 2:

[1487] If an obstacle is detected, the device will automatically slow down or stop.

[1488] Step 3:

[1489] Once conditions are deemed safe, the terminal will resume operation.

[1490] Delivery and payment

[1491] Step 1:

[1492] When the terminal arrives at the delivery destination, it sends an arrival notification to the server.

[1493] Step 2:

[1494] The AI ​​driver transports the goods and delivers them to the recipient.

[1495] Step 3:

[1496] The terminal receives payment information from the recipient and works with the payment system to process the payment.

[1497] Step 4:

[1498] After the payment is completed, the terminal sends a notification of delivery completion to the server.

[1499] User

[1500] Order Entry

[1501] Step 1:

[1502] Users select products through a web interface or mobile app.

[1503] Step 2:

[1504] The user enters the delivery address and payment information.

[1505] Step 3:

[1506] The user checks the order confirmation screen and makes a final confirmation.

[1507] Step 4:

[1508] The user presses the order button and sends the order information to the server.

[1509] Receive notifications

[1510] Step 1:

[1511] The user receives an order confirmation notice sent from the server.

[1512] Step 2:

[1513] Users will receive notifications regarding delivery progress and estimated arrival times.

[1514] Receipt confirmation and payment

[1515] Step 1:

[1516] The user prepares to receive the product at the scheduled delivery time.

[1517] Step 2:

[1518] When receiving the item, the user enters payment information on the terminal and completes the payment.

[1519] Step 3:

[1520] The user confirms receipt on the terminal and the delivery is completed.

[1521] Example 1

[1522] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1523] In conventional logistics systems, driver shortages and declining delivery efficiency are serious problems. Furthermore, because the entire process, from order acceptance to product pickup, delivery, handover, and payment, is done manually, human error and time loss are likely to occur. Furthermore, it is difficult to accommodate depopulated areas, making it necessary to improve the efficiency of logistics.

[1524] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1525] In this invention, the server includes means for accepting product orders from users, means for validating and saving order data, means for sending product pickup instructions to an automated warehouse system, means for planning an optimal delivery route based on delivery destination address data, means for sending delivery route information to an autonomous mobility terminal and monitoring operation, means for an autonomous mobility terminal loaded with products to operate along a specified route, means for an AI driver to transport the products and process payments at the delivery destination, means for providing sensors and an alarm system to prevent accidents, means for monitoring the location information of the autonomous mobility terminal in real time and issuing operation instructions, means for an autonomous mobility terminal that has arrived at the delivery destination to send an arrival notification, and means for the recipient to input payment information on the autonomous mobility terminal and process the payment. This enables the automation and efficiency of the entire logistics process.

[1526] "Means for accepting product orders" refers to a function that receives product ID, quantity, delivery address, and payment information from users via a web interface or mobile app.

[1527] The "means for validating and saving order data" is a function that checks the format of received order data and any missing fields, confirms the accuracy of the data, and then saves it in the database.

[1528] The "means for sending product pickup instructions" is a function that generates an API request containing the product ID, quantity, and location information within the warehouse based on order information, and sends it to the automated warehouse system.

[1529] The "means for planning the optimal delivery route" is a function that analyzes address data of the delivery destination and calculates the shortest route using a geographic information system (GIS).

[1530] "Means for transmitting delivery route information and monitoring operation" refers to a function that transmits planned delivery route information to an autonomous driving mobility terminal and monitors and manages its operation status in real time.

[1531] "Means for operating along a specified route" refers to the function of an autonomous mobility terminal to operate along a specified delivery route based on instructions from a server.

[1532] "Means of transporting goods and making payments" refers to the function in which an AI driver delivers goods to the recipient at the delivery destination, and the recipient enters payment information on the terminal to complete the payment.

[1533] "Means equipped with sensors and alarm systems to prevent accidents" refers to a function that ensures safe operation by equipping the vehicle with sensors to detect obstacles or abnormalities and alarm systems that issue warnings.

[1534] "Means for monitoring location information in real time and issuing driving instructions" refers to a function that uses the GPS of the autonomous driving mobility terminal to monitor location information in real time and issue driving instructions as necessary.

[1535] The "means for sending an arrival notification" is a function that sends a notification to the server when the autonomous driving mobility terminal arrives at the delivery destination.

[1536] "Means for inputting payment information and processing payment" refers to a function in which the recipient inputs payment information on the terminal and links that information with the payment system to complete the payment.

[1537] This invention relates to a system that automates the transportation of goods from a logistics terminal to a delivery destination. This system consists of three main components: a server, a terminal (autonomous driving mobility), and a user. This section explains how each component works together and what specific processing they perform.

[1538] server

[1539] The server plays a central role in the system, managing various data and issuing instructions. First, the server accepts a product order from the user. At this time, the product ID, quantity, delivery address, and payment information are entered via a web interface or mobile app. The server checks the format of the received order data and any missing fields, and performs validation. If validation is successful, the order data is saved in the database and an order confirmation notification is sent to the user.

[1540] Next, the server generates an API request based on the stored order information, including the product ID, quantity, and location information within the warehouse, and sends a product pickup instruction to the automated warehouse system. The specified product is then picked up. The server also analyzes the delivery address data and uses a geographic information system (GIS) to plan the optimal delivery route, and sends the planned delivery route information to the autonomous mobility device.

[1541] The server uses the autonomous mobility's GPS to monitor its location in real time and issues driving instructions as needed. For example, if there is information about a traffic jam, accident, or other obstacle, the server calculates a new optimal route and issues driving instructions to the autonomous mobility device. This management continues until all deliveries are completed.

[1542] Terminal (autonomous driving mobility)

[1543] The terminal operates autonomously based on instructions sent from the server. First, when goods are loaded, the terminal works in conjunction with an AI driver in the logistics terminal to load the specified goods onto the autonomous mobility vehicle. Using sensors and cameras, the terminal checks whether the goods have been loaded correctly and notifies the server once the process is complete.

[1544] The device receives delivery route information sent from the server and begins autonomous driving. During operation, it uses sensors and cameras to monitor the surroundings and ensures safe driving. The AI ​​driver analyzes data obtained from the sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device automatically slows down or stops, and resumes driving once safety is confirmed.

[1545] Upon arriving at the delivery destination, the terminal sends an arrival notification to the server. The AI ​​driver transports the goods and hands them over to the recipient. The recipient enters payment information on the terminal, and the terminal works with the payment system to process the payment. After payment is complete, a delivery completion notification is sent to the server.

[1546] User

[1547] The user enters the product ID, quantity, delivery address, and payment information through a dedicated app or web interface. After checking the order confirmation screen, the user confirms the order by pressing the final order button, and the data is sent to the server. The user then receives an order confirmation notification, delivery progress notification, and estimated arrival time notification from the server.

[1548] At the specified delivery time, the user prepares to receive the product and waits for the terminal to arrive at the delivery address. When the AI ​​driver delivers the product, the user receives the product and checks it. If necessary, they enter payment information into the terminal to complete the payment. This records the order history and completes the entire process.

[1549] Specific examples

[1550] For example, if a user orders a product from point A using a dedicated app, the system operates in the following steps: The user enters order information (product ID, quantity, delivery address, and payment information) through the app and makes a final confirmation. The server receives this order information, validates it, and then sends a product pickup instruction to the automated warehouse system at the logistics terminal. Based on the server's instructions, the terminal has an AI driver pick up the product and load it onto the autonomous mobility vehicle. The server analyzes the delivery address data, plans the optimal delivery route, and sends the route information to the terminal, which then begins autonomous driving. During operation, the terminal constantly monitors its surroundings, performs safety management, and automatically slows down or stops if an obstacle is detected. Upon arriving at the delivery destination, the terminal sends an arrival notification to the server, and the AI ​​driver hands over the product to the recipient. The user then makes the payment on the terminal, completing the delivery. This system automates and streamlines the entire logistics process, effectively resolving issues such as driver shortages and declining logistics efficiency.

[1551] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1552] Step 1: Receiving order data

[1553] The server receives product order data from the user. Input is made via a dedicated app or web interface and includes product ID, quantity, delivery address, and payment information. This allows the server to import the order data from the user into the system. Data processing involves converting this information into an internal data format and storing it.

[1554] Step 2: Data Validation

[1555] The server checks the format of the received order data and any missing fields, and performs validation. The input is the order data received in step 1. During the validation process, for example, it verifies the existence of the product ID, the validity of the quantity, and the validity of the payment information. If the validation is successful, a flag is set and saved in the database. The validation result is generated as output.

[1556] Step 3: Save order data

[1557] The server saves the order data that has been validated successfully in the database. The input is the order data that has passed validation. In this process, the order ID, user ID, product information, delivery address information etc. are saved in the database. As an output, a save successful flag is generated and an order confirmation notification is sent after saving is complete.

[1558] Step 4: Generate and send product pickup instructions

[1559] The server generates an API request based on the order information stored in the database, including the product ID, quantity, and location within the warehouse. The input is the stored order data. This API request is sent to the automated warehouse system and used as a product pickup instruction. The output is a pickup instruction sent to the automated warehouse system.

[1560] Step 5: Plan the optimal delivery route

[1561] The server analyzes the delivery address data contained in the order information and uses a geographic information system (GIS) to plan the optimal delivery route. The input is the delivery address data. The GIS is used to select the shortest route, taking into account factors such as distance and traffic conditions. The output is the planned delivery route information.

[1562] Step 6: Sending route information

[1563] The server sends the planned delivery route information to the autonomous mobility terminal. The input is the optimal delivery route information. The terminal starts the delivery work based on the sent route information. The output is a notification that the route information has been sent.

[1564] Step 7: Check product load

[1565] The terminal works in conjunction with an AI driver in the logistics terminal to load specified products onto the autonomous mobility vehicle. The input is a pickup instruction from the server. Sensors and cameras are used to confirm that the products have been loaded correctly. The output is a notification of loading completion sent to the server.

[1566] Step 8: Start Autonomous Driving

[1567] The terminal receives delivery route information sent from the server and begins autonomous driving. The input is delivery route information. During operation, the terminal monitors the surrounding situation using sensors and cameras to maintain a safe state. The output is a notification that autonomous driving has begun.

[1568] Step 9: Safety Management

[1569] The device analyzes data from sensors and cameras to detect obstacles and abnormalities. The input is real-time sensor and camera data. If an abnormality is detected, the device automatically slows down or stops. If the situation is deemed safe, it resumes operation. As an output, a safety notification is sent to the server.

[1570] Step 10: Making the delivery

[1571] Upon arriving at the delivery destination, the device sends an arrival notification to the server. The input is GPS location information. The AI ​​driver transports the goods and hands them over to the recipient. The output is a delivery completion notification sent to the server.

[1572] Step 11: Making a payment

[1573] The recipient enters payment information on the terminal, and the terminal processes the payment in conjunction with the payment system. The input is the payment information entered by the recipient. When payment is complete, a notification is generated and a delivery completion notification is sent to the server. The output is a payment completion notification.

[1574] The above are the specific processing steps in the present invention. Each step functions in conjunction with each other to realize automation and efficiency of the entire system.

[1575] (Application example 1)

[1576] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1577] Conventional logistics systems and food delivery services are required to improve delivery efficiency and resolve labor shortages. Furthermore, they often lack systems for smoothly accepting orders from customers and accurately delivering products and meals. In particular, there are still challenges to be overcome in terms of improving delivery efficiency and safety measures using systems that utilize autonomous driving technology.

[1578] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1579] In this invention, the server includes: means for accepting product orders from users; means for validating and storing order data; means for sending product pickup instructions to an automated warehouse system; means for planning an optimal delivery route based on delivery destination address data; means for sending delivery route information to an autonomous mobility terminal and monitoring operation; means for an autonomous mobility terminal loaded with products to operate along a specified route; means for an AI driver to transport the products and process payment at the delivery destination; means for providing sensors and an alarm system to prevent accidents; means for ordering food from a restaurant menu and processing payment; means for calculating the optimal route to the food delivery destination and transmitting this to a robot; means for monitoring the delivery process in real time and correcting the route as necessary; and means for delivering food to customers and receiving payment in cash or electronically depending on the situation. This enables the efficiency and automation of logistics and food delivery.

[1580] "User" means the end user who orders and receives goods and services.

[1581] "Means for accepting product orders" refers to an interface or device for receiving product or food orders from users.

[1582] "Order data" is a collection of information about an order, such as product or dish ID, quantity, delivery address, and payment information.

[1583] "Validation" refers to the process of checking whether input data is accurate.

[1584] "Means of storage" refers to methods and devices for recording and retaining information in a database, etc.

[1585] An "automated warehouse system" is a system for automatically organizing, managing, and retrieving goods within a warehouse.

[1586] The "item pickup instruction" is an instruction to pick up the ordered item from a specified location.

[1587] "Delivery address data" refers to the address information of the destination to which the product or meal is to be delivered.

[1588] The "optimal delivery route" is the most efficient route for efficiently delivering goods or food.

[1589] "Planning means" refers to a method or device for calculating and setting delivery routes.

[1590] An "autonomous mobility terminal" is a robot or vehicle that uses sensors and AI to operate autonomously and make deliveries.

[1591] "Means for monitoring operations" means a system or method for checking the current location and status of an autonomous mobility terminal in real time.

[1592] "AI Driver" refers to an artificial intelligence-based driving system installed in autonomous mobility devices.

[1593] "Payment" refers to the payment process when receiving goods or food.

[1594] A "sensor" is a device that detects a physical quantity and converts it into an electrical signal.

[1595] An "alarm system" is a warning device that alerts you to abnormalities or dangers.

[1596] A "restaurant menu" is a list of the food and drinks offered by a restaurant.

[1597] "Cash or electronic payment" refers to various forms of payment, such as cash payment, credit card payment, and electronic money.

[1598] The present invention relates to a system for automated delivery from restaurants to customers. This system is designed to consistently automate the entire process, from receiving orders to picking up food, delivering it, delivering it, and making payments. Specific embodiments of the system are described below.

[1599] server

[1600] 1. Order acceptance

[1601] The server accepts food orders from users via a dedicated application or web interface. Order information includes the food ID, quantity, delivery address, and payment information.

[1602] When the order data reaches the server, the server performs validation to check the format of the input data and any missing fields, thereby ensuring that the data is accurate.

[1603] If validation is successful, the order data is saved to the database, after which an order confirmation notification is sent to the user.

[1604] 2. Product Pickup Instructions

[1605] The server sends a pickup instruction to the restaurant based on the order information. The server generates an API request including the dish ID, quantity, and location information within the restaurant, and sends it to the restaurant.

[1606] 3. Delivery route planning

[1607] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS), which then transmits the planned route information to the autonomous mobility terminal.

[1608] 4. Operation management

[1609] The server monitors the location information of the autonomous driving mobility in real time and issues driving instructions as necessary. If an obstacle (such as traffic congestion or an accident) occurs, the server calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[1610] Autonomous driving mobility terminal

[1611] 1. Food loading

[1612] The device receives instructions from the server and communicates with the restaurant's AI driver, who then picks up the specified dishes and accurately loads them onto the autonomous mobility vehicle.

[1613] Using sensors and cameras, it checks whether the food has been loaded correctly and notifies the server when loading is complete.

[1614] 2. Start of autonomous driving

[1615] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[1616] 3. Safety management

[1617] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[1618] 4. Delivery and Payment

[1619] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the food to the recipient.

[1620] The recipient enters payment information on the terminal, which then processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a notification of delivery completion to the server.

[1621] User

[1622] 1. Order Entry

[1623] Users order food through the system's web interface or a dedicated app. Order information includes the food ID, quantity, delivery address, and payment information.

[1624] The user confirms the order confirmation screen and presses the final order button to confirm the order. The order information is sent to the server, where it is validated and saved.

[1625] 2. Receiving notifications

[1626] The user receives order confirmation notifications from the server, as well as notifications about delivery progress and estimated arrival times.

[1627] 3. Receipt confirmation and payment

[1628] The user prepares to receive the food at the specified delivery time, and when the AI ​​driver delivers the food, the user confirms receipt.

[1629] Upon receiving the item, enter your payment information into the terminal if necessary to complete the payment. If the payment is successful, you will receive a confirmation notification and the order will be recorded in your order history.

[1630] Specific examples

[1631] For example, when a user orders food from a restaurant using a dedicated app, the system operates in the following steps:

[1632] Users enter order information (food ID, quantity, delivery address, payment information) through the app and make a final confirmation.

[1633] The server receives this order information, performs validation, and then sends a food pickup instruction to the restaurant's automated warehouse system.

[1634] Based on instructions from the server, the terminal's AI driver will pick up the food and load it into the self-driving mobility vehicle.

[1635] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[1636] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[1637] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the food to the recipient. The user then pays on the device and the delivery is complete.

[1638] Examples of prompts to input to the AI ​​model:

[1639] "Please explain the order-taking function of a food delivery system."

[1640] "Please explain what algorithms are used to plan delivery routes using autonomous mobility."

[1641] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1642] Step 1:

[1643] The user enters an order

[1644] The user enters food order information through a dedicated application or web interface. The order information includes the food ID, quantity, delivery address, and payment information. The user checks the order confirmation screen and presses the final order button to confirm the order, and this data is sent to the server. The input data reaches the server and proceeds to the next validation step.

[1645] Step 2:

[1646] The server validates and saves the order data

[1647] The server validates the received order information to check that the input data format is correct and that all fields are complete. If validation is successful, the server saves the order information in the database and sends an order confirmation notification to the user. In this step, the accuracy of the data is maintained by verifying the input data and saving it in the database.

[1648] Step 3:

[1649] The server sends a pickup instruction to the restaurant

[1650] The server sends a pickup instruction to the restaurant based on the validated and saved order information. The server generates an API request including the dish ID, quantity, and location information within the restaurant, and sends it to the restaurant. The restaurant's system receives this instruction and prepares the specified dish.

[1651] Step 4:

[1652] The server plans the optimal delivery route based on the delivery destination address data.

[1653] The server uses a geographic information system (GIS) to plan the optimal delivery route based on the address data of the delivery destination. The delivery route information is sent to the autonomous driving mobility terminal. In this step, the route is calculated using the input address data, and an efficient delivery plan is created.

[1654] Step 5:

[1655] The server sends delivery route information to the autonomous mobility device and monitors its operation.

[1656] The server sends planned delivery route information to the autonomous mobility device and monitors the operation in real time. If an obstacle such as a traffic jam or accident occurs, it calculates a new optimal route and sends instructions to the device.

[1657] Step 6:

[1658] The device loads the food

[1659] The device receives instructions from the server, works with the restaurant's AI driver to pick up the specified dishes, and loads them accurately onto the autonomous mobility vehicle. Using sensors and cameras, the device checks whether the dishes have been loaded correctly and notifies the server when loading is complete.

[1660] Step 7:

[1661] The device begins autonomous driving

[1662] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[1663] Step 8:

[1664] The device manages safety

[1665] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[1666] Step 9:

[1667] The terminal handles delivery and payment

[1668] When the delivery arrives at the destination, the device sends a notification of arrival to the server. The AI ​​driver then carries the food and hands it over to the recipient. The recipient then enters payment information on the device, which then connects to the payment system to process the payment. After payment is complete, the device sends a notification of delivery completion to the server.

[1669] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1670] The present invention relates to a system that automates the transportation of goods from a logistics terminal to a delivery destination and combines it with an emotion engine that recognizes user emotions. Specific embodiments of the system will be described below.

[1671] server

[1672] 1. Order acceptance

[1673] The server accepts product orders from users via a web interface or mobile app. Order information includes product ID, quantity, delivery address, and payment information.

[1674] When the order data reaches the server, the server performs validation to check the format of the input data and any missing fields, thereby ensuring that the data is accurate.

[1675] If validation is successful, the server saves the order information to the database, after which an order confirmation notification is sent to the user.

[1676] 2. Product Pickup Instructions

[1677] The server sends product pickup instructions to the automated warehouse system based on the order information. The server generates an API request including the product ID, quantity, and location information within the warehouse, and sends it to the automated warehouse system.

[1678] 3. Delivery route planning

[1679] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS), which then transmits the planned route information to the autonomous mobility terminal.

[1680] 4. Operation management

[1681] The server monitors the location information of the autonomous driving mobility in real time and issues driving instructions as necessary. If an obstacle (such as traffic congestion or an accident) occurs, the server calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[1682] 5. Emotion Engine

[1683] The server uses an emotion engine to collect data to recognize the user's emotions, which are then fed back during the ordering process and when sending notifications.

[1684] The emotion engine dynamically adjusts notification content based on the user's emotional state, improving the user experience.

[1685] Terminal (autonomous driving mobility)

[1686] 1. Product loading

[1687] The terminal receives instructions from the server and communicates with an AI driver in the logistics terminal, who then picks up the specified items and accurately loads them onto the autonomous mobility vehicle.

[1688] Using sensors and cameras, it checks whether the items have been loaded correctly and notifies the server that loading is complete.

[1689] 2. Start of autonomous driving

[1690] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[1691] 3. Safety management

[1692] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[1693] 4. Delivery and Payment

[1694] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the goods and hands them over to the recipient.

[1695] The recipient enters payment information on the terminal, which then processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a notification of delivery completion to the server.

[1696] User

[1697] 1. Order Entry

[1698] Users order products through the system's web interface or a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[1699] The user confirms the order confirmation screen and presses the final order button to confirm the order. The order information is sent to the server, where it is validated and saved.

[1700] 2. Receiving notifications

[1701] The user receives order confirmation notifications from the server, as well as notifications about delivery progress and estimated arrival times.

[1702] 3. Receipt confirmation and payment

[1703] The user prepares to receive the goods at the specified delivery time, and when the AI ​​driver delivers the goods, the user confirms receipt.

[1704] Upon receiving the item, enter your payment information into the terminal if necessary to complete the payment. If the payment is successful, you will receive a confirmation notification and the order will be recorded in your order history.

[1705] 4. Emotional Data

[1706] Through the emotion engine, users can provide their own emotional data during the ordering process, and the server will dynamically adjust the notification and service content accordingly.

[1707] Specific examples

[1708] For example, if a user orders a product from location A using a dedicated app, the system operates in the following steps:

[1709] The user enters order information (product ID, quantity, delivery address, payment information) through the app and makes a final confirmation.

[1710] The server receives this order information, performs validation, and then sends product pickup instructions to the automated warehouse system at the logistics terminal.

[1711] Based on instructions from the server, the terminal will have an AI driver pick up the goods and load them into the self-driving mobility vehicle.

[1712] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[1713] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[1714] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the product to the recipient. The user then pays on the device and the delivery is complete.

[1715] Furthermore, the emotion engine recognizes the user's emotions and collects feedback during delivery and after receipt, allowing the server to improve the service content for the next time.

[1716] This invention can effectively solve problems such as driver shortages and declining logistics efficiency. In addition, the use of an emotion engine can improve the user experience and increase customer satisfaction.

[1717] The processing flow will be explained below.

[1718] server

[1719] Order acceptance

[1720] Step 1:

[1721] The server receives an HTTP request sent by the user, which includes the product ID, quantity, delivery address, and payment information.

[1722] Step 2:

[1723] The server checks the format of the received order information and validates that there are no missing fields.

[1724] Step 3:

[1725] If validation is successful, the server saves the order information to the database.

[1726] Step 4:

[1727] After the order information has been saved, the server sends a confirmation notice to the user terminal.

[1728] Product Pickup Instructions

[1729] Step 1:

[1730] Based on the order information, the server generates product pickup instructions for the automated warehouse system at the logistics terminal.

[1731] Step 2:

[1732] The server sends an API request to the automated warehouse system, which includes the product ID, warehouse location, and quantity.

[1733] Step 3:

[1734] The automated warehouse system notifies the server that the product has been picked up.

[1735] Delivery route planning

[1736] Step 1:

[1737] The server parses the delivery address data.

[1738] Step 2:

[1739] The server uses a geographic information system (GIS) to plan the optimal delivery route.

[1740] Step 3:

[1741] Planned delivery route information is sent to the autonomous mobility device.

[1742] Operation management

[1743] Step 1:

[1744] The server monitors the location information of autonomous vehicles in real time.

[1745] Step 2:

[1746] When an obstacle (such as traffic jam or accident) occurs, the server calculates a new route and sends instructions to the terminal.

[1747] Step 3:

[1748] Continue monitoring and supervision until delivery is complete.

[1749] Emotion Engine

[1750] Step 1:

[1751] The server uses an emotion engine to collect emotion data from users.

[1752] Step 2:

[1753] The collected emotional data is analyzed to identify the user's emotional state.

[1754] Step 3:

[1755] Based on the analysis results, notification content and service content are dynamically adjusted.

[1756] Step 4:

[1757] Emotional data is accumulated to improve services and reflected in future service content.

[1758] Terminal (autonomous driving mobility)

[1759] Product loading

[1760] Step 1:

[1761] The terminal receives instructions from the server.

[1762] Step 2:

[1763] The terminal works in conjunction with an AI driver in the logistics terminal to pick up the specified items.

[1764] Step 3:

[1765] The terminal uses sensors and cameras to verify that the goods have been loaded correctly.

[1766] Step 4:

[1767] Once loading is complete, the terminal sends a notification to the server.

[1768] Automatic operation begins

[1769] Step 1:

[1770] The terminal receives delivery route information from the server.

[1771] Step 2:

[1772] The device will then begin autonomous driving according to the specified route.

[1773] Step 3:

[1774] While in operation, the device uses sensors and cameras to monitor its surroundings.

[1775] safety management

[1776] Step 1:

[1777] The device detects obstacles and abnormalities based on sensor and camera data.

[1778] Step 2:

[1779] If an obstacle is detected, the device will automatically slow down or stop.

[1780] Step 3:

[1781] Once conditions are deemed safe, the terminal will resume operation.

[1782] Delivery and payment

[1783] Step 1:

[1784] When the terminal arrives at the delivery destination, it sends an arrival notification to the server.

[1785] Step 2:

[1786] The AI ​​driver transports the goods and delivers them to the recipient.

[1787] Step 3:

[1788] The terminal receives payment information from the recipient and works with the payment system to process the payment.

[1789] Step 4:

[1790] After the payment is completed, the terminal sends a notification of delivery completion to the server.

[1791] User

[1792] Order Entry

[1793] Step 1:

[1794] Users select products through a web interface or mobile app.

[1795] Step 2:

[1796] The user enters the delivery address and payment information.

[1797] Step 3:

[1798] The user checks the order confirmation screen and makes a final confirmation.

[1799] Step 4:

[1800] The user presses the order button and sends the order information to the server.

[1801] Receive notifications

[1802] Step 1:

[1803] The user receives an order confirmation notice sent from the server.

[1804] Step 2:

[1805] Users will receive notifications regarding delivery progress and estimated arrival times.

[1806] Receipt confirmation and payment

[1807] Step 1:

[1808] The user prepares to receive the product at the scheduled delivery time.

[1809] Step 2:

[1810] When receiving the item, the user enters payment information on the terminal and completes the payment.

[1811] Step 3:

[1812] The user confirms receipt on the terminal and the delivery is completed.

[1813] Emotional Data Feedback

[1814] Step 1:

[1815] The user inputs or provides their emotional data during the ordering process.

[1816] Step 2:

[1817] The user receives feedback through the emotion engine.

[1818] Step 3:

[1819] The server analyzes the user's emotional data and improves the content of the service next time.

[1820] Specific examples

[1821] For example, if a user orders a product from location A using a dedicated app, the system operates in the following steps:

[1822] The user enters order information (product ID, quantity, delivery address, payment information) through the app and makes a final confirmation.

[1823] The server receives this order information, performs validation, and then sends product pickup instructions to the automated warehouse system at the logistics terminal.

[1824] Based on instructions from the server, the terminal will have an AI driver pick up the goods and load them into the self-driving mobility vehicle.

[1825] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[1826] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[1827] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the product to the recipient. The user then pays on the device and the delivery is complete.

[1828] Furthermore, the emotion engine recognizes the user's emotions and collects feedback during delivery and after receipt, allowing the server to improve the service content for the next time.

[1829] This invention can effectively solve problems such as driver shortages and declining logistics efficiency. In addition, the use of an emotion engine can improve the user experience and increase customer satisfaction.

[1830] Example 2

[1831] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1832] Conventional logistics systems face issues such as labor shortages and declining efficiency, and there is a demand for improved user experience. This invention aims to solve these issues and further increase customer satisfaction by recognizing user emotions and dynamically adjusting service content.

[1833] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1834] In this invention, the server includes means for accepting product orders from users, means for validating and storing order data, means for sending product pickup instructions to an automated storage system, means for planning an optimal delivery route based on delivery destination address data, means for sending delivery route information to an autonomous mobile device and monitoring operation, means for an autonomous mobile device carrying products to operate along a specified route, means for the autonomous mobile device to transport the products at the delivery destination and process payments with the recipient, means for providing sensors and alarm devices to prevent accidents, and means for collecting user emotion data and dynamically adjusting notification content. This can address issues such as labor shortages and logistics efficiency, and by utilizing an emotion engine, it is possible to improve the user experience.

[1835] "User" means a person or organization that uses the System to order and receive delivery of Goods.

[1836] "Means for accepting product orders" refers to the part that provides a function for receiving product order information from users via a web interface or mobile application.

[1837] "Means for validating and storing order data" refers to the part that provides a function for checking the format and incompleteness of order information received from a user and storing accurate data in a database.

[1838] "Automated storage system" refers to warehouse management equipment and related systems that automatically store and retrieve goods.

[1839] The "means for sending product pickup instructions" refers to a part that provides a function for sending product pickup instructions to the automated storage system based on order information.

[1840] "Means for planning the optimal delivery route from the address data of the delivery destination" refers to the part that provides the function of analyzing the address information of the delivery destination and calculating the optimal delivery route using a geographic information system (GIS).

[1841] "Autonomous mobile terminal" refers to a mobility device that automatically delivers goods.

[1842] "Means for transmitting delivery route information and monitoring operation" refers to the part that provides the function of transmitting planned delivery route information to an autonomous mobile terminal and monitoring the location information and status of the terminal in real time while it is in operation.

[1843] "Means for an autonomous mobile terminal carrying goods to travel along a designated route" refers to the part that provides the function for an autonomous mobile terminal to travel along a planned delivery route carrying goods.

[1844] "Means for an autonomous mobile terminal to transport goods at the delivery destination and settle payments with the recipient" refers to the part that provides the function for an autonomous mobile terminal that arrives at the delivery destination to hand over goods to the recipient and for the recipient to enter payment information and complete payment.

[1845] "Sensors and alarm devices for preventing accidents" refers to sensors for detecting obstacles installed to ensure the safe operation of autonomous mobile devices, and devices that issue alarms in the event of an abnormality.

[1846] An "emotion engine" refers to a system that recognizes a user's emotions and dynamically adjusts notification content and service content based on collected emotional data.

[1847] The present invention relates to a system that automates the transportation of goods from a logistics terminal to a delivery destination and combines it with an emotion engine that recognizes user emotions. An embodiment of the system will be described below.

[1848] server

[1849] The server runs using the following hardware and software:

[1850] Hardware: High-performance processor (e.g., Intel Xeon), large memory capacity (e.g., 64GB or more RAM), high-speed storage (e.g., SSD)

[1851] Software: Operating system (e.g., Linux), database management system (e.g., MySQL), web server (e.g., Apache)

[1852] The server accepts product orders from users. Users enter order information via a web interface or mobile app. This order information includes product ID, quantity, delivery address, and payment information. The server performs validation to check the format of the order data and for missing fields to ensure the data is accurate. If validation is successful, the order information is saved to the database and an order confirmation notification is sent to the user. The server then sends a product pickup instruction to the automated storage system based on the order information. This API request includes the product ID, quantity, and location within the warehouse.

[1853] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS). The planned route information is sent to the autonomous mobile terminal. The server monitors the location information of the autonomous mobile terminal in real time and issues driving instructions as necessary. If an obstacle information (traffic jam, accident, etc.) occurs, it calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[1854] Furthermore, the server uses an emotion engine to recognize the user's emotions, which dynamically adjusts the notification content based on the user's emotional state to improve the user experience.

[1855] Terminal (autonomous driving vehicle)

[1856] The terminal is implemented using the following hardware and software:

[1857] Hardware: Processors (e.g., NVIDIA Jetson), sensors (e.g., LiDAR, cameras), and communication modules (e.g., 5G modules) that support autonomous driving technology

[1858] Software: Autonomous driving software platform (e.g., Autoware), real-time operating system (RTOS)

[1859] The terminal receives instructions from the server and connects to the automated storage system. The AI ​​driver picks up the specified items and loads them onto the autonomous vehicle. Using sensors and cameras, the terminal checks whether the items have been loaded correctly and notifies the server of completion.

[1860] The autonomous vehicle receives delivery route information sent from the server and begins autonomous driving. During operation, it uses sensors and cameras to monitor the surroundings and maintain safe conditions. The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume operation.

[1861] When the delivery arrives at the destination, the terminal sends an arrival notification to the server. The AI ​​driver transports the goods and hands them over to the recipient. The recipient enters payment information on the terminal, and the terminal processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a delivery completion notification to the server.

[1862] User

[1863] The user uses the service in the following way:

[1864] Order entry: A user orders a product through the system's web interface or a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[1865] For example, enter "Product ID 12345, Quantity 2, Delivery address Shibuya-ku, Tokyo, Payment method Credit card."

[1866] Receive notifications: The user receives order confirmation notifications sent by the server, as well as notifications about delivery progress and estimated arrival times.

[1867] Example: "Your order has been placed. The estimated delivery date is ____."

[1868] Confirmation of receipt and payment: The user prepares to receive the product at the specified delivery time. When the AI ​​driver delivers the product, the user confirms receipt. Upon receipt, the user enters payment information into the terminal to complete the payment.

[1869] For example: "Enter your credit card information and complete the payment."

[1870] Emotion data provision: Users provide their own emotional data through the emotion engine during the ordering process and delivery. The server dynamically adjusts the notification content and service content based on the collected emotional data, improving the next service.

[1871] For example: Providing feedback such as "I felt good when I placed my order."

[1872] An example of a prompt for the generative AI model could be, "Please explain in detail the entire process from when a user orders a product through a dedicated app to when it is delivered and when it is received."

[1873] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1874] Step 1:

[1875] User enters order for product

[1876] The user enters order information (product ID, quantity, delivery address, payment information) through the system's web interface or app.

[1877] Input: Product ID, quantity, delivery address, payment information

[1878] Output: Send order data to the server

[1879] Specific operation: For example, the user enters "Product ID: 12345, Quantity: 2, Delivery address: Shibuya-ku, Tokyo, Payment information: Credit card" and presses the final confirmation button. The system sends the order information to the server.

[1880] Step 2:

[1881] The server receives the order data, validates it, and saves it.

[1882] The server receives the order data, validates the data format and checks for any missing fields, and if successful, saves it in the database and sends an order confirmation to the user.

[1883] Input: Order data from the user

[1884] Output: Save to database, send order confirmation

[1885] Specific operation: The server receives the order information "Product ID: 12345, Quantity: 2, Delivery address: Shibuya-ku, Tokyo, Payment information: Credit card" and checks whether there are any missing fields. If confirmed, it saves it in the database and sends a notification to the user that "The order has been confirmed."

[1886] Step 3:

[1887] The server sends product pickup instructions to the automated storage system

[1888] The server sends product pickup instructions to the automated storage system based on the order information.

[1889] Input: Order data stored on the server

[1890] Output: Product pickup instructions to the automated storage system

[1891] Specific operation: The server sends a pickup instruction for "item ID: 12345, quantity: 2, location A3" to the automated storage system, which then begins preparing to retrieve the item.

[1892] Step 4:

[1893] Autonomous mobile terminal picks up and loads products

[1894] The terminal receives instructions from the server and works with the automated storage system to pick up the products. Sensors and cameras check that the products are loaded correctly.

[1895] Input: Pickup instructions from the server

[1896] Output: Product loading completion notification

[1897] Specific operation: The AI ​​driver picks up "Product ID: 12345, Quantity: 2" and loads it onto the autonomous vehicle. It checks with sensors and cameras and notifies the server that loading is complete.

[1898] Step 5:

[1899] The server plans the delivery route and sends the information

[1900] The server analyzes the delivery address data to plan the optimal delivery route and transmits the route information to the autonomous mobile terminal.

[1901] Input: Delivery address data, Geographic Information System (GIS) data

[1902] Output: Sending route information

[1903] Specific operation: The server uses GIS to calculate the route from "Shibuya-ku, Tokyo" to "Minato-ku, Tokyo" and sends the "shortest route" to the autonomous driving vehicle.

[1904] Step 6:

[1905] Autonomous driving mobile devices start driving autonomously

[1906] The device receives route information sent from the server and begins autonomous driving, while monitoring the surroundings using sensors and cameras.

[1907] Input: Route information, sensor data

[1908] Output: Maintaining safe operation

[1909] Specific operation: The autonomous driving mobile device begins autonomous driving from "Shibuya Ward, Tokyo" to "Minato Ward, Tokyo," and monitors the surrounding situation in real time using sensors and cameras.

[1910] Step 7:

[1911] The server monitors the operation and issues instructions

[1912] The server monitors the location information of autonomous mobile devices in real time and issues driving instructions as necessary.

[1913] Input: Location information of autonomous driving mobile terminal, obstacle information

[1914] Output: Send instruction information

[1915] Specific operation: Using a telemetry system, the autonomous vehicle sends information such as "Current location: Shibuya Ward, no obstacles, continuing operation" to a server, and the server issues instructions for a "new optimal route" as necessary.

[1916] Step 8:

[1917] An autonomous mobile device arrives at the delivery destination, delivers the product, and takes payment.

[1918] Upon arriving at the delivery destination, the AI ​​driver hands over the product to the recipient, who then enters payment information on the terminal to complete the payment.

[1919] Input: Delivery information, payment information

[1920] Output: Product delivery and payment completion notification

[1921] Specific operation: The autonomous mobile device "arrives at the delivery destination and hands over the product," and the recipient "enters payment information and completes payment." At the same time, a "delivery completion notification" is sent to the server.

[1922] Step 9:

[1923] The server uses an emotion engine to collect and analyze user emotions.

[1924] The server uses an emotion engine to collect user emotion data and dynamically adjust the notification content.

[1925] Input: User emotion data

[1926] Output: Adjusted notification content

[1927] Specific operation: The server analyzes the user's "emotional data (e.g., facial expression data and voice data)" during the ordering process or when sending notifications, and sends "appropriate feedback notifications" to the user.

[1928] Step 10:

[1929] Users provide emotional data and receive feedback

[1930] The user provides their own emotional data through the emotion engine, and the server provides service content based on that data.

[1931] Input: User emotion data

[1932] Output: Feedback notification based on emotion

[1933] Specific operation: The user inputs "mood and emotional data for the day," and the server sends "feedback notifications to improve the next service content."

[1934] (Application example 2)

[1935] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1936] Conventional food delivery systems have not sufficiently improved efficiency and customer satisfaction during the delivery process. Furthermore, there is a need for systems that can flexibly respond to obstacles and changes in traffic conditions during delivery. Furthermore, there is a lack of systems that can collect customer sentiment and feedback in real time and dynamically adjust services based on that information. This invention aims to solve these issues and provide an efficient food delivery service with high customer satisfaction.

[1937] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1938] In this invention, the server includes means for accepting product and service orders from users, means for validating and storing order data, means for sending product pickup instructions to an automated warehouse system, means for planning an optimal delivery route based on delivery destination address data, means for sending delivery route information to an autonomous driving terminal and monitoring operation, means for an autonomous driving terminal loaded with products and services to operate along a specified route, means for an AI operator to transport the products and services and process payments at the delivery destination, means for providing sensors and alarm systems to prevent accidents, and means for using an emotion engine to analyze user emotions and dynamically adjust notifications, thereby enabling the efficiency of the delivery process and improving customer satisfaction.

[1939] "User" means any person or entity that uses the System to place orders for goods and services.

[1940] "Means for accepting product and service orders" refers to the overall interface and associated processes by which a user can enter an order for a product or service and have it accepted by the system.

[1941] "Validation" is a process of checking entered order data to ensure it is accurate and complete.

[1942] "Means for storing" refers to a method for accumulating user order information and other related data in storage such as a database.

[1943] An "automated warehouse system" is a system that uses robotics and AI to automatically manage and pick up goods.

[1944] "Means for sending a pickup instruction" refers to a method for sending an instruction from the server to the automated warehouse system to pick up a specific product.

[1945] "Address Data" refers to information about delivery addresses and is used to plan delivery routes.

[1946] "Means for planning delivery routes" refers to systems or algorithms for calculating and determining optimal delivery routes based on delivery address data and geographic information.

[1947] An "autonomous driving terminal" refers to a mobility device that uses robotics technology to operate autonomously and deliver goods and services.

[1948] "Means for monitoring operations" refers to a system that monitors the location and operating status of autonomous driving terminals in real time and issues instructions as necessary.

[1949] "AI pilot" is a technology that uses artificial intelligence to control and operate autonomous driving devices.

[1950] A "payment method" is a system for processing payments from customers when receiving goods or services.

[1951] "Sensor and alarm system for accident prevention" refers to a device that detects obstacles and abnormalities to ensure safe operation of an autonomous driving device and issues warnings as necessary.

[1952] The "Emotion Engine" is an artificial intelligence-based system for recognizing and analyzing user emotions and dynamically adjusting the content of services and notifications.

[1953] The present invention is a food delivery system that applies autonomous driving technology and dynamically adjusts services using user emotion data to achieve efficient delivery with high customer satisfaction. Specific embodiments for implementing the present invention are described below.

[1954] server

[1955] The server has the following functions:

[1956] 1. A means of accepting orders for products and services from users

[1957] Orders are accepted from users through a web interface or mobile application. Order information includes product ID, quantity, delivery address, and payment information.

[1958] For example, a user orders a "Margherita pizza" through a smartphone app and enters the delivery address.

[1959] 2. A way to validate and store order data

[1960] Check the format of the received order information and any missing fields to confirm the accuracy of the data.

[1961] If validation is successful, save the order information to the database and send an order confirmation notification to the user.

[1962] 3. Means of sending product pickup instructions to the automated warehouse system

[1963] The server generates an API request containing the product ID, quantity, and location within the warehouse and sends it to the automated warehouse system.

[1964] 4. A means to plan optimal delivery routes based on delivery address data

[1965] Using a geographic information system (GIS), the optimal delivery route is calculated based on the delivery destination address data.

[1966] The planned route information is sent to the autonomous driving terminal.

[1967] 5. Means of monitoring operations

[1968] The location information of the autonomous driving device is monitored in real time and driving instructions are issued as necessary.

[1969] If congestion or an obstacle is detected, a new optimal route is calculated and sent to the device.

[1970] 6. A method to analyze user emotions and dynamically adjust notifications using an emotion engine

[1971] Collect and analyze user sentiment data during delivery and after delivery, and dynamically adjust notifications and service content based on the analysis results to improve the user experience.

[1972] For example, if a delivery is delayed, the system can sense the user's stress and send a notification offering a coupon.

[1973] Terminal (autonomous driving terminal)

[1974] The terminal has the following functions:

[1975] 1. A means of transporting goods and services along designated routes by automated driving devices.

[1976] It will begin autonomous driving along the designated route, and will constantly monitor the surrounding conditions using sensors and cameras while in operation.

[1977] For example, if the device detects an obstacle on the road during a delivery, it will automatically take a detour.

[1978] 2. AI-operated delivery of goods and services and payment at the destination

[1979] When the self-driving device arrives at the delivery destination, the AI ​​operator transports the goods and hands them over to the user.

[1980] The user enters payment information on the terminal and makes the payment.

[1981] 3. Means equipped with sensors and alarm systems to prevent accidents

[1982] It analyzes sensor and camera data to detect obstacles and abnormalities, and if an abnormality is detected, the device will automatically slow down or stop.

[1983] User

[1984] The user performs the following operations:

[1985] 1. Entering Goods and Services Orders

[1986] Order products through a web interface or a dedicated app, and enter your delivery address and payment information.

[1987] For example, order a "Margherita Pizza" and enter your home address.

[1988] 2. Receiving Notifications

[1989] Receive notifications from the server regarding order confirmation, delivery progress, and estimated arrival time.

[1990] For example, a notification like "Your pizza order is currently being delivered."

[1991] 3. Receipt confirmation and payment

[1992] Receive the product at the delivery address, enter payment information if necessary, and complete the payment.

[1993] 4. Providing Emotion Data

[1994] Through the emotion engine, customers provide their own emotional data during the ordering process, and the server dynamically adjusts notifications and service content based on this data.

[1995] Examples and prompts

[1996] Examples:

[1997] A user orders a Margherita pizza through the app and enters their delivery address and payment information.

[1998] The server validates the order information, stores it in the database, and sends a pickup instruction to the automated warehouse system.

[1999] The self-driving terminal picks up the goods and begins delivery along the designated route.

[2000] Detects obstacles on the route and automatically detours around them.

[2001] Once the delivery arrives, the AI ​​operator delivers the goods, and the user completes the payment.

[2002] The server uses an emotion engine to collect feedback during delivery and improve the next service.

[2003] Example prompt sentence:

[2004] "Deliver Margherita pizza to 4-2-8 Shibakoen, Minato-ku, Tokyo for order ID 12345. Calculate and submit the optimal route."

[2005] "Analyze customer feedback and tailor your notifications based on sentiment data."

[2006] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2007] Step 1:

[2008] The server accepts the order

[2009] Input: The user inputs product and service order information through a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[2010] Specific Operations: The server receives the order information via a web interface or mobile application.

[2011] Output: The order information is sent to the server.

[2012] Step 2:

[2013] The server validates and saves the order data

[2014] Input: Received order information.

[2015] Specific behavior: The server checks the order information for format and missing fields to ensure the data is accurate. If validation is successful, it saves the order information to the database and sends an order confirmation notification to the user.

[2016] Output: Validated order information and confirmation notice.

[2017] Step 3:

[2018] The server sends product pickup instructions to the automated warehouse system

[2019] Input: Validated order information (item ID, quantity, warehouse location).

[2020] Specific operation: The server generates an API request containing the product ID, quantity, and location information within the warehouse and sends it to the automated warehouse system.

[2021] Output: Pickup instructions to the automated warehouse system.

[2022] Step 4:

[2023] The server plans the optimal delivery route based on the delivery destination address data.

[2024] Input: Delivery address data.

[2025] Specific operation: The server uses a geographic information system (GIS) to calculate the optimal delivery route based on the delivery destination address data.

[2026] Output: Optimal delivery route information.

[2027] Step 5:

[2028] The server sends delivery route information to the autonomous driving terminal and monitors operation.

[2029] Input: Optimal delivery route information.

[2030] Specific operation: The server sends the planned route information to the autonomous driving terminal, monitors the location information in real time, and issues driving instructions according to the situation.

[2031] Output: Route information and instructions to the autonomous driving terminal.

[2032] Step 6:

[2033] The terminal is loaded with goods and services and begins operation.

[2034] Input: Delivery route information and product loading status from the server.

[2035] Specific operation: The autonomous driving device starts driving along the designated route, and while driving, it monitors the surroundings using sensors and cameras.

[2036] Output: Surroundings data and driving notifications.

[2037] Step 7:

[2038] The terminal delivers goods and services to the destination, where an AI operator delivers them and makes payments.

[2039] Input: Shipping address and product information.

[2040] Specific operation: When the autonomous driving terminal arrives at the delivery destination, the AI ​​operator carries the goods and delivers them to the user, who then enters payment information on the terminal and makes the payment.

[2041] Output: Receipt notification and payment completion notification.

[2042] Step 8:

[2043] The server monitors the sensor and alarm systems to prevent accidents.

[2044] Input: Sensor data from the autonomous driving device.

[2045] Specific operation: The server analyzes sensor and camera data, and if it detects an obstacle or abnormality, it instructs the device to slow down or stop. When it determines that the situation is safe, it resumes operation.

[2046] Output: Anomaly detection notification and operation instructions.

[2047] Step 9:

[2048] The server uses an emotion engine to analyze the user's emotions and dynamically adjust notifications.

[2049] Input: Feedback messages and sentiment data from users.

[2050] Specific operation: The server uses an emotion engine to analyze the user's emotions and dynamically adjusts the notification content and service content based on the feedback results.

[2051] Output: Dynamically adjusted notifications and service offerings.

[2052] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2053] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2054] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2055] [Fourth embodiment]

[2056] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2057] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2058] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2059] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2060] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2061] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2062] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2063] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2064] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2065] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2066] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2067] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2068] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2069] The present invention relates to a system for automating the transportation of goods from a logistics terminal to a delivery destination. This system is designed to consistently automate the entire process from order acceptance to product pickup, delivery, handover, and payment. Specific embodiments of the system are described below.

[2070] server

[2071] 1. Order acceptance

[2072] The server accepts product orders from users via a web interface or mobile app. Order information includes product ID, quantity, delivery address, and payment information.

[2073] When the order data reaches the server, the server performs validation to check the format of the input data and any missing fields, thereby ensuring that the data is accurate.

[2074] If validation is successful, the order data is saved to the database, after which an order confirmation notification is sent to the user.

[2075] 2. Product Pickup Instructions

[2076] The server sends product pickup instructions to the automated warehouse system based on the order information. The server generates an API request including the product ID, quantity, and location information within the warehouse, and sends it to the automated warehouse system.

[2077] 3. Delivery route planning

[2078] The server analyzes the address data of the delivery destination and plans the optimal delivery route using a geographic information system (GIS), which then transmits the planned route information to the autonomous mobility terminal.

[2079] 4. Operation management

[2080] The server monitors the location information of the autonomous driving mobility in real time and issues driving instructions as necessary. If an obstacle (such as traffic congestion or an accident) occurs, the server calculates a new optimal route and sends instructions to the terminal. This management continues until all deliveries are completed.

[2081] Terminal (autonomous driving mobility)

[2082] 1. Product loading

[2083] The terminal receives instructions from the server and communicates with an AI driver in the logistics terminal, who then picks up the specified items and accurately loads them onto the autonomous mobility vehicle.

[2084] Using sensors and cameras, it checks whether the items have been loaded correctly and notifies the server that loading is complete.

[2085] 2. Start of autonomous driving

[2086] The terminal receives delivery route information sent from the server and begins autonomous driving. During operation, the terminal monitors the surroundings using sensors and cameras to ensure safety at all times.

[2087] 3. Safety management

[2088] The AI ​​driver analyzes data from the device's sensors and cameras to detect obstacles and abnormalities. If an abnormality is detected, the device will automatically slow down or stop. Once the situation is deemed safe, it will resume driving.

[2089] 4. Delivery and Payment

[2090] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the goods and hands them over to the recipient.

[2091] The recipient enters payment information on the terminal, which then processes the payment in conjunction with the payment system. After payment is complete, the terminal sends a notification of delivery completion to the server.

[2092] User

[2093] 1. Order Entry

[2094] Users order products through the system's web interface or a dedicated app. Order information includes product ID, quantity, delivery address, and payment information.

[2095] The user confirms the order confirmation screen and presses the final order button to confirm the order. The order information is sent to the server, where it is validated and saved.

[2096] 2. Receiving notifications

[2097] The user receives order confirmation notifications from the server, as well as notifications about delivery progress and estimated arrival times.

[2098] 3. Receipt confirmation and payment

[2099] The user prepares to receive the goods at the specified delivery time, and when the AI ​​driver delivers the goods, the user confirms receipt.

[2100] Upon receiving the item, enter your payment information into the terminal if necessary to complete the payment. If the payment is successful, you will receive a confirmation notification and the order will be recorded in your order history.

[2101] Specific examples

[2102] For example, if a user orders a product from location A using a dedicated app, the system operates in the following steps:

[2103] The user enters order information (product ID, quantity, delivery address, payment information) through the app and makes a final confirmation.

[2104] The server receives this order information, performs validation, and then sends product pickup instructions to the automated warehouse system at the logistics terminal.

[2105] Based on instructions from the server, the terminal will have an AI driver pick up the goods and load them into the self-driving mobility vehicle.

[2106] The server analyzes the address data of the delivery destination and plans the optimal delivery route. The planned route information is sent to the terminal, and autonomous driving begins.

[2107] The device constantly monitors the surroundings while in operation, ensuring safety and automatically slowing down or stopping if an obstacle is detected.

[2108] When the delivery arrives at the destination, the device sends a notification to the server, and the AI ​​driver delivers the product to the recipient. The user then pays on the device and the delivery is complete.

[2109] This invention can effectively solve problems such as driver shortages and declining logistics efficiency. This system can also be used in depopulated areas, realizing efficient logistics over a wide area.

[2110] The processing flow will be explained below.

[2111] server

[2112] Order acceptance

[2113] Step 1:

[2114] The server receives an HTTP request sent by the user, which includes the product ID, quantity, delivery address, and payment information.

[2115] Step 2:

[2116] The server checks the format of the received order information and validates that there are no missing fields.

[2117] Step 3:

[2118] If validation is successful, the server saves the order information to the database.

[2119] Step 4:

[2120] After the order information has been saved, the server sends a confirmation notice to the user terminal.

[2121] Product Pickup Instructions

[2122] Step 1:

[2123] Based on the order information, the server generates product pickup instructions for the automated warehouse system at the logistics terminal.

[2124] Step 2:

[2125] The server sends an API request to the automated warehouse system, which includes the product ID, warehouse location, and quantity.

[2126] Step 3:

[2127] The automated warehouse system notifies the server that the product has been picked up.

[2128] Delivery route planning

[2129] Step 1:

[2130] The server parses the delivery address data.

[2131] Step 2:

[2132] The server uses a geographic information system (GIS) to plan the optimal delivery route.

[2133] Step 3:

[2134] Planned delivery route information is sent to the autonomous mobility device.

[2135] Operation management

[2136] Step 1:

[2137] The server monitors the location information of autonomous vehicles in real time.

[2138] Step 2:

[2139] When an obstacle (such as traffic jam or accident) occurs, the server calculates a new route and sends instructions to the terminal.

[2140] Step 3:

[2141] Continue monitoring and supervision until delivery is complete.

[2142] Terminal (autonomous driving mobility)

[2143] Product loading

[2144] Step 1:

[2145] The terminal receives instructions from the server.

[2146] Step 2:

[2147] The terminal works in conjunction with an AI driver in the logistics terminal to pick up the specified items.

[2148] Step 3:

[2149] The terminal uses sensors and cameras to verify that the goods have been loaded correctly.

[2150] Step 4:

[2151] Once loading is complete, the terminal sends a notification to the server.

[2152] Automatic operation begins

[2153] Step 1:

[2154] The terminal receives delivery route information from the server.

[2155] Step 2:

[2156] The device will then begin autonomous driving according to the specified route.

[2157] Step 3:

[2158] While in operation, the device uses sensors and cameras to monitor its surroundings.

[2159] safety management

[2160] Step 1:

[2161] The device detects obstacles and abnormalities based on sensor and camera data.

[2162] Step 2:

[2163] If an obstacle is detected, the device will automatically slow down or stop.

[2164] Step 3:

[2165] Once conditions are deemed safe, the terminal will resume operation.

[2166] Delivery and payment

[2167] Step 1:

[2168] When the terminal arrives at the delivery destination, it sends an arrival notification to the server.

[2169] Step 2:

[2170] The AI ​​driver transports the goods and delivers them to the recipient.

[2171] Step 3:

[2172] The terminal receives payment information from the recipient and works with the payment system to process the payment.

[2173] Step 4:

[2174] After the payment is completed, the terminal sends a notification of delivery completion to the server.

[2175] User

[2176] Order Entry

[2177] Step 1:

[2178] Users select products through a web interface or mobile app.

[2179] Step 2:

[2180] The user enters the delivery address and payment information.

[2181] Step 3:

[2182] The user checks the order confirmation screen and makes a final confirmation.

[2183] Step 4:

[2184] The user presses the order button and sends the order information to the server.

[2185] Receive notifications

[2186] Step 1:

[2187] The user receives an order confirmation notice sent from the server.

[2188] Step 2:

[2189] Users will receive notifications regarding delivery progress and estimated arrival times.

[2190] Receipt confirmation and payment

[2191] Step 1:

[2192] The user prepares to receive the product at the scheduled delivery time.

[2193] Step 2:

[2194] When receiving the item, the user enters payment information on the terminal and completes the payment.

[2195] Step 3:

[2196] The user confirms receipt on the terminal and the delivery is completed.

[2197] Example 1

[2198] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2199] In conventional logistics systems, driver shortages and declining delivery efficiency are serious problems. Furthermore, because the entire process, from order acceptance to product pickup, delivery, handover, and payment, is done manually, human error and time loss are likely to occur. Furthermore, it is difficult to accommodate depopulated areas, making it necessary to improve the efficiency of logistics.

[2200] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2201] In this invention, the server includes means for accepting product orders from users, means for validating and saving order data, means for sending product pickup instructions to an automated warehouse system, means for planning an optimal delivery route based on delivery destination address data, means for sending delivery route information to an autonomous mobility terminal and monitoring operation, means for an autonomous mobility terminal loaded with products to operate along a specified route, means for an AI driver to transport the products and process payments at the delivery destination, means for providing sensors and an alarm system to prevent accidents, means for monitoring the location information of the autonomous mobility terminal in real time and issuing operation instructions, means for an autonomous mobility terminal that has arrived at the delivery destination to send an arrival notification, and means for the recipient to input payment information on the autonomous mobility terminal and process the payment. This enables the automation and efficiency of the entire logistics process.

[2202] "Means for accepting product orders" refers to a function that receives product ID, quantity, delivery address, and payment information from users via a web interface or mobile app.

[2203] The "means for validating and saving order data" is a function that checks the format of received order data and any missing fields, confirms the accuracy of the data, and then saves it in the database.

[2204] The "means for sending product pickup instructions" is a function that generates an API request containing the product ID, quantity, and location information within the warehouse based on order information, and sends it to the automated warehouse system. ...

Claims

1. A means for accepting product orders from users; A means of validating and storing order data; means for transmitting product pickup instructions to an automated warehouse system; A means of planning the optimal delivery route based on delivery destination address data; A means for transmitting delivery route information to the autonomous driving mobility terminal and monitoring operation; A means for an autonomous mobility terminal loaded with goods to travel along a designated route; A method for an AI driver to transport goods and process payments at the delivery destination, A system including means with sensors and alarm systems for accident prevention.

2. 2. The system according to claim 1, further comprising means for transmitting order data to an automated warehouse system of a logistics terminal and generating product pickup instructions.

3. The system according to claim 1, wherein the autonomous driving mobility terminal is provided with a means for working in cooperation with an AI driver and for autonomous driving while monitoring the surrounding conditions.

Images