System

Abstract

To provide an unmanned cleaning reception system corresponding to 24 hours.SOLUTION: A means for a user to operate a terminal to select a type of clothes, a means for a camera to photograph a cleaning tag and generate image data thereof, a means for transmitting the generated image data to a server, a means for the server to analyze the received image data and select an appropriate cleaning method, a means for automatically calculating a fee based on the selected cleaning method, an electronic payment system means for the terminal to display the calculated fee and for the user to make payment, A system comprising: means for depositing in a deposit box; means for a server to send a notification to a user after cleaning is completed; and means for the user to receive the notification and receive cleaned clothes in an unmanned home delivery box.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional dry cleaning shops have limited business hours, meaning that users cannot request dry cleaning at their own convenience. Furthermore, since employees are required to accept and deposit laundry, this increases labor costs and makes efficient operation difficult. Furthermore, selecting the appropriate cleaning method and calculating fees are done manually, which can lead to errors. There is a need to solve these problems and provide an unmanned dry cleaning reception system that is available 24 hours a day. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means: A means for a user to operate a terminal to select the type of clothes, and a means for using a camera to photograph the cleaning tag and generate image data. A means for transmitting the generated image data to a server, which then analyzes the received image data and selects an appropriate cleaning method, is provided. Furthermore, a means for automatically calculating a fee based on the selected cleaning method is provided, and an electronic payment system is included for the terminal to display the calculated fee and for the user to make payment. Finally, a means for a user to place the clothes in a laundry bag and deposit it in a laundry box, and a means for the server to send a notification to the user after the cleaning is completed, is provided. A means for a user to receive the notification and pick up the cleaned clothes in an unmanned delivery box is also provided. This enables unmanned laundry reception and delivery 24 hours a day, improving convenience and reducing costs.

[0006] A "terminal" is an electronic device that a user operates, such as a tablet terminal or a kiosk terminal.

[0007] "Camera" is an image capture device used to photograph the cleaning tag.

[0008] A "cleaning tag" is a tag that lists washing instructions and material information for clothing.

[0009] A "server" is a central processing unit that performs processes such as analyzing image data and calculating fees.

[0010] "Image data" is image information of the cleaning tag photographed by a camera.

[0011] "Artificial intelligence" is a technology that analyzes image data from cleaning tags and selects the appropriate cleaning method.

[0012] "Means for automatically calculating fees" is a function that allows the server to calculate cleaning fees based on the information entered.

[0013] An "electronic payment system" is a system that allows users to make payments using credit cards or electronic money.

[0014] A "laundry bag" is a bag in which a user stores clothes for dry cleaning.

[0015] The "deposit box" is an unmanned reception box where users can deposit laundry bags.

[0016] The "means for sending notifications" is a function that allows the server to notify the user of the progress of cleaning.

[0017] An "unmanned delivery box" is a box where users can receive their cleaned clothes. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9]1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] The following system is proposed as an embodiment of the present invention. This system allows users to request cleaning by operating an unmanned reception terminal, and realizes unmanned cleaning reception and delivery 24 hours a day.

[0040] System configuration

[0041] 1. Device:

[0042] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can take a picture of the cleaning tag.

[0043] 2. Server:

[0044] This is a central processing unit that analyzes image data, calculates fees, etc. The server is equipped with artificial intelligence (AI) that analyzes the information extracted from the cleaning tag and selects the appropriate cleaning method.

[0045] 3. Camera:

[0046] An image capture device used to photograph the cleaning tag, built into the terminal.

[0047] 4. Electronic payment systems:

[0048] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[0049] 5. Laundry Bag:

[0050] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[0051] 6. Deposit Box:

[0052] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[0053] 7. Unmanned delivery box:

[0054] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[0055] Program processing flow

[0056] User selection of clothing type

[0057] The user selects the type of clothing they wish to have cleaned from a list displayed on the screen of the unmanned reception terminal, such as "suit jacket" or "shirt."

[0058] The terminal receives user input and transmits the data to the server.

[0059] The server analyzes the received data and sets the next step.

[0060] Photographing and analyzing cleaning tags

[0061] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[0062] The terminal transmits the generated image data to the server.

[0063] The server receives the image data and analyzes the tag information using artificial intelligence (AI). As a result of the analysis, information about the clothing's material and cleaning method can be extracted.

[0064] Selecting a cleaning method and calculating fees

[0065] Based on the analyzed information, the server uses AI to select the optimal cleaning method, which can include washing with water or dry cleaning.

[0066] The server automatically calculates the fee based on the selected cleaning method, and the calculated fee information is sent to the terminal.

[0067] The terminal displays the fee information to the user and prompts them to proceed with the payment procedure.

[0068] Payment via electronic payment systems

[0069] The user checks the displayed fee and pays using a credit card or electronic money.

[0070] The terminal transmits the payment information to the electronic payment system and waits for the transaction to complete.

[0071] The server receives confirmation of successful payment and sends instructions to the terminal on the next steps.

[0072] Preparing and posting laundry bags

[0073] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[0074] The user places the prepared laundry bag in the deposit box.

[0075] The terminal notifies the server that the laundry bag has been placed in the deposit box.

[0076] The server receives and records confirmation of the laundry bag posting.

[0077] After cleaning is complete

[0078] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[0079] The user receives a notification, goes to the designated unmanned delivery box, scans the QR code, and collects the cleaned clothes.

[0080] The device confirms the QR code scan and notifies the server.

[0081] The server records a confirmation of receipt and completes the process.

[0082] As described above, the system of the present invention provides users with the convenience of being able to have their clothes cleaned 24 hours a day, and also contributes to reducing labor costs and mistakes on the part of the store.

[0083] The processing flow will be explained below.

[0084] Step 1:

[0085] The user taps the type of clothing they wish to have cleaned (for example, "suit jacket" or "shirt") from the options displayed on the screen of the unmanned reception terminal.

[0086] Step 2:

[0087] The terminal receives user input and transmits the data to the server.

[0088] Step 3:

[0089] The server stores the received data and returns instructions for the next step to the terminal for display.

[0090] Step 4:

[0091] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[0092] Step 5:

[0093] The terminal transmits the generated image data to the server.

[0094] Step 6:

[0095] The server receives the image data and uses artificial intelligence (AI) to analyze the tag information, extracting information about the clothing's material (e.g., wool, cotton) and washing instructions (e.g., dry cleaning, do not wash).

[0096] Step 7:

[0097] The server then selects the optimal cleaning method based on the analysis results. For example, for a wool jacket, the AI ​​will select dry cleaning.

[0098] Step 8:

[0099] The server automatically calculates the fee using the selected cleaning method, and the calculated fee information is sent to the terminal.

[0100] Step 9:

[0101] The terminal receives the fee information to display to the user and displays it on the screen.

[0102] Step 10:

[0103] The user checks the displayed fee and pays using a credit card or electronic money. The user then enters the necessary information for the payment procedure.

[0104] Step 11:

[0105] The terminal sends the payment information to the electronic payment system and waits until the process is complete. After confirming that the payment is complete, the terminal sends the information to the server.

[0106] Step 12:

[0107] The server receives a confirmation of the payment and sends instructions for the next step to the terminal.

[0108] Step 13:

[0109] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[0110] Step 14:

[0111] The user places the filled laundry bag in the storage box and holds the QR code displayed on the terminal over the scanner in the storage box.

[0112] Step 15:

[0113] The terminal confirms that the laundry bag has been placed in the storage box and notifies the server of this information.

[0114] Step 16:

[0115] The server records confirmation that the laundry bag has been placed in the deposit box.

[0116] Step 17:

[0117] The dry cleaner's staff or an automated system will retrieve the laundry bag from the deposit box and begin the cleaning process.

[0118] Step 18:

[0119] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[0120] Step 19:

[0121] Users receive a notification, go to the designated unmanned delivery box, scan the QR code and collect their cleaned clothes.

[0122] Step 20:

[0123] The device confirms the QR code scan and notifies the server of the information.

[0124] Step 21:

[0125] The server records a confirmation of receipt and marks the whole process as complete.

[0126] The above are the detailed program processing steps in the unmanned cleaning reception system.

[0127] Example 1

[0128] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0129] Conventional dry cleaning systems have limited reception and collection times, making it difficult for users to use the system 24 hours a day. Furthermore, the process of accepting and collecting dry cleaning requires manual labor, which increases labor costs for the store and increases the likelihood of errors. The present invention aims to solve these problems by providing a system that allows users to use dry cleaning services 24 hours a day and improves the operational efficiency of the store.

[0130] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0131] In this invention, the server includes means for selecting the type of clothing using a terminal operated by the user, means for taking a picture of the cleaning tag with a camera and generating image data, means for analyzing the generated image data and selecting an appropriate cleaning method, means for automatically calculating the fee and sending the fee information to the terminal, means for the user to place the clothes in a laundry bag and place it in a deposit box, and means for the server to notify the user after the cleaning is complete and for the user to collect the clothes in an unmanned receiving box. This allows users to use the dry cleaning service 24 hours a day and improves the operational efficiency of the store.

[0132] "User" means an individual or organization that uses the system to request cleaning.

[0133] A "terminal" is an electronic device operated by a user, and is an interface device including a tablet terminal and a kiosk terminal.

[0134] A "server" is a device that handles the central processing of the entire system, and is a computer that analyzes and processes data and sends instructions.

[0135] A "cleaning tag" is a tag attached to clothing that contains information about the material of the clothing and the cleaning method.

[0136] A "laundry bag" is a bag in which a user stores clothes that they wish to have dry cleaned.

[0137] The "deposit box" is an unmanned reception box into which users deposit laundry bags, and operates in conjunction with the system.

[0138] An "unattended receiving box" is a box that users use to receive their cleaned clothes after cleaning is complete.

[0139] An "electronic payment system" is a system that allows users to make payments using credit cards or electronic money.

[0140] "Image data" refers to photographic data of the cleaning tag taken using a camera.

[0141] "Artificial intelligence" refers to AI technology built into the server, and is an algorithm that analyzes image data and selects cleaning methods.

[0142] "Notification" refers to a message sent by the server to inform the user of the completion of cleaning or availability of information.

[0143] To implement the present invention, the following system and its components will be described. This system allows users to request cleaning by operating an unmanned reception terminal, and realizes unmanned cleaning reception and delivery 24 hours a day.

[0144] System configuration

[0145] 1. Terminal

[0146] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can take a picture of the cleaning tag.

[0147] 2. Server

[0148] This is a central processing unit that analyzes image data and calculates fees. The server incorporates artificial intelligence (AI) to analyze the information extracted from the cleaning tag and select the appropriate cleaning method. It also processes payment information and sends notifications to users.

[0149] 3. Camera

[0150] An image capture device used to photograph the cleaning tag, built into the terminal.

[0151] 4. Electronic Payment Systems

[0152] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[0153] 5. Laundry bags

[0154] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[0155] 6. Deposit Box

[0156] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[0157] 7. Unattended Delivery Boxes

[0158] This is a box where users can receive their cleaned clothes after cleaning is complete. It receives a notification from the server and can be handled unattended.

[0159] Program processing overview

[0160] 1. Select the type of clothing

[0161] The user selects the type of clothing they want cleaned from a list displayed on the unmanned reception terminal's screen. The interface displays options such as "suit jacket" or "shirt." The terminal receives the user's input and sends the data to the server, which uses this data to determine the next steps.

[0162] Examples:

[0163] The user selects "suit jacket." The device sends this information to the server, which analyzes the information and prepares the next interface.

[0164] Prompt statement:

[0165] "Please enter the type of clothing selected by the user."

[0166] 2. Photographing and analyzing cleaning tags

[0167] The user shows the cleaning tag to the device's camera. The device's camera takes a photo of the tag and generates image data. This image data is then sent to a server. The server uses artificial intelligence (AI) to analyze the tag information and extract information about the garment's material and cleaning instructions.

[0168] Examples:

[0169] The user shows the tag to the camera, the device takes a photo, and the device sends the data to the server, where the server's AI extracts an analysis result, such as "100% cotton."

[0170] Prompt statement:

[0171] "Please send the image data of the tag to the server. Analyze the material information of the clothing based on that data."

[0172] 3. Selecting a cleaning method and calculating the fee

[0173] Based on the analyzed information, the server uses AI to select the optimal cleaning method, such as "water washing" or "dry cleaning." The server automatically calculates the fee based on the selected cleaning method and sends that information to the terminal. The terminal then displays the fee information to the user and prompts them to complete the payment process.

[0174] Examples:

[0175] The AI ​​determines that "water washing is best for a 100% cotton shirt," calculates the cost to be 500 yen, and sends this to the terminal. The terminal then displays the 500 yen fee to the user and guides them through the payment process.

[0176] Prompt statement:

[0177] "The AI ​​will select the cleaning method and calculate the fee, and the results will be displayed on your device."

[0178] 4. Payment via electronic payment systems

[0179] The user checks the displayed price and pays using a credit card or electronic money. The terminal sends the payment information to the electronic payment system and waits until the transaction is complete. The server receives confirmation of the payment and sends instructions for the next step to the terminal.

[0180] Examples:

[0181] The user inserts a credit card into the terminal and pays 500 yen. The terminal sends the payment information to the electronic payment system in real time. When the server receives notification that the payment is complete, the terminal displays the next step information.

[0182] Prompt statement:

[0183] Please explain the process for users to check the price and complete the payment.

[0184] 5. Prepare and post laundry bags

[0185] The user follows the instructions on the screen to pack their clothes into the laundry bag they brought with them. Then, they place the laundry bag they prepared in the deposit box. The terminal detects this and notifies the server. The server receives and records confirmation that the laundry bag has been placed in the box.

[0186] Examples:

[0187] The user follows the instructions on the screen to place the shirt in the laundry bag. When the laundry bag is placed in the deposit box, the device detects this action and notifies the server that the bag has been placed, and the server records the event.

[0188] Prompt statement:

[0189] "Please explain the process for users to put their clothes into laundry bags and place them in the drop box."

[0190] 6. What to do after cleaning is complete

[0191] The server will send a notification to the user when the cleaning is complete. The notification will include the location and details of the unmanned drop-off box where the laundry can be picked up. The user will receive the notification, go to the designated unmanned drop-off box, scan the QR code to pick up the cleaned laundry, and the device will confirm the QR code scan and notify the server. The server will record the receipt confirmation and complete the process.

[0192] Examples:

[0193] The server notifies the user that the cleaning is complete and provides the location of the unmanned receiving box. The user goes to the unmanned receiving box and scans the QR code on their device. The device verifies the QR code and notifies the server to record the receipt.

[0194] Prompt statement:

[0195] "Please explain how users can pick up their clothes after cleaning is complete."

[0196] This system allows users to enjoy the convenience of having their clothes cleaned 24 hours a day, and stores can expect to reduce labor costs and prevent mistakes.

[0197] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0198] Step 1: Select the type of clothing

[0199] The user selects the type of clothing they wish to have cleaned from a list displayed on the unmanned reception terminal screen. As input, the user selects an item such as "suit jacket" or "shirt" on the touch screen. The terminal receives the user's input and sends the data to the server.

[0200] Specific behavior:

[0201] The user selects "shirt."

[0202] The terminal transmits the selection information of "shirt" to the server.

[0203] The server receives this information and prepares for the next steps.

[0204] Input data: The type of clothing selected by the user (e.g., shirt)

[0205] Output data: Setting next steps based on clothing type

[0206] Step 2: Photograph and analyze the cleaning tag

[0207] The user shows the cleaning tag to the camera of the unmanned reception terminal. The terminal takes a picture of the cleaning tag with the camera and generates image data. The generated image data is sent to the server. The server uses artificial intelligence (AI) to analyze the image data and extract information about the clothing's material and cleaning method.

[0208] Specific behavior:

[0209] The user shows the cleaning tag in front of the device's camera.

[0210] The terminal takes a picture of the tag, generates image data, and sends it to the server.

[0211] The server uses AI to analyze the tag information and extract information such as "100% cotton."

[0212] Input data: Image data of cleaning tag

[0213] Output data: Analyzed material information (e.g., 100% cotton)

[0214] Step 3: Choose your cleaning method and calculate the cost

[0215] The server uses AI to select the optimal cleaning method based on the analyzed material information. For example, "washing with water" or "dry cleaning." Based on the selected cleaning method, the server automatically calculates the fee and sends that information to the terminal. The terminal then displays the fee information to the user.

[0216] Specific behavior:

[0217] The server determines that "water washing is best for 100% cotton shirts."

[0218] The server calculates the fee as 500 yen and sends that information to the terminal.

[0219] The terminal displays the charge of 500 yen to the user.

[0220] Input data: Analyzed material information (e.g., 100% cotton)

[0221] Output data: Best cleaning method and price information (e.g. water wash, 500 yen)

[0222] Step 4: Pay via electronic payment system

[0223] The user checks the displayed price and pays using a credit card or electronic money. As input, the user enters credit card or electronic money information into the terminal. The terminal sends the payment information to the electronic payment system and waits until the payment process is complete. The server receives confirmation of payment completion and sends instructions for the next step to the terminal.

[0224] Specific behavior:

[0225] The user inserts a credit card into the terminal and pays 500 yen.

[0226] The terminal transmits payment information in real time to an electronic payment system.

[0227] The server receives notification of the completion of payment and sends next step information to the terminal.

[0228] Input data: User's credit card information or electronic money information

[0229] Output data: Payment completion status

[0230] Step 5: Prepare and mail laundry bags

[0231] The user follows the instructions displayed on the terminal and places the clothes in the laundry bag they brought with them. When preparations are complete, the user places the laundry bag in the deposit box. The terminal detects this placement and notifies the server. The server receives and records confirmation of the placement.

[0232] Specific behavior:

[0233] The user follows the on-screen instructions to place the shirt in the laundry bag.

[0234] When you drop a laundry bag into the deposit box, the device detects the action.

[0235] The terminal notifies the server that the submission has been completed, and the server records it.

[0236] Input data: Information about laundry bags being dropped off in the deposit box

[0237] Output data: Posting completion status

[0238] Step 6: What to do after cleaning

[0239] The server will send a notification to the user when the cleaning is complete. The notification will include the location and details of the unmanned drop-off box where the laundry can be picked up. The user will receive the notification, go to the designated unmanned drop-off box, scan the QR code to pick up the cleaned laundry, and the device will confirm the QR code scan and notify the server. The server will record the receipt confirmation and complete the process.

[0240] Specific behavior:

[0241] The server will notify you when cleaning is complete and provide the location of your unattended receiving box.

[0242] The user goes to an unmanned receiving box and scans the QR code on the device.

[0243] The device checks the QR code and notifies the server to record the receipt.

[0244] Input data: Cleaning completion notification and QR code scan information

[0245] Output data: Receipt completion status

[0246] (Application example 1)

[0247] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0248] In modern society, the demand for 24-hour unmanned stores is increasing in the dry cleaning industry. However, the current unmanned reception system has the following problems.

[0249] 1. Customers rely on the reception terminal and are unable to complete cleaning requests in advance, resulting in waiting times at the store.

[0250] 2. Analyzing the information from cleaning tags is complicated, and there is a lack of technology to process it efficiently.

[0251] 3. The payment process is tedious, especially when making payments from remote locations.

[0252] It is necessary to solve these issues and improve the user experience.

[0253] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0254] In this invention, the server includes: means for the user to operate the terminal to select the type of clothes; means for photographing the cleaning tag with a camera and generating image data of the photograph; means for sending the generated image data to the server; means for the server to analyze the image data received and select an appropriate cleaning method; means for automatically calculating a fee based on the selected cleaning method; electronic payment system means for the terminal to display the calculated fee and for the user to make payment; means for the user to pack the clothes into a laundry bag and drop it in a laundry bag deposit box; means for the server to send a notification to the user after the cleaning is completed; means for the user to receive the notification and collect the cleaned clothes in an unmanned delivery box; means for the user to complete a cleaning request in advance using a smartphone; means for photographing the cleaning tag with a smartphone camera and using a generative AI model to analyze the image data; means for inputting a prompt text into the generative AI model and analyzing tag information from the image data; means for sending the prompt text to the generative AI model to obtain an analysis result; means for selecting an optimal cleaning method based on the analysis result and notifying the smartphone; and means for making payment remotely from the smartphone using the electronic payment system. This allows users to complete cleaning requests in advance using their smartphones from home, making it quick and easy to make cleaning requests.

[0255] A "terminal" is an electronic device that is operated by a user, and includes tablet terminals, smartphones, and the like.

[0256] A "server" is a central processing unit that analyzes image data and calculates fees, and is a computing device that incorporates artificial intelligence (AI).

[0257] The "camera" is an image capture device for photographing the cleaning tag, and is built into the terminal or smartphone.

[0258] A "cleaning tag" is an information tag attached to clothing that lists material information and cleaning instructions.

[0259] A "generative AI model" is an algorithm that uses generative AI to analyze image data and extract information.

[0260] A "prompt sentence" is text data that is input into a generative AI model and is used to provide instructions for analysis.

[0261] An "electronic payment system" is a system that allows users to make payments using credit cards or electronic money, and is integrated into terminals and smartphones.

[0262] The "deposit box" is an unmanned reception box where users can deposit laundry bags, and it operates in conjunction with terminals and a server.

[0263] An "unmanned delivery box" is a box used by users to receive their cleaned clothes after cleaning is completed.

[0264] The present invention provides a system that allows users to use an unmanned laundry reception system via a smartphone. The configuration and operation procedure of the system are described in detail below.

[0265] System configuration

[0266] 1. Device:

[0267] The electronic device is operated by a user, and in this embodiment, it is a smartphone. The smartphone is equipped with a touch screen and displays an interface for the user to select the type of clothing. The smartphone also has a built-in camera that can take a picture of the cleaning tag.

[0268] 2. Server:

[0269] It is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with a generative AI model that analyzes the information extracted from the cleaning tag and selects the appropriate cleaning method.

[0270] 3. Camera:

[0271] An image capture device built into a smartphone that is used to photograph cleaning tags.

[0272] 4. Electronic payment systems:

[0273] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into smartphones, allowing users to check the displayed charges and make payments.

[0274] 5. Deposit Box:

[0275] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[0276] 6. Unmanned delivery box:

[0277] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[0278] Program structure and processing

[0279] When a user operates a smartphone app to use the 24-hour unmanned cleaning reception system, the following process takes place:

[0280] 1. User operations

[0281] Users select the type of clothing they want to have cleaned using the smartphone app, which will display options such as "suit jacket" or "shirt."

[0282] 2. Photographing the cleaning tag

[0283] The user takes a photo of the cleaning tag using the smartphone camera, and image data of the tag is generated and sent from the smartphone to the server.

[0284] 3. Use of generative AI models

[0285] The server analyzes the received image data and inputs a prompt to the generative AI model to analyze the tag information. For example, the prompt "Analyze the following image and extract the cleaning tag information: uploads / tag_image.jpg" is sent to the generative AI model.

[0286] 4. Calculation and Notification

[0287] The server selects the optimal cleaning method based on the analysis results obtained from the generative AI model and calculates the fee. The calculated fee information is sent to the user's smartphone, where the user can check the displayed fee and pay via the electronic payment system.

[0288] 5. Posting and receiving laundry bags

[0289] Once payment is complete, the user places the clothes in a laundry bag and places it in the drop box. Once the cleaning is complete, the server notifies the user, and the user can pick up the cleaned clothes in the unmanned delivery box.

[0290] Specific examples

[0291] For example, suppose a user requests dry cleaning of a "suit jacket," takes a photo of the cleaning tag with their smartphone camera, and sends the image data to the server. The server analyzes the tag information of the "suit jacket" using a generative AI model and determines that "dry cleaning" is the best option. The server then presents the calculated fee, and the user completes payment using the smartphone's electronic payment system and places the laundry bag in the drop box. Once the cleaning is complete, the server sends a notification, and the user can collect the cleaned jacket from the unmanned delivery box.

[0292] As described above, the system of the present invention allows users to have their clothes cleaned 24 hours a day, reducing labor costs and mistakes on the store side.

[0293] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0294] Step 1:

[0295] A user launches the smartphone app and selects a type of clothing. Options such as "suit jacket" and "shirt" appear on the smartphone's touchscreen. The smartphone sends the user's selection as input data to the server. The server receives this input data and records it for use in the next processing step.

[0296] Step 2:

[0297] The user takes a photo of the cleaning tag using the smartphone camera. They press a button on the touch screen to activate the camera and take a photo of the cleaning tag, which generates image data. The smartphone then sends this image data to the server as input data. The server stores the received image data and proceeds to the next processing step.

[0298] Step 3:

[0299] The server inputs the received image data into the generative AI model and analyzes the cleaning tag information. Specifically, the server generates a prompt message saying, "Analyze the following image and extract the cleaning tag information: uploads / tag_image.jpg," and sends it to the generative AI model. Following this prompt, the generative AI model analyzes the tag information and extracts information about the clothing's material and the optimal cleaning method. The extracted information is recorded on the server and the process proceeds to the next step.

[0300] Step 4:

[0301] The server selects the optimal cleaning method based on the analysis results obtained from the generative AI model and calculates the fee based on that method. The server automatically calculates the fee using the selected cleaning method and a pre-set fee calculation algorithm. This calculation result is sent to the smartphone. The fee information notified to the smartphone is displayed and the user proceeds to the next step.

[0302] Step 5:

[0303] The user checks the displayed price and makes the payment using the smartphone's electronic payment system. Credit card information and electronic money information are required as input data. The smartphone sends the payment information, which is then processed by the electronic payment system. Once the payment is complete, a confirmation notice is sent to the server, which then confirms and records the payment completion.

[0304] Step 6:

[0305] After payment is confirmed, the user places the clothes in a laundry bag and deposits it in the designated deposit box. The user follows the instructions received from their smartphone to prepare the laundry bag in advance and deposit it in the deposit box. This deposit information is sent to the server via an RFID tag or other means, and the server continues to monitor the status of the deposit box.

[0306] Step 7:

[0307] When the cleaning is complete, the server sends a notification to the user. The notification is sent to a smartphone informing the user that the cleaned clothes are ready in the unmanned delivery box. The user receives the notification on their smartphone and heads to the unmanned delivery box.

[0308] Step 8:

[0309] The user receives their cleaned clothes in an unmanned delivery box. The box is unlocked by scanning a QR code displayed on their smartphone. Once the user scans the QR code, the information is sent to the server, which records a confirmation of receipt. This completes the entire process.

[0310] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0311] The following system is proposed as an embodiment of the present invention. This system allows a user to request cleaning by operating an unmanned reception terminal, and can improve the quality of service by analyzing the user's emotions in combination with an emotion engine.

[0312] System configuration

[0313] 1. Device:

[0314] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can capture images of the cleaning tag and the user's facial expression.

[0315] 2. Server:

[0316] This is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with artificial intelligence (AI) that analyzes information extracted from cleaning tags and selects the appropriate cleaning method. An emotion engine is also built into the server, which analyzes user emotions.

[0317] 3. Camera:

[0318] An image capture device used to capture the cleaning tag and the user's facial expression, built into the terminal.

[0319] 4. Electronic payment systems:

[0320] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[0321] 5. Laundry Bag:

[0322] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[0323] 6. Deposit Box:

[0324] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[0325] 7. Unmanned delivery box:

[0326] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[0327] 8. Emotion Engine:

[0328] This technology analyzes the user's facial expressions and predicts their current emotions. The emotion engine uses facial expression data captured by the camera while the user is operating the device.

[0329] Program processing flow

[0330] User selection of clothing type

[0331] The user selects the type of clothing they wish to have cleaned (for example, a "suit jacket" or a "shirt") from a list displayed on the screen of the unmanned reception terminal. This allows the user to input the necessary information into the terminal.

[0332] The terminal receives user input and transmits the data to the server.

[0333] The server stores the received data and sets up the next step.

[0334] Photographing and analyzing cleaning tags

[0335] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[0336] The terminal transmits the generated image data to the server.

[0337] The server receives the image data and analyzes the tag information using artificial intelligence (AI). As a result of the analysis, information about the clothing's material and cleaning method can be extracted.

[0338] Selecting a cleaning method and calculating fees

[0339] Based on the analyzed information, the server uses AI to select the optimal cleaning method, which can include washing with water or dry cleaning.

[0340] The server automatically calculates the fee based on the selected cleaning method, and the calculated fee information is sent to the terminal.

[0341] The terminal displays the fee information to the user and prompts them to proceed with the payment procedure.

[0342] Payment via electronic payment systems

[0343] The user checks the displayed fee and pays using a credit card or electronic money.

[0344] The terminal transmits the payment information to the electronic payment system and waits for the transaction to complete.

[0345] The server receives confirmation of successful payment and sends instructions to the terminal on the next steps.

[0346] Preparing and posting laundry bags

[0347] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[0348] The user places the prepared laundry bag in the deposit box.

[0349] The terminal notifies the server that the laundry bag has been placed in the deposit box.

[0350] The server receives and records confirmation of the laundry bag posting.

[0351] Analyzing user emotions with an emotion engine

[0352] When a user operates the device, the device's camera captures the user's facial expression.

[0353] The terminal transmits the user's facial expression data to the emotion engine.

[0354] The server's emotion engine analyzes the received facial expression data and infers the user's emotions. For example, if the user is feeling irritated or dissatisfied, it provides feedback to improve the service based on that information.

[0355] After cleaning is complete

[0356] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[0357] The user receives a notification, goes to the designated unmanned delivery box, scans the QR code, and collects the cleaned clothes.

[0358] The device confirms the QR code scan and notifies the server of the information.

[0359] The server records a confirmation of receipt and completes the process.

[0360] Specific examples

[0361] Example 1:

[0362] User A operates the unmanned reception terminal to have his suit jacket cleaned. After showing the cleaning tag to the camera, the fee of 1,500 yen is displayed. After completing the payment, he places the suit jacket in a laundry bag and places it in the deposit box. When the cleaning work is complete, he receives a notification from the server and collects the cleaned suit jacket from the unmanned delivery box.

[0363] Example 2:

[0364] While User B is having his shirt cleaned, he displays facial expressions that indicate dissatisfaction while operating the device. The emotion engine analyzes this and displays feedback on the device. The concierge service is also automatically called to provide support to resolve User B's dissatisfaction.

[0365] As described above, the system of the present invention provides users with the convenience of being able to use the dry cleaner 24 hours a day, improves the user experience through its emotion engine, and contributes to reducing labor costs and errors on the store side.

[0366] The processing flow will be explained below.

[0367] Step 1:

[0368] The user taps to select the type of clothing they wish to have cleaned (for example, "suit jacket" or "shirt") from the list displayed on the screen of the unmanned reception terminal.

[0369] Step 2:

[0370] The terminal receives the user's input and transmits the selected data to the server.

[0371] Step 3:

[0372] The server stores the received data, sets the next step, and transmits that information to the terminal.

[0373] Step 4:

[0374] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[0375] Step 5:

[0376] The terminal transmits the generated image data to the server.

[0377] Step 6:

[0378] The server uses artificial intelligence (AI) to analyze the received image data, analysing the tag information and extracting information about the garment's material and washing instructions.

[0379] Step 7:

[0380] Based on the analysis, the server uses AI to select the most appropriate cleaning method, for example, dry cleaning for a wool suit jacket.

[0381] Step 8:

[0382] The server automatically calculates the fee based on the selected cleaning method and sends the calculation result to the terminal.

[0383] Step 9:

[0384] The terminal displays the fee information to the user and prompts the user to select a payment method.

[0385] Step 10:

[0386] The user checks the displayed price and enters payment information using a credit card or electronic money.

[0387] Step 11:

[0388] The terminal sends the payment information to the electronic payment system, waits for the transaction to complete, and once it receives confirmation that the payment is complete, sends the information to the server.

[0389] Step 12:

[0390] The server receives a confirmation of the payment and sends instructions for the next step to the terminal.

[0391] Step 13:

[0392] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[0393] Step 14:

[0394] The user places the filled laundry bag in the storage box and holds the QR code displayed on the terminal over the scanner in the storage box.

[0395] Step 15:

[0396] The terminal confirms that the laundry bag has been placed in the storage box and notifies the server of this information.

[0397] Step 16:

[0398] The server records confirmation that the laundry bag has been placed in the deposit box.

[0399] Step 17:

[0400] The dry cleaner's staff or an automated system will retrieve the laundry bag from the deposit box and begin the cleaning process.

[0401] Step 18:

[0402] When a user operates the device, the device's camera captures the user's facial expression.

[0403] Step 19:

[0404] The terminal transmits the user's facial expression data to the emotion engine.

[0405] Step 20:

[0406] The server's emotion engine analyzes the received facial expression data and infers the user's emotions. For example, if the user is feeling irritated or dissatisfied, it adjusts the service accordingly.

[0407] Step 21:

[0408] Based on the user's emotional data, the server displays feedback on the terminal as needed or automatically calls a concierge service.

[0409] Step 22:

[0410] After the cleaning is complete, the server sends a notification to the user, which includes the location and details of the unmanned delivery box where the item can be picked up.

[0411] Step 23:

[0412] The user receives a notification and heads to the designated unmanned delivery box, where they scan the QR code with the scanner to receive their cleaned clothes.

[0413] Step 24:

[0414] The device confirms the QR code scan and notifies the server of the information.

[0415] Step 25:

[0416] The server records a confirmation of receipt and completes the whole process.

[0417] Example 2

[0418] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0419] Conventional cleaning reception systems require users to visit the store in person, which is inconvenient and makes it difficult to improve services based on user preferences. Furthermore, manually selecting cleaning methods and calculating fees takes time and can lead to errors. Furthermore, delays in payment confirmation can make it difficult to provide a smooth service.

[0420] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing received image data using artificial intelligence and selecting an appropriate cleaning method, means for automatically calculating fees, and means for analyzing user facial expression data using an emotion engine and generating feedback. This allows users to request unattended cleaning 24 hours a day, receives prompt and accurate presentations of cleaning methods and fees, and enables service improvements based on the user's emotions.

[0421] A "user" is a person who uses the system to request laundry.

[0422] A "terminal" is an electronic device operated by a user, and refers to devices such as tablet terminals and kiosk terminals.

[0423] The "camera" is an image capture device built into the terminal for capturing images of the cleaning tag and the user's facial expression.

[0424] "Image data" refers to an image of the cleaning tag taken by a camera and sent to a server for analysis.

[0425] A "server" is a central processing unit that performs a series of processes such as analyzing image data, calculating fees, sending notifications, and analyzing emotions.

[0426] "Artificial intelligence (AI)" is a technology used to analyze image data and select appropriate cleaning methods.

[0427] The "means for automatically calculating fees" is a function in which the server calculates fees based on the cleaning method and presents the calculated fees to the user.

[0428] An "electronic payment system" is a mechanism that allows users to make payments using credit cards or electronic money, and operates in conjunction with a terminal.

[0429] A "laundry bag" is a bag in which a user stores clothes for dry cleaning.

[0430] The "deposit box" is an unmanned reception box where users can deposit their laundry bags, and it is a box that transmits information to a server using an RFID tag or the like.

[0431] An "unmanned delivery box" is a box used by users to receive their cleaned clothes after cleaning is completed.

[0432] An "emotion engine" is a technology that analyzes a user's facial expressions and infers their current emotions.

[0433] As an embodiment of the present invention, a system is provided in which a user requests cleaning by operating an unmanned reception terminal. This system can improve the quality of service by analyzing the user's emotions in combination with an emotion engine.

[0434] System configuration

[0435] 1. Device:

[0436] The terminal is an electronic device operated by the user, such as a tablet or kiosk. The terminal is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal is also equipped with a camera that can capture images of the cleaning tag and the user's facial expression.

[0437] 2. Server:

[0438] The server is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with artificial intelligence (AI) that analyzes the information extracted from the cleaning tags and selects the appropriate cleaning method. An emotion engine is also built into the server, which analyzes the user's emotions.

[0439] 3. Camera:

[0440] The camera is an image capture device used to capture images of the cleaning tag and the user's facial expression, and is built into the terminal.

[0441] 4. Electronic payment systems:

[0442] An electronic payment system is a system that allows users to make payments using credit cards or electronic money. It is integrated into a terminal, allowing users to check the displayed price and make the payment.

[0443] 5. Laundry Bag:

[0444] A laundry bag is a bag in which a user stores clothes for dry cleaning, and is brought and used by the user himself.

[0445] 6. Deposit Box:

[0446] The deposit box is an unmanned reception box where users can deposit laundry bags, and it works in conjunction with a terminal. When a laundry bag is deposited, information about it is sent to a server using an RFID tag or other means.

[0447] 7. Unmanned delivery box:

[0448] The unmanned delivery box is a box that users can use to receive their cleaned clothes after their cleaning is complete. It receives a notification from the server and can be handled unmanned.

[0449] 8. Emotion Engine:

[0450] The emotion engine is a technology that analyzes the user's facial expressions and infers their current emotions. The emotion engine uses facial expression data captured by the camera while the user is operating the device.

[0451] Specific examples

[0452] Example 1:

[0453] User A operates the unmanned reception terminal to have his suit jacket cleaned. After selecting "suit jacket" on the screen, he shows the cleaning tag to the camera. The image data captured by the terminal is sent to the server, and AI analyzes the tag information. The fee of 1,500 yen is displayed, and User A completes the payment with a credit card. He places the suit jacket in a laundry bag and places it in a deposit box, and is notified when cleaning is complete. He then scans the QR code at the designated unmanned delivery box to complete collection.

[0454] Example 2:

[0455] User B operates the device to have his shirt cleaned. Following the device's instructions, he selects the shirt and shows the cleaning tag to the camera. The price is displayed, but during the operation, he shows a facial expression that indicates dissatisfaction. The emotion engine analyzes this facial expression, detects signs of dissatisfaction, and displays feedback on the device. Furthermore, a concierge service is automatically called to help User B resolve his dissatisfaction.

[0456] Prompt Sentence Examples

[0457] Prompt: "Please describe in detail the entire process steps a user would take to operate the device and use the cleaning service. Include specific actions and sentiment analysis steps."

[0458] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0459] Step 1:

[0460] The user selects the type of clothing they wish to have cleaned from a list displayed on the screen of the unmanned reception terminal. For example, they can select "suit jacket" or "shirt." This becomes the input data. The terminal receives this selection data and sends it to the server. The server analyzes the received data and sets the next step.

[0461] Step 2:

[0462] The user shows the cleaning tag to the device's camera. The device's camera takes a picture of the cleaning tag and generates high-resolution image data. This becomes the next input data. The device then sends the generated image data to the server. The server receives this image data and performs image analysis using artificial intelligence (AI). Through image analysis, information such as the clothing material and cleaning method is extracted from the cleaning tag.

[0463] Step 3:

[0464] The server uses AI to select the optimal cleaning method based on the analyzed tag information. This selection includes whether to wash or dry clean. This is the input information. The server then automatically calculates the fee based on the cleaning method. The calculated fee information is output and sent to the terminal.

[0465] Step 4:

[0466] The terminal displays the fee information to the user and guides them through the payment procedure. The user checks the displayed fee and pays using a credit card or electronic money. This becomes new input data. The terminal sends this payment information to the electronic payment system and waits for payment completion. The server receives confirmation of payment completion from the electronic payment system.

[0467] Step 5:

[0468] The terminal notifies the user that payment has been completed and instructs them on how to pack the clothes into the laundry bag. The user then packs the clothes into the laundry bag they brought with them and places it in the laundry bag deposit box. This is the next input. The deposited laundry bag is confirmed by the deposit box's sensors and RFID tag, and the information is sent to the server. The server receives this information and records confirmation of the bag being deposited.

[0469] Step 6:

[0470] While the user is operating the device, the device's camera continues to capture the user's facial expressions. The camera captures facial expression data, which becomes the next input data. The device then sends this data to the emotion engine. The server's emotion engine analyzes this facial expression data and infers the user's emotions. For example, if the user expresses dissatisfaction, the engine generates feedback for improving the service based on the results and sends it to the device.

[0471] Step 7:

[0472] Once the cleaning is complete, the server sends a notification to the user. This notification includes the location and details of the unmanned delivery box where the clothes can be picked up. This is the input data. The user receives the notification and goes to the designated unmanned delivery box. They scan the QR code at the delivery box and pick up the cleaned clothes. This information is the final output data. The device confirms the QR code scan and notifies the server of this information. The server records the confirmation of receipt and completes the process.

[0473] (Application example 2)

[0474] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0475] In modern society, while speed and accuracy are required for cleaning services, improving the user experience is also important. However, conventional cleaning services often make users wait for long periods of time in crowded stores and often result in dissatisfaction with the quality of service. Furthermore, the lack of a system to properly understand user emotions and respond in real time can lead to a decline in service quality.

[0476] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0477] In this invention, the server includes: means for a user to operate a terminal to select the type of clothing; means for photographing the identification tag with a camera and generating image data thereof; means for transmitting the generated image data to the server; means for the server to analyze the received image data and select an appropriate processing method; means for automatically calculating a fee based on the selected processing method; electronic payment system means for the terminal to display the calculated fee and for the user to pay; means for the user to pack the clothing into a storage bag and deposit it in a deposit box; means for the server to send a notification to the user after the cleaning is completed; means for the user to receive the notification and collect the cleaned clothing in an unmanned receiving box; emotion analysis means including an emotion engine to analyze the user's facial expression data and adjust a response; means for displaying information on the user's interface using augmented reality technology; and means for providing a real-time notification function. This not only allows users to avoid crowds and use cleaning services quickly and efficiently, but also enables appropriate responses to be provided in real time according to emotions, thereby aiming to improve the quality of service.

[0478] "User" refers to a person who uses this invention to request cleaning services.

[0479] A "terminal" is an electronic device operated by a user, such as a smartphone, tablet, or smart glasses.

[0480] "Clothing" refers to the clothes and other apparel items to be cleaned.

[0481] An "identification tag" is a tag attached to a garment that contains information necessary for cleaning.

[0482] "Camera" refers to a device installed on the terminal that captures an identification tag or the user's facial expression.

[0483] "Image data" is information captured by a camera expressed in digital form.

[0484] "Server" refers to a central processing unit that performs processes such as analyzing image data, calculating fees, and notifying users.

[0485] "Processing method" refers to the method of cleaning the clothing, and refers to specific measures such as washing with water or dry cleaning.

[0486] "Fees" means the amount for the Cleaning Services.

[0487] An "electronic payment system" refers to a system in which users make payments using credit cards or electronic money.

[0488] A "storage bag" refers to a bag in which a user puts clothes to be cleaned.

[0489] The "deposit box" refers to an unmanned reception box into which users deposit their storage bags.

[0490] "Notification" refers to information sent from the server to the user after cleaning is completed.

[0491] "Unmanned receiving box" refers to an unmanned box where users can receive their cleaned clothes.

[0492] "Emotion analysis means" refers to technology for analyzing a user's facial expression data and inferring their emotions.

[0493] "Augmented reality technology" refers to technology that displays virtual elements overlaid on the real world.

[0494] "Real-time notification function" refers to a function that instantly notifies the user of the progress and completion of cleaning.

[0495] To put the present invention into practice, a system is constructed in which a user operates a terminal to request a cleaning service. A specific implementation method for this system will be described below.

[0496] First, a user operates a "terminal" using an electronic device such as a smartphone, tablet, or smart glasses. The user selects the type of clothing they want to have cleaned from the interface displayed on the terminal. Once the selection is complete, the device's camera is used to capture an image of the identification tag attached to the clothing. This image data is generated as "tag data."

[0497] The generated tag data is then sent over the internet to a "server." The server analyzes the tag data using image recognition technology (e.g., OpenCV) and artificial intelligence (e.g., trained models) to extract information such as the garment's material and treatment method. Based on the extracted information, the server selects the optimal cleaning method and automatically calculates the fee.

[0498] The calculated fee information is sent back to the terminal and displayed. The user can check the displayed fee and make payment using an electronic payment system (e.g., Stripe API). Once payment is complete, a confirmation notice is sent from the server to the terminal.

[0499] The user then places the clothes in a storage bag and places it in a deposit box. The deposit box is equipped with an identification device such as an RFID tag, which notifies the server of the cleaning request. Once the cleaning is complete, the server sends a notification to the user. This notification includes the location of the unmanned delivery box and instructions on how to collect the clothes. Upon receiving the notification, the user goes to the unmanned delivery box and scans a QR code or other code to collect the cleaned clothes.

[0500] Furthermore, the system includes an emotion analysis function that captures the user's facial expression data with the device's camera and analyzes it in real time using an emotion engine. This enables early detection of user dissatisfaction or irritation and allows the service interface to be adjusted accordingly. Additionally, by using augmented reality technology (e.g., ARKit, ARCore), it is possible to overlay price displays and notification information on the user interface.

[0501] Using the real-time notification function, the server will instantly notify the user of the cleaning progress and completion information, so that the user can always receive the latest information in real time.

[0502] Specific examples

[0503] User A is using smart glasses. He scans the shirt he wants to clean and the price is displayed. The emotion engine analyzes User A's satisfaction level and completes the payment. After completion, the delivery status is notified on the AR display of the smart glasses.

[0504] Prompt Sentence Examples

[0505] "Implement an AR interface for smart glasses that scans cleaning tags with a camera, displays fee information, and allows electronic payment. Add a function that analyzes the user's facial expression data and displays improvement suggestions in the interface if the user is dissatisfied."

[0506] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0507] Step 1:

[0508] The user selects a type of clothing

[0509] Input: The user operates the terminal and selects the type of clothing (e.g., shirt, suit jacket).

[0510] Data processing: The terminal records the type of clothing selected as digital data.

[0511] Output: The recorded data is sent to the server.

[0512] How it works: The user interacts with the device's interface to select a type of clothing. The device records the selection and sends it to the server.

[0513] Step 2:

[0514] Take a photo of the ID tag with the camera

[0515] Input: The user shows the identification tag of the selected garment to the device's camera.

[0516] Data processing: The device's camera generates image data of the tag.

[0517] Output: The generated image data is sent to the server.

[0518] How it works: The user shows the identification tag on their clothing to the device's camera, which takes a picture, generates image data, and sends it to the server.

[0519] Step 3:

[0520] Tag image analysis and processing method selection

[0521] Input: tag image data received by the server.

[0522] Data processing: The server uses artificial intelligence to analyze the tag image and extract information about the clothing material and cleaning instructions.

[0523] Output: The optimal cleaning method and cost are calculated and sent to the terminal.

[0524] How it works: The server uses image recognition technology to analyze the tag, select the best cleaning method, and calculate the fee.

[0525] Step 4:

[0526] Display of fees and electronic payment

[0527] Input: Pricing data sent from the server.

[0528] Data processing: The terminal displays the fee information to the user and processes the payment in conjunction with the electronic payment system.

[0529] Output: A confirmation of the payment is sent to the server.

[0530] Operation: The terminal displays the fee information to the user, who then makes the payment through an electronic payment system.

[0531] Step 5:

[0532] Pack your clothes into a storage bag and drop them off in the deposit box.

[0533] Input: The user places the clothes in a storage bag and places it in the storage box.

[0534] Data processing: The identification device in the deposit box recognizes the deposited bag and sends the deposit information to the server.

[0535] Output: The data indicating the completion of submission is recorded on the server.

[0536] How it works: The user puts their clothes into a storage bag and places it in the deposit box. The RFID tag in the deposit box recognizes this and notifies the server.

[0537] Step 6:

[0538] Sentiment analysis and service interface adjustment

[0539] Input: User's facial expression data is captured by the camera.

[0540] Data processing: The device sends the facial expression data to the emotion engine for analysis.

[0541] Output: Based on the analysis results, the service interface is adjusted.

[0542] How it works: The device's camera captures the user's facial expressions, which are analyzed by the emotion engine, and the interface is adjusted based on the results.

[0543] Step 7:

[0544] Notification and collection after cleaning is complete

[0545] Input: Data indicating cleaning is complete.

[0546] Data processing: The server sends a notification to the user that cleaning is complete and provides the necessary information.

[0547] Output: User receives cleaned clothes in unattended receiving box.

[0548] How it works: The server notifies the user that the cleaning is complete, and the user scans the QR code in the unmanned receiving box to collect the clothes.

[0549] Step 8:

[0550] Real-time notifications provide progress updates

[0551] Input: Cleaning progress data collected by the server.

[0552] Data processing: The user is notified of progress in real time.

[0553] Output: User sees progress in real time.

[0554] Operation: The server periodically notifies the user of cleaning progress data, which the user can check in real time via their terminal.

[0555] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0556] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0557] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0558] [Second embodiment]

[0559] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0560] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0561] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0562] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0563] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0564] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0565] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0566] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0567] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0568] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0569] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0570] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0571] The following system is proposed as an embodiment of the present invention. This system allows users to request cleaning by operating an unmanned reception terminal, and realizes unmanned cleaning reception and delivery 24 hours a day.

[0572] System configuration

[0573] 1. Device:

[0574] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can take a picture of the cleaning tag.

[0575] 2. Server:

[0576] This is a central processing unit that analyzes image data, calculates fees, etc. The server is equipped with artificial intelligence (AI) that analyzes the information extracted from the cleaning tag and selects the appropriate cleaning method.

[0577] 3. Camera:

[0578] An image capture device used to photograph the cleaning tag, built into the terminal.

[0579] 4. Electronic payment systems:

[0580] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[0581] 5. Laundry Bag:

[0582] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[0583] 6. Deposit Box:

[0584] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[0585] 7. Unmanned delivery box:

[0586] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[0587] Program processing flow

[0588] User selection of clothing type

[0589] The user selects the type of clothing they wish to have cleaned from a list displayed on the screen of the unmanned reception terminal, such as "suit jacket" or "shirt."

[0590] The terminal receives user input and transmits the data to the server.

[0591] The server analyzes the received data and sets the next step.

[0592] Photographing and analyzing cleaning tags

[0593] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[0594] The terminal transmits the generated image data to the server.

[0595] The server receives the image data and analyzes the tag information using artificial intelligence (AI). As a result of the analysis, information about the clothing's material and cleaning method can be extracted.

[0596] Selecting a cleaning method and calculating fees

[0597] Based on the analyzed information, the server uses AI to select the optimal cleaning method, which can include washing with water or dry cleaning.

[0598] The server automatically calculates the fee based on the selected cleaning method, and the calculated fee information is sent to the terminal.

[0599] The terminal displays the fee information to the user and prompts them to proceed with the payment procedure.

[0600] Payment via electronic payment systems

[0601] The user checks the displayed fee and pays using a credit card or electronic money.

[0602] The terminal transmits the payment information to the electronic payment system and waits for the transaction to complete.

[0603] The server receives confirmation of successful payment and sends instructions to the terminal on the next steps.

[0604] Preparing and posting laundry bags

[0605] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[0606] The user places the prepared laundry bag in the deposit box.

[0607] The terminal notifies the server that the laundry bag has been placed in the deposit box.

[0608] The server receives and records confirmation of the laundry bag posting.

[0609] After cleaning is complete

[0610] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[0611] The user receives a notification, goes to the designated unmanned delivery box, scans the QR code, and collects the cleaned clothes.

[0612] The device confirms the QR code scan and notifies the server.

[0613] The server records a confirmation of receipt and completes the process.

[0614] As described above, the system of the present invention provides users with the convenience of being able to have their clothes cleaned 24 hours a day, and also contributes to reducing labor costs and mistakes on the part of the store.

[0615] The processing flow will be explained below.

[0616] Step 1:

[0617] The user taps the type of clothing they wish to have cleaned (for example, "suit jacket" or "shirt") from the options displayed on the screen of the unmanned reception terminal.

[0618] Step 2:

[0619] The terminal receives user input and transmits the data to the server.

[0620] Step 3:

[0621] The server stores the received data and returns instructions for the next step to the terminal for display.

[0622] Step 4:

[0623] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[0624] Step 5:

[0625] The terminal transmits the generated image data to the server.

[0626] Step 6:

[0627] The server receives the image data and uses artificial intelligence (AI) to analyze the tag information, extracting information about the clothing's material (e.g., wool, cotton) and washing instructions (e.g., dry cleaning, do not wash).

[0628] Step 7:

[0629] The server then selects the optimal cleaning method based on the analysis results. For example, for a wool jacket, the AI ​​will select dry cleaning.

[0630] Step 8:

[0631] The server automatically calculates the fee using the selected cleaning method, and the calculated fee information is sent to the terminal.

[0632] Step 9:

[0633] The terminal receives the fee information to display to the user and displays it on the screen.

[0634] Step 10:

[0635] The user checks the displayed fee and pays using a credit card or electronic money. The user then enters the necessary information for the payment procedure.

[0636] Step 11:

[0637] The terminal sends the payment information to the electronic payment system and waits until the process is complete. After confirming that the payment is complete, the terminal sends the information to the server.

[0638] Step 12:

[0639] The server receives a confirmation of the payment and sends instructions for the next step to the terminal.

[0640] Step 13:

[0641] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[0642] Step 14:

[0643] The user places the filled laundry bag in the storage box and holds the QR code displayed on the terminal over the scanner in the storage box.

[0644] Step 15:

[0645] The terminal confirms that the laundry bag has been placed in the storage box and notifies the server of this information.

[0646] Step 16:

[0647] The server records confirmation that the laundry bag has been placed in the deposit box.

[0648] Step 17:

[0649] The dry cleaner's staff or an automated system will retrieve the laundry bag from the deposit box and begin the cleaning process.

[0650] Step 18:

[0651] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[0652] Step 19:

[0653] Users receive a notification, go to the designated unmanned delivery box, scan the QR code and collect their cleaned clothes.

[0654] Step 20:

[0655] The device confirms the QR code scan and notifies the server of the information.

[0656] Step 21:

[0657] The server records a confirmation of receipt and marks the whole process as complete.

[0658] The above are the detailed program processing steps in the unmanned cleaning reception system.

[0659] Example 1

[0660] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0661] Conventional dry cleaning systems have limited reception and collection times, making it difficult for users to use the system 24 hours a day. Furthermore, the process of accepting and collecting dry cleaning requires manual labor, which increases labor costs for the store and increases the likelihood of errors. The present invention aims to solve these problems by providing a system that allows users to use dry cleaning services 24 hours a day and improves the operational efficiency of the store.

[0662] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0663] In this invention, the server includes means for selecting the type of clothing using a terminal operated by the user, means for taking a picture of the cleaning tag with a camera and generating image data, means for analyzing the generated image data and selecting an appropriate cleaning method, means for automatically calculating the fee and sending the fee information to the terminal, means for the user to place the clothes in a laundry bag and place it in a deposit box, and means for the server to notify the user after the cleaning is complete and for the user to collect the clothes in an unmanned receiving box. This allows users to use the dry cleaning service 24 hours a day and improves the operational efficiency of the store.

[0664] "User" means an individual or organization that uses the system to request cleaning.

[0665] A "terminal" is an electronic device operated by a user, and is an interface device including a tablet terminal and a kiosk terminal.

[0666] A "server" is a device that handles the central processing of the entire system, and is a computer that analyzes and processes data and sends instructions.

[0667] A "cleaning tag" is a tag attached to clothing that contains information about the material of the clothing and the cleaning method.

[0668] A "laundry bag" is a bag in which a user stores clothes that they wish to have dry cleaned.

[0669] The "deposit box" is an unmanned reception box into which users deposit laundry bags, and operates in conjunction with the system.

[0670] An "unattended receiving box" is a box that users use to receive their cleaned clothes after cleaning is complete.

[0671] An "electronic payment system" is a system that allows users to make payments using credit cards or electronic money.

[0672] "Image data" refers to photographic data of the cleaning tag taken using a camera.

[0673] "Artificial intelligence" refers to AI technology built into the server, and is an algorithm that analyzes image data and selects cleaning methods.

[0674] "Notification" refers to a message sent by the server to inform the user of the completion of cleaning or availability of information.

[0675] To implement the present invention, the following system and its components will be described. This system allows users to request cleaning by operating an unmanned reception terminal, and realizes unmanned cleaning reception and delivery 24 hours a day.

[0676] System configuration

[0677] 1. Terminal

[0678] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can take a picture of the cleaning tag.

[0679] 2. Server

[0680] This is a central processing unit that analyzes image data and calculates fees. The server incorporates artificial intelligence (AI) to analyze the information extracted from the cleaning tag and select the appropriate cleaning method. It also processes payment information and sends notifications to users.

[0681] 3. Camera

[0682] An image capture device used to photograph the cleaning tag, built into the terminal.

[0683] 4. Electronic Payment Systems

[0684] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[0685] 5. Laundry bags

[0686] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[0687] 6. Deposit Box

[0688] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[0689] 7. Unattended Delivery Boxes

[0690] This is a box where users can receive their cleaned clothes after cleaning is complete. It receives a notification from the server and can be handled unattended.

[0691] Program processing overview

[0692] 1. Select the type of clothing

[0693] The user selects the type of clothing they want cleaned from a list displayed on the unmanned reception terminal's screen. The interface displays options such as "suit jacket" or "shirt." The terminal receives the user's input and sends the data to the server, which uses this data to determine the next steps.

[0694] Examples:

[0695] The user selects "suit jacket." The device sends this information to the server, which analyzes the information and prepares the next interface.

[0696] Prompt statement:

[0697] "Please enter the type of clothing selected by the user."

[0698] 2. Photographing and analyzing cleaning tags

[0699] The user shows the cleaning tag to the device's camera. The device's camera takes a photo of the tag and generates image data. This image data is then sent to a server. The server uses artificial intelligence (AI) to analyze the tag information and extract information about the garment's material and cleaning instructions.

[0700] Examples:

[0701] The user shows the tag to the camera, the device takes a photo, and the device sends the data to the server, where the server's AI extracts an analysis result, such as "100% cotton."

[0702] Prompt statement:

[0703] "Please send the image data of the tag to the server. Analyze the material information of the clothing based on that data."

[0704] 3. Selecting a cleaning method and calculating the fee

[0705] Based on the analyzed information, the server uses AI to select the optimal cleaning method, such as "water washing" or "dry cleaning." The server automatically calculates the fee based on the selected cleaning method and sends that information to the terminal. The terminal then displays the fee information to the user and prompts them to complete the payment process.

[0706] Examples:

[0707] The AI ​​determines that "water washing is best for a 100% cotton shirt," calculates the cost to be 500 yen, and sends this to the terminal. The terminal then displays the 500 yen fee to the user and guides them through the payment process.

[0708] Prompt statement:

[0709] "The AI ​​will select the cleaning method and calculate the fee, and the results will be displayed on your device."

[0710] 4. Payment via electronic payment systems

[0711] The user checks the displayed price and pays using a credit card or electronic money. The terminal sends the payment information to the electronic payment system and waits until the transaction is complete. The server receives confirmation of the payment and sends instructions for the next step to the terminal.

[0712] Examples:

[0713] The user inserts a credit card into the terminal and pays 500 yen. The terminal sends the payment information to the electronic payment system in real time. When the server receives notification that the payment is complete, the terminal displays the next step information.

[0714] Prompt statement:

[0715] Please explain the process for users to check the price and complete the payment.

[0716] 5. Prepare and post laundry bags

[0717] The user follows the instructions on the screen to pack their clothes into the laundry bag they brought with them. Then, they place the laundry bag they prepared in the deposit box. The terminal detects this and notifies the server. The server receives and records confirmation that the laundry bag has been placed in the box.

[0718] Examples:

[0719] The user follows the instructions on the screen to place the shirt in the laundry bag. When the laundry bag is placed in the deposit box, the device detects this action and notifies the server that the bag has been placed, and the server records the event.

[0720] Prompt statement:

[0721] "Please explain the process for users to put their clothes into laundry bags and place them in the drop box."

[0722] 6. What to do after cleaning is complete

[0723] The server will send a notification to the user when the cleaning is complete. The notification will include the location and details of the unmanned drop-off box where the laundry can be picked up. The user will receive the notification, go to the designated unmanned drop-off box, scan the QR code to pick up the cleaned laundry, and the device will confirm the QR code scan and notify the server. The server will record the receipt confirmation and complete the process.

[0724] Examples:

[0725] The server notifies the user that the cleaning is complete and provides the location of the unmanned receiving box. The user goes to the unmanned receiving box and scans the QR code on their device. The device verifies the QR code and notifies the server to record the receipt.

[0726] Prompt statement:

[0727] "Please explain how users can pick up their clothes after cleaning is complete."

[0728] This system allows users to enjoy the convenience of having their clothes cleaned 24 hours a day, and stores can expect to reduce labor costs and prevent mistakes.

[0729] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0730] Step 1: Select the type of clothing

[0731] The user selects the type of clothing they wish to have cleaned from a list displayed on the unmanned reception terminal screen. As input, the user selects an item such as "suit jacket" or "shirt" on the touch screen. The terminal receives the user's input and sends the data to the server.

[0732] Specific behavior:

[0733] The user selects "shirt."

[0734] The terminal transmits the selection information of "shirt" to the server.

[0735] The server receives this information and prepares for the next steps.

[0736] Input data: The type of clothing selected by the user (e.g., shirt)

[0737] Output data: Setting next steps based on clothing type

[0738] Step 2: Photograph and analyze the cleaning tag

[0739] The user shows the cleaning tag to the camera of the unmanned reception terminal. The terminal takes a picture of the cleaning tag with the camera and generates image data. The generated image data is sent to the server. The server uses artificial intelligence (AI) to analyze the image data and extract information about the clothing's material and cleaning method.

[0740] Specific behavior:

[0741] The user shows the cleaning tag in front of the device's camera.

[0742] The terminal takes a picture of the tag, generates image data, and sends it to the server.

[0743] The server uses AI to analyze the tag information and extract information such as "100% cotton."

[0744] Input data: Image data of cleaning tag

[0745] Output data: Analyzed material information (e.g., 100% cotton)

[0746] Step 3: Choose your cleaning method and calculate the cost

[0747] The server uses AI to select the optimal cleaning method based on the analyzed material information. For example, "washing with water" or "dry cleaning." Based on the selected cleaning method, the server automatically calculates the fee and sends that information to the terminal. The terminal then displays the fee information to the user.

[0748] Specific behavior:

[0749] The server determines that "water washing is best for 100% cotton shirts."

[0750] The server calculates the fee as 500 yen and sends that information to the terminal.

[0751] The terminal displays the charge of 500 yen to the user.

[0752] Input data: Analyzed material information (e.g., 100% cotton)

[0753] Output data: Best cleaning method and price information (e.g. water wash, 500 yen)

[0754] Step 4: Pay via electronic payment system

[0755] The user checks the displayed price and pays using a credit card or electronic money. As input, the user enters credit card or electronic money information into the terminal. The terminal sends the payment information to the electronic payment system and waits until the payment process is complete. The server receives confirmation of payment completion and sends instructions for the next step to the terminal.

[0756] Specific behavior:

[0757] The user inserts a credit card into the terminal and pays 500 yen.

[0758] The terminal transmits payment information in real time to an electronic payment system.

[0759] The server receives notification of the completion of payment and sends next step information to the terminal.

[0760] Input data: User's credit card information or electronic money information

[0761] Output data: Payment completion status

[0762] Step 5: Prepare and mail laundry bags

[0763] The user follows the instructions displayed on the terminal and places the clothes in the laundry bag they brought with them. When preparations are complete, the user places the laundry bag in the deposit box. The terminal detects this placement and notifies the server. The server receives and records confirmation of the placement.

[0764] Specific behavior:

[0765] The user follows the on-screen instructions to place the shirt in the laundry bag.

[0766] When you drop a laundry bag into the deposit box, the device detects the action.

[0767] The terminal notifies the server that the submission has been completed, and the server records it.

[0768] Input data: Information about laundry bags being dropped off in the deposit box

[0769] Output data: Posting completion status

[0770] Step 6: What to do after cleaning

[0771] The server will send a notification to the user when the cleaning is complete. The notification will include the location and details of the unmanned drop-off box where the laundry can be picked up. The user will receive the notification, go to the designated unmanned drop-off box, scan the QR code to pick up the cleaned laundry, and the device will confirm the QR code scan and notify the server. The server will record the receipt confirmation and complete the process.

[0772] Specific behavior:

[0773] The server will notify you when cleaning is complete and provide the location of your unattended receiving box.

[0774] The user goes to an unmanned receiving box and scans the QR code on the device.

[0775] The device checks the QR code and notifies the server to record the receipt.

[0776] Input data: Cleaning completion notification and QR code scan information

[0777] Output data: Receipt completion status

[0778] (Application example 1)

[0779] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0780] In modern society, the demand for 24-hour unmanned stores is increasing in the dry cleaning industry. However, the current unmanned reception system has the following problems.

[0781] 1. Customers rely on the reception terminal and are unable to complete cleaning requests in advance, resulting in waiting times at the store.

[0782] 2. Analyzing the information from cleaning tags is complicated, and there is a lack of technology to process it efficiently.

[0783] 3. The payment process is tedious, especially when making payments from remote locations.

[0784] It is necessary to solve these issues and improve the user experience.

[0785] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0786] In this invention, the server includes: means for the user to operate the terminal to select the type of clothes; means for photographing the cleaning tag with a camera and generating image data of the photograph; means for sending the generated image data to the server; means for the server to analyze the image data received and select an appropriate cleaning method; means for automatically calculating a fee based on the selected cleaning method; electronic payment system means for the terminal to display the calculated fee and for the user to make payment; means for the user to pack the clothes into a laundry bag and drop it in a laundry bag deposit box; means for the server to send a notification to the user after the cleaning is completed; means for the user to receive the notification and collect the cleaned clothes in an unmanned delivery box; means for the user to complete a cleaning request in advance using a smartphone; means for photographing the cleaning tag with a smartphone camera and using a generative AI model to analyze the image data; means for inputting a prompt text into the generative AI model and analyzing tag information from the image data; means for sending the prompt text to the generative AI model to obtain an analysis result; means for selecting an optimal cleaning method based on the analysis result and notifying the smartphone; and means for making payment remotely from the smartphone using the electronic payment system. This allows users to complete cleaning requests in advance using their smartphones from home, making it quick and easy to make cleaning requests.

[0787] A "terminal" is an electronic device that is operated by a user, and includes tablet terminals, smartphones, and the like.

[0788] A "server" is a central processing unit that analyzes image data and calculates fees, and is a computing device that incorporates artificial intelligence (AI).

[0789] The "camera" is an image capture device for photographing the cleaning tag, and is built into the terminal or smartphone.

[0790] A "cleaning tag" is an information tag attached to clothing that lists material information and cleaning instructions.

[0791] A "generative AI model" is an algorithm that uses generative AI to analyze image data and extract information.

[0792] A "prompt sentence" is text data that is input into a generative AI model and is used to provide instructions for analysis.

[0793] An "electronic payment system" is a system that allows users to make payments using credit cards or electronic money, and is integrated into terminals and smartphones.

[0794] The "deposit box" is an unmanned reception box where users can deposit laundry bags, and it operates in conjunction with terminals and a server.

[0795] An "unmanned delivery box" is a box used by users to receive their cleaned clothes after cleaning is completed.

[0796] The present invention provides a system that allows users to use an unmanned laundry reception system via a smartphone. The configuration and operation procedure of the system are described in detail below.

[0797] System configuration

[0798] 1. Device:

[0799] The electronic device is operated by a user, and in this embodiment, it is a smartphone. The smartphone is equipped with a touch screen and displays an interface for the user to select the type of clothing. The smartphone also has a built-in camera that can take a picture of the cleaning tag.

[0800] 2. Server:

[0801] It is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with a generative AI model that analyzes the information extracted from the cleaning tag and selects the appropriate cleaning method.

[0802] 3. Camera:

[0803] An image capture device built into a smartphone that is used to photograph cleaning tags.

[0804] 4. Electronic payment systems:

[0805] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into smartphones, allowing users to check the displayed charges and make payments.

[0806] 5. Deposit Box:

[0807] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[0808] 6. Unmanned delivery box:

[0809] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[0810] Program structure and processing

[0811] When a user operates a smartphone app to use the 24-hour unmanned cleaning reception system, the following process takes place:

[0812] 1. User operations

[0813] Users select the type of clothing they want to have cleaned using the smartphone app, which will display options such as "suit jacket" or "shirt."

[0814] 2. Photographing the cleaning tag

[0815] The user takes a photo of the cleaning tag using the smartphone camera, and image data of the tag is generated and sent from the smartphone to the server.

[0816] 3. Use of generative AI models

[0817] The server analyzes the received image data and inputs a prompt to the generative AI model to analyze the tag information. For example, the prompt "Analyze the following image and extract the cleaning tag information: uploads / tag_image.jpg" is sent to the generative AI model.

[0818] 4. Calculation and Notification

[0819] The server selects the optimal cleaning method based on the analysis results obtained from the generative AI model and calculates the fee. The calculated fee information is sent to the user's smartphone, where the user can check the displayed fee and pay via the electronic payment system.

[0820] 5. Posting and receiving laundry bags

[0821] Once payment is complete, the user places the clothes in a laundry bag and places it in the drop box. Once the cleaning is complete, the server notifies the user, and the user can pick up the cleaned clothes in the unmanned delivery box.

[0822] Specific examples

[0823] For example, suppose a user requests dry cleaning of a "suit jacket," takes a photo of the cleaning tag with their smartphone camera, and sends the image data to the server. The server analyzes the tag information of the "suit jacket" using a generative AI model and determines that "dry cleaning" is the best option. The server then presents the calculated fee, and the user completes payment using the smartphone's electronic payment system and places the laundry bag in the drop box. Once the cleaning is complete, the server sends a notification, and the user can collect the cleaned jacket from the unmanned delivery box.

[0824] As described above, the system of the present invention allows users to have their clothes cleaned 24 hours a day, reducing labor costs and mistakes on the store side.

[0825] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0826] Step 1:

[0827] A user launches the smartphone app and selects a type of clothing. Options such as "suit jacket" and "shirt" appear on the smartphone's touchscreen. The smartphone sends the user's selection as input data to the server. The server receives this input data and records it for use in the next processing step.

[0828] Step 2:

[0829] The user takes a photo of the cleaning tag using the smartphone camera. They press a button on the touch screen to activate the camera and take a photo of the cleaning tag, which generates image data. The smartphone then sends this image data to the server as input data. The server stores the received image data and proceeds to the next processing step.

[0830] Step 3:

[0831] The server inputs the received image data into the generative AI model and analyzes the cleaning tag information. Specifically, the server generates a prompt message saying, "Analyze the following image and extract the cleaning tag information: uploads / tag_image.jpg," and sends it to the generative AI model. Following this prompt, the generative AI model analyzes the tag information and extracts information about the clothing's material and the optimal cleaning method. The extracted information is recorded on the server and the process proceeds to the next step.

[0832] Step 4:

[0833] The server selects the optimal cleaning method based on the analysis results obtained from the generative AI model and calculates the fee based on that method. The server automatically calculates the fee using the selected cleaning method and a pre-set fee calculation algorithm. This calculation result is sent to the smartphone. The fee information notified to the smartphone is displayed and the user proceeds to the next step.

[0834] Step 5:

[0835] The user checks the displayed price and makes the payment using the smartphone's electronic payment system. Credit card information and electronic money information are required as input data. The smartphone sends the payment information, which is then processed by the electronic payment system. Once the payment is complete, a confirmation notice is sent to the server, which then confirms and records the payment completion.

[0836] Step 6:

[0837] After payment is confirmed, the user places the clothes in a laundry bag and deposits it in the designated deposit box. The user follows the instructions received from their smartphone to prepare the laundry bag in advance and deposit it in the deposit box. This deposit information is sent to the server via an RFID tag or other means, and the server continues to monitor the status of the deposit box.

[0838] Step 7:

[0839] When the cleaning is complete, the server sends a notification to the user. The notification is sent to a smartphone informing the user that the cleaned clothes are ready in the unmanned delivery box. The user receives the notification on their smartphone and heads to the unmanned delivery box.

[0840] Step 8:

[0841] The user receives their cleaned clothes in an unmanned delivery box. The box is unlocked by scanning a QR code displayed on their smartphone. Once the user scans the QR code, the information is sent to the server, which records a confirmation of receipt. This completes the entire process.

[0842] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0843] The following system is proposed as an embodiment of the present invention. This system allows a user to request cleaning by operating an unmanned reception terminal, and can improve the quality of service by analyzing the user's emotions in combination with an emotion engine.

[0844] System configuration

[0845] 1. Device:

[0846] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can capture images of the cleaning tag and the user's facial expression.

[0847] 2. Server:

[0848] This is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with artificial intelligence (AI) that analyzes information extracted from cleaning tags and selects the appropriate cleaning method. An emotion engine is also built into the server, which analyzes user emotions.

[0849] 3. Camera:

[0850] An image capture device used to capture the cleaning tag and the user's facial expression, built into the terminal.

[0851] 4. Electronic payment systems:

[0852] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[0853] 5. Laundry Bag:

[0854] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[0855] 6. Deposit Box:

[0856] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[0857] 7. Unmanned delivery box:

[0858] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[0859] 8. Emotion Engine:

[0860] This technology analyzes the user's facial expressions and predicts their current emotions. The emotion engine uses facial expression data captured by the camera while the user is operating the device.

[0861] Program processing flow

[0862] User selection of clothing type

[0863] The user selects the type of clothing they wish to have cleaned (for example, a "suit jacket" or a "shirt") from a list displayed on the screen of the unmanned reception terminal. This allows the user to input the necessary information into the terminal.

[0864] The terminal receives user input and transmits the data to the server.

[0865] The server stores the received data and sets up the next step.

[0866] Photographing and analyzing cleaning tags

[0867] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[0868] The terminal transmits the generated image data to the server.

[0869] The server receives the image data and analyzes the tag information using artificial intelligence (AI). As a result of the analysis, information about the clothing's material and cleaning method can be extracted.

[0870] Selecting a cleaning method and calculating fees

[0871] Based on the analyzed information, the server uses AI to select the optimal cleaning method, which can include washing with water or dry cleaning.

[0872] The server automatically calculates the fee based on the selected cleaning method, and the calculated fee information is sent to the terminal.

[0873] The terminal displays the fee information to the user and prompts them to proceed with the payment procedure.

[0874] Payment via electronic payment systems

[0875] The user checks the displayed fee and pays using a credit card or electronic money.

[0876] The terminal transmits the payment information to the electronic payment system and waits for the transaction to complete.

[0877] The server receives confirmation of successful payment and sends instructions to the terminal on the next steps.

[0878] Preparing and posting laundry bags

[0879] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[0880] The user places the prepared laundry bag in the deposit box.

[0881] The terminal notifies the server that the laundry bag has been placed in the deposit box.

[0882] The server receives and records confirmation of the laundry bag posting.

[0883] Analyzing user emotions with an emotion engine

[0884] When a user operates the device, the device's camera captures the user's facial expression.

[0885] The terminal transmits the user's facial expression data to the emotion engine.

[0886] The server's emotion engine analyzes the received facial expression data and infers the user's emotions. For example, if the user is feeling irritated or dissatisfied, it provides feedback to improve the service based on that information.

[0887] After cleaning is complete

[0888] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[0889] The user receives a notification, goes to the designated unmanned delivery box, scans the QR code, and collects the cleaned clothes.

[0890] The device confirms the QR code scan and notifies the server of the information.

[0891] The server records a confirmation of receipt and completes the process.

[0892] Specific examples

[0893] Example 1:

[0894] User A operates the unmanned reception terminal to have his suit jacket cleaned. After showing the cleaning tag to the camera, the fee of 1,500 yen is displayed. After completing the payment, he places the suit jacket in a laundry bag and places it in the deposit box. When the cleaning work is complete, he receives a notification from the server and collects the cleaned suit jacket from the unmanned delivery box.

[0895] Example 2:

[0896] While User B is having his shirt cleaned, he displays facial expressions that indicate dissatisfaction while operating the device. The emotion engine analyzes this and displays feedback on the device. The concierge service is also automatically called to provide support to resolve User B's dissatisfaction.

[0897] As described above, the system of the present invention provides users with the convenience of being able to use the dry cleaner 24 hours a day, improves the user experience through its emotion engine, and contributes to reducing labor costs and errors on the store side.

[0898] The processing flow will be explained below.

[0899] Step 1:

[0900] The user taps to select the type of clothing they wish to have cleaned (for example, "suit jacket" or "shirt") from the list displayed on the screen of the unmanned reception terminal.

[0901] Step 2:

[0902] The terminal receives the user's input and transmits the selected data to the server.

[0903] Step 3:

[0904] The server stores the received data, sets the next step, and transmits that information to the terminal.

[0905] Step 4:

[0906] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[0907] Step 5:

[0908] The terminal transmits the generated image data to the server.

[0909] Step 6:

[0910] The server uses artificial intelligence (AI) to analyze the received image data, analysing the tag information and extracting information about the garment's material and washing instructions.

[0911] Step 7:

[0912] Based on the analysis, the server uses AI to select the most appropriate cleaning method, for example, dry cleaning for a wool suit jacket.

[0913] Step 8:

[0914] The server automatically calculates the fee based on the selected cleaning method and sends the calculation result to the terminal.

[0915] Step 9:

[0916] The terminal displays the fee information to the user and prompts the user to select a payment method.

[0917] Step 10:

[0918] The user checks the displayed price and enters payment information using a credit card or electronic money.

[0919] Step 11:

[0920] The terminal sends the payment information to the electronic payment system, waits for the transaction to complete, and once it receives confirmation that the payment is complete, sends the information to the server.

[0921] Step 12:

[0922] The server receives a confirmation of the payment and sends instructions for the next step to the terminal.

[0923] Step 13:

[0924] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[0925] Step 14:

[0926] The user places the filled laundry bag in the storage box and holds the QR code displayed on the terminal over the scanner in the storage box.

[0927] Step 15:

[0928] The terminal confirms that the laundry bag has been placed in the storage box and notifies the server of this information.

[0929] Step 16:

[0930] The server records confirmation that the laundry bag has been placed in the deposit box.

[0931] Step 17:

[0932] The dry cleaner's staff or an automated system will retrieve the laundry bag from the deposit box and begin the cleaning process.

[0933] Step 18:

[0934] When a user operates the device, the device's camera captures the user's facial expression.

[0935] Step 19:

[0936] The terminal transmits the user's facial expression data to the emotion engine.

[0937] Step 20:

[0938] The server's emotion engine analyzes the received facial expression data and infers the user's emotions. For example, if the user is feeling irritated or dissatisfied, it adjusts the service accordingly.

[0939] Step 21:

[0940] Based on the user's emotional data, the server displays feedback on the terminal as needed or automatically calls a concierge service.

[0941] Step 22:

[0942] After the cleaning is complete, the server sends a notification to the user, which includes the location and details of the unmanned delivery box where the item can be picked up.

[0943] Step 23:

[0944] The user receives a notification and heads to the designated unmanned delivery box, where they scan the QR code with the scanner to receive their cleaned clothes.

[0945] Step 24:

[0946] The device confirms the QR code scan and notifies the server of the information.

[0947] Step 25:

[0948] The server records a confirmation of receipt and completes the whole process.

[0949] Example 2

[0950] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0951] Conventional cleaning reception systems require users to visit the store in person, which is inconvenient and makes it difficult to improve services based on user preferences. Furthermore, manually selecting cleaning methods and calculating fees takes time and can lead to errors. Furthermore, delays in payment confirmation can make it difficult to provide a smooth service.

[0952] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing received image data using artificial intelligence and selecting an appropriate cleaning method, means for automatically calculating fees, and means for analyzing user facial expression data using an emotion engine and generating feedback. This allows users to request unattended cleaning 24 hours a day, receives prompt and accurate presentations of cleaning methods and fees, and enables service improvements based on the user's emotions.

[0953] A "user" is a person who uses the system to request laundry.

[0954] A "terminal" is an electronic device operated by a user, and refers to devices such as tablet terminals and kiosk terminals.

[0955] The "camera" is an image capture device built into the terminal for capturing images of the cleaning tag and the user's facial expression.

[0956] "Image data" refers to an image of the cleaning tag taken by a camera and sent to a server for analysis.

[0957] A "server" is a central processing unit that performs a series of processes such as analyzing image data, calculating fees, sending notifications, and analyzing emotions.

[0958] "Artificial intelligence (AI)" is a technology used to analyze image data and select appropriate cleaning methods.

[0959] The "means for automatically calculating fees" is a function in which the server calculates fees based on the cleaning method and presents the calculated fees to the user.

[0960] An "electronic payment system" is a mechanism that allows users to make payments using credit cards or electronic money, and operates in conjunction with a terminal.

[0961] A "laundry bag" is a bag in which a user stores clothes for dry cleaning.

[0962] The "deposit box" is an unmanned reception box where users can deposit their laundry bags, and it is a box that transmits information to a server using an RFID tag or the like.

[0963] An "unmanned delivery box" is a box used by users to receive their cleaned clothes after cleaning is completed.

[0964] An "emotion engine" is a technology that analyzes a user's facial expressions and infers their current emotions.

[0965] As an embodiment of the present invention, a system is provided in which a user requests cleaning by operating an unmanned reception terminal. This system can improve the quality of service by analyzing the user's emotions in combination with an emotion engine.

[0966] System configuration

[0967] 1. Device:

[0968] The terminal is an electronic device operated by the user, such as a tablet or kiosk. The terminal is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal is also equipped with a camera that can capture images of the cleaning tag and the user's facial expression.

[0969] 2. Server:

[0970] The server is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with artificial intelligence (AI) that analyzes the information extracted from the cleaning tags and selects the appropriate cleaning method. An emotion engine is also built into the server, which analyzes the user's emotions.

[0971] 3. Camera:

[0972] The camera is an image capture device used to capture images of the cleaning tag and the user's facial expression, and is built into the terminal.

[0973] 4. Electronic payment systems:

[0974] An electronic payment system is a system that allows users to make payments using credit cards or electronic money. It is integrated into a terminal, allowing users to check the displayed price and make the payment.

[0975] 5. Laundry Bag:

[0976] A laundry bag is a bag in which a user stores clothes for dry cleaning, and is brought and used by the user himself.

[0977] 6. Deposit Box:

[0978] The deposit box is an unmanned reception box where users can deposit laundry bags, and it works in conjunction with a terminal. When a laundry bag is deposited, information about it is sent to a server using an RFID tag or other means.

[0979] 7. Unmanned delivery box:

[0980] The unmanned delivery box is a box that users can use to receive their cleaned clothes after their cleaning is complete. It receives a notification from the server and can be handled unmanned.

[0981] 8. Emotion Engine:

[0982] The emotion engine is a technology that analyzes the user's facial expressions and infers their current emotions. The emotion engine uses facial expression data captured by the camera while the user is operating the device.

[0983] Specific examples

[0984] Example 1:

[0985] User A operates the unmanned reception terminal to have his suit jacket cleaned. After selecting "suit jacket" on the screen, he shows the cleaning tag to the camera. The image data captured by the terminal is sent to the server, and AI analyzes the tag information. The fee of 1,500 yen is displayed, and User A completes the payment with a credit card. He places the suit jacket in a laundry bag and places it in a deposit box, and is notified when cleaning is complete. He then scans the QR code at the designated unmanned delivery box to complete collection.

[0986] Example 2:

[0987] User B operates the device to have his shirt cleaned. Following the device's instructions, he selects the shirt and shows the cleaning tag to the camera. The price is displayed, but during the operation, he shows a facial expression that indicates dissatisfaction. The emotion engine analyzes this facial expression, detects signs of dissatisfaction, and displays feedback on the device. Furthermore, a concierge service is automatically called to help User B resolve his dissatisfaction.

[0988] Prompt Sentence Examples

[0989] Prompt: "Please describe in detail the entire process steps a user would take to operate the device and use the cleaning service. Include specific actions and sentiment analysis steps."

[0990] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0991] Step 1:

[0992] The user selects the type of clothing they wish to have cleaned from a list displayed on the screen of the unmanned reception terminal. For example, they can select "suit jacket" or "shirt." This becomes the input data. The terminal receives this selection data and sends it to the server. The server analyzes the received data and sets the next step.

[0993] Step 2:

[0994] The user shows the cleaning tag to the device's camera. The device's camera takes a picture of the cleaning tag and generates high-resolution image data. This becomes the next input data. The device then sends the generated image data to the server. The server receives this image data and performs image analysis using artificial intelligence (AI). Through image analysis, information such as the clothing material and cleaning method is extracted from the cleaning tag.

[0995] Step 3:

[0996] The server uses AI to select the optimal cleaning method based on the analyzed tag information. This selection includes whether to wash or dry clean. This is the input information. The server then automatically calculates the fee based on the cleaning method. The calculated fee information is output and sent to the terminal.

[0997] Step 4:

[0998] The terminal displays the fee information to the user and guides them through the payment procedure. The user checks the displayed fee and pays using a credit card or electronic money. This becomes new input data. The terminal sends this payment information to the electronic payment system and waits for payment completion. The server receives confirmation of payment completion from the electronic payment system.

[0999] Step 5:

[1000] The terminal notifies the user that payment has been completed and instructs them on how to pack the clothes into the laundry bag. The user then packs the clothes into the laundry bag they brought with them and places it in the laundry bag deposit box. This is the next input. The deposited laundry bag is confirmed by the deposit box's sensors and RFID tag, and the information is sent to the server. The server receives this information and records confirmation of the bag being deposited.

[1001] Step 6:

[1002] While the user is operating the device, the device's camera continues to capture the user's facial expressions. The camera captures facial expression data, which becomes the next input data. The device then sends this data to the emotion engine. The server's emotion engine analyzes this facial expression data and infers the user's emotions. For example, if the user expresses dissatisfaction, the engine generates feedback for improving the service based on the results and sends it to the device.

[1003] Step 7:

[1004] Once the cleaning is complete, the server sends a notification to the user. This notification includes the location and details of the unmanned delivery box where the clothes can be picked up. This is the input data. The user receives the notification and goes to the designated unmanned delivery box. They scan the QR code at the delivery box and pick up the cleaned clothes. This information is the final output data. The device confirms the QR code scan and notifies the server of this information. The server records the confirmation of receipt and completes the process.

[1005] (Application example 2)

[1006] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1007] In modern society, while speed and accuracy are required for cleaning services, improving the user experience is also important. However, conventional cleaning services often make users wait for long periods of time in crowded stores and often result in dissatisfaction with the quality of service. Furthermore, the lack of a system to properly understand user emotions and respond in real time can lead to a decline in service quality.

[1008] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1009] In this invention, the server includes: means for a user to operate a terminal to select the type of clothing; means for photographing the identification tag with a camera and generating image data thereof; means for transmitting the generated image data to the server; means for the server to analyze the received image data and select an appropriate processing method; means for automatically calculating a fee based on the selected processing method; electronic payment system means for the terminal to display the calculated fee and for the user to pay; means for the user to pack the clothing into a storage bag and deposit it in a deposit box; means for the server to send a notification to the user after the cleaning is completed; means for the user to receive the notification and collect the cleaned clothing in an unmanned receiving box; emotion analysis means including an emotion engine to analyze the user's facial expression data and adjust a response; means for displaying information on the user's interface using augmented reality technology; and means for providing a real-time notification function. This not only allows users to avoid crowds and use cleaning services quickly and efficiently, but also enables appropriate responses to be provided in real time according to emotions, thereby aiming to improve the quality of service.

[1010] "User" refers to a person who uses this invention to request cleaning services.

[1011] A "terminal" is an electronic device operated by a user, such as a smartphone, tablet, or smart glasses.

[1012] "Clothing" refers to the clothes and other apparel items to be cleaned.

[1013] An "identification tag" is a tag attached to a garment that contains information necessary for cleaning.

[1014] "Camera" refers to a device installed on the terminal that captures an identification tag or the user's facial expression.

[1015] "Image data" is information captured by a camera expressed in digital form.

[1016] "Server" refers to a central processing unit that performs processes such as analyzing image data, calculating fees, and notifying users.

[1017] "Processing method" refers to the method of cleaning the clothing, and refers to specific measures such as washing with water or dry cleaning.

[1018] "Fees" means the amount for the Cleaning Services.

[1019] An "electronic payment system" refers to a system in which users make payments using credit cards or electronic money.

[1020] A "storage bag" refers to a bag in which a user puts clothes to be cleaned.

[1021] The "deposit box" refers to an unmanned reception box into which users deposit their storage bags.

[1022] "Notification" refers to information sent from the server to the user after cleaning is completed.

[1023] "Unmanned receiving box" refers to an unmanned box where users can receive their cleaned clothes.

[1024] "Emotion analysis means" refers to technology for analyzing a user's facial expression data and inferring their emotions.

[1025] "Augmented reality technology" refers to technology that displays virtual elements overlaid on the real world.

[1026] "Real-time notification function" refers to a function that instantly notifies the user of the progress and completion of cleaning.

[1027] To put the present invention into practice, a system is constructed in which a user operates a terminal to request a cleaning service. A specific implementation method for this system will be described below.

[1028] First, a user operates a "terminal" using an electronic device such as a smartphone, tablet, or smart glasses. The user selects the type of clothing they want to have cleaned from the interface displayed on the terminal. Once the selection is complete, the device's camera is used to capture an image of the identification tag attached to the clothing. This image data is generated as "tag data."

[1029] The generated tag data is then sent over the internet to a "server." The server analyzes the tag data using image recognition technology (e.g., OpenCV) and artificial intelligence (e.g., trained models) to extract information such as the garment's material and treatment method. Based on the extracted information, the server selects the optimal cleaning method and automatically calculates the fee.

[1030] The calculated fee information is sent back to the terminal and displayed. The user can check the displayed fee and make payment using an electronic payment system (e.g., Stripe API). Once payment is complete, a confirmation notice is sent from the server to the terminal.

[1031] The user then places the clothes in a storage bag and places it in a deposit box. The deposit box is equipped with an identification device such as an RFID tag, which notifies the server of the cleaning request. Once the cleaning is complete, the server sends a notification to the user. This notification includes the location of the unmanned delivery box and instructions on how to collect the clothes. Upon receiving the notification, the user goes to the unmanned delivery box and scans a QR code or other code to collect the cleaned clothes.

[1032] Furthermore, the system includes an emotion analysis function that captures the user's facial expression data with the device's camera and analyzes it in real time using an emotion engine. This enables early detection of user dissatisfaction or irritation and allows the service interface to be adjusted accordingly. Additionally, by using augmented reality technology (e.g., ARKit, ARCore), it is possible to overlay price displays and notification information on the user interface.

[1033] Using the real-time notification function, the server will instantly notify the user of the cleaning progress and completion information, so that the user can always receive the latest information in real time.

[1034] Specific examples

[1035] User A is using smart glasses. He scans the shirt he wants to clean and the price is displayed. The emotion engine analyzes User A's satisfaction level and completes the payment. After completion, the delivery status is notified on the AR display of the smart glasses.

[1036] Prompt Sentence Examples

[1037] "Implement an AR interface for smart glasses that scans cleaning tags with a camera, displays fee information, and allows electronic payment. Add a function that analyzes the user's facial expression data and displays improvement suggestions in the interface if the user is dissatisfied."

[1038] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1039] Step 1:

[1040] The user selects a type of clothing

[1041] Input: The user operates the terminal and selects the type of clothing (e.g., shirt, suit jacket).

[1042] Data processing: The terminal records the type of clothing selected as digital data.

[1043] Output: The recorded data is sent to the server.

[1044] How it works: The user interacts with the device's interface to select a type of clothing. The device records the selection and sends it to the server.

[1045] Step 2:

[1046] Take a photo of the ID tag with the camera

[1047] Input: The user shows the identification tag of the selected garment to the device's camera.

[1048] Data processing: The device's camera generates image data of the tag.

[1049] Output: The generated image data is sent to the server.

[1050] How it works: The user shows the identification tag on their clothing to the device's camera, which takes a picture, generates image data, and sends it to the server.

[1051] Step 3:

[1052] Tag image analysis and processing method selection

[1053] Input: tag image data received by the server.

[1054] Data processing: The server uses artificial intelligence to analyze the tag image and extract information about the clothing material and cleaning instructions.

[1055] Output: The optimal cleaning method and cost are calculated and sent to the terminal.

[1056] How it works: The server uses image recognition technology to analyze the tag, select the best cleaning method, and calculate the fee.

[1057] Step 4:

[1058] Display of fees and electronic payment

[1059] Input: Pricing data sent from the server.

[1060] Data processing: The terminal displays the fee information to the user and processes the payment in conjunction with the electronic payment system.

[1061] Output: A confirmation of the payment is sent to the server.

[1062] Operation: The terminal displays the fee information to the user, who then makes the payment through an electronic payment system.

[1063] Step 5:

[1064] Pack your clothes into a storage bag and drop them off in the deposit box.

[1065] Input: The user places the clothes in a storage bag and places it in the storage box.

[1066] Data processing: The identification device in the deposit box recognizes the deposited bag and sends the deposit information to the server.

[1067] Output: The data indicating the completion of submission is recorded on the server.

[1068] How it works: The user puts their clothes into a storage bag and places it in the deposit box. The RFID tag in the deposit box recognizes this and notifies the server.

[1069] Step 6:

[1070] Sentiment analysis and service interface adjustment

[1071] Input: User's facial expression data is captured by the camera.

[1072] Data processing: The device sends the facial expression data to the emotion engine for analysis.

[1073] Output: Based on the analysis results, the service interface is adjusted.

[1074] How it works: The device's camera captures the user's facial expressions, which are analyzed by the emotion engine, and the interface is adjusted based on the results.

[1075] Step 7:

[1076] Notification and collection after cleaning is complete

[1077] Input: Data indicating cleaning is complete.

[1078] Data processing: The server sends a notification to the user that cleaning is complete and provides the necessary information.

[1079] Output: User receives cleaned clothes in unattended receiving box.

[1080] How it works: The server notifies the user that the cleaning is complete, and the user scans the QR code in the unmanned receiving box to collect the clothes.

[1081] Step 8:

[1082] Real-time notifications provide progress updates

[1083] Input: Cleaning progress data collected by the server.

[1084] Data processing: The user is notified of progress in real time.

[1085] Output: User sees progress in real time.

[1086] Operation: The server periodically notifies the user of cleaning progress data, which the user can check in real time via their terminal.

[1087] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1088] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1089] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1090] [Third embodiment]

[1091] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1092] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1093] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1094] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1095] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1096] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1097] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1098] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1099] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1100] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1101] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1102] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1103] The following system is proposed as an embodiment of the present invention. This system allows users to request cleaning by operating an unmanned reception terminal, and realizes unmanned cleaning reception and delivery 24 hours a day.

[1104] System configuration

[1105] 1. Device:

[1106] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can take a picture of the cleaning tag.

[1107] 2. Server:

[1108] This is a central processing unit that analyzes image data, calculates fees, etc. The server is equipped with artificial intelligence (AI) that analyzes the information extracted from the cleaning tag and selects the appropriate cleaning method.

[1109] 3. Camera:

[1110] An image capture device used to photograph the cleaning tag, built into the terminal.

[1111] 4. Electronic payment systems:

[1112] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[1113] 5. Laundry Bag:

[1114] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[1115] 6. Deposit Box:

[1116] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[1117] 7. Unmanned delivery box:

[1118] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[1119] Program processing flow

[1120] User selection of clothing type

[1121] The user selects the type of clothing they wish to have cleaned from a list displayed on the screen of the unmanned reception terminal, such as "suit jacket" or "shirt."

[1122] The terminal receives user input and transmits the data to the server.

[1123] The server analyzes the received data and sets the next step.

[1124] Photographing and analyzing cleaning tags

[1125] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[1126] The terminal transmits the generated image data to the server.

[1127] The server receives the image data and analyzes the tag information using artificial intelligence (AI). As a result of the analysis, information about the clothing's material and cleaning method can be extracted.

[1128] Selecting a cleaning method and calculating fees

[1129] Based on the analyzed information, the server uses AI to select the optimal cleaning method, which can include washing with water or dry cleaning.

[1130] The server automatically calculates the fee based on the selected cleaning method, and the calculated fee information is sent to the terminal.

[1131] The terminal displays the fee information to the user and prompts them to proceed with the payment procedure.

[1132] Payment via electronic payment systems

[1133] The user checks the displayed fee and pays using a credit card or electronic money.

[1134] The terminal transmits the payment information to the electronic payment system and waits for the transaction to complete.

[1135] The server receives confirmation of successful payment and sends instructions to the terminal on the next steps.

[1136] Preparing and posting laundry bags

[1137] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[1138] The user places the prepared laundry bag in the deposit box.

[1139] The terminal notifies the server that the laundry bag has been placed in the deposit box.

[1140] The server receives and records confirmation of the laundry bag posting.

[1141] After cleaning is complete

[1142] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[1143] The user receives a notification, goes to the designated unmanned delivery box, scans the QR code, and collects the cleaned clothes.

[1144] The device confirms the QR code scan and notifies the server.

[1145] The server records a confirmation of receipt and completes the process.

[1146] As described above, the system of the present invention provides users with the convenience of being able to have their clothes cleaned 24 hours a day, and also contributes to reducing labor costs and mistakes on the part of the store.

[1147] The processing flow will be explained below.

[1148] Step 1:

[1149] The user taps the type of clothing they wish to have cleaned (for example, "suit jacket" or "shirt") from the options displayed on the screen of the unmanned reception terminal.

[1150] Step 2:

[1151] The terminal receives user input and transmits the data to the server.

[1152] Step 3:

[1153] The server stores the received data and returns instructions for the next step to the terminal for display.

[1154] Step 4:

[1155] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[1156] Step 5:

[1157] The terminal transmits the generated image data to the server.

[1158] Step 6:

[1159] The server receives the image data and uses artificial intelligence (AI) to analyze the tag information, extracting information about the clothing's material (e.g., wool, cotton) and washing instructions (e.g., dry cleaning, do not wash).

[1160] Step 7:

[1161] The server then selects the optimal cleaning method based on the analysis results. For example, for a wool jacket, the AI ​​will select dry cleaning.

[1162] Step 8:

[1163] The server automatically calculates the fee using the selected cleaning method, and the calculated fee information is sent to the terminal.

[1164] Step 9:

[1165] The terminal receives the fee information to display to the user and displays it on the screen.

[1166] Step 10:

[1167] The user checks the displayed fee and pays using a credit card or electronic money. The user then enters the necessary information for the payment procedure.

[1168] Step 11:

[1169] The terminal sends the payment information to the electronic payment system and waits until the process is complete. After confirming that the payment is complete, the terminal sends the information to the server.

[1170] Step 12:

[1171] The server receives a confirmation of the payment and sends instructions for the next step to the terminal.

[1172] Step 13:

[1173] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[1174] Step 14:

[1175] The user places the filled laundry bag in the storage box and holds the QR code displayed on the terminal over the scanner in the storage box.

[1176] Step 15:

[1177] The terminal confirms that the laundry bag has been placed in the storage box and notifies the server of this information.

[1178] Step 16:

[1179] The server records confirmation that the laundry bag has been placed in the deposit box.

[1180] Step 17:

[1181] The dry cleaner's staff or an automated system will retrieve the laundry bag from the deposit box and begin the cleaning process.

[1182] Step 18:

[1183] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[1184] Step 19:

[1185] Users receive a notification, go to the designated unmanned delivery box, scan the QR code and collect their cleaned clothes.

[1186] Step 20:

[1187] The device confirms the QR code scan and notifies the server of the information.

[1188] Step 21:

[1189] The server records a confirmation of receipt and marks the whole process as complete.

[1190] The above are the detailed program processing steps in the unmanned cleaning reception system.

[1191] Example 1

[1192] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1193] Conventional dry cleaning systems have limited reception and collection times, making it difficult for users to use the system 24 hours a day. Furthermore, the process of accepting and collecting dry cleaning requires manual labor, which increases labor costs for the store and increases the likelihood of errors. The present invention aims to solve these problems by providing a system that allows users to use dry cleaning services 24 hours a day and improves the operational efficiency of the store.

[1194] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1195] In this invention, the server includes means for selecting the type of clothing using a terminal operated by the user, means for taking a picture of the cleaning tag with a camera and generating image data, means for analyzing the generated image data and selecting an appropriate cleaning method, means for automatically calculating the fee and sending the fee information to the terminal, means for the user to place the clothes in a laundry bag and place it in a deposit box, and means for the server to notify the user after the cleaning is complete and for the user to collect the clothes in an unmanned receiving box. This allows users to use the dry cleaning service 24 hours a day and improves the operational efficiency of the store.

[1196] "User" means an individual or organization that uses the system to request cleaning.

[1197] A "terminal" is an electronic device operated by a user, and is an interface device including a tablet terminal and a kiosk terminal.

[1198] A "server" is a device that handles the central processing of the entire system, and is a computer that analyzes and processes data and sends instructions.

[1199] A "cleaning tag" is a tag attached to clothing that contains information about the material of the clothing and the cleaning method.

[1200] A "laundry bag" is a bag in which a user stores clothes that they wish to have dry cleaned.

[1201] The "deposit box" is an unmanned reception box into which users deposit laundry bags, and operates in conjunction with the system.

[1202] An "unattended receiving box" is a box that users use to receive their cleaned clothes after cleaning is complete.

[1203] An "electronic payment system" is a system that allows users to make payments using credit cards or electronic money.

[1204] "Image data" refers to photographic data of the cleaning tag taken using a camera.

[1205] "Artificial intelligence" refers to AI technology built into the server, and is an algorithm that analyzes image data and selects cleaning methods.

[1206] "Notification" refers to a message sent by the server to inform the user of the completion of cleaning or availability of information.

[1207] To implement the present invention, the following system and its components will be described. This system allows users to request cleaning by operating an unmanned reception terminal, and realizes unmanned cleaning reception and delivery 24 hours a day.

[1208] System configuration

[1209] 1. Terminal

[1210] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can take a picture of the cleaning tag.

[1211] 2. Server

[1212] This is a central processing unit that analyzes image data and calculates fees. The server incorporates artificial intelligence (AI) to analyze the information extracted from the cleaning tag and select the appropriate cleaning method. It also processes payment information and sends notifications to users.

[1213] 3. Camera

[1214] An image capture device used to photograph the cleaning tag, built into the terminal.

[1215] 4. Electronic Payment Systems

[1216] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[1217] 5. Laundry bags

[1218] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[1219] 6. Deposit Box

[1220] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[1221] 7. Unattended Delivery Boxes

[1222] This is a box where users can receive their cleaned clothes after cleaning is complete. It receives a notification from the server and can be handled unattended.

[1223] Program processing overview

[1224] 1. Select the type of clothing

[1225] The user selects the type of clothing they want cleaned from a list displayed on the unmanned reception terminal's screen. The interface displays options such as "suit jacket" or "shirt." The terminal receives the user's input and sends the data to the server, which uses this data to determine the next steps.

[1226] Examples:

[1227] The user selects "suit jacket." The device sends this information to the server, which analyzes the information and prepares the next interface.

[1228] Prompt statement:

[1229] "Please enter the type of clothing selected by the user."

[1230] 2. Photographing and analyzing cleaning tags

[1231] The user shows the cleaning tag to the device's camera. The device's camera takes a photo of the tag and generates image data. This image data is then sent to a server. The server uses artificial intelligence (AI) to analyze the tag information and extract information about the garment's material and cleaning instructions.

[1232] Examples:

[1233] The user shows the tag to the camera, the device takes a photo, and the device sends the data to the server, where the server's AI extracts an analysis result, such as "100% cotton."

[1234] Prompt statement:

[1235] "Please send the image data of the tag to the server. Analyze the material information of the clothing based on that data."

[1236] 3. Selecting a cleaning method and calculating the fee

[1237] Based on the analyzed information, the server uses AI to select the optimal cleaning method, such as "water washing" or "dry cleaning." The server automatically calculates the fee based on the selected cleaning method and sends that information to the terminal. The terminal then displays the fee information to the user and prompts them to complete the payment process.

[1238] Examples:

[1239] The AI ​​determines that "water washing is best for a 100% cotton shirt," calculates the cost to be 500 yen, and sends this to the terminal. The terminal then displays the 500 yen fee to the user and guides them through the payment process.

[1240] Prompt statement:

[1241] "The AI ​​will select the cleaning method and calculate the fee, and the results will be displayed on your device."

[1242] 4. Payment via electronic payment systems

[1243] The user checks the displayed price and pays using a credit card or electronic money. The terminal sends the payment information to the electronic payment system and waits until the transaction is complete. The server receives confirmation of the payment and sends instructions for the next step to the terminal.

[1244] Examples:

[1245] The user inserts a credit card into the terminal and pays 500 yen. The terminal sends the payment information to the electronic payment system in real time. When the server receives notification that the payment is complete, the terminal displays the next step information.

[1246] Prompt statement:

[1247] Please explain the process for users to check the price and complete the payment.

[1248] 5. Prepare and post laundry bags

[1249] The user follows the instructions on the screen to pack their clothes into the laundry bag they brought with them. Then, they place the laundry bag they prepared in the deposit box. The terminal detects this and notifies the server. The server receives and records confirmation that the laundry bag has been placed in the box.

[1250] Examples:

[1251] The user follows the instructions on the screen to place the shirt in the laundry bag. When the laundry bag is placed in the deposit box, the device detects this action and notifies the server that the bag has been placed, and the server records the event.

[1252] Prompt statement:

[1253] "Please explain the process for users to put their clothes into laundry bags and place them in the drop box."

[1254] 6. What to do after cleaning is complete

[1255] The server will send a notification to the user when the cleaning is complete. The notification will include the location and details of the unmanned drop-off box where the laundry can be picked up. The user will receive the notification, go to the designated unmanned drop-off box, scan the QR code to pick up the cleaned laundry, and the device will confirm the QR code scan and notify the server. The server will record the receipt confirmation and complete the process.

[1256] Examples:

[1257] The server notifies the user that the cleaning is complete and provides the location of the unmanned receiving box. The user goes to the unmanned receiving box and scans the QR code on their device. The device verifies the QR code and notifies the server to record the receipt.

[1258] Prompt statement:

[1259] "Please explain how users can pick up their clothes after cleaning is complete."

[1260] This system allows users to enjoy the convenience of having their clothes cleaned 24 hours a day, and stores can expect to reduce labor costs and prevent mistakes.

[1261] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1262] Step 1: Select the type of clothing

[1263] The user selects the type of clothing they wish to have cleaned from a list displayed on the unmanned reception terminal screen. As input, the user selects an item such as "suit jacket" or "shirt" on the touch screen. The terminal receives the user's input and sends the data to the server.

[1264] Specific behavior:

[1265] The user selects "shirt."

[1266] The terminal transmits the selection information of "shirt" to the server.

[1267] The server receives this information and prepares for the next steps.

[1268] Input data: The type of clothing selected by the user (e.g., shirt)

[1269] Output data: Setting next steps based on clothing type

[1270] Step 2: Photograph and analyze the cleaning tag

[1271] The user shows the cleaning tag to the camera of the unmanned reception terminal. The terminal takes a picture of the cleaning tag with the camera and generates image data. The generated image data is sent to the server. The server uses artificial intelligence (AI) to analyze the image data and extract information about the clothing's material and cleaning method.

[1272] Specific behavior:

[1273] The user shows the cleaning tag in front of the device's camera.

[1274] The terminal takes a picture of the tag, generates image data, and sends it to the server.

[1275] The server uses AI to analyze the tag information and extract information such as "100% cotton."

[1276] Input data: Image data of cleaning tag

[1277] Output data: Analyzed material information (e.g., 100% cotton)

[1278] Step 3: Choose your cleaning method and calculate the cost

[1279] The server uses AI to select the optimal cleaning method based on the analyzed material information. For example, "washing with water" or "dry cleaning." Based on the selected cleaning method, the server automatically calculates the fee and sends that information to the terminal. The terminal then displays the fee information to the user.

[1280] Specific behavior:

[1281] The server determines that "water washing is best for 100% cotton shirts."

[1282] The server calculates the fee as 500 yen and sends that information to the terminal.

[1283] The terminal displays the charge of 500 yen to the user.

[1284] Input data: Analyzed material information (e.g., 100% cotton)

[1285] Output data: Best cleaning method and price information (e.g. water wash, 500 yen)

[1286] Step 4: Pay via electronic payment system

[1287] The user checks the displayed price and pays using a credit card or electronic money. As input, the user enters credit card or electronic money information into the terminal. The terminal sends the payment information to the electronic payment system and waits until the payment process is complete. The server receives confirmation of payment completion and sends instructions for the next step to the terminal.

[1288] Specific behavior:

[1289] The user inserts a credit card into the terminal and pays 500 yen.

[1290] The terminal transmits payment information in real time to an electronic payment system.

[1291] The server receives notification of the completion of payment and sends next step information to the terminal.

[1292] Input data: User's credit card information or electronic money information

[1293] Output data: Payment completion status

[1294] Step 5: Prepare and mail laundry bags

[1295] The user follows the instructions displayed on the terminal and places the clothes in the laundry bag they brought with them. When preparations are complete, the user places the laundry bag in the deposit box. The terminal detects this placement and notifies the server. The server receives and records confirmation of the placement.

[1296] Specific behavior:

[1297] The user follows the on-screen instructions to place the shirt in the laundry bag.

[1298] When you drop a laundry bag into the deposit box, the device detects the action.

[1299] The terminal notifies the server that the submission has been completed, and the server records it.

[1300] Input data: Information about laundry bags being dropped off in the deposit box

[1301] Output data: Posting completion status

[1302] Step 6: What to do after cleaning

[1303] The server will send a notification to the user when the cleaning is complete. The notification will include the location and details of the unmanned drop-off box where the laundry can be picked up. The user will receive the notification, go to the designated unmanned drop-off box, scan the QR code to pick up the cleaned laundry, and the device will confirm the QR code scan and notify the server. The server will record the receipt confirmation and complete the process.

[1304] Specific behavior:

[1305] The server will notify you when cleaning is complete and provide the location of your unattended receiving box.

[1306] The user goes to an unmanned receiving box and scans the QR code on the device.

[1307] The device checks the QR code and notifies the server to record the receipt.

[1308] Input data: Cleaning completion notification and QR code scan information

[1309] Output data: Receipt completion status

[1310] (Application example 1)

[1311] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1312] In modern society, the demand for 24-hour unmanned stores is increasing in the dry cleaning industry. However, the current unmanned reception system has the following problems.

[1313] 1. Customers rely on the reception terminal and are unable to complete cleaning requests in advance, resulting in waiting times at the store.

[1314] 2. Analyzing the information from cleaning tags is complicated, and there is a lack of technology to process it efficiently.

[1315] 3. The payment process is tedious, especially when making payments from remote locations.

[1316] It is necessary to solve these issues and improve the user experience.

[1317] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1318] In this invention, the server includes: means for the user to operate the terminal to select the type of clothes; means for photographing the cleaning tag with a camera and generating image data of the photograph; means for sending the generated image data to the server; means for the server to analyze the image data received and select an appropriate cleaning method; means for automatically calculating a fee based on the selected cleaning method; electronic payment system means for the terminal to display the calculated fee and for the user to make payment; means for the user to pack the clothes into a laundry bag and drop it in a laundry bag deposit box; means for the server to send a notification to the user after the cleaning is completed; means for the user to receive the notification and collect the cleaned clothes in an unmanned delivery box; means for the user to complete a cleaning request in advance using a smartphone; means for photographing the cleaning tag with a smartphone camera and using a generative AI model to analyze the image data; means for inputting a prompt text into the generative AI model and analyzing tag information from the image data; means for sending the prompt text to the generative AI model to obtain an analysis result; means for selecting an optimal cleaning method based on the analysis result and notifying the smartphone; and means for making payment remotely from the smartphone using the electronic payment system. This allows users to complete cleaning requests in advance using their smartphones from home, making it quick and easy to make cleaning requests.

[1319] A "terminal" is an electronic device that is operated by a user, and includes tablet terminals, smartphones, and the like.

[1320] A "server" is a central processing unit that analyzes image data and calculates fees, and is a computing device that incorporates artificial intelligence (AI).

[1321] The "camera" is an image capture device for photographing the cleaning tag, and is built into the terminal or smartphone.

[1322] A "cleaning tag" is an information tag attached to clothing that lists material information and cleaning instructions.

[1323] A "generative AI model" is an algorithm that uses generative AI to analyze image data and extract information.

[1324] A "prompt sentence" is text data that is input into a generative AI model and is used to provide instructions for analysis.

[1325] An "electronic payment system" is a system that allows users to make payments using credit cards or electronic money, and is integrated into terminals and smartphones.

[1326] The "deposit box" is an unmanned reception box where users can deposit laundry bags, and it operates in conjunction with terminals and a server.

[1327] An "unmanned delivery box" is a box used by users to receive their cleaned clothes after cleaning is completed.

[1328] The present invention provides a system that allows users to use an unmanned laundry reception system via a smartphone. The configuration and operation procedure of the system are described in detail below.

[1329] System configuration

[1330] 1. Device:

[1331] The electronic device is operated by a user, and in this embodiment, it is a smartphone. The smartphone is equipped with a touch screen and displays an interface for the user to select the type of clothing. The smartphone also has a built-in camera that can take a picture of the cleaning tag.

[1332] 2. Server:

[1333] It is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with a generative AI model that analyzes the information extracted from the cleaning tag and selects the appropriate cleaning method.

[1334] 3. Camera:

[1335] An image capture device built into a smartphone that is used to photograph cleaning tags.

[1336] 4. Electronic payment systems:

[1337] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into smartphones, allowing users to check the displayed charges and make payments.

[1338] 5. Deposit Box:

[1339] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[1340] 6. Unmanned delivery box:

[1341] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[1342] Program structure and processing

[1343] When a user operates a smartphone app to use the 24-hour unmanned cleaning reception system, the following process takes place:

[1344] 1. User operations

[1345] Users select the type of clothing they want to have cleaned using the smartphone app, which will display options such as "suit jacket" or "shirt."

[1346] 2. Photographing the cleaning tag

[1347] The user takes a photo of the cleaning tag using the smartphone camera, and image data of the tag is generated and sent from the smartphone to the server.

[1348] 3. Use of generative AI models

[1349] The server analyzes the received image data and inputs a prompt to the generative AI model to analyze the tag information. For example, the prompt "Analyze the following image and extract the cleaning tag information: uploads / tag_image.jpg" is sent to the generative AI model.

[1350] 4. Calculation and Notification

[1351] The server selects the optimal cleaning method based on the analysis results obtained from the generative AI model and calculates the fee. The calculated fee information is sent to the user's smartphone, where the user can check the displayed fee and pay via the electronic payment system.

[1352] 5. Posting and receiving laundry bags

[1353] Once payment is complete, the user places the clothes in a laundry bag and places it in the drop box. Once the cleaning is complete, the server notifies the user, and the user can pick up the cleaned clothes in the unmanned delivery box.

[1354] Specific examples

[1355] For example, suppose a user requests dry cleaning of a "suit jacket," takes a photo of the cleaning tag with their smartphone camera, and sends the image data to the server. The server analyzes the tag information of the "suit jacket" using a generative AI model and determines that "dry cleaning" is the best option. The server then presents the calculated fee, and the user completes payment using the smartphone's electronic payment system and places the laundry bag in the drop box. Once the cleaning is complete, the server sends a notification, and the user can collect the cleaned jacket from the unmanned delivery box.

[1356] As described above, the system of the present invention allows users to have their clothes cleaned 24 hours a day, reducing labor costs and mistakes on the store side.

[1357] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1358] Step 1:

[1359] A user launches the smartphone app and selects a type of clothing. Options such as "suit jacket" and "shirt" appear on the smartphone's touchscreen. The smartphone sends the user's selection as input data to the server. The server receives this input data and records it for use in the next processing step.

[1360] Step 2:

[1361] The user takes a photo of the cleaning tag using the smartphone camera. They press a button on the touch screen to activate the camera and take a photo of the cleaning tag, which generates image data. The smartphone then sends this image data to the server as input data. The server stores the received image data and proceeds to the next processing step.

[1362] Step 3:

[1363] The server inputs the received image data into the generative AI model and analyzes the cleaning tag information. Specifically, the server generates a prompt message saying, "Analyze the following image and extract the cleaning tag information: uploads / tag_image.jpg," and sends it to the generative AI model. Following this prompt, the generative AI model analyzes the tag information and extracts information about the clothing's material and the optimal cleaning method. The extracted information is recorded on the server and the process proceeds to the next step.

[1364] Step 4:

[1365] The server selects the optimal cleaning method based on the analysis results obtained from the generative AI model and calculates the fee based on that method. The server automatically calculates the fee using the selected cleaning method and a pre-set fee calculation algorithm. This calculation result is sent to the smartphone. The fee information notified to the smartphone is displayed and the user proceeds to the next step.

[1366] Step 5:

[1367] The user checks the displayed price and makes the payment using the smartphone's electronic payment system. Credit card information and electronic money information are required as input data. The smartphone sends the payment information, which is then processed by the electronic payment system. Once the payment is complete, a confirmation notice is sent to the server, which then confirms and records the payment completion.

[1368] Step 6:

[1369] After payment is confirmed, the user places the clothes in a laundry bag and deposits it in the designated deposit box. The user follows the instructions received from their smartphone to prepare the laundry bag in advance and deposit it in the deposit box. This deposit information is sent to the server via an RFID tag or other means, and the server continues to monitor the status of the deposit box.

[1370] Step 7:

[1371] When the cleaning is complete, the server sends a notification to the user. The notification is sent to a smartphone informing the user that the cleaned clothes are ready in the unmanned delivery box. The user receives the notification on their smartphone and heads to the unmanned delivery box.

[1372] Step 8:

[1373] The user receives their cleaned clothes in an unmanned delivery box. The box is unlocked by scanning a QR code displayed on their smartphone. Once the user scans the QR code, the information is sent to the server, which records a confirmation of receipt. This completes the entire process.

[1374] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1375] The following system is proposed as an embodiment of the present invention. This system allows a user to request cleaning by operating an unmanned reception terminal, and can improve the quality of service by analyzing the user's emotions in combination with an emotion engine.

[1376] System configuration

[1377] 1. Device:

[1378] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can capture images of the cleaning tag and the user's facial expression.

[1379] 2. Server:

[1380] This is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with artificial intelligence (AI) that analyzes information extracted from cleaning tags and selects the appropriate cleaning method. An emotion engine is also built into the server, which analyzes user emotions.

[1381] 3. Camera:

[1382] An image capture device used to capture the cleaning tag and the user's facial expression, built into the terminal.

[1383] 4. Electronic payment systems:

[1384] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[1385] 5. Laundry Bag:

[1386] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[1387] 6. Deposit Box:

[1388] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[1389] 7. Unmanned delivery box:

[1390] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[1391] 8. Emotion Engine:

[1392] This technology analyzes the user's facial expressions and predicts their current emotions. The emotion engine uses facial expression data captured by the camera while the user is operating the device.

[1393] Program processing flow

[1394] User selection of clothing type

[1395] The user selects the type of clothing they wish to have cleaned (for example, a "suit jacket" or a "shirt") from a list displayed on the screen of the unmanned reception terminal. This allows the user to input the necessary information into the terminal.

[1396] The terminal receives user input and transmits the data to the server.

[1397] The server stores the received data and sets up the next step.

[1398] Photographing and analyzing cleaning tags

[1399] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[1400] The terminal transmits the generated image data to the server.

[1401] The server receives the image data and analyzes the tag information using artificial intelligence (AI). As a result of the analysis, information about the clothing's material and cleaning method can be extracted.

[1402] Selecting a cleaning method and calculating fees

[1403] Based on the analyzed information, the server uses AI to select the optimal cleaning method, which can include washing with water or dry cleaning.

[1404] The server automatically calculates the fee based on the selected cleaning method, and the calculated fee information is sent to the terminal.

[1405] The terminal displays the fee information to the user and prompts them to proceed with the payment procedure.

[1406] Payment via electronic payment systems

[1407] The user checks the displayed fee and pays using a credit card or electronic money.

[1408] The terminal transmits the payment information to the electronic payment system and waits for the transaction to complete.

[1409] The server receives confirmation of successful payment and sends instructions to the terminal on the next steps.

[1410] Preparing and posting laundry bags

[1411] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[1412] The user places the prepared laundry bag in the deposit box.

[1413] The terminal notifies the server that the laundry bag has been placed in the deposit box.

[1414] The server receives and records confirmation of the laundry bag posting.

[1415] Analyzing user emotions with an emotion engine

[1416] When a user operates the device, the device's camera captures the user's facial expression.

[1417] The terminal transmits the user's facial expression data to the emotion engine.

[1418] The server's emotion engine analyzes the received facial expression data and infers the user's emotions. For example, if the user is feeling irritated or dissatisfied, it provides feedback to improve the service based on that information.

[1419] After cleaning is complete

[1420] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[1421] The user receives a notification, goes to the designated unmanned delivery box, scans the QR code, and collects the cleaned clothes.

[1422] The device confirms the QR code scan and notifies the server of the information.

[1423] The server records a confirmation of receipt and completes the process.

[1424] Specific examples

[1425] Example 1:

[1426] User A operates the unmanned reception terminal to have his suit jacket cleaned. After showing the cleaning tag to the camera, the fee of 1,500 yen is displayed. After completing the payment, he places the suit jacket in a laundry bag and places it in the deposit box. When the cleaning work is complete, he receives a notification from the server and collects the cleaned suit jacket from the unmanned delivery box.

[1427] Example 2:

[1428] While User B is having his shirt cleaned, he displays facial expressions that indicate dissatisfaction while operating the device. The emotion engine analyzes this and displays feedback on the device. The concierge service is also automatically called to provide support to resolve User B's dissatisfaction.

[1429] As described above, the system of the present invention provides users with the convenience of being able to use the dry cleaner 24 hours a day, improves the user experience through its emotion engine, and contributes to reducing labor costs and errors on the store side.

[1430] The processing flow will be explained below.

[1431] Step 1:

[1432] The user taps to select the type of clothing they wish to have cleaned (for example, "suit jacket" or "shirt") from the list displayed on the screen of the unmanned reception terminal.

[1433] Step 2:

[1434] The terminal receives the user's input and transmits the selected data to the server.

[1435] Step 3:

[1436] The server stores the received data, sets the next step, and transmits that information to the terminal.

[1437] Step 4:

[1438] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[1439] Step 5:

[1440] The terminal transmits the generated image data to the server.

[1441] Step 6:

[1442] The server uses artificial intelligence (AI) to analyze the received image data, analysing the tag information and extracting information about the garment's material and washing instructions.

[1443] Step 7:

[1444] Based on the analysis, the server uses AI to select the most appropriate cleaning method, for example, dry cleaning for a wool suit jacket.

[1445] Step 8:

[1446] The server automatically calculates the fee based on the selected cleaning method and sends the calculation result to the terminal.

[1447] Step 9:

[1448] The terminal displays the fee information to the user and prompts the user to select a payment method.

[1449] Step 10:

[1450] The user checks the displayed price and enters payment information using a credit card or electronic money.

[1451] Step 11:

[1452] The terminal sends the payment information to the electronic payment system, waits for the transaction to complete, and once it receives confirmation that the payment is complete, sends the information to the server.

[1453] Step 12:

[1454] The server receives a confirmation of the payment and sends instructions for the next step to the terminal.

[1455] Step 13:

[1456] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[1457] Step 14:

[1458] The user places the filled laundry bag in the storage box and holds the QR code displayed on the terminal over the scanner in the storage box.

[1459] Step 15:

[1460] The terminal confirms that the laundry bag has been placed in the storage box and notifies the server of this information.

[1461] Step 16:

[1462] The server records confirmation that the laundry bag has been placed in the deposit box.

[1463] Step 17:

[1464] The dry cleaner's staff or an automated system will retrieve the laundry bag from the deposit box and begin the cleaning process.

[1465] Step 18:

[1466] When a user operates the device, the device's camera captures the user's facial expression.

[1467] Step 19:

[1468] The terminal transmits the user's facial expression data to the emotion engine.

[1469] Step 20:

[1470] The server's emotion engine analyzes the received facial expression data and infers the user's emotions. For example, if the user is feeling irritated or dissatisfied, it adjusts the service accordingly.

[1471] Step 21:

[1472] Based on the user's emotional data, the server displays feedback on the terminal as needed or automatically calls a concierge service.

[1473] Step 22:

[1474] After the cleaning is complete, the server sends a notification to the user, which includes the location and details of the unmanned delivery box where the item can be picked up.

[1475] Step 23:

[1476] The user receives a notification and heads to the designated unmanned delivery box, where they scan the QR code with the scanner to receive their cleaned clothes.

[1477] Step 24:

[1478] The device confirms the QR code scan and notifies the server of the information.

[1479] Step 25:

[1480] The server records a confirmation of receipt and completes the whole process.

[1481] Example 2

[1482] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1483] Conventional cleaning reception systems require users to visit the store in person, which is inconvenient and makes it difficult to improve services based on user preferences. Furthermore, manually selecting cleaning methods and calculating fees takes time and can lead to errors. Furthermore, delays in payment confirmation can make it difficult to provide a smooth service.

[1484] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing received image data using artificial intelligence and selecting an appropriate cleaning method, means for automatically calculating fees, and means for analyzing user facial expression data using an emotion engine and generating feedback. This allows users to request unattended cleaning 24 hours a day, receives prompt and accurate presentations of cleaning methods and fees, and enables service improvements based on the user's emotions.

[1485] A "user" is a person who uses the system to request laundry.

[1486] A "terminal" is an electronic device operated by a user, and refers to devices such as tablet terminals and kiosk terminals.

[1487] The "camera" is an image capture device built into the terminal for capturing images of the cleaning tag and the user's facial expression.

[1488] "Image data" refers to an image of the cleaning tag taken by a camera and sent to a server for analysis.

[1489] A "server" is a central processing unit that performs a series of processes such as analyzing image data, calculating fees, sending notifications, and analyzing emotions.

[1490] "Artificial intelligence (AI)" is a technology used to analyze image data and select appropriate cleaning methods.

[1491] The "means for automatically calculating fees" is a function in which the server calculates fees based on the cleaning method and presents the calculated fees to the user.

[1492] An "electronic payment system" is a mechanism that allows users to make payments using credit cards or electronic money, and operates in conjunction with a terminal.

[1493] A "laundry bag" is a bag in which a user stores clothes for dry cleaning.

[1494] The "deposit box" is an unmanned reception box where users can deposit their laundry bags, and it is a box that transmits information to a server using an RFID tag or the like.

[1495] An "unmanned delivery box" is a box used by users to receive their cleaned clothes after cleaning is completed.

[1496] An "emotion engine" is a technology that analyzes a user's facial expressions and infers their current emotions.

[1497] As an embodiment of the present invention, a system is provided in which a user requests cleaning by operating an unmanned reception terminal. This system can improve the quality of service by analyzing the user's emotions in combination with an emotion engine.

[1498] System configuration

[1499] 1. Device:

[1500] The terminal is an electronic device operated by the user, such as a tablet or kiosk. The terminal is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal is also equipped with a camera that can capture images of the cleaning tag and the user's facial expression.

[1501] 2. Server:

[1502] The server is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with artificial intelligence (AI) that analyzes the information extracted from the cleaning tags and selects the appropriate cleaning method. An emotion engine is also built into the server, which analyzes the user's emotions.

[1503] 3. Camera:

[1504] The camera is an image capture device used to capture images of the cleaning tag and the user's facial expression, and is built into the terminal.

[1505] 4. Electronic payment systems:

[1506] An electronic payment system is a system that allows users to make payments using credit cards or electronic money. It is integrated into a terminal, allowing users to check the displayed price and make the payment.

[1507] 5. Laundry Bag:

[1508] A laundry bag is a bag in which a user stores clothes for dry cleaning, and is brought and used by the user himself.

[1509] 6. Deposit Box:

[1510] The deposit box is an unmanned reception box where users can deposit laundry bags, and it works in conjunction with a terminal. When a laundry bag is deposited, information about it is sent to a server using an RFID tag or other means.

[1511] 7. Unmanned delivery box:

[1512] The unmanned delivery box is a box that users can use to receive their cleaned clothes after their cleaning is complete. It receives a notification from the server and can be handled unmanned.

[1513] 8. Emotion Engine:

[1514] The emotion engine is a technology that analyzes the user's facial expressions and infers their current emotions. The emotion engine uses facial expression data captured by the camera while the user is operating the device.

[1515] Specific examples

[1516] Example 1:

[1517] User A operates the unmanned reception terminal to have his suit jacket cleaned. After selecting "suit jacket" on the screen, he shows the cleaning tag to the camera. The image data captured by the terminal is sent to the server, and AI analyzes the tag information. The fee of 1,500 yen is displayed, and User A completes the payment with a credit card. He places the suit jacket in a laundry bag and places it in a deposit box, and is notified when cleaning is complete. He then scans the QR code at the designated unmanned delivery box to complete collection.

[1518] Example 2:

[1519] User B operates the device to have his shirt cleaned. Following the device's instructions, he selects the shirt and shows the cleaning tag to the camera. The price is displayed, but during the operation, he shows a facial expression that indicates dissatisfaction. The emotion engine analyzes this facial expression, detects signs of dissatisfaction, and displays feedback on the device. Furthermore, a concierge service is automatically called to help User B resolve his dissatisfaction.

[1520] Prompt Sentence Examples

[1521] Prompt: "Please describe in detail the entire process steps a user would take to operate the device and use the cleaning service. Include specific actions and sentiment analysis steps."

[1522] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1523] Step 1:

[1524] The user selects the type of clothing they wish to have cleaned from a list displayed on the screen of the unmanned reception terminal. For example, they can select "suit jacket" or "shirt." This becomes the input data. The terminal receives this selection data and sends it to the server. The server analyzes the received data and sets the next step.

[1525] Step 2:

[1526] The user shows the cleaning tag to the device's camera. The device's camera takes a picture of the cleaning tag and generates high-resolution image data. This becomes the next input data. The device then sends the generated image data to the server. The server receives this image data and performs image analysis using artificial intelligence (AI). Through image analysis, information such as the clothing material and cleaning method is extracted from the cleaning tag.

[1527] Step 3:

[1528] The server uses AI to select the optimal cleaning method based on the analyzed tag information. This selection includes whether to wash or dry clean. This is the input information. The server then automatically calculates the fee based on the cleaning method. The calculated fee information is output and sent to the terminal.

[1529] Step 4:

[1530] The terminal displays the fee information to the user and guides them through the payment procedure. The user checks the displayed fee and pays using a credit card or electronic money. This becomes new input data. The terminal sends this payment information to the electronic payment system and waits for payment completion. The server receives confirmation of payment completion from the electronic payment system.

[1531] Step 5:

[1532] The terminal notifies the user that payment has been completed and instructs them on how to pack the clothes into the laundry bag. The user then packs the clothes into the laundry bag they brought with them and places it in the laundry bag deposit box. This is the next input. The deposited laundry bag is confirmed by the deposit box's sensors and RFID tag, and the information is sent to the server. The server receives this information and records confirmation of the bag being deposited.

[1533] Step 6:

[1534] While the user is operating the device, the device's camera continues to capture the user's facial expressions. The camera captures facial expression data, which becomes the next input data. The device then sends this data to the emotion engine. The server's emotion engine analyzes this facial expression data and infers the user's emotions. For example, if the user expresses dissatisfaction, the engine generates feedback for improving the service based on the results and sends it to the device.

[1535] Step 7:

[1536] Once the cleaning is complete, the server sends a notification to the user. This notification includes the location and details of the unmanned delivery box where the clothes can be picked up. This is the input data. The user receives the notification and goes to the designated unmanned delivery box. They scan the QR code at the delivery box and pick up the cleaned clothes. This information is the final output data. The device confirms the QR code scan and notifies the server of this information. The server records the confirmation of receipt and completes the process.

[1537] (Application example 2)

[1538] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1539] In modern society, while speed and accuracy are required for cleaning services, improving the user experience is also important. However, conventional cleaning services often make users wait for long periods of time in crowded stores and often result in dissatisfaction with the quality of service. Furthermore, the lack of a system to properly understand user emotions and respond in real time can lead to a decline in service quality.

[1540] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1541] In this invention, the server includes: means for a user to operate a terminal to select the type of clothing; means for photographing the identification tag with a camera and generating image data thereof; means for transmitting the generated image data to the server; means for the server to analyze the received image data and select an appropriate processing method; means for automatically calculating a fee based on the selected processing method; electronic payment system means for the terminal to display the calculated fee and for the user to pay; means for the user to pack the clothing into a storage bag and deposit it in a deposit box; means for the server to send a notification to the user after the cleaning is completed; means for the user to receive the notification and collect the cleaned clothing in an unmanned receiving box; emotion analysis means including an emotion engine to analyze the user's facial expression data and adjust a response; means for displaying information on the user's interface using augmented reality technology; and means for providing a real-time notification function. This not only allows users to avoid crowds and use cleaning services quickly and efficiently, but also enables appropriate responses to be provided in real time according to emotions, thereby aiming to improve the quality of service.

[1542] "User" refers to a person who uses this invention to request cleaning services.

[1543] A "terminal" is an electronic device operated by a user, such as a smartphone, tablet, or smart glasses.

[1544] "Clothing" refers to the clothes and other apparel items to be cleaned.

[1545] An "identification tag" is a tag attached to a garment that contains information necessary for cleaning.

[1546] "Camera" refers to a device installed on the terminal that captures an identification tag or the user's facial expression.

[1547] "Image data" is information captured by a camera expressed in digital form.

[1548] "Server" refers to a central processing unit that performs processes such as analyzing image data, calculating fees, and notifying users.

[1549] "Processing method" refers to the method of cleaning the clothing, and refers to specific measures such as washing with water or dry cleaning.

[1550] "Fees" means the amount for the Cleaning Services.

[1551] An "electronic payment system" refers to a system in which users make payments using credit cards or electronic money.

[1552] A "storage bag" refers to a bag in which a user puts clothes to be cleaned.

[1553] The "deposit box" refers to an unmanned reception box into which users deposit their storage bags.

[1554] "Notification" refers to information sent from the server to the user after cleaning is completed.

[1555] "Unmanned receiving box" refers to an unmanned box where users can receive their cleaned clothes.

[1556] "Emotion analysis means" refers to technology for analyzing a user's facial expression data and inferring their emotions.

[1557] "Augmented reality technology" refers to technology that displays virtual elements overlaid on the real world.

[1558] "Real-time notification function" refers to a function that instantly notifies the user of the progress and completion of cleaning.

[1559] To put the present invention into practice, a system is constructed in which a user operates a terminal to request a cleaning service. A specific implementation method for this system will be described below.

[1560] First, a user operates a "terminal" using an electronic device such as a smartphone, tablet, or smart glasses. The user selects the type of clothing they want to have cleaned from the interface displayed on the terminal. Once the selection is complete, the device's camera is used to capture an image of the identification tag attached to the clothing. This image data is generated as "tag data."

[1561] The generated tag data is then sent over the internet to a "server." The server analyzes the tag data using image recognition technology (e.g., OpenCV) and artificial intelligence (e.g., trained models) to extract information such as the garment's material and treatment method. Based on the extracted information, the server selects the optimal cleaning method and automatically calculates the fee.

[1562] The calculated fee information is sent back to the terminal and displayed. The user can check the displayed fee and make payment using an electronic payment system (e.g., Stripe API). Once payment is complete, a confirmation notice is sent from the server to the terminal.

[1563] The user then places the clothes in a storage bag and places it in a deposit box. The deposit box is equipped with an identification device such as an RFID tag, which notifies the server of the cleaning request. Once the cleaning is complete, the server sends a notification to the user. This notification includes the location of the unmanned delivery box and instructions on how to collect the clothes. Upon receiving the notification, the user goes to the unmanned delivery box and scans a QR code or other code to collect the cleaned clothes.

[1564] Furthermore, the system includes an emotion analysis function that captures the user's facial expression data with the device's camera and analyzes it in real time using an emotion engine. This enables early detection of user dissatisfaction or irritation and allows the service interface to be adjusted accordingly. Additionally, by using augmented reality technology (e.g., ARKit, ARCore), it is possible to overlay price displays and notification information on the user interface.

[1565] Using the real-time notification function, the server will instantly notify the user of the cleaning progress and completion information, so that the user can always receive the latest information in real time.

[1566] Specific examples

[1567] User A is using smart glasses. He scans the shirt he wants to clean and the price is displayed. The emotion engine analyzes User A's satisfaction level and completes the payment. After completion, the delivery status is notified on the AR display of the smart glasses.

[1568] Prompt Sentence Examples

[1569] "Implement an AR interface for smart glasses that scans cleaning tags with a camera, displays fee information, and allows electronic payment. Add a function that analyzes the user's facial expression data and displays improvement suggestions in the interface if the user is dissatisfied."

[1570] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1571] Step 1:

[1572] The user selects a type of clothing

[1573] Input: The user operates the terminal and selects the type of clothing (e.g., shirt, suit jacket).

[1574] Data processing: The terminal records the type of clothing selected as digital data.

[1575] Output: The recorded data is sent to the server.

[1576] How it works: The user interacts with the device's interface to select a type of clothing. The device records the selection and sends it to the server.

[1577] Step 2:

[1578] Take a photo of the ID tag with the camera

[1579] Input: The user shows the identification tag of the selected garment to the device's camera.

[1580] Data processing: The device's camera generates image data of the tag.

[1581] Output: The generated image data is sent to the server.

[1582] How it works: The user shows the identification tag on their clothing to the device's camera, which takes a picture, generates image data, and sends it to the server.

[1583] Step 3:

[1584] Tag image analysis and processing method selection

[1585] Input: tag image data received by the server.

[1586] Data processing: The server uses artificial intelligence to analyze the tag image and extract information about the clothing material and cleaning instructions.

[1587] Output: The optimal cleaning method and cost are calculated and sent to the terminal.

[1588] How it works: The server uses image recognition technology to analyze the tag, select the best cleaning method, and calculate the fee.

[1589] Step 4:

[1590] Display of fees and electronic payment

[1591] Input: Pricing data sent from the server.

[1592] Data processing: The terminal displays the fee information to the user and processes the payment in conjunction with the electronic payment system.

[1593] Output: A confirmation of the payment is sent to the server.

[1594] Operation: The terminal displays the fee information to the user, who then makes the payment through an electronic payment system.

[1595] Step 5:

[1596] Pack your clothes into a storage bag and drop them off in the deposit box.

[1597] Input: The user places the clothes in a storage bag and places it in the storage box.

[1598] Data processing: The identification device in the deposit box recognizes the deposited bag and sends the deposit information to the server.

[1599] Output: The data indicating the completion of submission is recorded on the server.

[1600] How it works: The user puts their clothes into a storage bag and places it in the deposit box. The RFID tag in the deposit box recognizes this and notifies the server.

[1601] Step 6:

[1602] Sentiment analysis and service interface adjustment

[1603] Input: User's facial expression data is captured by the camera.

[1604] Data processing: The device sends the facial expression data to the emotion engine for analysis.

[1605] Output: Based on the analysis results, the service interface is adjusted.

[1606] How it works: The device's camera captures the user's facial expressions, which are analyzed by the emotion engine, and the interface is adjusted based on the results.

[1607] Step 7:

[1608] Notification and collection after cleaning is complete

[1609] Input: Data indicating cleaning is complete.

[1610] Data processing: The server sends a notification to the user that cleaning is complete and provides the necessary information.

[1611] Output: User receives cleaned clothes in unattended receiving box.

[1612] How it works: The server notifies the user that the cleaning is complete, and the user scans the QR code in the unmanned receiving box to collect the clothes.

[1613] Step 8:

[1614] Real-time notifications provide progress updates

[1615] Input: Cleaning progress data collected by the server.

[1616] Data processing: The user is notified of progress in real time.

[1617] Output: User sees progress in real time.

[1618] Operation: The server periodically notifies the user of cleaning progress data, which the user can check in real time via their terminal.

[1619] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1620] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1621] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1622] [Fourth embodiment]

[1623] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1624] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1625] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1626] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1627] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1628] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1629] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1630] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1631] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1632] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1633] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1634] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1635] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1636] The following system is proposed as an embodiment of the present invention. This system allows users to request cleaning by operating an unmanned reception terminal, and realizes unmanned cleaning reception and delivery 24 hours a day.

[1637] System configuration

[1638] 1. Device:

[1639] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can take a picture of the cleaning tag.

[1640] 2. Server:

[1641] This is a central processing unit that analyzes image data, calculates fees, etc. The server is equipped with artificial intelligence (AI) that analyzes the information extracted from the cleaning tag and selects the appropriate cleaning method.

[1642] 3. Camera:

[1643] An image capture device used to photograph the cleaning tag, built into the terminal.

[1644] 4. Electronic payment systems:

[1645] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[1646] 5. Laundry Bag:

[1647] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[1648] 6. Deposit Box:

[1649] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[1650] 7. Unmanned delivery box:

[1651] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[1652] Program processing flow

[1653] User selection of clothing type

[1654] The user selects the type of clothing they wish to have cleaned from a list displayed on the screen of the unmanned reception terminal, such as "suit jacket" or "shirt."

[1655] The terminal receives user input and transmits the data to the server.

[1656] The server analyzes the received data and sets the next step.

[1657] Photographing and analyzing cleaning tags

[1658] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[1659] The terminal transmits the generated image data to the server.

[1660] The server receives the image data and analyzes the tag information using artificial intelligence (AI). As a result of the analysis, information about the clothing's material and cleaning method can be extracted.

[1661] Selecting a cleaning method and calculating fees

[1662] Based on the analyzed information, the server uses AI to select the optimal cleaning method, which can include washing with water or dry cleaning.

[1663] The server automatically calculates the fee based on the selected cleaning method, and the calculated fee information is sent to the terminal.

[1664] The terminal displays the fee information to the user and prompts them to proceed with the payment procedure.

[1665] Payment via electronic payment systems

[1666] The user checks the displayed fee and pays using a credit card or electronic money.

[1667] The terminal transmits the payment information to the electronic payment system and waits for the transaction to complete.

[1668] The server receives confirmation of successful payment and sends instructions to the terminal on the next steps.

[1669] Preparing and posting laundry bags

[1670] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[1671] The user places the prepared laundry bag in the deposit box.

[1672] The terminal notifies the server that the laundry bag has been placed in the deposit box.

[1673] The server receives and records confirmation of the laundry bag posting.

[1674] After cleaning is complete

[1675] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[1676] The user receives a notification, goes to the designated unmanned delivery box, scans the QR code, and collects the cleaned clothes.

[1677] The device confirms the QR code scan and notifies the server.

[1678] The server records a confirmation of receipt and completes the process.

[1679] As described above, the system of the present invention provides users with the convenience of being able to have their clothes cleaned 24 hours a day, and also contributes to reducing labor costs and mistakes on the part of the store.

[1680] The processing flow will be explained below.

[1681] Step 1:

[1682] The user taps the type of clothing they wish to have cleaned (for example, "suit jacket" or "shirt") from the options displayed on the screen of the unmanned reception terminal.

[1683] Step 2:

[1684] The terminal receives user input and transmits the data to the server.

[1685] Step 3:

[1686] The server stores the received data and returns instructions for the next step to the terminal for display.

[1687] Step 4:

[1688] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[1689] Step 5:

[1690] The terminal transmits the generated image data to the server.

[1691] Step 6:

[1692] The server receives the image data and uses artificial intelligence (AI) to analyze the tag information, extracting information about the clothing's material (e.g., wool, cotton) and washing instructions (e.g., dry cleaning, do not wash).

[1693] Step 7:

[1694] The server then selects the optimal cleaning method based on the analysis results. For example, for a wool jacket, the AI ​​will select dry cleaning.

[1695] Step 8:

[1696] The server automatically calculates the fee using the selected cleaning method, and the calculated fee information is sent to the terminal.

[1697] Step 9:

[1698] The terminal receives the fee information to display to the user and displays it on the screen.

[1699] Step 10:

[1700] The user checks the displayed fee and pays using a credit card or electronic money. The user then enters the necessary information for the payment procedure.

[1701] Step 11:

[1702] The terminal sends the payment information to the electronic payment system and waits until the process is complete. After confirming that the payment is complete, the terminal sends the information to the server.

[1703] Step 12:

[1704] The server receives a confirmation of the payment and sends instructions for the next step to the terminal.

[1705] Step 13:

[1706] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[1707] Step 14:

[1708] The user places the filled laundry bag in the storage box and holds the QR code displayed on the terminal over the scanner in the storage box.

[1709] Step 15:

[1710] The terminal confirms that the laundry bag has been placed in the storage box and notifies the server of this information.

[1711] Step 16:

[1712] The server records confirmation that the laundry bag has been placed in the deposit box.

[1713] Step 17:

[1714] The dry cleaner's staff or an automated system will retrieve the laundry bag from the deposit box and begin the cleaning process.

[1715] Step 18:

[1716] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[1717] Step 19:

[1718] Users receive a notification, go to the designated unmanned delivery box, scan the QR code and collect their cleaned clothes.

[1719] Step 20:

[1720] The device confirms the QR code scan and notifies the server of the information.

[1721] Step 21:

[1722] The server records a confirmation of receipt and marks the whole process as complete.

[1723] The above are the detailed program processing steps in the unmanned cleaning reception system.

[1724] Example 1

[1725] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1726] Conventional dry cleaning systems have limited reception and collection times, making it difficult for users to use the system 24 hours a day. Furthermore, the process of accepting and collecting dry cleaning requires manual labor, which increases labor costs for the store and increases the likelihood of errors. The present invention aims to solve these problems by providing a system that allows users to use dry cleaning services 24 hours a day and improves the operational efficiency of the store.

[1727] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1728] In this invention, the server includes means for selecting the type of clothing using a terminal operated by the user, means for taking a picture of the cleaning tag with a camera and generating image data, means for analyzing the generated image data and selecting an appropriate cleaning method, means for automatically calculating the fee and sending the fee information to the terminal, means for the user to place the clothes in a laundry bag and place it in a deposit box, and means for the server to notify the user after the cleaning is complete and for the user to collect the clothes in an unmanned receiving box. This allows users to use the dry cleaning service 24 hours a day and improves the operational efficiency of the store.

[1729] "User" means an individual or organization that uses the system to request cleaning.

[1730] A "terminal" is an electronic device operated by a user, and is an interface device including a tablet terminal and a kiosk terminal.

[1731] A "server" is a device that handles the central processing of the entire system, and is a computer that analyzes and processes data and sends instructions.

[1732] A "cleaning tag" is a tag attached to clothing that contains information about the material of the clothing and the cleaning method.

[1733] A "laundry bag" is a bag in which a user stores clothes that they wish to have dry cleaned.

[1734] The "deposit box" is an unmanned reception box into which users deposit laundry bags, and operates in conjunction with the system.

[1735] An "unattended receiving box" is a box that users use to receive their cleaned clothes after cleaning is complete.

[1736] An "electronic payment system" is a system that allows users to make payments using credit cards or electronic money.

[1737] "Image data" refers to photographic data of the cleaning tag taken using a camera.

[1738] "Artificial intelligence" refers to AI technology built into the server, and is an algorithm that analyzes image data and selects cleaning methods.

[1739] "Notification" refers to a message sent by the server to inform the user of the completion of cleaning or availability of information.

[1740] To implement the present invention, the following system and its components will be described. This system allows users to request cleaning by operating an unmanned reception terminal, and realizes unmanned cleaning reception and delivery 24 hours a day.

[1741] System configuration

[1742] 1. Terminal

[1743] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can take a picture of the cleaning tag.

[1744] 2. Server

[1745] This is a central processing unit that analyzes image data and calculates fees. The server incorporates artificial intelligence (AI) to analyze the information extracted from the cleaning tag and select the appropriate cleaning method. It also processes payment information and sends notifications to users.

[1746] 3. Camera

[1747] An image capture device used to photograph the cleaning tag, built into the terminal.

[1748] 4. Electronic Payment Systems

[1749] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[1750] 5. Laundry bags

[1751] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[1752] 6. Deposit Box

[1753] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[1754] 7. Unattended Delivery Boxes

[1755] This is a box where users can receive their cleaned clothes after cleaning is complete. It receives a notification from the server and can be handled unattended.

[1756] Program processing overview

[1757] 1. Select the type of clothing

[1758] The user selects the type of clothing they want cleaned from a list displayed on the unmanned reception terminal's screen. The interface displays options such as "suit jacket" or "shirt." The terminal receives the user's input and sends the data to the server, which uses this data to determine the next steps.

[1759] Examples:

[1760] The user selects "suit jacket." The device sends this information to the server, which analyzes the information and prepares the next interface.

[1761] Prompt statement:

[1762] "Please enter the type of clothing selected by the user."

[1763] 2. Photographing and analyzing cleaning tags

[1764] The user shows the cleaning tag to the device's camera. The device's camera takes a photo of the tag and generates image data. This image data is then sent to a server. The server uses artificial intelligence (AI) to analyze the tag information and extract information about the garment's material and cleaning instructions.

[1765] Examples:

[1766] The user shows the tag to the camera, the device takes a photo, and the device sends the data to the server, where the server's AI extracts an analysis result, such as "100% cotton."

[1767] Prompt statement:

[1768] "Please send the image data of the tag to the server. Analyze the material information of the clothing based on that data."

[1769] 3. Selecting a cleaning method and calculating the fee

[1770] Based on the analyzed information, the server uses AI to select the optimal cleaning method, such as "water washing" or "dry cleaning." The server automatically calculates the fee based on the selected cleaning method and sends that information to the terminal. The terminal then displays the fee information to the user and prompts them to complete the payment process.

[1771] Examples:

[1772] The AI ​​determines that "water washing is best for a 100% cotton shirt," calculates the cost to be 500 yen, and sends this to the terminal. The terminal then displays the 500 yen fee to the user and guides them through the payment process.

[1773] Prompt statement:

[1774] "The AI ​​will select the cleaning method and calculate the fee, and the results will be displayed on your device."

[1775] 4. Payment via electronic payment systems

[1776] The user checks the displayed price and pays using a credit card or electronic money. The terminal sends the payment information to the electronic payment system and waits until the transaction is complete. The server receives confirmation of the payment and sends instructions for the next step to the terminal.

[1777] Examples:

[1778] The user inserts a credit card into the terminal and pays 500 yen. The terminal sends the payment information to the electronic payment system in real time. When the server receives notification that the payment is complete, the terminal displays the next step information.

[1779] Prompt statement:

[1780] Please explain the process for users to check the price and complete the payment.

[1781] 5. Prepare and post laundry bags

[1782] The user follows the instructions on the screen to pack their clothes into the laundry bag they brought with them. Then, they place the laundry bag they prepared in the deposit box. The terminal detects this and notifies the server. The server receives and records confirmation that the laundry bag has been placed in the box.

[1783] Examples:

[1784] The user follows the instructions on the screen to place the shirt in the laundry bag. When the laundry bag is placed in the deposit box, the device detects this action and notifies the server that the bag has been placed, and the server records the event.

[1785] Prompt statement:

[1786] "Please explain the process for users to put their clothes into laundry bags and place them in the drop box."

[1787] 6. What to do after cleaning is complete

[1788] The server will send a notification to the user when the cleaning is complete. The notification will include the location and details of the unmanned drop-off box where the laundry can be picked up. The user will receive the notification, go to the designated unmanned drop-off box, scan the QR code to pick up the cleaned laundry, and the device will confirm the QR code scan and notify the server. The server will record the receipt confirmation and complete the process.

[1789] Examples:

[1790] The server notifies the user that the cleaning is complete and provides the location of the unmanned receiving box. The user goes to the unmanned receiving box and scans the QR code on their device. The device verifies the QR code and notifies the server to record the receipt.

[1791] Prompt statement:

[1792] "Please explain how users can pick up their clothes after cleaning is complete."

[1793] This system allows users to enjoy the convenience of having their clothes cleaned 24 hours a day, and stores can expect to reduce labor costs and prevent mistakes.

[1794] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1795] Step 1: Select the type of clothing

[1796] The user selects the type of clothing they wish to have cleaned from a list displayed on the unmanned reception terminal screen. As input, the user selects an item such as "suit jacket" or "shirt" on the touch screen. The terminal receives the user's input and sends the data to the server.

[1797] Specific behavior:

[1798] The user selects "shirt."

[1799] The terminal transmits the selection information of "shirt" to the server.

[1800] The server receives this information and prepares for the next steps.

[1801] Input data: The type of clothing selected by the user (e.g., shirt)

[1802] Output data: Setting next steps based on clothing type

[1803] Step 2: Photograph and analyze the cleaning tag

[1804] The user shows the cleaning tag to the camera of the unmanned reception terminal. The terminal takes a picture of the cleaning tag with the camera and generates image data. The generated image data is sent to the server. The server uses artificial intelligence (AI) to analyze the image data and extract information about the clothing's material and cleaning method.

[1805] Specific behavior:

[1806] The user shows the cleaning tag in front of the device's camera.

[1807] The terminal takes a picture of the tag, generates image data, and sends it to the server.

[1808] The server uses AI to analyze the tag information and extract information such as "100% cotton."

[1809] Input data: Image data of cleaning tag

[1810] Output data: Analyzed material information (e.g., 100% cotton)

[1811] Step 3: Choose your cleaning method and calculate the cost

[1812] The server uses AI to select the optimal cleaning method based on the analyzed material information. For example, "washing with water" or "dry cleaning." Based on the selected cleaning method, the server automatically calculates the fee and sends that information to the terminal. The terminal then displays the fee information to the user.

[1813] Specific behavior:

[1814] The server determines that "water washing is best for 100% cotton shirts."

[1815] The server calculates the fee as 500 yen and sends that information to the terminal.

[1816] The terminal displays the charge of 500 yen to the user.

[1817] Input data: Analyzed material information (e.g., 100% cotton)

[1818] Output data: Best cleaning method and price information (e.g. water wash, 500 yen)

[1819] Step 4: Pay via electronic payment system

[1820] The user checks the displayed price and pays using a credit card or electronic money. As input, the user enters credit card or electronic money information into the terminal. The terminal sends the payment information to the electronic payment system and waits until the payment process is complete. The server receives confirmation of payment completion and sends instructions for the next step to the terminal.

[1821] Specific behavior:

[1822] The user inserts a credit card into the terminal and pays 500 yen.

[1823] The terminal transmits payment information in real time to an electronic payment system.

[1824] The server receives notification of the completion of payment and sends next step information to the terminal.

[1825] Input data: User's credit card information or electronic money information

[1826] Output data: Payment completion status

[1827] Step 5: Prepare and mail laundry bags

[1828] The user follows the instructions displayed on the terminal and places the clothes in the laundry bag they brought with them. When preparations are complete, the user places the laundry bag in the deposit box. The terminal detects this placement and notifies the server. The server receives and records confirmation of the placement.

[1829] Specific behavior:

[1830] The user follows the on-screen instructions to place the shirt in the laundry bag.

[1831] When you drop a laundry bag into the deposit box, the device detects the action.

[1832] The terminal notifies the server that the submission has been completed, and the server records it.

[1833] Input data: Information about laundry bags being dropped off in the deposit box

[1834] Output data: Posting completion status

[1835] Step 6: What to do after cleaning

[1836] The server will send a notification to the user when the cleaning is complete. The notification will include the location and details of the unmanned drop-off box where the laundry can be picked up. The user will receive the notification, go to the designated unmanned drop-off box, scan the QR code to pick up the cleaned laundry, and the device will confirm the QR code scan and notify the server. The server will record the receipt confirmation and complete the process.

[1837] Specific behavior:

[1838] The server will notify you when cleaning is complete and provide the location of your unattended receiving box.

[1839] The user goes to an unmanned receiving box and scans the QR code on the device.

[1840] The device checks the QR code and notifies the server to record the receipt.

[1841] Input data: Cleaning completion notification and QR code scan information

[1842] Output data: Receipt completion status

[1843] (Application example 1)

[1844] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1845] In modern society, the demand for 24-hour unmanned stores is increasing in the dry cleaning industry. However, the current unmanned reception system has the following problems.

[1846] 1. Customers rely on the reception terminal and are unable to complete cleaning requests in advance, resulting in waiting times at the store.

[1847] 2. Analyzing the information from cleaning tags is complicated, and there is a lack of technology to process it efficiently.

[1848] 3. The payment process is tedious, especially when making payments from remote locations.

[1849] It is necessary to solve these issues and improve the user experience.

[1850] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1851] In this invention, the server includes: means for the user to operate the terminal to select the type of clothes; means for photographing the cleaning tag with a camera and generating image data of the photograph; means for sending the generated image data to the server; means for the server to analyze the image data received and select an appropriate cleaning method; means for automatically calculating a fee based on the selected cleaning method; electronic payment system means for the terminal to display the calculated fee and for the user to make payment; means for the user to pack the clothes into a laundry bag and drop it in a laundry bag deposit box; means for the server to send a notification to the user after the cleaning is completed; means for the user to receive the notification and collect the cleaned clothes in an unmanned delivery box; means for the user to complete a cleaning request in advance using a smartphone; means for photographing the cleaning tag with a smartphone camera and using a generative AI model to analyze the image data; means for inputting a prompt text into the generative AI model and analyzing tag information from the image data; means for sending the prompt text to the generative AI model to obtain an analysis result; means for selecting an optimal cleaning method based on the analysis result and notifying the smartphone; and means for making payment remotely from the smartphone using the electronic payment system. This allows users to complete cleaning requests in advance using their smartphones from home, making it quick and easy to make cleaning requests.

[1852] A "terminal" is an electronic device that is operated by a user, and includes tablet terminals, smartphones, and the like.

[1853] A "server" is a central processing unit that analyzes image data and calculates fees, and is a computing device that incorporates artificial intelligence (AI).

[1854] The "camera" is an image capture device for photographing the cleaning tag, and is built into the terminal or smartphone.

[1855] A "cleaning tag" is an information tag attached to clothing that lists material information and cleaning instructions.

[1856] A "generative AI model" is an algorithm that uses generative AI to analyze image data and extract information.

[1857] A "prompt sentence" is text data that is input into a generative AI model and is used to provide instructions for analysis.

[1858] An "electronic payment system" is a system that allows users to make payments using credit cards or electronic money, and is integrated into terminals and smartphones.

[1859] The "deposit box" is an unmanned reception box where users can deposit laundry bags, and it operates in conjunction with terminals and a server.

[1860] An "unmanned delivery box" is a box used by users to receive their cleaned clothes after cleaning is completed.

[1861] The present invention provides a system that allows users to use an unmanned laundry reception system via a smartphone. The configuration and operation procedure of the system are described in detail below.

[1862] System configuration

[1863] 1. Device:

[1864] The electronic device is operated by a user, and in this embodiment, it is a smartphone. The smartphone is equipped with a touch screen and displays an interface for the user to select the type of clothing. The smartphone also has a built-in camera that can take a picture of the cleaning tag.

[1865] 2. Server:

[1866] It is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with a generative AI model that analyzes the information extracted from the cleaning tag and selects the appropriate cleaning method.

[1867] 3. Camera:

[1868] An image capture device built into a smartphone that is used to photograph cleaning tags.

[1869] 4. Electronic payment systems:

[1870] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into smartphones, allowing users to check the displayed charges and make payments.

[1871] 5. Deposit Box:

[1872] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[1873] 6. Unmanned delivery box:

[1874] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[1875] Program structure and processing

[1876] When a user operates a smartphone app to use the 24-hour unmanned cleaning reception system, the following process takes place:

[1877] 1. User operations

[1878] Users select the type of clothing they want to have cleaned using the smartphone app, which will display options such as "suit jacket" or "shirt."

[1879] 2. Photographing the cleaning tag

[1880] The user takes a photo of the cleaning tag using the smartphone camera, and image data of the tag is generated and sent from the smartphone to the server.

[1881] 3. Use of generative AI models

[1882] The server analyzes the received image data and inputs a prompt to the generative AI model to analyze the tag information. For example, the prompt "Analyze the following image and extract the cleaning tag information: uploads / tag_image.jpg" is sent to the generative AI model.

[1883] 4. Calculation and Notification

[1884] The server selects the optimal cleaning method based on the analysis results obtained from the generative AI model and calculates the fee. The calculated fee information is sent to the user's smartphone, where the user can check the displayed fee and pay via the electronic payment system.

[1885] 5. Posting and receiving laundry bags

[1886] Once payment is complete, the user places the clothes in a laundry bag and places it in the drop box. Once the cleaning is complete, the server notifies the user, and the user can pick up the cleaned clothes in the unmanned delivery box.

[1887] Specific examples

[1888] For example, suppose a user requests dry cleaning of a "suit jacket," takes a photo of the cleaning tag with their smartphone camera, and sends the image data to the server. The server analyzes the tag information of the "suit jacket" using a generative AI model and determines that "dry cleaning" is the best option. The server then presents the calculated fee, and the user completes payment using the smartphone's electronic payment system and places the laundry bag in the drop box. Once the cleaning is complete, the server sends a notification, and the user can collect the cleaned jacket from the unmanned delivery box.

[1889] As described above, the system of the present invention allows users to have their clothes cleaned 24 hours a day, reducing labor costs and mistakes on the store side.

[1890] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1891] Step 1:

[1892] A user launches the smartphone app and selects a type of clothing. Options such as "suit jacket" and "shirt" appear on the smartphone's touchscreen. The smartphone sends the user's selection as input data to the server. The server receives this input data and records it for use in the next processing step.

[1893] Step 2:

[1894] The user takes a photo of the cleaning tag using the smartphone camera. They press a button on the touch screen to activate the camera and take a photo of the cleaning tag, which generates image data. The smartphone then sends this image data to the server as input data. The server stores the received image data and proceeds to the next processing step.

[1895] Step 3:

[1896] The server inputs the received image data into the generative AI model and analyzes the cleaning tag information. Specifically, the server generates a prompt message saying, "Analyze the following image and extract the cleaning tag information: uploads / tag_image.jpg," and sends it to the generative AI model. Following this prompt, the generative AI model analyzes the tag information and extracts information about the clothing's material and the optimal cleaning method. The extracted information is recorded on the server and the process proceeds to the next step.

[1897] Step 4:

[1898] The server selects the optimal cleaning method based on the analysis results obtained from the generative AI model and calculates the fee based on that method. The server automatically calculates the fee using the selected cleaning method and a pre-set fee calculation algorithm. This calculation result is sent to the smartphone. The fee information notified to the smartphone is displayed and the user proceeds to the next step.

[1899] Step 5:

[1900] The user checks the displayed price and makes the payment using the smartphone's electronic payment system. Credit card information and electronic money information are required as input data. The smartphone sends the payment information, which is then processed by the electronic payment system. Once the payment is complete, a confirmation notice is sent to the server, which then confirms and records the payment completion.

[1901] Step 6:

[1902] After payment is confirmed, the user places the clothes in a laundry bag and deposits it in the designated deposit box. The user follows the instructions received from their smartphone to prepare the laundry bag in advance and deposit it in the deposit box. This deposit information is sent to the server via an RFID tag or other means, and the server continues to monitor the status of the deposit box.

[1903] Step 7:

[1904] When the cleaning is complete, the server sends a notification to the user. The notification is sent to a smartphone informing the user that the cleaned clothes are ready in the unmanned delivery box. The user receives the notification on their smartphone and heads to the unmanned delivery box.

[1905] Step 8:

[1906] The user receives their cleaned clothes in an unmanned delivery box. The box is unlocked by scanning a QR code displayed on their smartphone. Once the user scans the QR code, the information is sent to the server, which records a confirmation of receipt. This completes the entire process.

[1907] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1908] The following system is proposed as an embodiment of the present invention. This system allows a user to request cleaning by operating an unmanned reception terminal, and can improve the quality of service by analyzing the user's emotions in combination with an emotion engine.

[1909] System configuration

[1910] 1. Device:

[1911] An electronic device operated by a user, such as a tablet or kiosk terminal, is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal also has a camera that can capture images of the cleaning tag and the user's facial expression.

[1912] 2. Server:

[1913] This is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with artificial intelligence (AI) that analyzes information extracted from cleaning tags and selects the appropriate cleaning method. An emotion engine is also built into the server, which analyzes user emotions.

[1914] 3. Camera:

[1915] An image capture device used to capture the cleaning tag and the user's facial expression, built into the terminal.

[1916] 4. Electronic payment systems:

[1917] It is a system that allows users to make payments using credit cards or electronic money. It is integrated into the terminal, and users can check the displayed fee and make the payment.

[1918] 5. Laundry Bag:

[1919] This is a bag that users can bring and use to store their clothes when they have them dry cleaned.

[1920] 6. Deposit Box:

[1921] This is an unmanned reception box where users can drop off laundry bags, and it works in conjunction with a terminal. When a laundry bag is dropped off, information is sent to the server using an RFID tag or other means.

[1922] 7. Unmanned delivery box:

[1923] This is a box that users can use to collect their cleaned clothes after cleaning is complete. It receives notifications from the server and can be handled unattended.

[1924] 8. Emotion Engine:

[1925] This technology analyzes the user's facial expressions and predicts their current emotions. The emotion engine uses facial expression data captured by the camera while the user is operating the device.

[1926] Program processing flow

[1927] User selection of clothing type

[1928] The user selects the type of clothing they wish to have cleaned (for example, a "suit jacket" or a "shirt") from a list displayed on the screen of the unmanned reception terminal. This allows the user to input the necessary information into the terminal.

[1929] The terminal receives user input and transmits the data to the server.

[1930] The server stores the received data and sets up the next step.

[1931] Photographing and analyzing cleaning tags

[1932] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[1933] The terminal transmits the generated image data to the server.

[1934] The server receives the image data and analyzes the tag information using artificial intelligence (AI). As a result of the analysis, information about the clothing's material and cleaning method can be extracted.

[1935] Selecting a cleaning method and calculating fees

[1936] Based on the analyzed information, the server uses AI to select the optimal cleaning method, which can include washing with water or dry cleaning.

[1937] The server automatically calculates the fee based on the selected cleaning method, and the calculated fee information is sent to the terminal.

[1938] The terminal displays the fee information to the user and prompts them to proceed with the payment procedure.

[1939] Payment via electronic payment systems

[1940] The user checks the displayed fee and pays using a credit card or electronic money.

[1941] The terminal transmits the payment information to the electronic payment system and waits for the transaction to complete.

[1942] The server receives confirmation of successful payment and sends instructions to the terminal on the next steps.

[1943] Preparing and posting laundry bags

[1944] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[1945] The user places the prepared laundry bag in the deposit box.

[1946] The terminal notifies the server that the laundry bag has been placed in the deposit box.

[1947] The server receives and records confirmation of the laundry bag posting.

[1948] Analyzing user emotions with an emotion engine

[1949] When a user operates the device, the device's camera captures the user's facial expression.

[1950] The terminal transmits the user's facial expression data to the emotion engine.

[1951] The server's emotion engine analyzes the received facial expression data and infers the user's emotions. For example, if the user is feeling irritated or dissatisfied, it provides feedback to improve the service based on that information.

[1952] After cleaning is complete

[1953] The server will then send a notification to the user once the cleaning is complete, including the location and details of the unmanned delivery box where the item can be picked up.

[1954] The user receives a notification, goes to the designated unmanned delivery box, scans the QR code, and collects the cleaned clothes.

[1955] The device confirms the QR code scan and notifies the server of the information.

[1956] The server records a confirmation of receipt and completes the process.

[1957] Specific examples

[1958] Example 1:

[1959] User A operates the unmanned reception terminal to have his suit jacket cleaned. After showing the cleaning tag to the camera, the fee of 1,500 yen is displayed. After completing the payment, he places the suit jacket in a laundry bag and places it in the deposit box. When the cleaning work is complete, he receives a notification from the server and collects the cleaned suit jacket from the unmanned delivery box.

[1960] Example 2:

[1961] While User B is having his shirt cleaned, he displays facial expressions that indicate dissatisfaction while operating the device. The emotion engine analyzes this and displays feedback on the device. The concierge service is also automatically called to provide support to resolve User B's dissatisfaction.

[1962] As described above, the system of the present invention provides users with the convenience of being able to use the dry cleaner 24 hours a day, improves the user experience through its emotion engine, and contributes to reducing labor costs and errors on the store side.

[1963] The processing flow will be explained below.

[1964] Step 1:

[1965] The user taps to select the type of clothing they wish to have cleaned (for example, "suit jacket" or "shirt") from the list displayed on the screen of the unmanned reception terminal.

[1966] Step 2:

[1967] The terminal receives the user's input and transmits the selected data to the server.

[1968] Step 3:

[1969] The server stores the received data, sets the next step, and transmits that information to the terminal.

[1970] Step 4:

[1971] The user shows the cleaning tag to the device camera, which takes a picture of the tag and generates image data.

[1972] Step 5:

[1973] The terminal transmits the generated image data to the server.

[1974] Step 6:

[1975] The server uses artificial intelligence (AI) to analyze the received image data, analysing the tag information and extracting information about the garment's material and washing instructions.

[1976] Step 7:

[1977] Based on the analysis, the server uses AI to select the most appropriate cleaning method, for example, dry cleaning for a wool suit jacket.

[1978] Step 8:

[1979] The server automatically calculates the fee based on the selected cleaning method and sends the calculation result to the terminal.

[1980] Step 9:

[1981] The terminal displays the fee information to the user and prompts the user to select a payment method.

[1982] Step 10:

[1983] The user checks the displayed price and enters payment information using a credit card or electronic money.

[1984] Step 11:

[1985] The terminal sends the payment information to the electronic payment system, waits for the transaction to complete, and once it receives confirmation that the payment is complete, sends the information to the server.

[1986] Step 12:

[1987] The server receives a confirmation of the payment and sends instructions for the next step to the terminal.

[1988] Step 13:

[1989] Users follow the instructions on the screen and pack their clothes into the laundry bag they brought with them.

[1990] Step 14:

[1991] The user places the filled laundry bag in the storage box and holds the QR code displayed on the terminal over the scanner in the storage box.

[1992] Step 15:

[1993] The terminal confirms that the laundry bag has been placed in the storage box and notifies the server of this information.

[1994] Step 16:

[1995] The server records confirmation that the laundry bag has been placed in the deposit box.

[1996] Step 17:

[1997] The dry cleaner's staff or an automated system will retrieve the laundry bag from the deposit box and begin the cleaning process.

[1998] Step 18:

[1999] When a user operates the device, the device's camera captures the user's facial expression.

[2000] Step 19:

[2001] The terminal transmits the user's facial expression data to the emotion engine.

[2002] Step 20:

[2003] The server's emotion engine analyzes the received facial expression data and infers the user's emotions. For example, if the user is feeling irritated or dissatisfied, it adjusts the service accordingly.

[2004] Step 21:

[2005] Based on the user's emotional data, the server displays feedback on the terminal as needed or automatically calls a concierge service.

[2006] Step 22:

[2007] After the cleaning is complete, the server sends a notification to the user, which includes the location and details of the unmanned delivery box where the item can be picked up.

[2008] Step 23:

[2009] The user receives a notification and heads to the designated unmanned delivery box, where they scan the QR code with the scanner to receive their cleaned clothes.

[2010] Step 24:

[2011] The device confirms the QR code scan and notifies the server of the information.

[2012] Step 25:

[2013] The server records a confirmation of receipt and completes the whole process.

[2014] Example 2

[2015] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2016] Conventional cleaning reception systems require users to visit the store in person, which is inconvenient and makes it difficult to improve services based on user preferences. Furthermore, manually selecting cleaning methods and calculating fees takes time and can lead to errors. Furthermore, delays in payment confirmation can make it difficult to provide a smooth service.

[2017] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing received image data using artificial intelligence and selecting an appropriate cleaning method, means for automatically calculating fees, and means for analyzing user facial expression data using an emotion engine and generating feedback. This allows users to request unattended cleaning 24 hours a day, receives prompt and accurate presentations of cleaning methods and fees, and enables service improvements based on the user's emotions.

[2018] A "user" is a person who uses the system to request laundry.

[2019] A "terminal" is an electronic device operated by a user, and refers to devices such as tablet terminals and kiosk terminals.

[2020] The "camera" is an image capture device built into the terminal for capturing images of the cleaning tag and the user's facial expression.

[2021] "Image data" refers to an image of the cleaning tag taken by a camera and sent to a server for analysis.

[2022] A "server" is a central processing unit that performs a series of processes such as analyzing image data, calculating fees, sending notifications, and analyzing emotions.

[2023] "Artificial intelligence (AI)" is a technology used to analyze image data and select appropriate cleaning methods.

[2024] The "means for automatically calculating fees" is a function in which the server calculates fees based on the cleaning method and presents the calculated fees to the user.

[2025] An "electronic payment system" is a mechanism that allows users to make payments using credit cards or electronic money, and operates in conjunction with a terminal.

[2026] A "laundry bag" is a bag in which a user stores clothes for dry cleaning.

[2027] The "deposit box" is an unmanned reception box where users can deposit their laundry bags, and it is a box that transmits information to a server using an RFID tag or the like.

[2028] An "unmanned delivery box" is a box used by users to receive their cleaned clothes after cleaning is completed.

[2029] An "emotion engine" is a technology that analyzes a user's facial expressions and infers their current emotions.

[2030] As an embodiment of the present invention, a system is provided in which a user requests cleaning by operating an unmanned reception terminal. This system can improve the quality of service by analyzing the user's emotions in combination with an emotion engine.

[2031] System configuration

[2032] 1. Device:

[2033] The terminal is an electronic device operated by the user, such as a tablet or kiosk. The terminal is equipped with a touch screen and displays an interface for the user to select the type of clothing. The terminal is also equipped with a camera that can capture images of the cleaning tag and the user's facial expression.

[2034] 2. Server:

[2035] The server is a central processing unit that processes image data analysis, fee calculations, etc. The server is equipped with artificial intelligence (AI) that analyzes the information extracted from the cleaning tags and selects the appropriate cleaning method. An emotion engine is also built into the server, which analyzes the user's emotions.

[2036] 3. Camera:

[2037] The camera is an image capture device used to capture images of the cleaning tag and the user's facial expression, and is built into the terminal.

[2038] 4. Electronic payment systems:

[2039] An electronic payment system is a system that allows users to make payments using credit cards or electronic money. It is integrated into a terminal, allowing users to check the displayed price and make the payment.

[2040] 5. Laundry Bag:

[2041] A laundry bag is a bag in which a user stores clothes for dry cleaning, and is brought and used by the user himself.

[2042] 6. Deposit Box:

[2043] The deposit box is an unmanned reception box where users can deposit laundry bags, and it works in conjunction with a terminal. When a laundry bag is deposited, information about it is sent to a server using an RFID tag or other means.

[2044] 7. Unmanned delivery box:

[2045] The unmanned delivery box is a box that users can use to receive their cleaned clothes after their cleaning is complete. It receives a notification from the server and can be handled unmanned.

[2046] 8. Emotion Engine:

[2047] The emotion engine is a technology that analyzes the user's facial expressions and infers their current emotions. The emotion engine uses facial expression data captured by the camera while the user is operating the device.

[2048] Specific examples

[2049] Example 1:

[2050] User A operates the unmanned reception terminal to have his suit jacket cleaned. After selecting "suit jacket" on the screen, he shows the cleaning tag to the camera. The image data captured by the terminal is sent to the server, and AI analyzes the tag information. The fee of 1,500 yen is displayed, and User A completes the payment with a credit card. He places the suit jacket in a laundry bag and places it in a deposit box, and is notified when cleaning is complete. He then scans the QR code at the designated unmanned delivery box to complete collection.

[2051] Example 2:

[2052] User B operates the device to have his shirt cleaned. Following the device's instructions, he selects the shirt and shows the cleaning tag to the camera. The price is displayed, but during the operation, he shows a facial expression that indicates dissatisfaction. The emotion engine analyzes this facial expression, detects signs of dissatisfaction, and displays feedback on the device. Furthermore, a concierge service is automatically called to help User B resolve his dissatisfaction.

[2053] Prompt Sentence Examples

[2054] Prompt: "Please describe in detail the entire process steps a user would take to operate the device and use the cleaning service. Include specific actions and sentiment analysis steps."

[2055] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2056] Step 1:

[2057] The user selects the type of clothing they wish to have cleaned from a list displayed on the screen of the unmanned reception terminal. For example, they can select "suit jacket" or "shirt." This becomes the input data. The terminal receives this selection data and sends it to the server. The server analyzes the received data and sets the next step.

[2058] Step 2:

[2059] The user shows the cleaning tag to the device's camera. The device's camera takes a picture of the cleaning tag and generates high-resolution image data. This becomes the next input data. The device then sends the generated image data to the server. The server receives this image data and performs image analysis using artificial intelligence (AI). Through image analysis, information such as the clothing material and cleaning method is extracted from the cleaning tag.

[2060] Step 3:

[2061] The server uses AI to select the optimal cleaning method based on the analyzed tag information. This selection includes whether to wash or dry clean. This is the input information. The server then automatically calculates the fee based on the cleaning method. The calculated fee information is output and sent to the terminal.

[2062] Step 4:

[2063] The terminal displays the fee information to the user and guides them through the payment procedure. The user checks the displayed fee and pays using a credit card or electronic money. This becomes new input data. The terminal sends this payment information to the electronic payment system and waits for payment completion. The server receives confirmation of payment completion from the electronic payment system.

[2064] Step 5:

[2065] The terminal notifies the user that payment has been completed and instructs them on how to pack the clothes into the laundry bag. The user then packs the clothes into the laundry bag they brought with them and places it in the laundry bag deposit box. This is the next input. The deposited laundry bag is confirmed by the deposit box's sensors and RFID tag, and the information is sent to the server. The server receives this information and records confirmation of the bag being deposited.

[2066] Step 6:

[2067] While the user is operating the device, the device's camera continues to capture the user's facial expressions. The camera captures facial expression data, which becomes the next input data. The device then sends this data to the emotion engine. The server's emotion engine analyzes this facial expression data and infers the user's emotions. For example, if the user expresses dissatisfaction, the engine generates feedback for improving the service based on the results and sends it to the device.

[2068] Step 7:

[2069] Once the cleaning is complete, the server sends a notification to the user. This notification includes the location and details of the unmanned delivery box where the clothes can be picked up. This is the input data. The user receives the notification and goes to the designated unmanned delivery box. They scan the QR code at the delivery box and pick up the cleaned clothes. This information is the final output data. The device confirms the QR code scan and notifies the server of this information. The server records the confirmation of receipt and completes the process.

[2070] (Application example 2)

[2071] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2072] In modern society, while speed and accuracy are required for cleaning services, improving the user experience is also important. However, conventional cleaning services often make users wait for long periods of time in crowded stores and often result in dissatisfaction with the quality of service. Furthermore, the lack of a system to properly understand user emotions and respond in real time can lead to a decline in service quality.

[2073] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2074] In this invention, the server includes: means for a user to operate a terminal to select the type of clothing; means for photographing the identification tag with a camera and generating image data thereof; means for transmitting the generated image data to the server; means for the server to analyze the received image data and select an appropriate processing method; means for automatically calculati...

Claims

1. A means for the user to operate the terminal to select a type of clothing; a means for taking an image of the cleaning tag with a camera and generating image data thereof; means for transmitting the generated image data to a server; A means for analyzing the image data received by the server and selecting an appropriate cleaning method; means for automatically calculating a fee based on the cleaning method selected; an electronic payment system means by which the terminal displays the calculated fee and the user makes the payment; A method for users to put clothes in a laundry bag and drop it off in a laundry box; a means for the server to notify the user after cleaning is complete; The system includes a means for users to receive notifications and receive their cleaned clothes in an unmanned delivery box.

2. 10. The system of claim 1, wherein the server uses artificial intelligence to analyze the image data.

3. 2. The system of claim 1, further comprising means for transmitting payment information to an electronic payment system and confirming completion of the payment.

Images