System

Abstract

A system is provided.SOLUTION: A system comprising: means for a user to register information about an article; means for identifying the registered article information; means for storing the article information in a database; artificial intelligence means for automatically matching the information; means for notifying the user of the matching result; means for managing delivery of the notified article; and means for distributing a reward after delivery of the article.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] This invention aims to improve the rate at which lost items are returned to their owners and reduce waste by providing a system that allows people who have lost or found items to quickly and easily register and search for information. In particular, it aims to address the problem of items other than money, valuables, and cards being disposed of without being returned to their owners, and to realize an efficient item return process that eliminates the hassle of reporting and searching. [Means for solving the problem]

[0005] In order to solve the above-mentioned problems, the present invention provides the following means. It provides a means for users to register information about items, including a means for storing the registered item information in a database. It also includes a means for collating item information using artificial intelligence means for automatically matching information, and notifying the user of the matching results. It also provides a system that includes a means for managing the delivery of notified items and a means for distributing rewards after delivery. This allows items to be quickly returned to their owners, and the finder is given an appropriate reward, improving overall efficiency.

[0006] "User" refers to an individual or corporation that uses the system and is the entity that registers or searches for information about an item.

[0007] "Item" means any item or property that a User registers as found or lost.

[0008] "Information" refers to data including the type, color, characteristics, location, date and time of the item, and other relevant details.

[0009] "Database" refers to a storage device for storing and managing registered product information.

[0010] "Artificial intelligence means" refers to machine learning models and algorithms for analyzing and matching product information stored in a database.

[0011] "Matching" refers to the process of comparing information about found and lost items to determine whether they match.

[0012] "Notification" refers to the means of communication that conveys match results and other related information to users.

[0013] "Release" refers to the process of returning a matched item to its owner, including the physical movement of the item.

[0014] "Reward" refers to the money or points that the owner pays to the finder after the item is handed over.

[0015] "System" refers to the entire entity that includes all of the above elements and provides consistent services to users. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] This invention is a system that allows people who have lost or found an item to easily register and search for information about the item using their smartphone, and through AI matching, the lost item can be quickly and reliably returned to its owner. Below, we will explain each element of the system and how it works.

[0038] System configuration

[0039] This system mainly consists of the following elements:

[0040] 1. User device: A smartphone or tablet with the LINE application installed.

[0041] 2. Server: A remote server that hosts the database and artificial intelligence means.

[0042] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[0043] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[0044] Program processing description

[0045] User Registration

[0046] User: Open the LINE application on first launch and enter your profile information.

[0047] Device: Sends profile information to the server.

[0048] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[0049] Registering lost items

[0050] User: Enter details of the lost item, such as the type, characteristics, location, date and time of the item, into the LINE app.

[0051] Terminal: Sends the entered information to the server.

[0052] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[0053] Registering lost items

[0054] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[0055] Terminal: Sends the entered information to the server.

[0056] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[0057] Search process

[0058] User: If the lost item cannot be found, use the LINE app's search function to search for lost items that match the criteria.

[0059] Terminal: Sends search criteria to the server.

[0060] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[0061] Matching process

[0062] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[0063] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[0064] Server: Manages matching results and notifies the owner and finder.

[0065] Delivery of goods

[0066] User (owner): Make arrangements to collect the item at the notified storage location.

[0067] User: After picking up the item, report "Pickup completed" via the LINE app.

[0068] Terminal: Sends information about the completion of collection to the server.

[0069] Server: Updates the database with the pickup completion information.

[0070] Rewards and points

[0071] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[0072] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank you PayPay points."

[0073] User (findr): Receives notification and checks "Thank you PayPay points."

[0074] Specific examples

[0075] For example, suppose user A loses their wallet in a park. A opens the LINE app and registers the wallet's characteristics (color, size, distinctive markings, etc.). Meanwhile, user B finds the wallet and similarly registers the characteristic information via the LINE app. The server stores this information in a database, and the AI ​​matches them. Once a match is confirmed, A and B are notified of the details of the storage location, and A follows the notification to pick up the wallet at the park management office. After that, when A reports that he has picked up the wallet, the reward procedure is carried out, and B is awarded "Thank you PayPay points."

[0076] In this way, the system helps return lost items to their owners efficiently, reducing waste. Furthermore, the entire process can be completed via the user's smartphone, making it highly convenient.

[0077] The processing flow will be explained below.

[0078] Step 1:

[0079] A user installs the LINE app and enters their profile information (name, email address, phone number, etc.) when using it for the first time.

[0080] Step 2:

[0081] The terminal formats the entered profile information and transmits it to the server.

[0082] Step 3:

[0083] The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[0084] Step 4:

[0085] The user opens the LINE app and enters details such as the type of lost item, its characteristics, where it was found, and the date and time.

[0086] Step 5:

[0087] The terminal transmits the entered found item information to the server.

[0088] Step 6:

[0089] The server stores the received information about the lost item in a database and returns a confirmation message to the terminal.

[0090] Step 7:

[0091] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[0092] Step 8:

[0093] The terminal transmits the input lost item information to the server.

[0094] Step 9:

[0095] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[0096] Step 10:

[0097] Users can use the LINE app's search function to search for lost items that meet their criteria.

[0098] Step 11:

[0099] The terminal transmits the search conditions to the server.

[0100] Step 12:

[0101] The server searches the database for lost item information and returns results that match the conditions to the terminal.

[0102] Step 13:

[0103] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[0104] Step 14:

[0105] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[0106] Step 15:

[0107] The server manages the matching results and notifies the owner and finder.

[0108] Step 16:

[0109] The user (owner) will complete the procedures to collect the item at the notified storage location.

[0110] Step 17:

[0111] The user (owner) reports the completion of collection via the LINE app.

[0112] Step 18:

[0113] The terminal transmits information indicating that the collection has been completed to the server.

[0114] Step 19:

[0115] The server updates the database with the information about the completion of collection.

[0116] Step 20:

[0117] The server confirms the information on the completion of collection and carries out the procedure to collect a predetermined reward from the owner.

[0118] Step 21:

[0119] The server manages the collected rewards on the system and gives a portion of them to the finder as "Thank you PayPay points."

[0120] Step 22:

[0121] The user (findr) receives a notification and checks the "Thank you PayPay points."

[0122] Example 1

[0123] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0124] Conventional lost property management systems have problems with complex and time-consuming tasks such as identifying the location and date of an item, sharing information between the owner and finder, handling the item handover procedure, and distributing rewards. Furthermore, because they rely on manual matching, the speed at which items are returned to their owners is slow and unreliable. This invention aims to solve these problems, streamline the process of finding and returning items, and ensure that items are returned to their owners quickly and reliably.

[0125] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0126] In this invention, the server includes a means for using a communication application that users use when registering or searching for items, a means for updating the database with information about the completion of collection, and a means for awarding points as a reward. This allows users to easily register and search for item information, and enables rapid matching using artificial intelligence. In addition, by immediately updating the database with information about the completion of item collection and awarding points as a reward, a system that is highly convenient for both the owner and the finder can be realized.

[0127] "User" means an individual or organization that uses this system to register, search, and match information about items.

[0128] "Item" refers to any lost or found object registered by a User.

[0129] "Information" refers to detailed data about an item (type, characteristics, location, date and time, etc.).

[0130] "Registering" refers to the act of a user entering information about an item and storing it in a database.

[0131] "Identification" refers to the process of identifying and recognizing registered product information.

[0132] "Database" refers to a relational database system (RDBMS) for storing and managing registered product information.

[0133] "Artificial intelligence" refers to machine learning algorithms and models that match items based on information.

[0134] "Matching" refers to the process of analyzing found and lost item information to identify likely matches.

[0135] "Notification" refers to the act of informing users of information such as the item matching results, collection procedures, and rewards.

[0136] "Release" refers to the procedure of returning the notified item to the owner at the storage location.

[0137] "Reward" refers to the money or points collected by the system from the owner after the item is handed over and distributed to the finder.

[0138] "Communication Application" refers to a platform that allows users to register and search for items.

[0139] "Points" refers to a digital reward system that is awarded to finders as a reward.

[0140] This invention is a system that allows people who have lost or found an item to easily register and search for information about the item using their smartphone, and through AI matching, the lost item can be quickly and reliably returned to its owner. Below, we will explain each element of this system and how it works.

[0141] System configuration

[0142] This system mainly consists of the following elements:

[0143] 1. User device: A smartphone or tablet with a communication application installed.

[0144] 2. Server: A remote server that hosts the database and artificial intelligence means.

[0145] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[0146] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[0147] Operating Procedure

[0148] User Registration

[0149] A user launches a communications application for the first time and enters profile information such as name, email address, and phone number.

[0150] The terminal transmits the input profile information to the server.

[0151] The server stores the received profile information in a database, generates a user ID, and returns it to the terminal.

[0152] Registering lost items

[0153] The user enters details of the found item, such as the type, characteristics, location, date and time of the found item, into a communication application.

[0154] The terminal transmits the input information to the server.

[0155] The server stores the received lost item information in a database and returns a confirmation message to the terminal.

[0156] Registering lost items

[0157] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[0158] The terminal transmits the input information to the server.

[0159] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[0160] Search process

[0161] The user uses the search function of the communication application to search for lost items that meet the criteria.

[0162] The terminal transmits the search conditions to the server.

[0163] The server searches the database for lost item information and returns results that match the criteria to the terminal.

[0164] Matching process

[0165] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[0166] The artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[0167] The server manages the matching results and notifies the owner and finder.

[0168] Delivery of goods

[0169] The user (owner) will take steps to collect the item at the notified storage location.

[0170] After picking up the item, the user reports "pickup completed" using the communication application.

[0171] The terminal transmits information indicating that the collection has been completed to the server.

[0172] The server updates the database with the information about the completion of collection.

[0173] Rewards and points

[0174] The server confirms the information about the completed collection and performs procedures to collect the pre-set reward from the owner, for example, by using a digital payment system.

[0175] The server manages the collected rewards on the system and gives a portion of them to the finder as digital points.

[0176] The user (finder) receives a notification of the points awarded via a communication application and confirms that the digital points have been reflected.

[0177] Specific examples

[0178] For example, if user A drops his wallet in a park, he uses a communication application to register its characteristics as a "black leather wallet." Meanwhile, user B finds the wallet and similarly registers the characteristics information via the communication application.

[0179] The server stores this information in a database, and an artificial intelligence tool matches the information. Once a match is confirmed, A and B are notified of the details of the storage location, and A picks up the wallet at the storage location. After that, when A reports that he has picked up the wallet, the reward procedure is carried out and B is awarded digital points.

[0180] Prompt Sentence Examples

[0181] Below is an example of a prompt sentence to input to the generative AI model.

[0182] Describe a system that allows a user to input characteristics of a lost item (such as color, size, distinctive markings, etc.) and returns information about similar lost items.

[0183] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0184] Processing flow

[0185] Step 1: User Registration

[0186] 1.1 A user launches a communications application for the first time and enters profile information such as name, email address, and phone number.

[0187] Input: User profile information (name, email address, phone number)

[0188] Output: Request to send profile information

[0189] Specific operation: The user opens a communication application (on a smartphone or tablet) and enters information into the designated input fields.

[0190] 1.2 The device sends the entered profile information to the server.

[0191] Input: Profile information entered by the user

[0192] Output: A request containing profile information is sent to the server

[0193] What happens: The application converts the profile information into JSON format and generates a request to send to the server over SSL / TLS.

[0194] 1.3 The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[0195] Input: Submitted profile information

[0196] Output: Profile information stored in the database and generated user ID.

[0197] Specific operation: The server checks the uniqueness of the profile information, stores it in the database, and then generates and returns a new user ID.

[0198] Step 2: Register your lost item

[0199] 2.1 The user enters details of the found item, such as type, characteristics, location, date and time into the communication application.

[0200] Input: Details of the lost item (type, characteristics, location of the item, date and time)

[0201] Output: A request containing the lost item information

[0202] Specific operation: A user opens a lost item registration screen in a communications application and enters details into several input fields.

[0203] 2.2 The terminal sends the entered information to the server.

[0204] Input: User-entered details of the found item

[0205] Output: A request containing the found item information is sent to the server.

[0206] Specific behavior: Converts the found item information into JSON format and generates a request to send to the server.

[0207] 2.3 The server stores the received lost item information in a database and returns a confirmation message to the terminal.

[0208] Input: Details of the lost item submitted

[0209] Output: Information stored in the database and a confirmation message

[0210] Specific operation: The server checks the format of the information, saves it in the database, and then returns a confirmation message to the terminal.

[0211] Step 3: Register your lost item

[0212] 3.1 The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the communication application.

[0213] Input: Details of lost item (type, characteristics, location, date and time)

[0214] Output: A request containing lost items

[0215] Specific behavior: The user opens the lost item registration screen of a communication application and enters details into several input fields.

[0216] 3.2 The terminal sends the entered information to the server.

[0217] Input: User-entered details of the lost item

[0218] Output: A request containing the lost item information is sent to the server.

[0219] Specific operation: Converts the lost item information into JSON format and generates a request to send to the server.

[0220] 3.3 The server stores the information of the lost item in a database and returns a confirmation message to the device.

[0221] Input: Details of the lost item submitted

[0222] Output: Information stored in the database and a confirmation message

[0223] Specific operation: The server checks the format of the information, saves it in the database, and then returns a confirmation message to the terminal.

[0224] Step 4: Search process

[0225] 4.1 The user uses the search function of the communication application to search for lost items that meet the criteria.

[0226] Input: Search criteria for the item you are looking for (type, characteristics, location found, date and time, etc.)

[0227] Output: Request containing search criteria

[0228] Specific operation: The user opens the search screen of a communication application, enters the required information in the search criteria input field, and presses the search button.

[0229] 4.2 The terminal sends the search criteria to the server.

[0230] Input: The search criteria entered by the user

[0231] Output: A request containing search criteria is sent to the server.

[0232] Specific operation: Converts search criteria into JSON format and generates a request to send to the server.

[0233] 4.3 The server searches the database for lost item information and returns results that match the criteria to the terminal.

[0234] Input: Submitted search criteria

[0235] Output: Lost and found items matching the criteria

[0236] What it does: The server searches for lost items in the database and returns matching results in JSON format.

[0237] Step 5: Matching

[0238] 5.1 The server will periodically scan the database and match newly registered lost and found items using artificial intelligence means.

[0239] Input: All item information in the database (lost and found)

[0240] Output: Matching results

[0241] What it does: The server runs a scheduled job to periodically scan the database.

[0242] 5.2 Artificial intelligence means will analyze the registered information and identify combinations that are likely to match.

[0243] Input: Lost and found information retrieved from the database

[0244] Output: likely matching pairs

[0245] Specific operation: Uses machine learning algorithms to perform matching based on features and generate results.

[0246] 5.3 The server manages the matching results and notifies the owner and finder.

[0247] Input: Matching results

[0248] Output: Information message

[0249] Specific operation: Create a notification message based on the matching results and send it to the user.

[0250] Step 6: Handover of goods

[0251] 6.1 The User (Owner) will complete the procedures to collect the item at the notified storage location.

[0252] Input: Subinventory Notification

[0253] Output: Report of pick-up completion

[0254] Specific operations: The user goes to the designated storage location and goes through the necessary procedures, such as verifying their identity.

[0255] 6.2 After the user has collected the item, he / she reports "collection completed" in the communication application.

[0256] Input: Report of completion of collection

[0257] Output: A completion report is sent to the server

[0258] Specific operation: Press the Complete button on the dedicated screen of the application to report that the pickup is complete.

[0259] 6.3 The terminal sends information about the completion of collection to the server.

[0260] Input: Pickup completion report entered by the user

[0261] Output: Pickup completion information is sent to the server

[0262] Specific behavior: The application converts the completion report into JSON format and generates a request to send to the server.

[0263] 6.4 The server updates the database with the information on the completion of collection.

[0264] Input: Pickup completion report

[0265] Output: Pickup completion information updated in the database

[0266] Specific operation: The server reflects the received pickup completion information in the database.

[0267] Step 7: Rewards and Points

[0268] 7.1 The server confirms the collection completion information and proceeds to collect the pre-set reward from the owner.

[0269] Input: Pickup completion information

[0270] Output: Confirmation of collection completion

[0271] Specific operation: The server collects rewards from the owner using a digital payment system.

[0272] 7.2 The server manages the collected rewards on the system and gives a portion of them to the finder as digital points.

[0273] Input: Remuneration collected

[0274] Output: Digital points awarded

[0275] Specific operation: The server converts a certain percentage of the reward into digital points and reflects them in the finder's account.

[0276] 7.3 The user (finder) receives a notification of the points awarded via the communication application and confirms that the digital points have been reflected.

[0277] Input: Point award notification

[0278] Output: Points are reflected in your account.

[0279] Specific behavior: The application displays the awarded points and the user confirms them.

[0280] (Application example 1)

[0281] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0282] In modern society, many people lose items or find other people's items on a daily basis. However, there is a lack of a system to quickly and reliably return these items to their owners. In particular, in places where many people gather or at event venues, information on lost and found items is mixed together, making management difficult. To solve this problem, an efficient system is needed that registers item information in real time, performs matching, and integrates notification and delivery management.

[0283] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0284] In this invention, the server includes means for a user to register information about an item, means for identifying the registered item information, means for storing the item information in a database, artificial intelligence means for automatically matching information, means for notifying the user of the matching result, means for managing the delivery of the notified item, means for distributing a reward after the delivery of the item, means for taking an image of the item with a head-mounted display or eyeglass-type display device and registering information by voice input, and means for notifying the user of the matching processing result in real time by voice or visual display, thereby enabling information about lost or found items to be processed quickly and efficiently and allowing the user to recover the item as soon as possible.

[0285] "User" means any person or legal entity that registers items and searches for and checks lost and found items.

[0286] "Item information" is detailed data about lost or found items, such as their characteristics, type, where they were found, and the date and time they were found.

[0287] A "database" is an information system for storing, managing, and searching product information.

[0288] "Artificial intelligence means" refers to technical means for matching product information using machine learning algorithms or models.

[0289] "Notification means" means a method for communicating information about the matching results or delivery to the user, including audio or visual notifications.

[0290] The "delivery management means" is a system for managing the storage location and delivery procedures of notified items.

[0291] The "reward distribution means" is a means for giving rewards or points to the finder after the item is handed over.

[0292] A "head-mounted display" is a device that is worn on the user's head to display information, such as smart glasses or a head-mounted display (HMD).

[0293] "Image capture means" refers to a device or technique for capturing an image of an item using a camera.

[0294] "Voice input means" refers to means for accepting information input from a user using a microphone or voice recognition technology.

[0295] "Real-time notification means" refers to a method for communicating the results of the matching process to the user without delay by voice or visual display.

[0296] A "generative AI model" is an artificial intelligence technology that analyzes data such as audio and images and generates results that meet specific purposes.

[0297] This invention is a system that allows users to register information about items and quickly and reliably return lost items to their owners. The detailed configuration and operation of this system will be described below.

[0298] System configuration

[0299] The system mainly consists of the following components:

[0300] 1. User terminal: smart glasses (e.g., head-mounted display or eyeglass display).

[0301] 2. Server: A remote server that hosts the database and artificial intelligence tools.

[0302] 3. Database: Relational database system (RDBMS) for managing product information.

[0303] 4. Artificial intelligence tools: Machine learning algorithms and generative AI models that perform the matching process.

[0304] System Operation

[0305] User Registration

[0306] When the user first starts up the smart glasses, they put them on and register their profile information (such as name and contact details) through voice recognition. This information is sent to the server and stored in a database. Based on the user's profile information, the system generates a user ID and returns it to the user's device.

[0307] Registering lost items

[0308] When a user finds a lost item, they take a photo of it with the camera on their smart glasses and register its characteristics (color, size, distinctive marks, etc.) through voice input. The entered information is sent from the device to a server and stored in a database.

[0309] Registering lost items

[0310] Similarly, users who lose an item can register details of the lost item (type, characteristics, location, date and time, etc.) by voice input using the smart glasses. The transmitted information is stored on the server.

[0311] Matching process

[0312] The server periodically scans the database and analyzes newly registered lost and found items using artificial intelligence methods (machine learning algorithms and generative AI models) for automatic matching, identifying pairs with a high probability of matching.

[0313] Notice and Delivery

[0314] When a match is found, the server will send a push notification to the smart glasses and notify the user in real time via audio or visual display. The user can then follow the notification to complete the item delivery procedure. After the item delivery is completed, the server will update the database and report the completion.

[0315] Rewards and points

[0316] After the delivery is complete, the server calculates a pre-set reward and awards rewards and points to the finder, using a generative AI model to analyze the voice data and generate a thank-you prompt for the user.

[0317] Examples of concrete examples and prompts

[0318] For example, if user A loses their wallet at an event:

[0319] User A uses the smart glasses to voice input the following: "I dropped my black wallet near the main stage. It contains a credit card and a 1,000 yen bill."

[0320] User B then picks up the wallet and similarly registers through voice input, "I found a black wallet near the main stage." The server analyzes this information, generates a matching result, and notifies A and B's smart glasses. Upon receiving the notification, A collects the wallet at the storage location, and B receives a reward.

[0321] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0322] Step 1:

[0323] User Registration

[0324] The user puts on the smart glasses and registers their profile information using voice recognition when they first start up the device.

[0325] Input: User's spoken input (name, contact information, etc.).

[0326] Data processing: Speech recognition software converts the voice data into text data.

[0327] Output: Profile information in text format.

[0328] Specific operation: The device sends the collected profile information to the server, which stores it in a database. The server generates a user ID and sends it back to the device.

[0329] Step 2:

[0330] Registering lost items

[0331] The user takes a photo of the item they pick up with the smart glasses' camera and registers its characteristics using voice input.

[0332] Input: Image of the item and voice input (item characteristics, location found, date and time, etc.).

[0333] Data processing: Image analysis software extracts the features of the item, and voice recognition software converts the voice data into text data.

[0334] Output: Textual feature information and object images.

[0335] Specific operation: The terminal sends the image and characteristic information of the item to the server, which stores it in a database.

[0336] Step 3:

[0337] Registering lost items

[0338] Users register details of lost items using voice input using smart glasses.

[0339] Input: Voice input (item characteristics, location of loss, date and time, etc.).

[0340] Data processing: Speech recognition software converts the voice data into text data.

[0341] Output: Textual information about the lost item.

[0342] Specific operation: The device sends feature information to the server, which then stores it in a database.

[0343] Step 4:

[0344] Matching process

[0345] The server periodically scans the database for newly registered lost and found items and matches them using artificial intelligence means.

[0346] Input: Characteristics of lost and found items in the database.

[0347] Data processing: Analyze feature information using machine learning algorithms (generative AI models) to improve matching accuracy.

[0348] Output: Matching results (likely combinations).

[0349] Specific operation: The server runs the generative AI model, generates matching results, and registers them in the database.

[0350] Step 5:

[0351] Notice and Delivery

[0352] The server pushes the matching results to the smart glasses, notifying the user via audio or visual display.

[0353] Input: Matching results.

[0354] Output: Push notification (audio and visual information).

[0355] Specific operation: The server generates notification content and sends it to the device (smart glasses), which then notifies the user of the content via audio or visual means.

[0356] Step 6:

[0357] Post-delivery updates

[0358] After the user hands over the item, the smart glasses send a completion report to the server.

[0359] Input: Completion report.

[0360] Data Processing: Matching entered completion reports with corresponding records in the database.

[0361] Output: Updated database records.

[0362] Specific operation: The terminal sends a completion report to the server, and the server updates the database.

[0363] Step 7:

[0364] Rewards and points

[0365] The server will then carry out the process of awarding rewards and points to the finder based on the data collected after the item has been picked up.

[0366] Input: Delivery completion data.

[0367] Data processing: The reward amount is calculated using a reward calculation algorithm and points are awarded.

[0368] Output: Rewards and points awarded.

[0369] Specific operation: The server processes rewards and points, generates a thank you prompt using a generative AI model, and notifies the user.

[0370] Prompt Sentence Examples

[0371] For example, if user A loses their wallet at an event:

[0372] User A uses the smart glasses to voice input the following: "I dropped my black wallet near the main stage. It contains a credit card and a 1,000 yen bill."

[0373] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0374] This invention is a system that allows users to easily register and search information about items, and by combining artificial intelligence and an emotion engine, it enables lost items to be returned to their owners quickly and reliably. It also improves the user experience by recognizing the user's emotions and personalizing responses based on them.

[0375] System configuration

[0376] This system mainly consists of the following elements:

[0377] 1. User device: A smartphone or tablet with the LINE application and emotion engine installed.

[0378] 2. Server: A remote server that hosts the database, artificial intelligence means, and emotion engine.

[0379] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[0380] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[0381] 5. Emotion Engine: Algorithms and modules for analyzing user emotions and dynamically adjusting the system's response.

[0382] Program processing description

[0383] User Registration

[0384] User: When launching the LINE application for the first time, open it and enter your profile information (name, email address, phone number, etc.).

[0385] Device: Sends profile information to the server.

[0386] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[0387] Registering lost items

[0388] User: Enter details of the lost item, such as the type, characteristics, location, date and time of the item, into the LINE app.

[0389] Terminal: Sends the entered information to the server.

[0390] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[0391] Registering lost items

[0392] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[0393] Terminal: Sends the entered information to the server.

[0394] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[0395] Search process

[0396] User: If the lost item cannot be found, use the LINE app's search function to search for lost items that match the criteria.

[0397] Terminal: Sends search criteria to the server.

[0398] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[0399] Matching process

[0400] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[0401] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[0402] Server: Manages matching results and notifies the owner and finder.

[0403] Emotion Recognition and Response

[0404] User: Provides emotional data such as facial expressions and voice to use the emotion engine when registering and searching for items.

[0405] Terminal: The emotion engine analyzes the emotion data and sends the results to the server.

[0406] Server: Based on the results of the emotion engine, determine the user's emotional state and tailor appropriate responses and notification content.

[0407] Delivery of goods

[0408] User (owner): Make arrangements to collect the item at the notified storage location.

[0409] User: After picking up the item, report "Pickup completed" via the LINE app.

[0410] Terminal: Sends information about the completion of collection to the server.

[0411] Server: Updates the database with the pickup completion information.

[0412] Rewards and points

[0413] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[0414] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank you PayPay points."

[0415] User (findr): Receives notification and checks "Thank you PayPay points."

[0416] Specific examples

[0417] For example, suppose Person A loses their wallet in a park. Person A opens the LINE app and registers the wallet's characteristics (color, size, distinctive markings, etc.). If Person A looks anxious, the emotion engine recognizes this emotion and sends it to the server. The server then sends a kind and comforting message to the LINE app to alleviate Person A's anxiety. Meanwhile, Person B picks up the wallet and similarly registers the wallet's characteristics via the LINE app. The server stores this information in a database, and the AI ​​matches them. Once a match is confirmed, Person A and Person B are notified of the details of where the wallet was stored, and Person A follows the notification to pick up the wallet at the park management office. After that, when Person A reports that they have retrieved it, the reward process begins and Person B is awarded "Thank you PayPay points."

[0418] In this way, the system helps return lost items to their owners quickly and provides appropriate responses depending on the user's emotional state, improving the overall experience.

[0419] The processing flow will be explained below.

[0420] Step 1:

[0421] A user installs the LINE app and enters their profile information (name, email address, phone number, etc.) when using it for the first time.

[0422] Step 2:

[0423] The terminal formats the entered profile information and transmits it to the server.

[0424] Step 3:

[0425] The server stores the received profile information in a database, generates a user ID, and returns it to the terminal.

[0426] Step 4:

[0427] The user opens the LINE app and enters details such as the type of lost item, its characteristics, where it was found, and the date and time.

[0428] Step 5:

[0429] The terminal transmits the entered found item information to the server.

[0430] Step 6:

[0431] The server stores the received information about the lost item in a database and returns a confirmation message to the terminal.

[0432] Step 7:

[0433] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[0434] Step 8:

[0435] The terminal transmits the input lost item information to the server.

[0436] Step 9:

[0437] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[0438] Step 10:

[0439] Users can use the LINE app's search function to search for lost items that meet their criteria.

[0440] Step 11:

[0441] The terminal transmits the search conditions to the server.

[0442] Step 12:

[0443] The server searches the database for lost item information and returns results that match the conditions to the terminal.

[0444] Step 13:

[0445] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[0446] Step 14:

[0447] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[0448] Step 15:

[0449] The server manages the matching results and notifies the owner and finder.

[0450] Step 16:

[0451] Users will be provided with emotional data such as facial expressions and voice in order to use the emotion engine when registering and searching for items.

[0452] Step 17:

[0453] The device acquires emotion data and analyzes it using an emotion engine.

[0454] Step 18:

[0455] The emotion engine analyzes the emotion data and sends the analysis results to the server.

[0456] Step 19:

[0457] The server determines the user's emotional state based on the analysis results of the emotion engine and generates an appropriate response message.

[0458] Step 20:

[0459] The server sends a response message or notification content to the device according to the user's emotional state.

[0460] Step 21:

[0461] The user (owner) will complete the procedures to collect the item at the notified storage location.

[0462] Step 22:

[0463] The user reports completion of pickup via the LINE app.

[0464] Step 23:

[0465] The terminal transmits information indicating that the collection has been completed to the server.

[0466] Step 24:

[0467] The server updates the database with the information about the completion of collection.

[0468] Step 25:

[0469] The server confirms the information on the completion of collection and carries out the procedure to collect a predetermined reward from the owner.

[0470] Step 26:

[0471] The server manages the collected rewards on the system and gives a portion of them to the finder as "Thank you PayPay points."

[0472] Step 27:

[0473] The user (findr) receives a notification and checks the "Thank you PayPay points."

[0474] Example 2

[0475] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0476] Even if a lost item is found, it is difficult to quickly and reliably return it to its owner, and it is also difficult to respond appropriately depending on the user's emotional state. There is a need to solve these problems and improve the user experience.

[0477] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0478] In this invention, the server includes means for a user to register information about an item, means for identifying the registered item information, means for storing the item information in a database, artificial intelligence means for automatically matching information, means for notifying the user of the matching result, means for managing the notified item delivery, means for distributing a reward after the item is delivered, emotion engine means for analyzing the user's emotion data and adjusting the system's response, and means for transmitting emotion recognition data by the emotion engine means to the server. This allows lost items to be returned to their owners quickly and reliably, and enables appropriate responses according to the user's emotional state.

[0479] "User" refers to an individual or legal entity that registers or searches for information about an item.

[0480] "Item" refers to an object that a user has registered or found.

[0481] "Item information" refers to detailed information such as the type of item, its characteristics, the location where it was found, and the date and time it was found.

[0482] "Database" refers to an information storage system for accumulating and managing product information.

[0483] "Artificial intelligence means" refers to machine learning algorithms and models that analyze product information and automatically match it.

[0484] "Matching results" refer to data pairs that are likely to match the product information analyzed by the artificial intelligence means.

[0485] "Emotion engine means" refers to algorithms or modules that analyze user emotional data and adjust the system's response.

[0486] "Emotion recognition data" refers to data that indicates the emotional state of a user extracted from their facial expressions, voice, etc.

[0487] "Delivery means" refers to the system function for managing the procedure for delivering the notified item to the user.

[0488] "Reward distribution means" refers to a system function for distributing rewards after delivery of an item.

[0489] "Communication application" refers to software that users use to register and search for product information.

[0490] This invention is a system that allows users to easily register and search information about items, and by combining artificial intelligence and an emotion engine, it enables lost items to be returned to their owners quickly and reliably. It also improves the user experience by recognizing the user's emotions and personalizing responses based on them.

[0491] System configuration

[0492] This system mainly consists of the following elements:

[0493] 1. User device: A smartphone or tablet with a communication application and emotion engine installed.

[0494] 2. Server: A remote server that hosts the database, artificial intelligence means and emotion engine.

[0495] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[0496] 4. Artificial intelligence tools: Machine learning algorithms and models for analyzing and automatically matching item information.

[0497] 5. Emotion engine means: Algorithms and modules for analyzing user emotion data and adjusting the system's response.

[0498] Program processing description

[0499] User Registration

[0500] User: On first launch, open the communications application and enter your profile information (name, email address, phone number, etc.).

[0501] Device: Sends profile information to the server.

[0502] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[0503] Registering lost items

[0504] User: Enters details of the found item, such as type, description, location, date and time into a communication application.

[0505] Terminal: Sends the entered information to the server.

[0506] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[0507] Registering lost items

[0508] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[0509] Terminal: Sends the entered information to the server.

[0510] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[0511] Search process

[0512] User: If the lost item cannot be found, use the search function of the communication application to search for lost items that match the criteria.

[0513] Terminal: Sends search criteria to the server.

[0514] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[0515] Matching process

[0516] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[0517] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[0518] Server: Manages matching results and notifies the owner and finder.

[0519] Emotion Recognition and Response

[0520] User: Provides emotional data such as facial expressions and voice to use the emotion engine when registering and searching for items.

[0521] Terminal: The emotion engine means analyzes the emotion data and sends the results to the server.

[0522] Server: Determines the user's emotional state based on the results of the emotion engine means and adjusts appropriate responses and notification content.

[0523] Delivery of goods

[0524] User (owner): Make arrangements to collect the item at the notified storage location.

[0525] User: After picking up the item, report "Pickup completed" in the communication application.

[0526] Terminal: Sends information about the completion of collection to the server.

[0527] Server: Updates the database with the pickup completion information.

[0528] Rewards and points

[0529] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[0530] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank You Points."

[0531] User (findr): Receives notification and checks "Thank you points."

[0532] Specific examples

[0533] For example, suppose user A loses his wallet in a park. User A opens a communication application and registers the wallet's characteristics (color, size, distinctive markings, etc.). If user A looks anxious at this time, the emotion engine means recognizes this emotion and sends it to the server. The server then sends a kind and comforting message to the communication application to alleviate user A's anxiety. Meanwhile, user B picks up the wallet and similarly registers the characteristic information via the communication application. The server stores this information in a database, and the artificial intelligence means matches them. Once the match is confirmed, user A and user B are notified of the details of the storage location, and user A follows the notification to collect the wallet at the storage location. After that, when user A reports that he has picked up the wallet, the reward procedure is carried out and user B is awarded "thank you points."

[0534] Prompt Sentence Examples

[0535] Examples of prompts to input to a generative AI model might include:

[0536] "I found a wallet in the park. It's black leather and has my student ID inside. Where should I return it?"

[0537] "I dropped my wallet in the park. It's black leather and the corners are scuffed. Please let me know if you find it."

[0538] "I lost my wallet. How do I register the item in the communication application?"

[0539] Through this detailed description of the invention, it will be possible to concretely understand how the present system provides users with a convenient and efficient lost item handling experience.

[0540] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0541] Step 1: User Registration

[0542] Input: A user launches a communications application for the first time and enters profile information (such as name, email address, and phone number).

[0543] Specific operation: The user opens the registration screen of the communication application, enters the required information, and presses the "Register" button.

[0544] Data processing: The terminal converts the input information into JSON format.

[0545] Output: The device sends profile information in JSON format to the server.

[0546] Step 2: Save your profile information

[0547] Input: The server receives the profile information sent from the device.

[0548] Specific operation: The server saves the received information in the database using the INSERT statement.

[0549] Data processing: Saves profile information and generates a new user ID.

[0550] Output: The server returns a confirmation message to the terminal containing the generated user ID.

[0551] Step 3: Register your lost item

[0552] Input: The user enters details of the found item, such as the type, characteristics, location, and date and time of the item into a communication application.

[0553] Specific operation: The user opens the lost item registration screen, enters detailed information, and presses the "Submit" button.

[0554] Data processing: The terminal converts the input information into JSON format.

[0555] Output: The device sends the lost item information in JSON format to the server.

[0556] Step 4: Save the lost item

[0557] Input: The server receives the lost item information sent from the device.

[0558] Specific operation: The server saves the received information in the database using the INSERT statement.

[0559] Data processing: Executes the process of saving the lost item information and generates a confirmation message.

[0560] Output: The server returns a confirmation message to the terminal.

[0561] Step 5: Register your lost item

[0562] Input: The user enters details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[0563] Specific operation: The user opens the lost item registration screen, enters details, and presses the "Submit" button.

[0564] Data processing: The terminal converts the input information into JSON format.

[0565] Output: The device sends the lost item information in JSON format to the server.

[0566] Step 6: Save the lost item

[0567] Input: The server receives the lost item information sent from the device.

[0568] Specific operation: The server saves the received information in the database using the INSERT statement.

[0569] Data processing: Executes the process of saving lost item information and generates a confirmation message.

[0570] Output: The server returns a confirmation message to the terminal.

[0571] Step 7: Enter search criteria

[0572] Input: A user uses a communications application to search for matching lost items.

[0573] Specific behavior: The user opens the search screen, enters criteria, and presses the "Search" button.

[0574] Data processing: The terminal converts the entered search criteria into JSON format.

[0575] Output: The terminal sends the search criteria in JSON format to the server.

[0576] Step 8: Database Search

[0577] Input: The server receives the search criteria sent from the terminal.

[0578] Specific operation: The server uses a SELECT statement in the RDBMS to search for data that matches the conditions.

[0579] Data processing: Extract lost property information that matches the criteria and convert the search results into JSON format.

[0580] Output: The server sends the search results to the device.

[0581] Step 9: Matching

[0582] Input: The server periodically scans the database for lost and found items.

[0583] What happens: The server uses a cron job to scan the database and retrieve new data.

[0584] Data processing: Artificial intelligence tools use machine learning algorithms to calculate matching scores and identify high matches.

[0585] Output: The server manages the matching results and generates notification messages.

[0586] Step 10: Provide emotion data

[0587] Input: Users provide emotional data such as facial expressions and voice when registering or searching for items.

[0588] What happens: The user enables the camera and microphone and provides emotional data to a communication application.

[0589] Data processing: The device analyzes emotion data in real time and converts the results into JSON format.

[0590] Output: The device sends the analysis results to the server.

[0591] Step 11: Emotion Recognition and Responding

[0592] Input: The server receives emotion recognition data sent from the device.

[0593] Specific operation: The server determines the user's emotional state based on the results of the emotion engine means.

[0594] Data processing: The server generates a response message and adjusts the content according to the emotional state.

[0595] Output: The server sends a response message to the terminal.

[0596] Step 12: Collect your items

[0597] Input: The owner user picks up the item at the notified storage location.

[0598] Specific operations: The user goes to the designated storage location and goes through the necessary procedures, such as verifying their identity.

[0599] Output: Owner receives item.

[0600] Step 13: Report the completion of collection

[0601] Input: The user reports the completion of the pickup in the communication application.

[0602] Specific operation: The user opens the pickup completion report screen and presses the "Pickup complete" button.

[0603] Data processing: The terminal converts the completion information into JSON format.

[0604] Output: The device sends the pickup completion information in JSON format to the server.

[0605] Step 14: Database Update

[0606] Input: The server receives the pickup completion information sent from the terminal.

[0607] Specific operation: The server updates the received information in the database using the UPDATE statement.

[0608] Data processing: Update the pickup completion status.

[0609] Output: The server sends an update complete message to the terminal.

[0610] Step 15: Collect rewards and award points

[0611] Input: The server verifies the collection completion information and collects the pre-set reward from the owner.

[0612] Specific operation: The server carries out the collection procedure based on the owner's registration information.

[0613] Data processing: Manage rewards and give a portion of them to the finder as "thank you points."

[0614] Output: The server sends a notification to the user (finder) that "Thank you points" have been awarded.

[0615] (Application example 2)

[0616] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0617] In conventional item management systems, users had to go through cumbersome operations when registering and searching for lost and found items, and registered information was often not matched quickly and reliably. Furthermore, there were a lack of ways to alleviate the anxiety and stress users felt when they lost their belongings, making it difficult to improve the user experience. Furthermore, in virtual stores, item management within the virtual space was not adequate, leading to problems with finding and losing items not being properly matched.

[0618] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to register information about items, an artificial intelligence means for automatically matching information, and an emotion engine means for recognizing the user's emotional state and personalizing responses. This allows the item information registered by the user to be matched quickly and reliably, and provides a response according to the user's emotional state, improving the user experience. In addition, items in the virtual store are managed efficiently, and lost and found items in the virtual space are appropriately matched.

[0619] "User" refers to people who register and search for product information.

[0620] "Information about the item" refers to detailed information such as the type of item, its characteristics, where it was found, where it was dropped, and the date and time.

[0621] "Means for registration" refers to a system or application that allows a user to input product information and transmit it to a database.

[0622] "Means for identification" refers to the functions and algorithms for identifying and specifying registered product information.

[0623] "Database" refers to a relational database system (RDBMS) for storing and managing registered product information.

[0624] "Artificial intelligence means" refers to machine learning algorithms and models for analyzing product information and performing matching processes.

[0625] "Means for notifying users of matching results" refers to communication technology for informing users of information about matched items.

[0626] "Means for managing the release of items" refers to the function of managing the process by which lost items are released to their owners.

[0627] "Means for distributing rewards" refers to the system or mechanism for distributing rewards after delivery of the goods.

[0628] "Emotion Engine" refers to algorithms and modules for analyzing user emotions and personalizing responses.

[0629] "Means for utilizing virtual space" refers to the functions and technologies for managing goods within a virtual store.

[0630] This invention is a system that allows users to register and search information about items, recognize emotions, and provide personalized responses to quickly return lost items to their owners. Furthermore, this system can be applied to virtual stores, enabling item management in virtual space.

[0631] The system mainly consists of the following components:

[0632] 1. User device: A smartphone with a communication application and emotion engine installed.

[0633] 2. Server: A remote server that hosts the database, artificial intelligence means, and emotion engine.

[0634] 3. Database: A relational database system for managing registered item information.

[0635] 4. Artificial intelligence means: machine learning algorithms to carry out the matching process.

[0636] 5. Emotion engine: An algorithm for analyzing user emotions and dynamically adjusting the system's response.

[0637] The user terminal is used as a method for users to register information about items. The specific procedure is explained below.

[0638] 1. User Registration:

[0639] A user opens a communications application and enters profile information (such as name, email address, and phone number).

[0640] The device sends the profile information to the server, which stores it in a database, and a user ID is generated and returned to the device.

[0641] 2. Registering lost items:

[0642] The user inputs the type of found item, its characteristics, the location where it was found, the date and time, etc.

[0643] The terminal sends the input information to the server, which stores the information in a database.

[0644] 3. Registering lost items:

[0645] The user enters details of the lost item.

[0646] The device sends the information and the server stores it in a database.

[0647] 4. Emotion recognition and response:

[0648] When a user registers or searches for an item, the device uses an emotion engine to analyze the user's emotion data.

[0649] The server responds appropriately based on the analysis results of the emotion engine.

[0650] The hardware and software used include smartphones, relational database systems (e.g., SQLite, MySQL), machine learning algorithms (e.g., Python, scikit-learn), and communication applications (e.g., LINE app).

[0651] For example:

[0652] User A loses his wallet in a virtual store and registers it as a "black leather wallet" and "found at the entrance of the virtual store" through a communication application. The emotion engine recognizes the user's anxiety and responds, "Don't worry. We will deal with it promptly."

[0653] Store staff member B uses the same communication application to register the lost item, "black leather wallet" and "found at the entrance of the virtual store." The AI ​​performs matching and notifies user A, "Your wallet has been found. You can pick it up at the entrance of the virtual store."

[0654] Example prompt sentence:

[0655] Prompt: "When a user registers an item in a virtual store, provide an appropriate response based on their emotion (e.g., anxiety)."

[0656] Response: "Don't worry, we'll get back to you as soon as possible. Please enter the item information."

[0657] In this way, flexible responses based on the user's emotional state and item management within the virtual store are realized.

[0658] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0659] Step 1:

[0660] User Registration

[0661] Input: A user launches a communications application and enters profile information (such as name, email address, and phone number).

[0662] Specific behavior:

[0663] User input is received and the device sends profile information to the server.

[0664] The server stores the received profile information in a database and generates a new user ID.

[0665] The server returns the generated user ID to the terminal.

[0666] Output: The profile information is saved to the database and the user ID is returned to the device.

[0667] Step 2:

[0668] Registering lost items

[0669] Input: The user enters the type, description, location, date, etc. of the found item into a communication application.

[0670] Specific behavior:

[0671] User input is received and the device sends the information to the server.

[0672] The server stores the received lost item information in a database.

[0673] Output: The found item information is saved to the database and a confirmation message is displayed on the terminal.

[0674] Step 3:

[0675] Registering lost items

[0676] Input: The user enters details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[0677] Specific behavior:

[0678] User input is received and the device sends the information to the server.

[0679] The server stores the information about the lost items received in a database.

[0680] Output: The lost item information is saved to the database and a confirmation message is displayed on the terminal.

[0681] Step 4:

[0682] Emotion Recognition and Response

[0683] Input: Users provide emotional data (facial expressions, voice, etc.) when registering or searching for items.

[0684] Specific behavior:

[0685] The device uses an emotion engine to analyze the user's emotion data.

[0686] The server determines the user's emotional state based on the analysis results of the emotion engine and determines the optimal response.

[0687] The server sends an appropriate response message to the terminal.

[0688] Output: A response depending on the user's emotional state is displayed in the communication application.

[0689] Step 5:

[0690] Matching process

[0691] Input: Newly registered lost and found information.

[0692] Specific behavior:

[0693] The server periodically scans the database for lost and found information.

[0694] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[0695] The server manages the matching results and notifies the owner and finder.

[0696] Output: The user is notified of the matched item information.

[0697] Step 6:

[0698] Delivery of goods

[0699] Input: Storage location information notified by the matching result.

[0700] Specific behavior:

[0701] The user will collect the item at the storage location notified.

[0702] After the pickup is complete, the user reports "Pickup completed" via the communication application.

[0703] The terminal transmits information about the completion of collection to the server, and the server updates the database.

[0704] Output: Pickup completion information is saved in the database.

[0705] Step 7:

[0706] Rewards and points

[0707] Input: Pickup completion information.

[0708] Specific behavior:

[0709] The server confirms the information on the completion of collection and carries out the procedure to collect the pre-set reward from the owner.

[0710] The server manages the collected rewards on the system and gives a portion of them to the finder as points.

[0711] The user (findr) will receive a notification and check their points.

[0712] Output: Points are awarded to the finder and a reward is collected from the owner.

[0713] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0714] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0715] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0716] [Second embodiment]

[0717] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0718] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0719] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0720] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0721] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0722] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0723] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0724] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0725] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0726] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0727] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0728] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0729] This invention is a system that allows people who have lost or found an item to easily register and search for information about the item using their smartphone, and through AI matching, the lost item can be quickly and reliably returned to its owner. Below, we will explain each element of the system and how it works.

[0730] System configuration

[0731] This system mainly consists of the following elements:

[0732] 1. User device: A smartphone or tablet with the LINE application installed.

[0733] 2. Server: A remote server that hosts the database and artificial intelligence means.

[0734] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[0735] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[0736] Program processing description

[0737] User Registration

[0738] User: Open the LINE application on first launch and enter your profile information.

[0739] Device: Sends profile information to the server.

[0740] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[0741] Registering lost items

[0742] User: Enter details of the lost item, such as the type, characteristics, location, date and time of the item, into the LINE app.

[0743] Terminal: Sends the entered information to the server.

[0744] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[0745] Registering lost items

[0746] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[0747] Terminal: Sends the entered information to the server.

[0748] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[0749] Search process

[0750] User: If the lost item cannot be found, use the LINE app's search function to search for lost items that match the criteria.

[0751] Terminal: Sends search criteria to the server.

[0752] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[0753] Matching process

[0754] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[0755] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[0756] Server: Manages matching results and notifies the owner and finder.

[0757] Delivery of goods

[0758] User (owner): Make arrangements to collect the item at the notified storage location.

[0759] User: After picking up the item, report "Pickup completed" via the LINE app.

[0760] Terminal: Sends information about the completion of collection to the server.

[0761] Server: Updates the database with the pickup completion information.

[0762] Rewards and points

[0763] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[0764] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank you PayPay points."

[0765] User (findr): Receives notification and checks "Thank you PayPay points."

[0766] Specific examples

[0767] For example, suppose user A loses their wallet in a park. A opens the LINE app and registers the wallet's characteristics (color, size, distinctive markings, etc.). Meanwhile, user B finds the wallet and similarly registers the characteristic information via the LINE app. The server stores this information in a database, and the AI ​​matches them. Once a match is confirmed, A and B are notified of the details of the storage location, and A follows the notification to pick up the wallet at the park management office. After that, when A reports that he has picked up the wallet, the reward procedure is carried out, and B is awarded "Thank you PayPay points."

[0768] In this way, the system helps return lost items to their owners efficiently, reducing waste. Furthermore, the entire process can be completed via the user's smartphone, making it highly convenient.

[0769] The processing flow will be explained below.

[0770] Step 1:

[0771] A user installs the LINE app and enters their profile information (name, email address, phone number, etc.) when using it for the first time.

[0772] Step 2:

[0773] The terminal formats the entered profile information and transmits it to the server.

[0774] Step 3:

[0775] The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[0776] Step 4:

[0777] The user opens the LINE app and enters details such as the type of lost item, its characteristics, where it was found, and the date and time.

[0778] Step 5:

[0779] The terminal transmits the entered found item information to the server.

[0780] Step 6:

[0781] The server stores the received information about the lost item in a database and returns a confirmation message to the terminal.

[0782] Step 7:

[0783] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[0784] Step 8:

[0785] The terminal transmits the input lost item information to the server.

[0786] Step 9:

[0787] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[0788] Step 10:

[0789] Users can use the LINE app's search function to search for lost items that meet their criteria.

[0790] Step 11:

[0791] The terminal transmits the search conditions to the server.

[0792] Step 12:

[0793] The server searches the database for lost item information and returns results that match the conditions to the terminal.

[0794] Step 13:

[0795] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[0796] Step 14:

[0797] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[0798] Step 15:

[0799] The server manages the matching results and notifies the owner and finder.

[0800] Step 16:

[0801] The user (owner) will complete the procedures to collect the item at the notified storage location.

[0802] Step 17:

[0803] The user (owner) reports the completion of collection via the LINE app.

[0804] Step 18:

[0805] The terminal transmits information indicating that the collection has been completed to the server.

[0806] Step 19:

[0807] The server updates the database with the information about the completion of collection.

[0808] Step 20:

[0809] The server confirms the information on the completion of collection and carries out the procedure to collect a predetermined reward from the owner.

[0810] Step 21:

[0811] The server manages the collected rewards on the system and gives a portion of them to the finder as "Thank you PayPay points."

[0812] Step 22:

[0813] The user (findr) receives a notification and checks the "Thank you PayPay points."

[0814] Example 1

[0815] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0816] Conventional lost property management systems have problems with complex and time-consuming tasks such as identifying the location and date of an item, sharing information between the owner and finder, handling the item handover procedure, and distributing rewards. Furthermore, because they rely on manual matching, the speed at which items are returned to their owners is slow and unreliable. This invention aims to solve these problems, streamline the process of finding and returning items, and ensure that items are returned to their owners quickly and reliably.

[0817] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0818] In this invention, the server includes a means for using a communication application that users use when registering or searching for items, a means for updating the database with information about the completion of collection, and a means for awarding points as a reward. This allows users to easily register and search for item information, and enables rapid matching using artificial intelligence. In addition, by immediately updating the database with information about the completion of item collection and awarding points as a reward, a system that is highly convenient for both the owner and the finder can be realized.

[0819] "User" means an individual or organization that uses this system to register, search, and match information about items.

[0820] "Item" refers to any lost or found object registered by a User.

[0821] "Information" refers to detailed data about an item (type, characteristics, location, date and time, etc.).

[0822] "Registering" refers to the act of a user entering information about an item and storing it in a database.

[0823] "Identification" refers to the process of identifying and recognizing registered product information.

[0824] "Database" refers to a relational database system (RDBMS) for storing and managing registered product information.

[0825] "Artificial intelligence" refers to machine learning algorithms and models that match items based on information.

[0826] "Matching" refers to the process of analyzing found and lost item information to identify likely matches.

[0827] "Notification" refers to the act of informing users of information such as the item matching results, collection procedures, and rewards.

[0828] "Release" refers to the procedure of returning the notified item to the owner at the storage location.

[0829] "Reward" refers to the money or points collected by the system from the owner after the item is handed over and distributed to the finder.

[0830] "Communication Application" refers to a platform that allows users to register and search for items.

[0831] "Points" refers to a digital reward system that is awarded to finders as a reward.

[0832] This invention is a system that allows people who have lost or found an item to easily register and search for information about the item using their smartphone, and through AI matching, the lost item can be quickly and reliably returned to its owner. Below, we will explain each element of this system and how it works.

[0833] System configuration

[0834] This system mainly consists of the following elements:

[0835] 1. User device: A smartphone or tablet with a communication application installed.

[0836] 2. Server: A remote server that hosts the database and artificial intelligence means.

[0837] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[0838] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[0839] Operating Procedure

[0840] User Registration

[0841] A user launches a communications application for the first time and enters profile information such as name, email address, and phone number.

[0842] The terminal transmits the input profile information to the server.

[0843] The server stores the received profile information in a database, generates a user ID, and returns it to the terminal.

[0844] Registering lost items

[0845] The user enters details of the found item, such as the type, characteristics, location, date and time of the found item, into a communication application.

[0846] The terminal transmits the input information to the server.

[0847] The server stores the received lost item information in a database and returns a confirmation message to the terminal.

[0848] Registering lost items

[0849] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[0850] The terminal transmits the input information to the server.

[0851] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[0852] Search process

[0853] The user uses the search function of the communication application to search for lost items that meet the criteria.

[0854] The terminal transmits the search conditions to the server.

[0855] The server searches the database for lost item information and returns results that match the criteria to the terminal.

[0856] Matching process

[0857] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[0858] The artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[0859] The server manages the matching results and notifies the owner and finder.

[0860] Delivery of goods

[0861] The user (owner) will take steps to collect the item at the notified storage location.

[0862] After picking up the item, the user reports "pickup completed" using the communication application.

[0863] The terminal transmits information indicating that the collection has been completed to the server.

[0864] The server updates the database with the information about the completion of collection.

[0865] Rewards and points

[0866] The server confirms the information about the completed collection and performs procedures to collect the pre-set reward from the owner, for example, by using a digital payment system.

[0867] The server manages the collected rewards on the system and gives a portion of them to the finder as digital points.

[0868] The user (finder) receives a notification of the points awarded via a communication application and confirms that the digital points have been reflected.

[0869] Specific examples

[0870] For example, if user A drops his wallet in a park, he uses a communication application to register its characteristics as a "black leather wallet." Meanwhile, user B finds the wallet and similarly registers the characteristics information via the communication application.

[0871] The server stores this information in a database, and an artificial intelligence tool matches the information. Once a match is confirmed, A and B are notified of the details of the storage location, and A picks up the wallet at the storage location. After that, when A reports that he has picked up the wallet, the reward procedure is carried out and B is awarded digital points.

[0872] Prompt Sentence Examples

[0873] Below is an example of a prompt sentence to input to the generative AI model.

[0874] Describe a system that allows a user to input characteristics of a lost item (such as color, size, distinctive markings, etc.) and returns information about similar lost items.

[0875] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0876] Processing flow

[0877] Step 1: User Registration

[0878] 1.1 A user launches a communications application for the first time and enters profile information such as name, email address, and phone number.

[0879] Input: User profile information (name, email address, phone number)

[0880] Output: Request to send profile information

[0881] Specific operation: The user opens a communication application (on a smartphone or tablet) and enters information into the designated input fields.

[0882] 1.2 The device sends the entered profile information to the server.

[0883] Input: Profile information entered by the user

[0884] Output: A request containing profile information is sent to the server

[0885] What happens: The application converts the profile information into JSON format and generates a request to send to the server over SSL / TLS.

[0886] 1.3 The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[0887] Input: Submitted profile information

[0888] Output: Profile information stored in the database and generated user ID.

[0889] Specific operation: The server checks the uniqueness of the profile information, stores it in the database, and then generates and returns a new user ID.

[0890] Step 2: Register your lost item

[0891] 2.1 The user enters details of the found item, such as type, characteristics, location, date and time into the communication application.

[0892] Input: Details of the lost item (type, characteristics, location of the item, date and time)

[0893] Output: A request containing the lost item information

[0894] Specific operation: A user opens a lost item registration screen in a communications application and enters details into several input fields.

[0895] 2.2 The terminal sends the entered information to the server.

[0896] Input: User-entered details of the found item

[0897] Output: A request containing the found item information is sent to the server.

[0898] Specific behavior: Converts the found item information into JSON format and generates a request to send to the server.

[0899] 2.3 The server stores the received lost item information in a database and returns a confirmation message to the terminal.

[0900] Input: Details of the lost item submitted

[0901] Output: Information stored in the database and a confirmation message

[0902] Specific operation: The server checks the format of the information, saves it in the database, and then returns a confirmation message to the terminal.

[0903] Step 3: Register your lost item

[0904] 3.1 The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the communication application.

[0905] Input: Details of lost item (type, characteristics, location, date and time)

[0906] Output: A request containing lost items

[0907] Specific behavior: The user opens the lost item registration screen of a communication application and enters details into several input fields.

[0908] 3.2 The terminal sends the entered information to the server.

[0909] Input: User-entered details of the lost item

[0910] Output: A request containing the lost item information is sent to the server.

[0911] Specific operation: Converts the lost item information into JSON format and generates a request to send to the server.

[0912] 3.3 The server stores the information of the lost item in a database and returns a confirmation message to the device.

[0913] Input: Details of the lost item submitted

[0914] Output: Information stored in the database and a confirmation message

[0915] Specific operation: The server checks the format of the information, saves it in the database, and then returns a confirmation message to the terminal.

[0916] Step 4: Search process

[0917] 4.1 The user uses the search function of the communication application to search for lost items that meet the criteria.

[0918] Input: Search criteria for the item you are looking for (type, characteristics, location found, date and time, etc.)

[0919] Output: Request containing search criteria

[0920] Specific operation: The user opens the search screen of a communication application, enters the required information in the search criteria input field, and presses the search button.

[0921] 4.2 The terminal sends the search criteria to the server.

[0922] Input: The search criteria entered by the user

[0923] Output: A request containing search criteria is sent to the server.

[0924] Specific operation: Converts search criteria into JSON format and generates a request to send to the server.

[0925] 4.3 The server searches the database for lost item information and returns results that match the criteria to the terminal.

[0926] Input: Submitted search criteria

[0927] Output: Lost and found items matching the criteria

[0928] What it does: The server searches for lost items in the database and returns matching results in JSON format.

[0929] Step 5: Matching

[0930] 5.1 The server will periodically scan the database and match newly registered lost and found items using artificial intelligence means.

[0931] Input: All item information in the database (lost and found)

[0932] Output: Matching results

[0933] What it does: The server runs a scheduled job to periodically scan the database.

[0934] 5.2 Artificial intelligence means will analyze the registered information and identify combinations that are likely to match.

[0935] Input: Lost and found information retrieved from the database

[0936] Output: likely matching pairs

[0937] Specific operation: Uses machine learning algorithms to perform matching based on features and generate results.

[0938] 5.3 The server manages the matching results and notifies the owner and finder.

[0939] Input: Matching results

[0940] Output: Information message

[0941] Specific operation: Create a notification message based on the matching results and send it to the user.

[0942] Step 6: Handover of goods

[0943] 6.1 The User (Owner) will complete the procedures to collect the item at the notified storage location.

[0944] Input: Subinventory Notification

[0945] Output: Report of pick-up completion

[0946] Specific operations: The user goes to the designated storage location and goes through the necessary procedures, such as verifying their identity.

[0947] 6.2 After the user has collected the item, he / she reports "collection completed" in the communication application.

[0948] Input: Report of completion of collection

[0949] Output: A completion report is sent to the server

[0950] Specific operation: Press the Complete button on the dedicated screen of the application to report that the pickup is complete.

[0951] 6.3 The terminal sends information about the completion of collection to the server.

[0952] Input: Pickup completion report entered by the user

[0953] Output: Pickup completion information is sent to the server

[0954] Specific behavior: The application converts the completion report into JSON format and generates a request to send to the server.

[0955] 6.4 The server updates the database with the information on the completion of collection.

[0956] Input: Pickup completion report

[0957] Output: Pickup completion information updated in the database

[0958] Specific operation: The server reflects the received pickup completion information in the database.

[0959] Step 7: Rewards and Points

[0960] 7.1 The server confirms the collection completion information and proceeds to collect the pre-set reward from the owner.

[0961] Input: Pickup completion information

[0962] Output: Confirmation of collection completion

[0963] Specific operation: The server collects rewards from the owner using a digital payment system.

[0964] 7.2 The server manages the collected rewards on the system and gives a portion of them to the finder as digital points.

[0965] Input: Remuneration collected

[0966] Output: Digital points awarded

[0967] Specific operation: The server converts a certain percentage of the reward into digital points and reflects them in the finder's account.

[0968] 7.3 The user (finder) receives a notification of the points awarded via the communication application and confirms that the digital points have been reflected.

[0969] Input: Point award notification

[0970] Output: Points are reflected in your account.

[0971] Specific behavior: The application displays the awarded points and the user confirms them.

[0972] (Application example 1)

[0973] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0974] In modern society, many people lose items or find other people's items on a daily basis. However, there is a lack of a system to quickly and reliably return these items to their owners. In particular, in places where many people gather or at event venues, information on lost and found items is mixed together, making management difficult. To solve this problem, an efficient system is needed that registers item information in real time, performs matching, and integrates notification and delivery management.

[0975] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0976] In this invention, the server includes means for a user to register information about an item, means for identifying the registered item information, means for storing the item information in a database, artificial intelligence means for automatically matching information, means for notifying the user of the matching result, means for managing the delivery of the notified item, means for distributing a reward after the delivery of the item, means for taking an image of the item with a head-mounted display or eyeglass-type display device and registering information by voice input, and means for notifying the user of the matching processing result in real time by voice or visual display, thereby enabling information about lost or found items to be processed quickly and efficiently and allowing the user to recover the item as soon as possible.

[0977] "User" means any person or legal entity that registers items and searches for and checks lost and found items.

[0978] "Item information" is detailed data about lost or found items, such as their characteristics, type, where they were found, and the date and time they were found.

[0979] A "database" is an information system for storing, managing, and searching product information.

[0980] "Artificial intelligence means" refers to technical means for matching product information using machine learning algorithms or models.

[0981] "Notification means" means a method for communicating information about the matching results or delivery to the user, including audio or visual notifications.

[0982] The "delivery management means" is a system for managing the storage location and delivery procedures of notified items.

[0983] The "reward distribution means" is a means for giving rewards or points to the finder after the item is handed over.

[0984] A "head-mounted display" is a device that is worn on the user's head to display information, such as smart glasses or a head-mounted display (HMD).

[0985] "Image capture means" refers to a device or technique for capturing an image of an item using a camera.

[0986] "Voice input means" refers to means for accepting information input from a user using a microphone or voice recognition technology.

[0987] "Real-time notification means" refers to a method for communicating the results of the matching process to the user without delay by voice or visual display.

[0988] A "generative AI model" is an artificial intelligence technology that analyzes data such as audio and images and generates results that meet specific purposes.

[0989] This invention is a system that allows users to register information about items and quickly and reliably return lost items to their owners. The detailed configuration and operation of this system will be described below.

[0990] System configuration

[0991] The system mainly consists of the following components:

[0992] 1. User terminal: smart glasses (e.g., head-mounted display or eyeglass display).

[0993] 2. Server: A remote server that hosts the database and artificial intelligence tools.

[0994] 3. Database: Relational database system (RDBMS) for managing product information.

[0995] 4. Artificial intelligence tools: Machine learning algorithms and generative AI models that perform the matching process.

[0996] System Operation

[0997] User Registration

[0998] When the user first starts up the smart glasses, they put them on and register their profile information (such as name and contact details) through voice recognition. This information is sent to the server and stored in a database. Based on the user's profile information, the system generates a user ID and returns it to the user's device.

[0999] Registering lost items

[1000] When a user finds a lost item, they take a photo of it with the camera on their smart glasses and register its characteristics (color, size, distinctive marks, etc.) through voice input. The entered information is sent from the device to a server and stored in a database.

[1001] Registering lost items

[1002] Similarly, users who lose an item can register details of the lost item (type, characteristics, location, date and time, etc.) by voice input using the smart glasses. The transmitted information is stored on the server.

[1003] Matching process

[1004] The server periodically scans the database and analyzes newly registered lost and found items using artificial intelligence methods (machine learning algorithms and generative AI models) for automatic matching, identifying pairs with a high probability of matching.

[1005] Notice and Delivery

[1006] When a match is found, the server will send a push notification to the smart glasses and notify the user in real time via audio or visual display. The user can then follow the notification to complete the item delivery procedure. After the item delivery is completed, the server will update the database and report the completion.

[1007] Rewards and points

[1008] After the delivery is complete, the server calculates a pre-set reward and awards rewards and points to the finder, using a generative AI model to analyze the voice data and generate a thank-you prompt for the user.

[1009] Examples of concrete examples and prompts

[1010] For example, if user A loses their wallet at an event:

[1011] User A uses the smart glasses to voice input the following: "I dropped my black wallet near the main stage. It contains a credit card and a 1,000 yen bill."

[1012] User B then picks up the wallet and similarly registers through voice input, "I found a black wallet near the main stage." The server analyzes this information, generates a matching result, and notifies A and B's smart glasses. Upon receiving the notification, A collects the wallet at the storage location, and B receives a reward.

[1013] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1014] Step 1:

[1015] User Registration

[1016] The user puts on the smart glasses and registers their profile information using voice recognition when they first start up the device.

[1017] Input: User's spoken input (name, contact information, etc.).

[1018] Data processing: Speech recognition software converts the voice data into text data.

[1019] Output: Profile information in text format.

[1020] Specific operation: The device sends the collected profile information to the server, which stores it in a database. The server generates a user ID and sends it back to the device.

[1021] Step 2:

[1022] Registering lost items

[1023] The user takes a photo of the item they pick up with the smart glasses' camera and registers its characteristics using voice input.

[1024] Input: Image of the item and voice input (item characteristics, location found, date and time, etc.).

[1025] Data processing: Image analysis software extracts the features of the item, and voice recognition software converts the voice data into text data.

[1026] Output: Textual feature information and object images.

[1027] Specific operation: The terminal sends the image and characteristic information of the item to the server, which stores it in a database.

[1028] Step 3:

[1029] Registering lost items

[1030] Users register details of lost items using voice input using smart glasses.

[1031] Input: Voice input (item characteristics, location of loss, date and time, etc.).

[1032] Data processing: Speech recognition software converts the voice data into text data.

[1033] Output: Textual information about the lost item.

[1034] Specific operation: The device sends feature information to the server, which then stores it in a database.

[1035] Step 4:

[1036] Matching process

[1037] The server periodically scans the database for newly registered lost and found items and matches them using artificial intelligence means.

[1038] Input: Characteristics of lost and found items in the database.

[1039] Data processing: Analyze feature information using machine learning algorithms (generative AI models) to improve matching accuracy.

[1040] Output: Matching results (likely combinations).

[1041] Specific operation: The server runs the generative AI model, generates matching results, and registers them in the database.

[1042] Step 5:

[1043] Notice and Delivery

[1044] The server pushes the matching results to the smart glasses, notifying the user via audio or visual display.

[1045] Input: Matching results.

[1046] Output: Push notification (audio and visual information).

[1047] Specific operation: The server generates notification content and sends it to the device (smart glasses), which then notifies the user of the content via audio or visual means.

[1048] Step 6:

[1049] Post-delivery updates

[1050] After the user hands over the item, the smart glasses send a completion report to the server.

[1051] Input: Completion report.

[1052] Data Processing: Matching entered completion reports with corresponding records in the database.

[1053] Output: Updated database records.

[1054] Specific operation: The terminal sends a completion report to the server, and the server updates the database.

[1055] Step 7:

[1056] Rewards and points

[1057] The server will then carry out the process of awarding rewards and points to the finder based on the data collected after the item has been picked up.

[1058] Input: Delivery completion data.

[1059] Data processing: The reward amount is calculated using a reward calculation algorithm and points are awarded.

[1060] Output: Rewards and points awarded.

[1061] Specific operation: The server processes rewards and points, generates a thank you prompt using a generative AI model, and notifies the user.

[1062] Prompt Sentence Examples

[1063] For example, if user A loses their wallet at an event:

[1064] User A uses the smart glasses to voice input the following: "I dropped my black wallet near the main stage. It contains a credit card and a 1,000 yen bill."

[1065] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1066] This invention is a system that allows users to easily register and search information about items, and by combining artificial intelligence and an emotion engine, it enables lost items to be returned to their owners quickly and reliably. It also improves the user experience by recognizing the user's emotions and personalizing responses based on them.

[1067] System configuration

[1068] This system mainly consists of the following elements:

[1069] 1. User device: A smartphone or tablet with the LINE application and emotion engine installed.

[1070] 2. Server: A remote server that hosts the database, artificial intelligence means, and emotion engine.

[1071] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[1072] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[1073] 5. Emotion Engine: Algorithms and modules for analyzing user emotions and dynamically adjusting the system's response.

[1074] Program processing description

[1075] User Registration

[1076] User: When launching the LINE application for the first time, open it and enter your profile information (name, email address, phone number, etc.).

[1077] Device: Sends profile information to the server.

[1078] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[1079] Registering lost items

[1080] User: Enter details of the lost item, such as the type, characteristics, location, date and time of the item, into the LINE app.

[1081] Terminal: Sends the entered information to the server.

[1082] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[1083] Registering lost items

[1084] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[1085] Terminal: Sends the entered information to the server.

[1086] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[1087] Search process

[1088] User: If the lost item cannot be found, use the LINE app's search function to search for lost items that match the criteria.

[1089] Terminal: Sends search criteria to the server.

[1090] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[1091] Matching process

[1092] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[1093] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[1094] Server: Manages matching results and notifies the owner and finder.

[1095] Emotion Recognition and Response

[1096] User: Provides emotional data such as facial expressions and voice to use the emotion engine when registering and searching for items.

[1097] Terminal: The emotion engine analyzes the emotion data and sends the results to the server.

[1098] Server: Based on the results of the emotion engine, determine the user's emotional state and tailor appropriate responses and notification content.

[1099] Delivery of goods

[1100] User (owner): Make arrangements to collect the item at the notified storage location.

[1101] User: After picking up the item, report "Pickup completed" via the LINE app.

[1102] Terminal: Sends information about the completion of collection to the server.

[1103] Server: Updates the database with the pickup completion information.

[1104] Rewards and points

[1105] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[1106] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank you PayPay points."

[1107] User (findr): Receives notification and checks "Thank you PayPay points."

[1108] Specific examples

[1109] For example, suppose Person A loses their wallet in a park. Person A opens the LINE app and registers the wallet's characteristics (color, size, distinctive markings, etc.). If Person A looks anxious, the emotion engine recognizes this emotion and sends it to the server. The server then sends a kind and comforting message to the LINE app to alleviate Person A's anxiety. Meanwhile, Person B picks up the wallet and similarly registers the wallet's characteristics via the LINE app. The server stores this information in a database, and the AI ​​matches them. Once a match is confirmed, Person A and Person B are notified of the details of where the wallet was stored, and Person A follows the notification to pick up the wallet at the park management office. After that, when Person A reports that they have retrieved it, the reward process begins and Person B is awarded "Thank you PayPay points."

[1110] In this way, the system helps return lost items to their owners quickly and provides appropriate responses depending on the user's emotional state, improving the overall experience.

[1111] The processing flow will be explained below.

[1112] Step 1:

[1113] A user installs the LINE app and enters their profile information (name, email address, phone number, etc.) when using it for the first time.

[1114] Step 2:

[1115] The terminal formats the entered profile information and transmits it to the server.

[1116] Step 3:

[1117] The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[1118] Step 4:

[1119] The user opens the LINE app and enters details such as the type of lost item, its characteristics, where it was found, and the date and time.

[1120] Step 5:

[1121] The terminal transmits the entered found item information to the server.

[1122] Step 6:

[1123] The server stores the received information about the lost item in a database and returns a confirmation message to the terminal.

[1124] Step 7:

[1125] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[1126] Step 8:

[1127] The terminal transmits the input lost item information to the server.

[1128] Step 9:

[1129] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[1130] Step 10:

[1131] Users can use the LINE app's search function to search for lost items that meet their criteria.

[1132] Step 11:

[1133] The terminal transmits the search conditions to the server.

[1134] Step 12:

[1135] The server searches the database for lost item information and returns results that match the conditions to the terminal.

[1136] Step 13:

[1137] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[1138] Step 14:

[1139] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[1140] Step 15:

[1141] The server manages the matching results and notifies the owner and finder.

[1142] Step 16:

[1143] Users will be provided with emotional data such as facial expressions and voice in order to use the emotion engine when registering and searching for items.

[1144] Step 17:

[1145] The device acquires emotion data and analyzes it using an emotion engine.

[1146] Step 18:

[1147] The emotion engine analyzes the emotion data and sends the analysis results to the server.

[1148] Step 19:

[1149] The server determines the user's emotional state based on the analysis results of the emotion engine and generates an appropriate response message.

[1150] Step 20:

[1151] The server sends a response message or notification content to the device according to the user's emotional state.

[1152] Step 21:

[1153] The user (owner) will complete the procedures to collect the item at the notified storage location.

[1154] Step 22:

[1155] The user reports completion of pickup via the LINE app.

[1156] Step 23:

[1157] The terminal transmits information indicating that the collection has been completed to the server.

[1158] Step 24:

[1159] The server updates the database with the information about the completion of collection.

[1160] Step 25:

[1161] The server confirms the information on the completion of collection and carries out the procedure to collect a predetermined reward from the owner.

[1162] Step 26:

[1163] The server manages the collected rewards on the system and gives a portion of them to the finder as "Thank you PayPay points."

[1164] Step 27:

[1165] The user (findr) receives a notification and checks the "Thank you PayPay points."

[1166] Example 2

[1167] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1168] Even if a lost item is found, it is difficult to quickly and reliably return it to its owner, and it is also difficult to respond appropriately depending on the user's emotional state. There is a need to solve these problems and improve the user experience.

[1169] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1170] In this invention, the server includes means for a user to register information about an item, means for identifying the registered item information, means for storing the item information in a database, artificial intelligence means for automatically matching information, means for notifying the user of the matching result, means for managing the notified item delivery, means for distributing a reward after the item is delivered, emotion engine means for analyzing the user's emotion data and adjusting the system's response, and means for transmitting emotion recognition data by the emotion engine means to the server. This allows lost items to be returned to their owners quickly and reliably, and enables appropriate responses according to the user's emotional state.

[1171] "User" refers to an individual or legal entity that registers or searches for information about an item.

[1172] "Item" refers to an object that a user has registered or found.

[1173] "Item information" refers to detailed information such as the type of item, its characteristics, the location where it was found, and the date and time it was found.

[1174] "Database" refers to an information storage system for accumulating and managing product information.

[1175] "Artificial intelligence means" refers to machine learning algorithms and models that analyze product information and automatically match it.

[1176] "Matching results" refer to data pairs that are likely to match the product information analyzed by the artificial intelligence means.

[1177] "Emotion engine means" refers to algorithms or modules that analyze user emotional data and adjust the system's response.

[1178] "Emotion recognition data" refers to data that indicates the emotional state of a user extracted from their facial expressions, voice, etc.

[1179] "Delivery means" refers to the system function for managing the procedure for delivering the notified item to the user.

[1180] "Reward distribution means" refers to a system function for distributing rewards after delivery of an item.

[1181] "Communication application" refers to software that users use to register and search for product information.

[1182] This invention is a system that allows users to easily register and search information about items, and by combining artificial intelligence and an emotion engine, it enables lost items to be returned to their owners quickly and reliably. It also improves the user experience by recognizing the user's emotions and personalizing responses based on them.

[1183] System configuration

[1184] This system mainly consists of the following elements:

[1185] 1. User device: A smartphone or tablet with a communication application and emotion engine installed.

[1186] 2. Server: A remote server that hosts the database, artificial intelligence means and emotion engine.

[1187] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[1188] 4. Artificial intelligence tools: Machine learning algorithms and models for analyzing and automatically matching item information.

[1189] 5. Emotion engine means: Algorithms and modules for analyzing user emotion data and adjusting the system's response.

[1190] Program processing description

[1191] User Registration

[1192] User: On first launch, open the communications application and enter your profile information (name, email address, phone number, etc.).

[1193] Device: Sends profile information to the server.

[1194] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[1195] Registering lost items

[1196] User: Enters details of the found item, such as type, description, location, date and time into a communication application.

[1197] Terminal: Sends the entered information to the server.

[1198] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[1199] Registering lost items

[1200] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[1201] Terminal: Sends the entered information to the server.

[1202] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[1203] Search process

[1204] User: If the lost item cannot be found, use the search function of the communication application to search for lost items that match the criteria.

[1205] Terminal: Sends search criteria to the server.

[1206] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[1207] Matching process

[1208] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[1209] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[1210] Server: Manages matching results and notifies the owner and finder.

[1211] Emotion Recognition and Response

[1212] User: Provides emotional data such as facial expressions and voice to use the emotion engine when registering and searching for items.

[1213] Terminal: The emotion engine means analyzes the emotion data and sends the results to the server.

[1214] Server: Determines the user's emotional state based on the results of the emotion engine means and adjusts appropriate responses and notification content.

[1215] Delivery of goods

[1216] User (owner): Make arrangements to collect the item at the notified storage location.

[1217] User: After picking up the item, report "Pickup completed" in the communication application.

[1218] Terminal: Sends information about the completion of collection to the server.

[1219] Server: Updates the database with the pickup completion information.

[1220] Rewards and points

[1221] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[1222] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank You Points."

[1223] User (findr): Receives notification and checks "Thank you points."

[1224] Specific examples

[1225] For example, suppose user A loses his wallet in a park. User A opens a communication application and registers the wallet's characteristics (color, size, distinctive markings, etc.). If user A looks anxious at this time, the emotion engine means recognizes this emotion and sends it to the server. The server then sends a kind and comforting message to the communication application to alleviate user A's anxiety. Meanwhile, user B picks up the wallet and similarly registers the characteristic information via the communication application. The server stores this information in a database, and the artificial intelligence means matches them. Once the match is confirmed, user A and user B are notified of the details of the storage location, and user A follows the notification to collect the wallet at the storage location. After that, when user A reports that he has picked up the wallet, the reward procedure is carried out and user B is awarded "thank you points."

[1226] Prompt Sentence Examples

[1227] Examples of prompts to input to a generative AI model might include:

[1228] "I found a wallet in the park. It's black leather and has my student ID inside. Where should I return it?"

[1229] "I dropped my wallet in the park. It's black leather and the corners are scuffed. Please let me know if you find it."

[1230] "I lost my wallet. How do I register the item in the communication application?"

[1231] Through this detailed description of the invention, it will be possible to concretely understand how the present system provides users with a convenient and efficient lost item handling experience.

[1232] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1233] Step 1: User Registration

[1234] Input: A user launches a communications application for the first time and enters profile information (such as name, email address, and phone number).

[1235] Specific operation: The user opens the registration screen of the communication application, enters the required information, and presses the "Register" button.

[1236] Data processing: The terminal converts the input information into JSON format.

[1237] Output: The device sends profile information in JSON format to the server.

[1238] Step 2: Save your profile information

[1239] Input: The server receives the profile information sent from the device.

[1240] Specific operation: The server saves the received information in the database using the INSERT statement.

[1241] Data processing: Saves profile information and generates a new user ID.

[1242] Output: The server returns a confirmation message to the terminal containing the generated user ID.

[1243] Step 3: Register your lost item

[1244] Input: The user enters details of the found item, such as the type, characteristics, location, and date and time of the item into a communication application.

[1245] Specific operation: The user opens the lost item registration screen, enters detailed information, and presses the "Submit" button.

[1246] Data processing: The terminal converts the input information into JSON format.

[1247] Output: The device sends the lost item information in JSON format to the server.

[1248] Step 4: Save the lost item

[1249] Input: The server receives the lost item information sent from the device.

[1250] Specific operation: The server saves the received information in the database using the INSERT statement.

[1251] Data processing: Executes the process of saving the lost item information and generates a confirmation message.

[1252] Output: The server returns a confirmation message to the terminal.

[1253] Step 5: Register your lost item

[1254] Input: The user enters details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[1255] Specific operation: The user opens the lost item registration screen, enters details, and presses the "Submit" button.

[1256] Data processing: The terminal converts the input information into JSON format.

[1257] Output: The device sends the lost item information in JSON format to the server.

[1258] Step 6: Save the lost item

[1259] Input: The server receives the lost item information sent from the device.

[1260] Specific operation: The server saves the received information in the database using the INSERT statement.

[1261] Data processing: Executes the process of saving lost item information and generates a confirmation message.

[1262] Output: The server returns a confirmation message to the terminal.

[1263] Step 7: Enter search criteria

[1264] Input: A user uses a communications application to search for matching lost items.

[1265] Specific behavior: The user opens the search screen, enters criteria, and presses the "Search" button.

[1266] Data processing: The terminal converts the entered search criteria into JSON format.

[1267] Output: The terminal sends the search criteria in JSON format to the server.

[1268] Step 8: Database Search

[1269] Input: The server receives the search criteria sent from the terminal.

[1270] Specific operation: The server uses a SELECT statement in the RDBMS to search for data that matches the conditions.

[1271] Data processing: Extract lost property information that matches the criteria and convert the search results into JSON format.

[1272] Output: The server sends the search results to the device.

[1273] Step 9: Matching

[1274] Input: The server periodically scans the database for lost and found items.

[1275] What happens: The server uses a cron job to scan the database and retrieve new data.

[1276] Data processing: Artificial intelligence tools use machine learning algorithms to calculate matching scores and identify high matches.

[1277] Output: The server manages the matching results and generates notification messages.

[1278] Step 10: Provide emotion data

[1279] Input: Users provide emotional data such as facial expressions and voice when registering or searching for items.

[1280] What happens: The user enables the camera and microphone and provides emotional data to a communication application.

[1281] Data processing: The device analyzes emotion data in real time and converts the results into JSON format.

[1282] Output: The device sends the analysis results to the server.

[1283] Step 11: Emotion Recognition and Responding

[1284] Input: The server receives emotion recognition data sent from the device.

[1285] Specific operation: The server determines the user's emotional state based on the results of the emotion engine means.

[1286] Data processing: The server generates a response message and adjusts the content according to the emotional state.

[1287] Output: The server sends a response message to the terminal.

[1288] Step 12: Collect your items

[1289] Input: The owner user picks up the item at the notified storage location.

[1290] Specific operations: The user goes to the designated storage location and goes through the necessary procedures, such as verifying their identity.

[1291] Output: Owner receives item.

[1292] Step 13: Report the completion of collection

[1293] Input: The user reports the completion of the pickup in the communication application.

[1294] Specific operation: The user opens the pickup completion report screen and presses the "Pickup complete" button.

[1295] Data processing: The terminal converts the completion information into JSON format.

[1296] Output: The device sends the pickup completion information in JSON format to the server.

[1297] Step 14: Database Update

[1298] Input: The server receives the pickup completion information sent from the terminal.

[1299] Specific operation: The server updates the received information in the database using the UPDATE statement.

[1300] Data processing: Update the pickup completion status.

[1301] Output: The server sends an update complete message to the terminal.

[1302] Step 15: Collect rewards and award points

[1303] Input: The server verifies the collection completion information and collects the pre-set reward from the owner.

[1304] Specific operation: The server carries out the collection procedure based on the owner's registration information.

[1305] Data processing: Manage rewards and give a portion of them to the finder as "thank you points."

[1306] Output: The server sends a notification to the user (finder) that "Thank you points" have been awarded.

[1307] (Application example 2)

[1308] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1309] In conventional item management systems, users had to go through cumbersome operations when registering and searching for lost and found items, and registered information was often not matched quickly and reliably. Furthermore, there were a lack of ways to alleviate the anxiety and stress users felt when they lost their belongings, making it difficult to improve the user experience. Furthermore, in virtual stores, item management within the virtual space was not adequate, leading to problems with finding and losing items not being properly matched.

[1310] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to register information about items, an artificial intelligence means for automatically matching information, and an emotion engine means for recognizing the user's emotional state and personalizing responses. This allows the item information registered by the user to be matched quickly and reliably, and provides a response according to the user's emotional state, improving the user experience. In addition, items in the virtual store are managed efficiently, and lost and found items in the virtual space are appropriately matched.

[1311] "User" refers to people who register and search for product information.

[1312] "Information about the item" refers to detailed information such as the type of item, its characteristics, where it was found, where it was dropped, and the date and time.

[1313] "Means for registration" refers to a system or application that allows a user to input product information and transmit it to a database.

[1314] "Means for identification" refers to the functions and algorithms for identifying and specifying registered product information.

[1315] "Database" refers to a relational database system (RDBMS) for storing and managing registered product information.

[1316] "Artificial intelligence means" refers to machine learning algorithms and models for analyzing product information and performing matching processes.

[1317] "Means for notifying users of matching results" refers to communication technology for informing users of information about matched items.

[1318] "Means for managing the release of items" refers to the function of managing the process by which lost items are released to their owners.

[1319] "Means for distributing rewards" refers to the system or mechanism for distributing rewards after delivery of the goods.

[1320] "Emotion Engine" refers to algorithms and modules for analyzing user emotions and personalizing responses.

[1321] "Means for utilizing virtual space" refers to the functions and technologies for managing goods within a virtual store.

[1322] This invention is a system that allows users to register and search information about items, recognize emotions, and provide personalized responses to quickly return lost items to their owners. Furthermore, this system can be applied to virtual stores, enabling item management in virtual space.

[1323] The system mainly consists of the following components:

[1324] 1. User device: A smartphone with a communication application and emotion engine installed.

[1325] 2. Server: A remote server that hosts the database, artificial intelligence means, and emotion engine.

[1326] 3. Database: A relational database system for managing registered item information.

[1327] 4. Artificial intelligence means: machine learning algorithms to carry out the matching process.

[1328] 5. Emotion engine: An algorithm for analyzing user emotions and dynamically adjusting the system's response.

[1329] The user terminal is used as a method for users to register information about items. The specific procedure is explained below.

[1330] 1. User Registration:

[1331] A user opens a communications application and enters profile information (such as name, email address, and phone number).

[1332] The device sends the profile information to the server, which stores it in a database, and a user ID is generated and returned to the device.

[1333] 2. Registering lost items:

[1334] The user inputs the type of found item, its characteristics, the location where it was found, the date and time, etc.

[1335] The terminal sends the input information to the server, which stores the information in a database.

[1336] 3. Registering lost items:

[1337] The user enters details of the lost item.

[1338] The device sends the information and the server stores it in a database.

[1339] 4. Emotion recognition and response:

[1340] When a user registers or searches for an item, the device uses an emotion engine to analyze the user's emotion data.

[1341] The server responds appropriately based on the analysis results of the emotion engine.

[1342] The hardware and software used include smartphones, relational database systems (e.g., SQLite, MySQL), machine learning algorithms (e.g., Python, scikit-learn), and communication applications (e.g., LINE app).

[1343] For example:

[1344] User A loses his wallet in a virtual store and registers it as a "black leather wallet" and "found at the entrance of the virtual store" through a communication application. The emotion engine recognizes the user's anxiety and responds, "Don't worry. We will deal with it promptly."

[1345] Store staff member B uses the same communication application to register the lost item, "black leather wallet" and "found at the entrance of the virtual store." The AI ​​performs matching and notifies user A, "Your wallet has been found. You can pick it up at the entrance of the virtual store."

[1346] Example prompt sentence:

[1347] Prompt: "When a user registers an item in a virtual store, provide an appropriate response based on their emotion (e.g., anxiety)."

[1348] Response: "Don't worry, we'll get back to you as soon as possible. Please enter the item information."

[1349] In this way, flexible responses based on the user's emotional state and item management within the virtual store are realized.

[1350] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1351] Step 1:

[1352] User Registration

[1353] Input: A user launches a communications application and enters profile information (such as name, email address, and phone number).

[1354] Specific behavior:

[1355] User input is received and the device sends profile information to the server.

[1356] The server stores the received profile information in a database and generates a new user ID.

[1357] The server returns the generated user ID to the terminal.

[1358] Output: The profile information is saved to the database and the user ID is returned to the device.

[1359] Step 2:

[1360] Registering lost items

[1361] Input: The user enters the type, description, location, date, etc. of the found item into a communication application.

[1362] Specific behavior:

[1363] User input is received and the device sends the information to the server.

[1364] The server stores the received lost item information in a database.

[1365] Output: The found item information is saved to the database and a confirmation message is displayed on the terminal.

[1366] Step 3:

[1367] Registering lost items

[1368] Input: The user enters details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[1369] Specific behavior:

[1370] User input is received and the device sends the information to the server.

[1371] The server stores the information about the lost items received in a database.

[1372] Output: The lost item information is saved to the database and a confirmation message is displayed on the terminal.

[1373] Step 4:

[1374] Emotion Recognition and Response

[1375] Input: Users provide emotional data (facial expressions, voice, etc.) when registering or searching for items.

[1376] Specific behavior:

[1377] The device uses an emotion engine to analyze the user's emotion data.

[1378] The server determines the user's emotional state based on the analysis results of the emotion engine and determines the optimal response.

[1379] The server sends an appropriate response message to the terminal.

[1380] Output: A response depending on the user's emotional state is displayed in the communication application.

[1381] Step 5:

[1382] Matching process

[1383] Input: Newly registered lost and found information.

[1384] Specific behavior:

[1385] The server periodically scans the database for lost and found information.

[1386] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[1387] The server manages the matching results and notifies the owner and finder.

[1388] Output: The user is notified of the matched item information.

[1389] Step 6:

[1390] Delivery of goods

[1391] Input: Storage location information notified by the matching result.

[1392] Specific behavior:

[1393] The user will collect the item at the storage location notified.

[1394] After the pickup is complete, the user reports "Pickup completed" via the communication application.

[1395] The terminal transmits information about the completion of collection to the server, and the server updates the database.

[1396] Output: Pickup completion information is saved in the database.

[1397] Step 7:

[1398] Rewards and points

[1399] Input: Pickup completion information.

[1400] Specific behavior:

[1401] The server confirms the information on the completion of collection and carries out the procedure to collect the pre-set reward from the owner.

[1402] The server manages the collected rewards on the system and gives a portion of them to the finder as points.

[1403] The user (findr) will receive a notification and check their points.

[1404] Output: Points are awarded to the finder and a reward is collected from the owner.

[1405] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1406] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1407] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1408] [Third embodiment]

[1409] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1410] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1411] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1412] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1413] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1414] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1415] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1416] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1417] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1418] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1419] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1420] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1421] This invention is a system that allows people who have lost or found an item to easily register and search for information about the item using their smartphone, and through AI matching, the lost item can be quickly and reliably returned to its owner. Below, we will explain each element of the system and how it works.

[1422] System configuration

[1423] This system mainly consists of the following elements:

[1424] 1. User device: A smartphone or tablet with the LINE application installed.

[1425] 2. Server: A remote server that hosts the database and artificial intelligence means.

[1426] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[1427] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[1428] Program processing description

[1429] User Registration

[1430] User: Open the LINE application on first launch and enter your profile information.

[1431] Device: Sends profile information to the server.

[1432] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[1433] Registering lost items

[1434] User: Enter details of the lost item, such as the type, characteristics, location, date and time of the item, into the LINE app.

[1435] Terminal: Sends the entered information to the server.

[1436] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[1437] Registering lost items

[1438] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[1439] Terminal: Sends the entered information to the server.

[1440] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[1441] Search process

[1442] User: If the lost item cannot be found, use the LINE app's search function to search for lost items that match the criteria.

[1443] Terminal: Sends search criteria to the server.

[1444] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[1445] Matching process

[1446] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[1447] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[1448] Server: Manages matching results and notifies the owner and finder.

[1449] Delivery of goods

[1450] User (owner): Make arrangements to collect the item at the notified storage location.

[1451] User: After picking up the item, report "Pickup completed" via the LINE app.

[1452] Terminal: Sends information about the completion of collection to the server.

[1453] Server: Updates the database with the pickup completion information.

[1454] Rewards and points

[1455] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[1456] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank you PayPay points."

[1457] User (findr): Receives notification and checks "Thank you PayPay points."

[1458] Specific examples

[1459] For example, suppose user A loses their wallet in a park. A opens the LINE app and registers the wallet's characteristics (color, size, distinctive markings, etc.). Meanwhile, user B finds the wallet and similarly registers the characteristic information via the LINE app. The server stores this information in a database, and the AI ​​matches them. Once a match is confirmed, A and B are notified of the details of the storage location, and A follows the notification to pick up the wallet at the park management office. After that, when A reports that he has picked up the wallet, the reward procedure is carried out, and B is awarded "Thank you PayPay points."

[1460] In this way, the system helps return lost items to their owners efficiently, reducing waste. Furthermore, the entire process can be completed via the user's smartphone, making it highly convenient.

[1461] The processing flow will be explained below.

[1462] Step 1:

[1463] A user installs the LINE app and enters their profile information (name, email address, phone number, etc.) when using it for the first time.

[1464] Step 2:

[1465] The terminal formats the entered profile information and transmits it to the server.

[1466] Step 3:

[1467] The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[1468] Step 4:

[1469] The user opens the LINE app and enters details such as the type of lost item, its characteristics, where it was found, and the date and time.

[1470] Step 5:

[1471] The terminal transmits the entered found item information to the server.

[1472] Step 6:

[1473] The server stores the received information about the lost item in a database and returns a confirmation message to the terminal.

[1474] Step 7:

[1475] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[1476] Step 8:

[1477] The terminal transmits the input lost item information to the server.

[1478] Step 9:

[1479] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[1480] Step 10:

[1481] Users can use the LINE app's search function to search for lost items that meet their criteria.

[1482] Step 11:

[1483] The terminal transmits the search conditions to the server.

[1484] Step 12:

[1485] The server searches the database for lost item information and returns results that match the conditions to the terminal.

[1486] Step 13:

[1487] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[1488] Step 14:

[1489] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[1490] Step 15:

[1491] The server manages the matching results and notifies the owner and finder.

[1492] Step 16:

[1493] The user (owner) will complete the procedures to collect the item at the notified storage location.

[1494] Step 17:

[1495] The user (owner) reports the completion of collection via the LINE app.

[1496] Step 18:

[1497] The terminal transmits information indicating that the collection has been completed to the server.

[1498] Step 19:

[1499] The server updates the database with the information about the completion of collection.

[1500] Step 20:

[1501] The server confirms the information on the completion of collection and carries out the procedure to collect a predetermined reward from the owner.

[1502] Step 21:

[1503] The server manages the collected rewards on the system and gives a portion of them to the finder as "Thank you PayPay points."

[1504] Step 22:

[1505] The user (findr) receives a notification and checks the "Thank you PayPay points."

[1506] Example 1

[1507] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1508] Conventional lost property management systems have problems with complex and time-consuming tasks such as identifying the location and date of an item, sharing information between the owner and finder, handling the item handover procedure, and distributing rewards. Furthermore, because they rely on manual matching, the speed at which items are returned to their owners is slow and unreliable. This invention aims to solve these problems, streamline the process of finding and returning items, and ensure that items are returned to their owners quickly and reliably.

[1509] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1510] In this invention, the server includes a means for using a communication application that users use when registering or searching for items, a means for updating the database with information about the completion of collection, and a means for awarding points as a reward. This allows users to easily register and search for item information, and enables rapid matching using artificial intelligence. In addition, by immediately updating the database with information about the completion of item collection and awarding points as a reward, a system that is highly convenient for both the owner and the finder can be realized.

[1511] "User" means an individual or organization that uses this system to register, search, and match information about items.

[1512] "Item" refers to any lost or found object registered by a User.

[1513] "Information" refers to detailed data about an item (type, characteristics, location, date and time, etc.).

[1514] "Registering" refers to the act of a user entering information about an item and storing it in a database.

[1515] "Identification" refers to the process of identifying and recognizing registered product information.

[1516] "Database" refers to a relational database system (RDBMS) for storing and managing registered product information.

[1517] "Artificial intelligence" refers to machine learning algorithms and models that match items based on information.

[1518] "Matching" refers to the process of analyzing found and lost item information to identify likely matches.

[1519] "Notification" refers to the act of informing users of information such as the item matching results, collection procedures, and rewards.

[1520] "Release" refers to the procedure of returning the notified item to the owner at the storage location.

[1521] "Reward" refers to the money or points collected by the system from the owner after the item is handed over and distributed to the finder.

[1522] "Communication Application" refers to a platform that allows users to register and search for items.

[1523] "Points" refers to a digital reward system that is awarded to finders as a reward.

[1524] This invention is a system that allows people who have lost or found an item to easily register and search for information about the item using their smartphone, and through AI matching, the lost item can be quickly and reliably returned to its owner. Below, we will explain each element of this system and how it works.

[1525] System configuration

[1526] This system mainly consists of the following elements:

[1527] 1. User device: A smartphone or tablet with a communication application installed.

[1528] 2. Server: A remote server that hosts the database and artificial intelligence means.

[1529] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[1530] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[1531] Operating Procedure

[1532] User Registration

[1533] A user launches a communications application for the first time and enters profile information such as name, email address, and phone number.

[1534] The terminal transmits the input profile information to the server.

[1535] The server stores the received profile information in a database, generates a user ID, and returns it to the terminal.

[1536] Registering lost items

[1537] The user enters details of the found item, such as the type, characteristics, location, date and time of the found item, into a communication application.

[1538] The terminal transmits the input information to the server.

[1539] The server stores the received lost item information in a database and returns a confirmation message to the terminal.

[1540] Registering lost items

[1541] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[1542] The terminal transmits the input information to the server.

[1543] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[1544] Search process

[1545] The user uses the search function of the communication application to search for lost items that meet the criteria.

[1546] The terminal transmits the search conditions to the server.

[1547] The server searches the database for lost item information and returns results that match the criteria to the terminal.

[1548] Matching process

[1549] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[1550] The artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[1551] The server manages the matching results and notifies the owner and finder.

[1552] Delivery of goods

[1553] The user (owner) will take steps to collect the item at the notified storage location.

[1554] After picking up the item, the user reports "pickup completed" using the communication application.

[1555] The terminal transmits information indicating that the collection has been completed to the server.

[1556] The server updates the database with the information about the completion of collection.

[1557] Rewards and points

[1558] The server confirms the information about the completed collection and performs procedures to collect the pre-set reward from the owner, for example, by using a digital payment system.

[1559] The server manages the collected rewards on the system and gives a portion of them to the finder as digital points.

[1560] The user (finder) receives a notification of the points awarded via a communication application and confirms that the digital points have been reflected.

[1561] Specific examples

[1562] For example, if user A drops his wallet in a park, he uses a communication application to register its characteristics as a "black leather wallet." Meanwhile, user B finds the wallet and similarly registers the characteristics information via the communication application.

[1563] The server stores this information in a database, and an artificial intelligence tool matches the information. Once a match is confirmed, A and B are notified of the details of the storage location, and A picks up the wallet at the storage location. After that, when A reports that he has picked up the wallet, the reward procedure is carried out and B is awarded digital points.

[1564] Prompt Sentence Examples

[1565] Below is an example of a prompt sentence to input to the generative AI model.

[1566] Describe a system that allows a user to input characteristics of a lost item (such as color, size, distinctive markings, etc.) and returns information about similar lost items.

[1567] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1568] Processing flow

[1569] Step 1: User Registration

[1570] 1.1 A user launches a communications application for the first time and enters profile information such as name, email address, and phone number.

[1571] Input: User profile information (name, email address, phone number)

[1572] Output: Request to send profile information

[1573] Specific operation: The user opens a communication application (on a smartphone or tablet) and enters information into the designated input fields.

[1574] 1.2 The device sends the entered profile information to the server.

[1575] Input: Profile information entered by the user

[1576] Output: A request containing profile information is sent to the server

[1577] What happens: The application converts the profile information into JSON format and generates a request to send to the server over SSL / TLS.

[1578] 1.3 The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[1579] Input: Submitted profile information

[1580] Output: Profile information stored in the database and generated user ID.

[1581] Specific operation: The server checks the uniqueness of the profile information, stores it in the database, and then generates and returns a new user ID.

[1582] Step 2: Register your lost item

[1583] 2.1 The user enters details of the found item, such as type, characteristics, location, date and time into the communication application.

[1584] Input: Details of the lost item (type, characteristics, location of the item, date and time)

[1585] Output: A request containing the lost item information

[1586] Specific operation: A user opens a lost item registration screen in a communications application and enters details into several input fields.

[1587] 2.2 The terminal sends the entered information to the server.

[1588] Input: User-entered details of the found item

[1589] Output: A request containing the found item information is sent to the server.

[1590] Specific behavior: Converts the found item information into JSON format and generates a request to send to the server.

[1591] 2.3 The server stores the received lost item information in a database and returns a confirmation message to the terminal.

[1592] Input: Details of the lost item submitted

[1593] Output: Information stored in the database and a confirmation message

[1594] Specific operation: The server checks the format of the information, saves it in the database, and then returns a confirmation message to the terminal.

[1595] Step 3: Register your lost item

[1596] 3.1 The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the communication application.

[1597] Input: Details of lost item (type, characteristics, location, date and time)

[1598] Output: A request containing lost items

[1599] Specific behavior: The user opens the lost item registration screen of a communication application and enters details into several input fields.

[1600] 3.2 The terminal sends the entered information to the server.

[1601] Input: User-entered details of the lost item

[1602] Output: A request containing the lost item information is sent to the server.

[1603] Specific operation: Converts the lost item information into JSON format and generates a request to send to the server.

[1604] 3.3 The server stores the information of the lost item in a database and returns a confirmation message to the device.

[1605] Input: Details of the lost item submitted

[1606] Output: Information stored in the database and a confirmation message

[1607] Specific operation: The server checks the format of the information, saves it in the database, and then returns a confirmation message to the terminal.

[1608] Step 4: Search process

[1609] 4.1 The user uses the search function of the communication application to search for lost items that meet the criteria.

[1610] Input: Search criteria for the item you are looking for (type, characteristics, location found, date and time, etc.)

[1611] Output: Request containing search criteria

[1612] Specific operation: The user opens the search screen of a communication application, enters the required information in the search criteria input field, and presses the search button.

[1613] 4.2 The terminal sends the search criteria to the server.

[1614] Input: The search criteria entered by the user

[1615] Output: A request containing search criteria is sent to the server.

[1616] Specific operation: Converts search criteria into JSON format and generates a request to send to the server.

[1617] 4.3 The server searches the database for lost item information and returns results that match the criteria to the terminal.

[1618] Input: Submitted search criteria

[1619] Output: Lost and found items matching the criteria

[1620] What it does: The server searches for lost items in the database and returns matching results in JSON format.

[1621] Step 5: Matching

[1622] 5.1 The server will periodically scan the database and match newly registered lost and found items using artificial intelligence means.

[1623] Input: All item information in the database (lost and found)

[1624] Output: Matching results

[1625] What it does: The server runs a scheduled job to periodically scan the database.

[1626] 5.2 Artificial intelligence means will analyze the registered information and identify combinations that are likely to match.

[1627] Input: Lost and found information retrieved from the database

[1628] Output: likely matching pairs

[1629] Specific operation: Uses machine learning algorithms to perform matching based on features and generate results.

[1630] 5.3 The server manages the matching results and notifies the owner and finder.

[1631] Input: Matching results

[1632] Output: Information message

[1633] Specific operation: Create a notification message based on the matching results and send it to the user.

[1634] Step 6: Handover of goods

[1635] 6.1 The User (Owner) will complete the procedures to collect the item at the notified storage location.

[1636] Input: Subinventory Notification

[1637] Output: Report of pick-up completion

[1638] Specific operations: The user goes to the designated storage location and goes through the necessary procedures, such as verifying their identity.

[1639] 6.2 After the user has collected the item, he / she reports "collection completed" in the communication application.

[1640] Input: Report of completion of collection

[1641] Output: A completion report is sent to the server

[1642] Specific operation: Press the Complete button on the dedicated screen of the application to report that the pickup is complete.

[1643] 6.3 The terminal sends information about the completion of collection to the server.

[1644] Input: Pickup completion report entered by the user

[1645] Output: Pickup completion information is sent to the server

[1646] Specific behavior: The application converts the completion report into JSON format and generates a request to send to the server.

[1647] 6.4 The server updates the database with the information on the completion of collection.

[1648] Input: Pickup completion report

[1649] Output: Pickup completion information updated in the database

[1650] Specific operation: The server reflects the received pickup completion information in the database.

[1651] Step 7: Rewards and Points

[1652] 7.1 The server confirms the collection completion information and proceeds to collect the pre-set reward from the owner.

[1653] Input: Pickup completion information

[1654] Output: Confirmation of collection completion

[1655] Specific operation: The server collects rewards from the owner using a digital payment system.

[1656] 7.2 The server manages the collected rewards on the system and gives a portion of them to the finder as digital points.

[1657] Input: Remuneration collected

[1658] Output: Digital points awarded

[1659] Specific operation: The server converts a certain percentage of the reward into digital points and reflects them in the finder's account.

[1660] 7.3 The user (finder) receives a notification of the points awarded via the communication application and confirms that the digital points have been reflected.

[1661] Input: Point award notification

[1662] Output: Points are reflected in your account.

[1663] Specific behavior: The application displays the awarded points and the user confirms them.

[1664] (Application example 1)

[1665] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1666] In modern society, many people lose items or find other people's items on a daily basis. However, there is a lack of a system to quickly and reliably return these items to their owners. In particular, in places where many people gather or at event venues, information on lost and found items is mixed together, making management difficult. To solve this problem, an efficient system is needed that registers item information in real time, performs matching, and integrates notification and delivery management.

[1667] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1668] In this invention, the server includes means for a user to register information about an item, means for identifying the registered item information, means for storing the item information in a database, artificial intelligence means for automatically matching information, means for notifying the user of the matching result, means for managing the delivery of the notified item, means for distributing a reward after the delivery of the item, means for taking an image of the item with a head-mounted display or eyeglass-type display device and registering information by voice input, and means for notifying the user of the matching processing result in real time by voice or visual display, thereby enabling information about lost or found items to be processed quickly and efficiently and allowing the user to recover the item as soon as possible.

[1669] "User" means any person or legal entity that registers items and searches for and checks lost and found items.

[1670] "Item information" is detailed data about lost or found items, such as their characteristics, type, where they were found, and the date and time they were found.

[1671] A "database" is an information system for storing, managing, and searching product information.

[1672] "Artificial intelligence means" refers to technical means for matching product information using machine learning algorithms or models.

[1673] "Notification means" means a method for communicating information about the matching results or delivery to the user, including audio or visual notifications.

[1674] The "delivery management means" is a system for managing the storage location and delivery procedures of notified items.

[1675] The "reward distribution means" is a means for giving rewards or points to the finder after the item is handed over.

[1676] A "head-mounted display" is a device that is worn on the user's head to display information, such as smart glasses or a head-mounted display (HMD).

[1677] "Image capture means" refers to a device or technique for capturing an image of an item using a camera.

[1678] "Voice input means" refers to means for accepting information input from a user using a microphone or voice recognition technology.

[1679] "Real-time notification means" refers to a method for communicating the results of the matching process to the user without delay by voice or visual display.

[1680] A "generative AI model" is an artificial intelligence technology that analyzes data such as audio and images and generates results that meet specific purposes.

[1681] This invention is a system that allows users to register information about items and quickly and reliably return lost items to their owners. The detailed configuration and operation of this system will be described below.

[1682] System configuration

[1683] The system mainly consists of the following components:

[1684] 1. User terminal: smart glasses (e.g., head-mounted display or eyeglass display).

[1685] 2. Server: A remote server that hosts the database and artificial intelligence tools.

[1686] 3. Database: Relational database system (RDBMS) for managing product information.

[1687] 4. Artificial intelligence tools: Machine learning algorithms and generative AI models that perform the matching process.

[1688] System Operation

[1689] User Registration

[1690] When the user first starts up the smart glasses, they put them on and register their profile information (such as name and contact details) through voice recognition. This information is sent to the server and stored in a database. Based on the user's profile information, the system generates a user ID and returns it to the user's device.

[1691] Registering lost items

[1692] When a user finds a lost item, they take a photo of it with the camera on their smart glasses and register its characteristics (color, size, distinctive marks, etc.) through voice input. The entered information is sent from the device to a server and stored in a database.

[1693] Registering lost items

[1694] Similarly, users who lose an item can register details of the lost item (type, characteristics, location, date and time, etc.) by voice input using the smart glasses. The transmitted information is stored on the server.

[1695] Matching process

[1696] The server periodically scans the database and analyzes newly registered lost and found items using artificial intelligence methods (machine learning algorithms and generative AI models) for automatic matching, identifying pairs with a high probability of matching.

[1697] Notice and Delivery

[1698] When a match is found, the server will send a push notification to the smart glasses and notify the user in real time via audio or visual display. The user can then follow the notification to complete the item delivery procedure. After the item delivery is completed, the server will update the database and report the completion.

[1699] Rewards and points

[1700] After the delivery is complete, the server calculates a pre-set reward and awards rewards and points to the finder, using a generative AI model to analyze the voice data and generate a thank-you prompt for the user.

[1701] Examples of concrete examples and prompts

[1702] For example, if user A loses their wallet at an event:

[1703] User A uses the smart glasses to voice input the following: "I dropped my black wallet near the main stage. It contains a credit card and a 1,000 yen bill."

[1704] User B then picks up the wallet and similarly registers through voice input, "I found a black wallet near the main stage." The server analyzes this information, generates a matching result, and notifies A and B's smart glasses. Upon receiving the notification, A collects the wallet at the storage location, and B receives a reward.

[1705] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1706] Step 1:

[1707] User Registration

[1708] The user puts on the smart glasses and registers their profile information using voice recognition when they first start up the device.

[1709] Input: User's spoken input (name, contact information, etc.).

[1710] Data processing: Speech recognition software converts the voice data into text data.

[1711] Output: Profile information in text format.

[1712] Specific operation: The device sends the collected profile information to the server, which stores it in a database. The server generates a user ID and sends it back to the device.

[1713] Step 2:

[1714] Registering lost items

[1715] The user takes a photo of the item they pick up with the smart glasses' camera and registers its characteristics using voice input.

[1716] Input: Image of the item and voice input (item characteristics, location found, date and time, etc.).

[1717] Data processing: Image analysis software extracts the features of the item, and voice recognition software converts the voice data into text data.

[1718] Output: Textual feature information and object images.

[1719] Specific operation: The terminal sends the image and characteristic information of the item to the server, which stores it in a database.

[1720] Step 3:

[1721] Registering lost items

[1722] Users register details of lost items using voice input using smart glasses.

[1723] Input: Voice input (item characteristics, location of loss, date and time, etc.).

[1724] Data processing: Speech recognition software converts the voice data into text data.

[1725] Output: Textual information about the lost item.

[1726] Specific operation: The device sends feature information to the server, which then stores it in a database.

[1727] Step 4:

[1728] Matching process

[1729] The server periodically scans the database for newly registered lost and found items and matches them using artificial intelligence means.

[1730] Input: Characteristics of lost and found items in the database.

[1731] Data processing: Analyze feature information using machine learning algorithms (generative AI models) to improve matching accuracy.

[1732] Output: Matching results (likely combinations).

[1733] Specific operation: The server runs the generative AI model, generates matching results, and registers them in the database.

[1734] Step 5:

[1735] Notice and Delivery

[1736] The server pushes the matching results to the smart glasses, notifying the user via audio or visual display.

[1737] Input: Matching results.

[1738] Output: Push notification (audio and visual information).

[1739] Specific operation: The server generates notification content and sends it to the device (smart glasses), which then notifies the user of the content via audio or visual means.

[1740] Step 6:

[1741] Post-delivery updates

[1742] After the user hands over the item, the smart glasses send a completion report to the server.

[1743] Input: Completion report.

[1744] Data Processing: Matching entered completion reports with corresponding records in the database.

[1745] Output: Updated database records.

[1746] Specific operation: The terminal sends a completion report to the server, and the server updates the database.

[1747] Step 7:

[1748] Rewards and points

[1749] The server will then carry out the process of awarding rewards and points to the finder based on the data collected after the item has been picked up.

[1750] Input: Delivery completion data.

[1751] Data processing: The reward amount is calculated using a reward calculation algorithm and points are awarded.

[1752] Output: Rewards and points awarded.

[1753] Specific operation: The server processes rewards and points, generates a thank you prompt using a generative AI model, and notifies the user.

[1754] Prompt Sentence Examples

[1755] For example, if user A loses their wallet at an event:

[1756] User A uses the smart glasses to voice input the following: "I dropped my black wallet near the main stage. It contains a credit card and a 1,000 yen bill."

[1757] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1758] This invention is a system that allows users to easily register and search information about items, and by combining artificial intelligence and an emotion engine, it enables lost items to be returned to their owners quickly and reliably. It also improves the user experience by recognizing the user's emotions and personalizing responses based on them.

[1759] System configuration

[1760] This system mainly consists of the following elements:

[1761] 1. User device: A smartphone or tablet with the LINE application and emotion engine installed.

[1762] 2. Server: A remote server that hosts the database, artificial intelligence means, and emotion engine.

[1763] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[1764] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[1765] 5. Emotion Engine: Algorithms and modules for analyzing user emotions and dynamically adjusting the system's response.

[1766] Program processing description

[1767] User Registration

[1768] User: When launching the LINE application for the first time, open it and enter your profile information (name, email address, phone number, etc.).

[1769] Device: Sends profile information to the server.

[1770] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[1771] Registering lost items

[1772] User: Enter details of the lost item, such as the type, characteristics, location, date and time of the item, into the LINE app.

[1773] Terminal: Sends the entered information to the server.

[1774] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[1775] Registering lost items

[1776] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[1777] Terminal: Sends the entered information to the server.

[1778] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[1779] Search process

[1780] User: If the lost item cannot be found, use the LINE app's search function to search for lost items that match the criteria.

[1781] Terminal: Sends search criteria to the server.

[1782] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[1783] Matching process

[1784] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[1785] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[1786] Server: Manages matching results and notifies the owner and finder.

[1787] Emotion Recognition and Response

[1788] User: Provides emotional data such as facial expressions and voice to use the emotion engine when registering and searching for items.

[1789] Terminal: The emotion engine analyzes the emotion data and sends the results to the server.

[1790] Server: Based on the results of the emotion engine, determine the user's emotional state and tailor appropriate responses and notification content.

[1791] Delivery of goods

[1792] User (owner): Make arrangements to collect the item at the notified storage location.

[1793] User: After picking up the item, report "Pickup completed" via the LINE app.

[1794] Terminal: Sends information about the completion of collection to the server.

[1795] Server: Updates the database with the pickup completion information.

[1796] Rewards and points

[1797] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[1798] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank you PayPay points."

[1799] User (findr): Receives notification and checks "Thank you PayPay points."

[1800] Specific examples

[1801] For example, suppose Person A loses their wallet in a park. Person A opens the LINE app and registers the wallet's characteristics (color, size, distinctive markings, etc.). If Person A looks anxious, the emotion engine recognizes this emotion and sends it to the server. The server then sends a kind and comforting message to the LINE app to alleviate Person A's anxiety. Meanwhile, Person B picks up the wallet and similarly registers the wallet's characteristics via the LINE app. The server stores this information in a database, and the AI ​​matches them. Once a match is confirmed, Person A and Person B are notified of the details of where the wallet was stored, and Person A follows the notification to pick up the wallet at the park management office. After that, when Person A reports that they have retrieved it, the reward process begins and Person B is awarded "Thank you PayPay points."

[1802] In this way, the system helps return lost items to their owners quickly and provides appropriate responses depending on the user's emotional state, improving the overall experience.

[1803] The processing flow will be explained below.

[1804] Step 1:

[1805] A user installs the LINE app and enters their profile information (name, email address, phone number, etc.) when using it for the first time.

[1806] Step 2:

[1807] The terminal formats the entered profile information and transmits it to the server.

[1808] Step 3:

[1809] The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[1810] Step 4:

[1811] The user opens the LINE app and enters details such as the type of lost item, its characteristics, where it was found, and the date and time.

[1812] Step 5:

[1813] The terminal transmits the entered found item information to the server.

[1814] Step 6:

[1815] The server stores the received information about the lost item in a database and returns a confirmation message to the terminal.

[1816] Step 7:

[1817] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[1818] Step 8:

[1819] The terminal transmits the input lost item information to the server.

[1820] Step 9:

[1821] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[1822] Step 10:

[1823] Users can use the LINE app's search function to search for lost items that meet their criteria.

[1824] Step 11:

[1825] The terminal transmits the search conditions to the server.

[1826] Step 12:

[1827] The server searches the database for lost item information and returns results that match the conditions to the terminal.

[1828] Step 13:

[1829] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[1830] Step 14:

[1831] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[1832] Step 15:

[1833] The server manages the matching results and notifies the owner and finder.

[1834] Step 16:

[1835] Users will be provided with emotional data such as facial expressions and voice in order to use the emotion engine when registering and searching for items.

[1836] Step 17:

[1837] The device acquires emotion data and analyzes it using an emotion engine.

[1838] Step 18:

[1839] The emotion engine analyzes the emotion data and sends the analysis results to the server.

[1840] Step 19:

[1841] The server determines the user's emotional state based on the analysis results of the emotion engine and generates an appropriate response message.

[1842] Step 20:

[1843] The server sends a response message or notification content to the device according to the user's emotional state.

[1844] Step 21:

[1845] The user (owner) will complete the procedures to collect the item at the notified storage location.

[1846] Step 22:

[1847] The user reports completion of pickup via the LINE app.

[1848] Step 23:

[1849] The terminal transmits information indicating that the collection has been completed to the server.

[1850] Step 24:

[1851] The server updates the database with the information about the completion of collection.

[1852] Step 25:

[1853] The server confirms the information on the completion of collection and carries out the procedure to collect a predetermined reward from the owner.

[1854] Step 26:

[1855] The server manages the collected rewards on the system and gives a portion of them to the finder as "Thank you PayPay points."

[1856] Step 27:

[1857] The user (findr) receives a notification and checks the "Thank you PayPay points."

[1858] Example 2

[1859] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1860] Even if a lost item is found, it is difficult to quickly and reliably return it to its owner, and it is also difficult to respond appropriately depending on the user's emotional state. There is a need to solve these problems and improve the user experience.

[1861] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1862] In this invention, the server includes means for a user to register information about an item, means for identifying the registered item information, means for storing the item information in a database, artificial intelligence means for automatically matching information, means for notifying the user of the matching result, means for managing the notified item delivery, means for distributing a reward after the item is delivered, emotion engine means for analyzing the user's emotion data and adjusting the system's response, and means for transmitting emotion recognition data by the emotion engine means to the server. This allows lost items to be returned to their owners quickly and reliably, and enables appropriate responses according to the user's emotional state.

[1863] "User" refers to an individual or legal entity that registers or searches for information about an item.

[1864] "Item" refers to an object that a user has registered or found.

[1865] "Item information" refers to detailed information such as the type of item, its characteristics, the location where it was found, and the date and time it was found.

[1866] "Database" refers to an information storage system for accumulating and managing product information.

[1867] "Artificial intelligence means" refers to machine learning algorithms and models that analyze product information and automatically match it.

[1868] "Matching results" refer to data pairs that are likely to match the product information analyzed by the artificial intelligence means.

[1869] "Emotion engine means" refers to algorithms or modules that analyze user emotional data and adjust the system's response.

[1870] "Emotion recognition data" refers to data that indicates the emotional state of a user extracted from their facial expressions, voice, etc.

[1871] "Delivery means" refers to the system function for managing the procedure for delivering the notified item to the user.

[1872] "Reward distribution means" refers to a system function for distributing rewards after delivery of an item.

[1873] "Communication application" refers to software that users use to register and search for product information.

[1874] This invention is a system that allows users to easily register and search information about items, and by combining artificial intelligence and an emotion engine, it enables lost items to be returned to their owners quickly and reliably. It also improves the user experience by recognizing the user's emotions and personalizing responses based on them.

[1875] System configuration

[1876] This system mainly consists of the following elements:

[1877] 1. User device: A smartphone or tablet with a communication application and emotion engine installed.

[1878] 2. Server: A remote server that hosts the database, artificial intelligence means and emotion engine.

[1879] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[1880] 4. Artificial intelligence tools: Machine learning algorithms and models for analyzing and automatically matching item information.

[1881] 5. Emotion engine means: Algorithms and modules for analyzing user emotion data and adjusting the system's response.

[1882] Program processing description

[1883] User Registration

[1884] User: On first launch, open the communications application and enter your profile information (name, email address, phone number, etc.).

[1885] Device: Sends profile information to the server.

[1886] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[1887] Registering lost items

[1888] User: Enters details of the found item, such as type, description, location, date and time into a communication application.

[1889] Terminal: Sends the entered information to the server.

[1890] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[1891] Registering lost items

[1892] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[1893] Terminal: Sends the entered information to the server.

[1894] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[1895] Search process

[1896] User: If the lost item cannot be found, use the search function of the communication application to search for lost items that match the criteria.

[1897] Terminal: Sends search criteria to the server.

[1898] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[1899] Matching process

[1900] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[1901] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[1902] Server: Manages matching results and notifies the owner and finder.

[1903] Emotion Recognition and Response

[1904] User: Provides emotional data such as facial expressions and voice to use the emotion engine when registering and searching for items.

[1905] Terminal: The emotion engine means analyzes the emotion data and sends the results to the server.

[1906] Server: Determines the user's emotional state based on the results of the emotion engine means and adjusts appropriate responses and notification content.

[1907] Delivery of goods

[1908] User (owner): Make arrangements to collect the item at the notified storage location.

[1909] User: After picking up the item, report "Pickup completed" in the communication application.

[1910] Terminal: Sends information about the completion of collection to the server.

[1911] Server: Updates the database with the pickup completion information.

[1912] Rewards and points

[1913] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[1914] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank You Points."

[1915] User (findr): Receives notification and checks "Thank you points."

[1916] Specific examples

[1917] For example, suppose user A loses his wallet in a park. User A opens a communication application and registers the wallet's characteristics (color, size, distinctive markings, etc.). If user A looks anxious at this time, the emotion engine means recognizes this emotion and sends it to the server. The server then sends a kind and comforting message to the communication application to alleviate user A's anxiety. Meanwhile, user B picks up the wallet and similarly registers the characteristic information via the communication application. The server stores this information in a database, and the artificial intelligence means matches them. Once the match is confirmed, user A and user B are notified of the details of the storage location, and user A follows the notification to collect the wallet at the storage location. After that, when user A reports that he has picked up the wallet, the reward procedure is carried out and user B is awarded "thank you points."

[1918] Prompt Sentence Examples

[1919] Examples of prompts to input to a generative AI model might include:

[1920] "I found a wallet in the park. It's black leather and has my student ID inside. Where should I return it?"

[1921] "I dropped my wallet in the park. It's black leather and the corners are scuffed. Please let me know if you find it."

[1922] "I lost my wallet. How do I register the item in the communication application?"

[1923] Through this detailed description of the invention, it will be possible to concretely understand how the present system provides users with a convenient and efficient lost item handling experience.

[1924] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1925] Step 1: User Registration

[1926] Input: A user launches a communications application for the first time and enters profile information (such as name, email address, and phone number).

[1927] Specific operation: The user opens the registration screen of the communication application, enters the required information, and presses the "Register" button.

[1928] Data processing: The terminal converts the input information into JSON format.

[1929] Output: The device sends profile information in JSON format to the server.

[1930] Step 2: Save your profile information

[1931] Input: The server receives the profile information sent from the device.

[1932] Specific operation: The server saves the received information in the database using the INSERT statement.

[1933] Data processing: Saves profile information and generates a new user ID.

[1934] Output: The server returns a confirmation message to the terminal containing the generated user ID.

[1935] Step 3: Register your lost item

[1936] Input: The user enters details of the found item, such as the type, characteristics, location, and date and time of the item into a communication application.

[1937] Specific operation: The user opens the lost item registration screen, enters detailed information, and presses the "Submit" button.

[1938] Data processing: The terminal converts the input information into JSON format.

[1939] Output: The device sends the lost item information in JSON format to the server.

[1940] Step 4: Save the lost item

[1941] Input: The server receives the lost item information sent from the device.

[1942] Specific operation: The server saves the received information in the database using the INSERT statement.

[1943] Data processing: Executes the process of saving the lost item information and generates a confirmation message.

[1944] Output: The server returns a confirmation message to the terminal.

[1945] Step 5: Register your lost item

[1946] Input: The user enters details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[1947] Specific operation: The user opens the lost item registration screen, enters details, and presses the "Submit" button.

[1948] Data processing: The terminal converts the input information into JSON format.

[1949] Output: The device sends the lost item information in JSON format to the server.

[1950] Step 6: Save the lost item

[1951] Input: The server receives the lost item information sent from the device.

[1952] Specific operation: The server saves the received information in the database using the INSERT statement.

[1953] Data processing: Executes the process of saving lost item information and generates a confirmation message.

[1954] Output: The server returns a confirmation message to the terminal.

[1955] Step 7: Enter search criteria

[1956] Input: A user uses a communications application to search for matching lost items.

[1957] Specific behavior: The user opens the search screen, enters criteria, and presses the "Search" button.

[1958] Data processing: The terminal converts the entered search criteria into JSON format.

[1959] Output: The terminal sends the search criteria in JSON format to the server.

[1960] Step 8: Database Search

[1961] Input: The server receives the search criteria sent from the terminal.

[1962] Specific operation: The server uses a SELECT statement in the RDBMS to search for data that matches the conditions.

[1963] Data processing: Extract lost property information that matches the criteria and convert the search results into JSON format.

[1964] Output: The server sends the search results to the device.

[1965] Step 9: Matching

[1966] Input: The server periodically scans the database for lost and found items.

[1967] What happens: The server uses a cron job to scan the database and retrieve new data.

[1968] Data processing: Artificial intelligence tools use machine learning algorithms to calculate matching scores and identify high matches.

[1969] Output: The server manages the matching results and generates notification messages.

[1970] Step 10: Provide emotion data

[1971] Input: Users provide emotional data such as facial expressions and voice when registering or searching for items.

[1972] What happens: The user enables the camera and microphone and provides emotional data to a communication application.

[1973] Data processing: The device analyzes emotion data in real time and converts the results into JSON format.

[1974] Output: The device sends the analysis results to the server.

[1975] Step 11: Emotion Recognition and Responding

[1976] Input: The server receives emotion recognition data sent from the device.

[1977] Specific operation: The server determines the user's emotional state based on the results of the emotion engine means.

[1978] Data processing: The server generates a response message and adjusts the content according to the emotional state.

[1979] Output: The server sends a response message to the terminal.

[1980] Step 12: Collect your items

[1981] Input: The owner user picks up the item at the notified storage location.

[1982] Specific operations: The user goes to the designated storage location and goes through the necessary procedures, such as verifying their identity.

[1983] Output: Owner receives item.

[1984] Step 13: Report the completion of collection

[1985] Input: The user reports the completion of the pickup in the communication application.

[1986] Specific operation: The user opens the pickup completion report screen and presses the "Pickup complete" button.

[1987] Data processing: The terminal converts the completion information into JSON format.

[1988] Output: The device sends the pickup completion information in JSON format to the server.

[1989] Step 14: Database Update

[1990] Input: The server receives the pickup completion information sent from the terminal.

[1991] Specific operation: The server updates the received information in the database using the UPDATE statement.

[1992] Data processing: Update the pickup completion status.

[1993] Output: The server sends an update complete message to the terminal.

[1994] Step 15: Collect rewards and award points

[1995] Input: The server verifies the collection completion information and collects the pre-set reward from the owner.

[1996] Specific operation: The server carries out the collection procedure based on the owner's registration information.

[1997] Data processing: Manage rewards and give a portion of them to the finder as "thank you points."

[1998] Output: The server sends a notification to the user (finder) that "Thank you points" have been awarded.

[1999] (Application example 2)

[2000] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2001] In conventional item management systems, users had to go through cumbersome operations when registering and searching for lost and found items, and registered information was often not matched quickly and reliably. Furthermore, there were a lack of ways to alleviate the anxiety and stress users felt when they lost their belongings, making it difficult to improve the user experience. Furthermore, in virtual stores, item management within the virtual space was not adequate, leading to problems with finding and losing items not being properly matched.

[2002] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to register information about items, an artificial intelligence means for automatically matching information, and an emotion engine means for recognizing the user's emotional state and personalizing responses. This allows the item information registered by the user to be matched quickly and reliably, and provides a response according to the user's emotional state, improving the user experience. In addition, items in the virtual store are managed efficiently, and lost and found items in the virtual space are appropriately matched.

[2003] "User" refers to people who register and search for product information.

[2004] "Information about the item" refers to detailed information such as the type of item, its characteristics, where it was found, where it was dropped, and the date and time.

[2005] "Means for registration" refers to a system or application that allows a user to input product information and transmit it to a database.

[2006] "Means for identification" refers to the functions and algorithms for identifying and specifying registered product information.

[2007] "Database" refers to a relational database system (RDBMS) for storing and managing registered product information.

[2008] "Artificial intelligence means" refers to machine learning algorithms and models for analyzing product information and performing matching processes.

[2009] "Means for notifying users of matching results" refers to communication technology for informing users of information about matched items.

[2010] "Means for managing the release of items" refers to the function of managing the process by which lost items are released to their owners.

[2011] "Means for distributing rewards" refers to the system or mechanism for distributing rewards after delivery of the goods.

[2012] "Emotion Engine" refers to algorithms and modules for analyzing user emotions and personalizing responses.

[2013] "Means for utilizing virtual space" refers to the functions and technologies for managing goods within a virtual store.

[2014] This invention is a system that allows users to register and search information about items, recognize emotions, and provide personalized responses to quickly return lost items to their owners. Furthermore, this system can be applied to virtual stores, enabling item management in virtual space.

[2015] The system mainly consists of the following components:

[2016] 1. User device: A smartphone with a communication application and emotion engine installed.

[2017] 2. Server: A remote server that hosts the database, artificial intelligence means, and emotion engine.

[2018] 3. Database: A relational database system for managing registered item information.

[2019] 4. Artificial intelligence means: machine learning algorithms to carry out the matching process.

[2020] 5. Emotion engine: An algorithm for analyzing user emotions and dynamically adjusting the system's response.

[2021] The user terminal is used as a method for users to register information about items. The specific procedure is explained below.

[2022] 1. User Registration:

[2023] A user opens a communications application and enters profile information (such as name, email address, and phone number).

[2024] The device sends the profile information to the server, which stores it in a database, and a user ID is generated and returned to the device.

[2025] 2. Registering lost items:

[2026] The user inputs the type of found item, its characteristics, the location where it was found, the date and time, etc.

[2027] The terminal sends the input information to the server, which stores the information in a database.

[2028] 3. Registering lost items:

[2029] The user enters details of the lost item.

[2030] The device sends the information and the server stores it in a database.

[2031] 4. Emotion recognition and response:

[2032] When a user registers or searches for an item, the device uses an emotion engine to analyze the user's emotion data.

[2033] The server responds appropriately based on the analysis results of the emotion engine.

[2034] The hardware and software used include smartphones, relational database systems (e.g., SQLite, MySQL), machine learning algorithms (e.g., Python, scikit-learn), and communication applications (e.g., LINE app).

[2035] For example:

[2036] User A loses his wallet in a virtual store and registers it as a "black leather wallet" and "found at the entrance of the virtual store" through a communication application. The emotion engine recognizes the user's anxiety and responds, "Don't worry. We will deal with it promptly."

[2037] Store staff member B uses the same communication application to register the lost item, "black leather wallet" and "found at the entrance of the virtual store." The AI ​​performs matching and notifies user A, "Your wallet has been found. You can pick it up at the entrance of the virtual store."

[2038] Example prompt sentence:

[2039] Prompt: "When a user registers an item in a virtual store, provide an appropriate response based on their emotion (e.g., anxiety)."

[2040] Response: "Don't worry, we'll get back to you as soon as possible. Please enter the item information."

[2041] In this way, flexible responses based on the user's emotional state and item management within the virtual store are realized.

[2042] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2043] Step 1:

[2044] User Registration

[2045] Input: A user launches a communications application and enters profile information (such as name, email address, and phone number).

[2046] Specific behavior:

[2047] User input is received and the device sends profile information to the server.

[2048] The server stores the received profile information in a database and generates a new user ID.

[2049] The server returns the generated user ID to the terminal.

[2050] Output: The profile information is saved to the database and the user ID is returned to the device.

[2051] Step 2:

[2052] Registering lost items

[2053] Input: The user enters the type, description, location, date, etc. of the found item into a communication application.

[2054] Specific behavior:

[2055] User input is received and the device sends the information to the server.

[2056] The server stores the received lost item information in a database.

[2057] Output: The found item information is saved to the database and a confirmation message is displayed on the terminal.

[2058] Step 3:

[2059] Registering lost items

[2060] Input: The user enters details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[2061] Specific behavior:

[2062] User input is received and the device sends the information to the server.

[2063] The server stores the information about the lost items received in a database.

[2064] Output: The lost item information is saved to the database and a confirmation message is displayed on the terminal.

[2065] Step 4:

[2066] Emotion Recognition and Response

[2067] Input: Users provide emotional data (facial expressions, voice, etc.) when registering or searching for items.

[2068] Specific behavior:

[2069] The device uses an emotion engine to analyze the user's emotion data.

[2070] The server determines the user's emotional state based on the analysis results of the emotion engine and determines the optimal response.

[2071] The server sends an appropriate response message to the terminal.

[2072] Output: A response depending on the user's emotional state is displayed in the communication application.

[2073] Step 5:

[2074] Matching process

[2075] Input: Newly registered lost and found information.

[2076] Specific behavior:

[2077] The server periodically scans the database for lost and found information.

[2078] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[2079] The server manages the matching results and notifies the owner and finder.

[2080] Output: The user is notified of the matched item information.

[2081] Step 6:

[2082] Delivery of goods

[2083] Input: Storage location information notified by the matching result.

[2084] Specific behavior:

[2085] The user will collect the item at the storage location notified.

[2086] After the pickup is complete, the user reports "Pickup completed" via the communication application.

[2087] The terminal transmits information about the completion of collection to the server, and the server updates the database.

[2088] Output: Pickup completion information is saved in the database.

[2089] Step 7:

[2090] Rewards and points

[2091] Input: Pickup completion information.

[2092] Specific behavior:

[2093] The server confirms the information on the completion of collection and carries out the procedure to collect the pre-set reward from the owner.

[2094] The server manages the collected rewards on the system and gives a portion of them to the finder as points.

[2095] The user (findr) will receive a notification and check their points.

[2096] Output: Points are awarded to the finder and a reward is collected from the owner.

[2097] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2098] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2099] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2100] [Fourth embodiment]

[2101] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2102] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2103] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2104] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2105] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2106] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2107] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2108] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2109] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2110] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2111] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2112] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2113] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2114] This invention is a system that allows people who have lost or found an item to easily register and search for information about the item using their smartphone, and through AI matching, the lost item can be quickly and reliably returned to its owner. Below, we will explain each element of the system and how it works.

[2115] System configuration

[2116] This system mainly consists of the following elements:

[2117] 1. User device: A smartphone or tablet with the LINE application installed.

[2118] 2. Server: A remote server that hosts the database and artificial intelligence means.

[2119] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[2120] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[2121] Program processing description

[2122] User Registration

[2123] User: Open the LINE application on first launch and enter your profile information.

[2124] Device: Sends profile information to the server.

[2125] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[2126] Registering lost items

[2127] User: Enter details of the lost item, such as the type, characteristics, location, date and time of the item, into the LINE app.

[2128] Terminal: Sends the entered information to the server.

[2129] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[2130] Registering lost items

[2131] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[2132] Terminal: Sends the entered information to the server.

[2133] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[2134] Search process

[2135] User: If the lost item cannot be found, use the LINE app's search function to search for lost items that match the criteria.

[2136] Terminal: Sends search criteria to the server.

[2137] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[2138] Matching process

[2139] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[2140] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[2141] Server: Manages matching results and notifies the owner and finder.

[2142] Delivery of goods

[2143] User (owner): Make arrangements to collect the item at the notified storage location.

[2144] User: After picking up the item, report "Pickup completed" via the LINE app.

[2145] Terminal: Sends information about the completion of collection to the server.

[2146] Server: Updates the database with the pickup completion information.

[2147] Rewards and points

[2148] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[2149] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank you PayPay points."

[2150] User (findr): Receives notification and checks "Thank you PayPay points."

[2151] Specific examples

[2152] For example, suppose user A loses their wallet in a park. A opens the LINE app and registers the wallet's characteristics (color, size, distinctive markings, etc.). Meanwhile, user B finds the wallet and similarly registers the characteristic information via the LINE app. The server stores this information in a database, and the AI ​​matches them. Once a match is confirmed, A and B are notified of the details of the storage location, and A follows the notification to pick up the wallet at the park management office. After that, when A reports that he has picked up the wallet, the reward procedure is carried out, and B is awarded "Thank you PayPay points."

[2153] In this way, the system helps return lost items to their owners efficiently, reducing waste. Furthermore, the entire process can be completed via the user's smartphone, making it highly convenient.

[2154] The processing flow will be explained below.

[2155] Step 1:

[2156] A user installs the LINE app and enters their profile information (name, email address, phone number, etc.) when using it for the first time.

[2157] Step 2:

[2158] The terminal formats the entered profile information and transmits it to the server.

[2159] Step 3:

[2160] The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[2161] Step 4:

[2162] The user opens the LINE app and enters details such as the type of lost item, its characteristics, where it was found, and the date and time.

[2163] Step 5:

[2164] The terminal transmits the entered found item information to the server.

[2165] Step 6:

[2166] The server stores the received information about the lost item in a database and returns a confirmation message to the terminal.

[2167] Step 7:

[2168] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[2169] Step 8:

[2170] The terminal transmits the input lost item information to the server.

[2171] Step 9:

[2172] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[2173] Step 10:

[2174] Users can use the LINE app's search function to search for lost items that meet their criteria.

[2175] Step 11:

[2176] The terminal transmits the search conditions to the server.

[2177] Step 12:

[2178] The server searches the database for lost item information and returns results that match the conditions to the terminal.

[2179] Step 13:

[2180] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[2181] Step 14:

[2182] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[2183] Step 15:

[2184] The server manages the matching results and notifies the owner and finder.

[2185] Step 16:

[2186] The user (owner) will complete the procedures to collect the item at the notified storage location.

[2187] Step 17:

[2188] The user (owner) reports the completion of collection via the LINE app.

[2189] Step 18:

[2190] The terminal transmits information indicating that the collection has been completed to the server.

[2191] Step 19:

[2192] The server updates the database with the information about the completion of collection.

[2193] Step 20:

[2194] The server confirms the information on the completion of collection and carries out the procedure to collect a predetermined reward from the owner.

[2195] Step 21:

[2196] The server manages the collected rewards on the system and gives a portion of them to the finder as "Thank you PayPay points."

[2197] Step 22:

[2198] The user (findr) receives a notification and checks the "Thank you PayPay points."

[2199] Example 1

[2200] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2201] Conventional lost property management systems have problems with complex and time-consuming tasks such as identifying the location and date of an item, sharing information between the owner and finder, handling the item handover procedure, and distributing rewards. Furthermore, because they rely on manual matching, the speed at which items are returned to their owners is slow and unreliable. This invention aims to solve these problems, streamline the process of finding and returning items, and ensure that items are returned to their owners quickly and reliably.

[2202] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2203] In this invention, the server includes a means for using a communication application that users use when registering or searching for items, a means for updating the database with information about the completion of collection, and a means for awarding points as a reward. This allows users to easily register and search for item information, and enables rapid matching using artificial intelligence. In addition, by immediately updating the database with information about the completion of item collection and awarding points as a reward, a system that is highly convenient for both the owner and the finder can be realized.

[2204] "User" means an individual or organization that uses this system to register, search, and match information about items.

[2205] "Item" refers to any lost or found object registered by a User.

[2206] "Information" refers to detailed data about an item (type, characteristics, location, date and time, etc.).

[2207] "Registering" refers to the act of a user entering information about an item and storing it in a database.

[2208] "Identification" refers to the process of identifying and recognizing registered product information.

[2209] "Database" refers to a relational database system (RDBMS) for storing and managing registered product information.

[2210] "Artificial intelligence" refers to machine learning algorithms and models that match items based on information.

[2211] "Matching" refers to the process of analyzing found and lost item information to identify likely matches.

[2212] "Notification" refers to the act of informing users of information such as the item matching results, collection procedures, and rewards.

[2213] "Release" refers to the procedure of returning the notified item to the owner at the storage location.

[2214] "Reward" refers to the money or points collected by the system from the owner after the item is handed over and distributed to the finder.

[2215] "Communication Application" refers to a platform that allows users to register and search for items.

[2216] "Points" refers to a digital reward system that is awarded to finders as a reward.

[2217] This invention is a system that allows people who have lost or found an item to easily register and search for information about the item using their smartphone, and through AI matching, the lost item can be quickly and reliably returned to its owner. Below, we will explain each element of this system and how it works.

[2218] System configuration

[2219] This system mainly consists of the following elements:

[2220] 1. User device: A smartphone or tablet with a communication application installed.

[2221] 2. Server: A remote server that hosts the database and artificial intelligence means.

[2222] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[2223] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[2224] Operating Procedure

[2225] User Registration

[2226] A user launches a communications application for the first time and enters profile information such as name, email address, and phone number.

[2227] The terminal transmits the input profile information to the server.

[2228] The server stores the received profile information in a database, generates a user ID, and returns it to the terminal.

[2229] Registering lost items

[2230] The user enters details of the found item, such as the type, characteristics, location, date and time of the found item, into a communication application.

[2231] The terminal transmits the input information to the server.

[2232] The server stores the received lost item information in a database and returns a confirmation message to the terminal.

[2233] Registering lost items

[2234] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into a communication application.

[2235] The terminal transmits the input information to the server.

[2236] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[2237] Search process

[2238] The user uses the search function of the communication application to search for lost items that meet the criteria.

[2239] The terminal transmits the search conditions to the server.

[2240] The server searches the database for lost item information and returns results that match the criteria to the terminal.

[2241] Matching process

[2242] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[2243] The artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[2244] The server manages the matching results and notifies the owner and finder.

[2245] Delivery of goods

[2246] The user (owner) will take steps to collect the item at the notified storage location.

[2247] After picking up the item, the user reports "pickup completed" using the communication application.

[2248] The terminal transmits information indicating that the collection has been completed to the server.

[2249] The server updates the database with the information about the completion of collection.

[2250] Rewards and points

[2251] The server confirms the information about the completed collection and performs procedures to collect the pre-set reward from the owner, for example, by using a digital payment system.

[2252] The server manages the collected rewards on the system and gives a portion of them to the finder as digital points.

[2253] The user (finder) receives a notification of the points awarded via a communication application and confirms that the digital points have been reflected.

[2254] Specific examples

[2255] For example, if user A drops his wallet in a park, he uses a communication application to register its characteristics as a "black leather wallet." Meanwhile, user B finds the wallet and similarly registers the characteristics information via the communication application.

[2256] The server stores this information in a database, and an artificial intelligence tool matches the information. Once a match is confirmed, A and B are notified of the details of the storage location, and A picks up the wallet at the storage location. After that, when A reports that he has picked up the wallet, the reward procedure is carried out and B is awarded digital points.

[2257] Prompt Sentence Examples

[2258] Below is an example of a prompt sentence to input to the generative AI model.

[2259] Describe a system that allows a user to input characteristics of a lost item (such as color, size, distinctive markings, etc.) and returns information about similar lost items.

[2260] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2261] Processing flow

[2262] Step 1: User Registration

[2263] 1.1 A user launches a communications application for the first time and enters profile information such as name, email address, and phone number.

[2264] Input: User profile information (name, email address, phone number)

[2265] Output: Request to send profile information

[2266] Specific operation: The user opens a communication application (on a smartphone or tablet) and enters information into the designated input fields.

[2267] 1.2 The device sends the entered profile information to the server.

[2268] Input: Profile information entered by the user

[2269] Output: A request containing profile information is sent to the server

[2270] What happens: The application converts the profile information into JSON format and generates a request to send to the server over SSL / TLS.

[2271] 1.3 The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[2272] Input: Submitted profile information

[2273] Output: Profile information stored in the database and generated user ID.

[2274] Specific operation: The server checks the uniqueness of the profile information, stores it in the database, and then generates and returns a new user ID.

[2275] Step 2: Register your lost item

[2276] 2.1 The user enters details of the found item, such as type, characteristics, location, date and time into the communication application.

[2277] Input: Details of the lost item (type, characteristics, location of the item, date and time)

[2278] Output: A request containing the lost item information

[2279] Specific operation: A user opens a lost item registration screen in a communications application and enters details into several input fields.

[2280] 2.2 The terminal sends the entered information to the server.

[2281] Input: User-entered details of the found item

[2282] Output: A request containing the found item information is sent to the server.

[2283] Specific behavior: Converts the found item information into JSON format and generates a request to send to the server.

[2284] 2.3 The server stores the received lost item information in a database and returns a confirmation message to the terminal.

[2285] Input: Details of the lost item submitted

[2286] Output: Information stored in the database and a confirmation message

[2287] Specific operation: The server checks the format of the information, saves it in the database, and then returns a confirmation message to the terminal.

[2288] Step 3: Register your lost item

[2289] 3.1 The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the communication application.

[2290] Input: Details of lost item (type, characteristics, location, date and time)

[2291] Output: A request containing lost items

[2292] Specific behavior: The user opens the lost item registration screen of a communication application and enters details into several input fields.

[2293] 3.2 The terminal sends the entered information to the server.

[2294] Input: User-entered details of the lost item

[2295] Output: A request containing the lost item information is sent to the server.

[2296] Specific operation: Converts the lost item information into JSON format and generates a request to send to the server.

[2297] 3.3 The server stores the information of the lost item in a database and returns a confirmation message to the device.

[2298] Input: Details of the lost item submitted

[2299] Output: Information stored in the database and a confirmation message

[2300] Specific operation: The server checks the format of the information, saves it in the database, and then returns a confirmation message to the terminal.

[2301] Step 4: Search process

[2302] 4.1 The user uses the search function of the communication application to search for lost items that meet the criteria.

[2303] Input: Search criteria for the item you are looking for (type, characteristics, location found, date and time, etc.)

[2304] Output: Request containing search criteria

[2305] Specific operation: The user opens the search screen of a communication application, enters the required information in the search criteria input field, and presses the search button.

[2306] 4.2 The terminal sends the search criteria to the server.

[2307] Input: The search criteria entered by the user

[2308] Output: A request containing search criteria is sent to the server.

[2309] Specific operation: Converts search criteria into JSON format and generates a request to send to the server.

[2310] 4.3 The server searches the database for lost item information and returns results that match the criteria to the terminal.

[2311] Input: Submitted search criteria

[2312] Output: Lost and found items matching the criteria

[2313] What it does: The server searches for lost items in the database and returns matching results in JSON format.

[2314] Step 5: Matching

[2315] 5.1 The server will periodically scan the database and match newly registered lost and found items using artificial intelligence means.

[2316] Input: All item information in the database (lost and found)

[2317] Output: Matching results

[2318] What it does: The server runs a scheduled job to periodically scan the database.

[2319] 5.2 Artificial intelligence means will analyze the registered information and identify combinations that are likely to match.

[2320] Input: Lost and found information retrieved from the database

[2321] Output: likely matching pairs

[2322] Specific operation: Uses machine learning algorithms to perform matching based on features and generate results.

[2323] 5.3 The server manages the matching results and notifies the owner and finder.

[2324] Input: Matching results

[2325] Output: Information message

[2326] Specific operation: Create a notification message based on the matching results and send it to the user.

[2327] Step 6: Handover of goods

[2328] 6.1 The User (Owner) will complete the procedures to collect the item at the notified storage location.

[2329] Input: Subinventory Notification

[2330] Output: Report of pick-up completion

[2331] Specific operations: The user goes to the designated storage location and goes through the necessary procedures, such as verifying their identity.

[2332] 6.2 After the user has collected the item, he / she reports "collection completed" in the communication application.

[2333] Input: Report of completion of collection

[2334] Output: A completion report is sent to the server

[2335] Specific operation: Press the Complete button on the dedicated screen of the application to report that the pickup is complete.

[2336] 6.3 The terminal sends information about the completion of collection to the server.

[2337] Input: Pickup completion report entered by the user

[2338] Output: Pickup completion information is sent to the server

[2339] Specific behavior: The application converts the completion report into JSON format and generates a request to send to the server.

[2340] 6.4 The server updates the database with the information on the completion of collection.

[2341] Input: Pickup completion report

[2342] Output: Pickup completion information updated in the database

[2343] Specific operation: The server reflects the received pickup completion information in the database.

[2344] Step 7: Rewards and Points

[2345] 7.1 The server confirms the collection completion information and proceeds to collect the pre-set reward from the owner.

[2346] Input: Pickup completion information

[2347] Output: Confirmation of collection completion

[2348] Specific operation: The server collects rewards from the owner using a digital payment system.

[2349] 7.2 The server manages the collected rewards on the system and gives a portion of them to the finder as digital points.

[2350] Input: Remuneration collected

[2351] Output: Digital points awarded

[2352] Specific operation: The server converts a certain percentage of the reward into digital points and reflects them in the finder's account.

[2353] 7.3 The user (finder) receives a notification of the points awarded via the communication application and confirms that the digital points have been reflected.

[2354] Input: Point award notification

[2355] Output: Points are reflected in your account.

[2356] Specific behavior: The application displays the awarded points and the user confirms them.

[2357] (Application example 1)

[2358] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2359] In modern society, many people lose items or find other people's items on a daily basis. However, there is a lack of a system to quickly and reliably return these items to their owners. In particular, in places where many people gather or at event venues, information on lost and found items is mixed together, making management difficult. To solve this problem, an efficient system is needed that registers item information in real time, performs matching, and integrates notification and delivery management.

[2360] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2361] In this invention, the server includes means for a user to register information about an item, means for identifying the registered item information, means for storing the item information in a database, artificial intelligence means for automatically matching information, means for notifying the user of the matching result, means for managing the delivery of the notified item, means for distributing a reward after the delivery of the item, means for taking an image of the item with a head-mounted display or eyeglass-type display device and registering information by voice input, and means for notifying the user of the matching processing result in real time by voice or visual display, thereby enabling information about lost or found items to be processed quickly and efficiently and allowing the user to recover the item as soon as possible.

[2362] "User" means any person or legal entity that registers items and searches for and checks lost and found items.

[2363] "Item information" is detailed data about lost or found items, such as their characteristics, type, where they were found, and the date and time they were found.

[2364] A "database" is an information system for storing, managing, and searching product information.

[2365] "Artificial intelligence means" refers to technical means for matching product information using machine learning algorithms or models.

[2366] "Notification means" means a method for communicating information about the matching results or delivery to the user, including audio or visual notifications.

[2367] The "delivery management means" is a system for managing the storage location and delivery procedures of notified items.

[2368] The "reward distribution means" is a means for giving rewards or points to the finder after the item is handed over.

[2369] A "head-mounted display" is a device that is worn on the user's head to display information, such as smart glasses or a head-mounted display (HMD).

[2370] "Image capture means" refers to a device or technique for capturing an image of an item using a camera.

[2371] "Voice input means" refers to means for accepting information input from a user using a microphone or voice recognition technology.

[2372] "Real-time notification means" refers to a method for communicating the results of the matching process to the user without delay by voice or visual display.

[2373] A "generative AI model" is an artificial intelligence technology that analyzes data such as audio and images and generates results that meet specific purposes.

[2374] This invention is a system that allows users to register information about items and quickly and reliably return lost items to their owners. The detailed configuration and operation of this system will be described below.

[2375] System configuration

[2376] The system mainly consists of the following components:

[2377] 1. User terminal: smart glasses (e.g., head-mounted display or eyeglass display).

[2378] 2. Server: A remote server that hosts the database and artificial intelligence tools.

[2379] 3. Database: Relational database system (RDBMS) for managing product information.

[2380] 4. Artificial intelligence tools: Machine learning algorithms and generative AI models that perform the matching process.

[2381] System Operation

[2382] User Registration

[2383] When the user first starts up the smart glasses, they put them on and register their profile information (such as name and contact details) through voice recognition. This information is sent to the server and stored in a database. Based on the user's profile information, the system generates a user ID and returns it to the user's device.

[2384] Registering lost items

[2385] When a user finds a lost item, they take a photo of it with the camera on their smart glasses and register its characteristics (color, size, distinctive marks, etc.) through voice input. The entered information is sent from the device to a server and stored in a database.

[2386] Registering lost items

[2387] Similarly, users who lose an item can register details of the lost item (type, characteristics, location, date and time, etc.) by voice input using the smart glasses. The transmitted information is stored on the server.

[2388] Matching process

[2389] The server periodically scans the database and analyzes newly registered lost and found items using artificial intelligence methods (machine learning algorithms and generative AI models) for automatic matching, identifying pairs with a high probability of matching.

[2390] Notice and Delivery

[2391] When a match is found, the server will send a push notification to the smart glasses and notify the user in real time via audio or visual display. The user can then follow the notification to complete the item delivery procedure. After the item delivery is completed, the server will update the database and report the completion.

[2392] Rewards and points

[2393] After the delivery is complete, the server calculates a pre-set reward and awards rewards and points to the finder, using a generative AI model to analyze the voice data and generate a thank-you prompt for the user.

[2394] Examples of concrete examples and prompts

[2395] For example, if user A loses their wallet at an event:

[2396] User A uses the smart glasses to voice input the following: "I dropped my black wallet near the main stage. It contains a credit card and a 1,000 yen bill."

[2397] User B then picks up the wallet and similarly registers through voice input, "I found a black wallet near the main stage." The server analyzes this information, generates a matching result, and notifies A and B's smart glasses. Upon receiving the notification, A collects the wallet at the storage location, and B receives a reward.

[2398] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2399] Step 1:

[2400] User Registration

[2401] The user puts on the smart glasses and registers their profile information using voice recognition when they first start up the device.

[2402] Input: User's spoken input (name, contact information, etc.).

[2403] Data processing: Speech recognition software converts the voice data into text data.

[2404] Output: Profile information in text format.

[2405] Specific operation: The device sends the collected profile information to the server, which stores it in a database. The server generates a user ID and sends it back to the device.

[2406] Step 2:

[2407] Registering lost items

[2408] The user takes a photo of the item they pick up with the smart glasses' camera and registers its characteristics using voice input.

[2409] Input: Image of the item and voice input (item characteristics, location found, date and time, etc.).

[2410] Data processing: Image analysis software extracts the features of the item, and voice recognition software converts the voice data into text data.

[2411] Output: Textual feature information and object images.

[2412] Specific operation: The terminal sends the image and characteristic information of the item to the server, which stores it in a database.

[2413] Step 3:

[2414] Registering lost items

[2415] Users register details of lost items using voice input using smart glasses.

[2416] Input: Voice input (item characteristics, location of loss, date and time, etc.).

[2417] Data processing: Speech recognition software converts the voice data into text data.

[2418] Output: Textual information about the lost item.

[2419] Specific operation: The device sends feature information to the server, which then stores it in a database.

[2420] Step 4:

[2421] Matching process

[2422] The server periodically scans the database for newly registered lost and found items and matches them using artificial intelligence means.

[2423] Input: Characteristics of lost and found items in the database.

[2424] Data processing: Analyze feature information using machine learning algorithms (generative AI models) to improve matching accuracy.

[2425] Output: Matching results (likely combinations).

[2426] Specific operation: The server runs the generative AI model, generates matching results, and registers them in the database.

[2427] Step 5:

[2428] Notice and Delivery

[2429] The server pushes the matching results to the smart glasses, notifying the user via audio or visual display.

[2430] Input: Matching results.

[2431] Output: Push notification (audio and visual information).

[2432] Specific operation: The server generates notification content and sends it to the device (smart glasses), which then notifies the user of the content via audio or visual means.

[2433] Step 6:

[2434] Post-delivery updates

[2435] After the user hands over the item, the smart glasses send a completion report to the server.

[2436] Input: Completion report.

[2437] Data Processing: Matching entered completion reports with corresponding records in the database.

[2438] Output: Updated database records.

[2439] Specific operation: The terminal sends a completion report to the server, and the server updates the database.

[2440] Step 7:

[2441] Rewards and points

[2442] The server will then carry out the process of awarding rewards and points to the finder based on the data collected after the item has been picked up.

[2443] Input: Delivery completion data.

[2444] Data processing: The reward amount is calculated using a reward calculation algorithm and points are awarded.

[2445] Output: Rewards and points awarded.

[2446] Specific operation: The server processes rewards and points, generates a thank you prompt using a generative AI model, and notifies the user.

[2447] Prompt Sentence Examples

[2448] For example, if user A loses their wallet at an event:

[2449] User A uses the smart glasses to voice input the following: "I dropped my black wallet near the main stage. It contains a credit card and a 1,000 yen bill."

[2450] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2451] This invention is a system that allows users to easily register and search information about items, and by combining artificial intelligence and an emotion engine, it enables lost items to be returned to their owners quickly and reliably. It also improves the user experience by recognizing the user's emotions and personalizing responses based on them.

[2452] System configuration

[2453] This system mainly consists of the following elements:

[2454] 1. User device: A smartphone or tablet with the LINE application and emotion engine installed.

[2455] 2. Server: A remote server that hosts the database, artificial intelligence means, and emotion engine.

[2456] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[2457] 4. Artificial intelligence tools: Machine learning algorithms and models to carry out the matching process.

[2458] 5. Emotion Engine: Algorithms and modules for analyzing user emotions and dynamically adjusting the system's response.

[2459] Program processing description

[2460] User Registration

[2461] User: When launching the LINE application for the first time, open it and enter your profile information (name, email address, phone number, etc.).

[2462] Device: Sends profile information to the server.

[2463] Server: Stores the received profile information in a database, generates a user ID, and returns it to the device.

[2464] Registering lost items

[2465] User: Enter details of the lost item, such as the type, characteristics, location, date and time of the item, into the LINE app.

[2466] Terminal: Sends the entered information to the server.

[2467] Server: Stores the received lost item information in a database and returns a confirmation message to the device.

[2468] Registering lost items

[2469] User: Enter details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[2470] Terminal: Sends the entered information to the server.

[2471] Server: Stores the information about the lost item in a database and returns a confirmation message to the device.

[2472] Search process

[2473] User: If the lost item cannot be found, use the LINE app's search function to search for lost items that match the criteria.

[2474] Terminal: Sends search criteria to the server.

[2475] Server: Searches the database for lost items and returns results that match the criteria to the terminal.

[2476] Matching process

[2477] Server: Periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[2478] Artificial intelligence means: Analyzes registered information and identifies combinations that are likely to match.

[2479] Server: Manages matching results and notifies the owner and finder.

[2480] Emotion Recognition and Response

[2481] User: Provides emotional data such as facial expressions and voice to use the emotion engine when registering and searching for items.

[2482] Terminal: The emotion engine analyzes the emotion data and sends the results to the server.

[2483] Server: Based on the results of the emotion engine, determine the user's emotional state and tailor appropriate responses and notification content.

[2484] Delivery of goods

[2485] User (owner): Make arrangements to collect the item at the notified storage location.

[2486] User: After picking up the item, report "Pickup completed" via the LINE app.

[2487] Terminal: Sends information about the completion of collection to the server.

[2488] Server: Updates the database with the pickup completion information.

[2489] Rewards and points

[2490] Server: Confirms the collection completion information and carries out the procedure to collect the pre-set reward from the owner.

[2491] Server: The collected rewards are managed on the system, and a portion of them is given to the finder as "Thank you PayPay points."

[2492] User (findr): Receives notification and checks "Thank you PayPay points."

[2493] Specific examples

[2494] For example, suppose Person A loses their wallet in a park. Person A opens the LINE app and registers the wallet's characteristics (color, size, distinctive markings, etc.). If Person A looks anxious, the emotion engine recognizes this emotion and sends it to the server. The server then sends a kind and comforting message to the LINE app to alleviate Person A's anxiety. Meanwhile, Person B picks up the wallet and similarly registers the wallet's characteristics via the LINE app. The server stores this information in a database, and the AI ​​matches them. Once a match is confirmed, Person A and Person B are notified of the details of where the wallet was stored, and Person A follows the notification to pick up the wallet at the park management office. After that, when Person A reports that they have retrieved it, the reward process begins and Person B is awarded "Thank you PayPay points."

[2495] In this way, the system helps return lost items to their owners quickly and provides appropriate responses depending on the user's emotional state, improving the overall experience.

[2496] The processing flow will be explained below.

[2497] Step 1:

[2498] A user installs the LINE app and enters their profile information (name, email address, phone number, etc.) when using it for the first time.

[2499] Step 2:

[2500] The terminal formats the entered profile information and transmits it to the server.

[2501] Step 3:

[2502] The server stores the received profile information in a database, generates a user ID, and returns it to the device.

[2503] Step 4:

[2504] The user opens the LINE app and enters details such as the type of lost item, its characteristics, where it was found, and the date and time.

[2505] Step 5:

[2506] The terminal transmits the entered found item information to the server.

[2507] Step 6:

[2508] The server stores the received information about the lost item in a database and returns a confirmation message to the terminal.

[2509] Step 7:

[2510] The user enters details of the lost item (type, characteristics, location, date and time, etc.) into the LINE app.

[2511] Step 8:

[2512] The terminal transmits the input lost item information to the server.

[2513] Step 9:

[2514] The server stores the information about the lost item in a database and returns a confirmation message to the terminal.

[2515] Step 10:

[2516] Users can use the LINE app's search function to search for lost items that meet their criteria.

[2517] Step 11:

[2518] The terminal transmits the search conditions to the server.

[2519] Step 12:

[2520] The server searches the database for lost item information and returns results that match the conditions to the terminal.

[2521] Step 13:

[2522] The server periodically scans the database and matches newly registered lost and found items using artificial intelligence means.

[2523] Step 14:

[2524] Artificial intelligence means analyzes the registered information and identifies combinations that are likely to match.

[2525] Step 15:

[2526] The server manages the matching results and notifies the owner and finder.

[2527] Step 16:

[2528] Users will be provided with emotional data such as facial expressions and voice in order to use the emotion engine when registering and searching for items.

[2529] Step 17:

[2530] The device acquires emotion data and analyzes it using an emotion engine.

[2531] Step 18:

[2532] The emotion engine analyzes the emotion data and sends the analysis results to the server.

[2533] Step 19:

[2534] The server determines the user's emotional state based on the analysis results of the emotion engine and generates an appropriate response message.

[2535] Step 20:

[2536] The server sends a response message or notification content to the device according to the user's emotional state.

[2537] Step 21:

[2538] The user (owner) will complete the procedures to collect the item at the notified storage location.

[2539] Step 22:

[2540] The user reports completion of pickup via the LINE app.

[2541] Step 23:

[2542] The terminal transmits information indicating that the collection has been completed to the server.

[2543] Step 24:

[2544] The server updates the database with the information about the completion of collection.

[2545] Step 25:

[2546] The server confirms the information on the completion of collection and carries out the procedure to collect a predetermined reward from the owner.

[2547] Step 26:

[2548] The server manages the collected rewards on the system and gives a portion of them to the finder as "Thank you PayPay points."

[2549] Step 27:

[2550] The user (findr) receives a notification and checks the "Thank you PayPay points."

[2551] Example 2

[2552] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2553] Even if a lost item is found, it is difficult to quickly and reliably return it to its owner, and it is also difficult to respond appropriately depending on the user's emotional state. There is a need to solve these problems and improve the user experience.

[2554] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2555] In this invention, the server includes means for a user to register information about an item, means for identifying the registered item information, means for storing the item information in a database, artificial intelligence means for automatically matching information, means for notifying the user of the matching result, means for managing the notified item delivery, means for distributing a reward after the item is delivered, emotion engine means for analyzing the user's emotion data and adjusting the system's response, and means for transmitting emotion recognition data by the emotion engine means to the server. This allows lost items to be returned to their owners quickly and reliably, and enables appropriate responses according to the user's emotional state.

[2556] "User" refers to an individual or legal entity that registers or searches for information about an item.

[2557] "Item" refers to an object that a user has registered or found.

[2558] "Item information" refers to detailed information such as the type of item, its characteristics, the location where it was found, and the date and time it was found.

[2559] "Database" refers to an information storage system for accumulating and managing product information.

[2560] "Artificial intelligence means" refers to machine learning algorithms and models that analyze product information and automatically match it.

[2561] "Matching results" refer to data pairs that are likely to match the product information analyzed by the artificial intelligence means.

[2562] "Emotion engine means" refers to algorithms or modules that analyze user emotional data and adjust the system's response.

[2563] "Emotion recognition data" refers to data that indicates the emotional state of a user extracted from their facial expressions, voice, etc.

[2564] "Delivery means" refers to the system function for managing the procedure for delivering the notified item to the user.

[2565] "Reward distribution means" refers to a system function for distributing rewards after delivery of an item.

[2566] "Communication application" refers to software that users use to register and search for product information.

[2567] This invention is a system that allows users to easily register and search information about items, and by combining artificial intelligence and an emotion engine, it enables lost items to be returned to their owners quickly and reliably. It also improves the user experience by recognizing the user's emotions and personalizing responses based on them.

[2568] System configuration

[2569] This system mainly consists of the following elements:

[2570] 1. User device: A smartphone or tablet with a communication application and emotion engine installed.

[2571] 2. Server: A remote server that hosts the database, artificial intelligence means and emotion engine.

[2572] 3. Database: A relational database system (RDBMS) for storing and managing registered product information.

[2573] 4. Artificial intelligence tools: Machine learning algorithms and models for analyzing and automatically matching item information.

[2574] 5. Emotion engine means: Algorithms and modules for analyzing user emotion data and adjusting the system's response.

[2575] Program processing description

[2576] ...

Claims

1. A means for a user to register information about an item; means for identifying registered product information; means for storing the item information in a database; artificial intelligence means for automatically matching information; a means for notifying the user of the matching result; means for controlling the delivery of the notified goods; means for distributing the reward after delivery of the goods; A system including:

2. 2. The system according to claim 1, wherein the means for the user to register and search for product information is realized by utilizing a communication application.

3. 2. The system of claim 1, wherein the artificial intelligence means includes an algorithm for analyzing the characteristics of the product information and improving the accuracy of the matching.

Images