system

Abstract

Provide a system. A means for registering detailed information about lost items; a means for registering details of lost items; a means for matching information about lost and found items using a generative artificial intelligence model; means for notifying the finder and loser upon successful matching; The system includes a means for collecting a performance fee based on the match.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] This invention relates to a system for managing and returning lost and found items in Japan. Under the current system, approximately 30% of lost items are cash and cards, and many other items are disposed of without being returned to their owners. This creates problems from the perspective of environmental protection. The purpose of this invention is to solve this problem by providing a system that efficiently connects finders and lost items, thereby improving the return rate of items and contributing to environmental protection. [Means for solving the problem]

[0005] The present invention solves the above problems by the following means. First, a means for registering detailed information on found items and a means for registering detailed information on lost items is provided. Next, a means for matching information on found items and lost items using a generative artificial intelligence model is included. A system is then constructed that includes a means for notifying the finder and the loser if the match is successful, and a means for collecting a reward based on the match. Furthermore, a generative artificial intelligence model is employed to analyze characteristics based on information on found items and information on lost items, and to analyze the type, characteristics, location, date, and image data of the items, thereby improving the accuracy of the match. Furthermore, if the match is successful, a means for contacting the finder and the loser is provided to facilitate information exchange. These means make it possible to efficiently manage and return found and lost items, thereby contributing to environmental protection.

[0006] "Lost property" refers to items that are found by others in a particular location and whose ownership is unknown.

[0007] "Lost property" refers to an item that has been lost by its owner through carelessness or other circumstances and that is expected to be found.

[0008] A "generative artificial intelligence model" refers to a computational method that uses techniques such as machine learning and neural networks to analyze data and extract specific patterns and features.

[0009] "Matching" refers to the process of comparing information about found and lost items to identify items with common characteristics.

[0010] "Performance reward" refers to a fixed amount of reward collected when a match is successful and the item is returned to its owner.

[0011] "Notification" refers to a means of communication that notifies the finder and the lost item of the result when a found item is successfully matched with a lost item.

[0012] "Means of communication" refers to the functions and platforms provided by the system to allow the finder and loser to exchange information after being matched. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0014] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0017] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0018] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0019] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0021] [First embodiment]

[0022] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0023] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0026] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0029] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0033] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0034] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative artificial intelligence model, and a means for collecting performance-based rewards.

[0035] System configuration and operation:

[0036] Registering lost items

[0037] Device: The finder uses a web form or mobile app to enter details about the lost item (item type, characteristics, location, date found, photos, etc.) and sends the information to the server.

[0038] Server: The server verifies the received information, stores it in the database, and notifies the finder that the information has been registered.

[0039] Registering a lost item report

[0040] Device: The lost person uses a web form or mobile app to enter details of the lost item (item type, characteristics, location, date of loss, photo, etc.) and sends the information to the server.

[0041] Server: The server verifies the received information, stores it in the database, and notifies the lost person that the information has been registered.

[0042] matching

[0043] Server: The server retrieves lost and found items from the database and analyzes them using a generative artificial intelligence model to compare item types, characteristics, locations, dates, and image data to find matching items.

[0044] Example: Finder A finds a "red wallet" in a park, and loser B loses it near a train station on the same day. A generative AI model analyzes this information, matches the wallet type, color, where it was found, and the proximity of where it was lost, and sends a notification.

[0045] Notification and communication

[0046] Server: If the match is successful, the server sends an in-system notification to the finder and the loser, and provides a dedicated means of communication (such as a chat function) so that the finder and the loser can directly communicate and confirm details.

[0047] Users: The finder and the loser can use the system's communication tools to discuss how to hand over the item and what to check.

[0048] Performance-based billing

[0049] Server: If the match is successful and the item has been returned to its owner, the system processes the user to claim the reward. The system collects a predetermined flat fee (either 300 yen, 500 yen, or 800 yen) based on the user's payment information.

[0050] User: When an item is safely returned, the loser pays a fixed fee to the system and receives a notification of completion.

[0051] This system streamlines the matching process between lost and found items, returning more items to their owners and contributing to environmental conservation. Furthermore, by using a generative AI model, matching accuracy is improved and communication between users is facilitated. This system benefits both the finder and the lost item, supporting reliable item return.

[0052] The processing flow will be explained below.

[0053] Step 1:

[0054] Terminal: The finder enters details of the lost item.

[0055] The finder opens a web form or mobile app and enters information such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[0056] Once you have completed the input, click the send button to send the information to the server.

[0057] Step 2:

[0058] Server: Receives and verifies the found item information.

[0059] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[0060] Once verification is complete, the found item information will be saved in the database.

[0061] Step 3:

[0062] Server: Confirms that the found item information has been saved and notifies the finder.

[0063] A message indicating successful registration is generated and sent back to the finder's device.

[0064] The finder will receive a notification that the lost item has been registered.

[0065] Step 4:

[0066] Terminal: The loser enters the details of the lost item.

[0067] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and photo.

[0068] Once you have completed the input, click the send button to send the information to the server.

[0069] Step 5:

[0070] Server: Receives and verifies the lost item information.

[0071] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[0072] Once verification is complete, we will store the lost item information in our database.

[0073] Step 6:

[0074] Server: Confirms that the lost item information has been saved and notifies the loser.

[0075] A message indicating successful registration is generated and sent back to the lost device.

[0076] The person who lost the item will receive a notification that their lost item has been registered.

[0077] Step 7:

[0078] Server: Retrieves lost and found data from the database.

[0079] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[0080] Step 8:

[0081] Server: Matches lost and found items using a generative AI model.

[0082] The server inputs information about lost and found items into a generative AI model, comparing the item's characteristics, where it was found, where it was lost, the date, and image data.

[0083] If the match is successful, the result is stored in an internal system.

[0084] Step 9:

[0085] Server: Notifies the finder and the lost person that the match was successful.

[0086] - Create a notification message based on the matching results and send it to the devices of the finder and the lost person.

[0087] The notification will also include a link to the system's contact methods (such as chat functionality).

[0088] Step 10:

[0089] User: The finder and the loser exchange information using the communication means within the system.

[0090] · The finder and loser can click on the link in the notification to access the chat function within the system.

[0091] · Discuss details and delivery methods of items through communication channels.

[0092] Step 11:

[0093] Server: Handles the billing process for performance-based rewards.

[0094] After confirming that the match was successful and the item was returned to its owner, the server will begin the process of collecting the appropriate reward.

[0095] - Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, 800 yen) will be charged.

[0096] Step 12:

[0097] User: The loser pays the reward.

[0098] The loser will check the claim from the system and pay a fixed fee.

[0099] You will receive a notification that your payment has been made and the process is complete.

[0100] Example 1

[0101] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0102] There is a need for a system that can efficiently and accurately match found and lost items. However, conventional methods involve a series of complicated and inefficient processes, including information registration, matching, notification, contact, and billing. In addition, matching accuracy is low, and there is no guarantee that lost items will be returned to their owners safely. This has resulted in low trust among users and low user satisfaction.

[0103] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0104] In this invention, the server includes: [means for registering detailed information on found items]; [means for registering detailed information on lost items]; [means for matching information on found items and lost items using a generative artificial intelligence model]; [means for sending an in-system notification to the finder and the loser if the match is successful]; [means for collecting a performance-based reward based on the match]; [means for providing a function that allows the finder and the loser to communicate directly using communication means within the system]; [means for verifying information and filtering spam]; and [means for collecting a flat fee based on payment information if the return of the item is confirmed.] This allows for efficient and accurate matching of information on found items and lost items, smooth communication between users, and reliable return of items through performance-based reward charging.

[0105] "Means for registering detailed information about found items" refers to a means that provides a function for a user to input detailed information about a found item (item type, characteristics, location where found, date found, photograph, etc.), send it to a server, and register it in a database.

[0106] "Means for registering detailed information about lost items" refers to a means that provides a function for a user to input detailed information about a lost item (item type, characteristics, location lost, date lost, photo, etc.), send it to a server, and register it in a database.

[0107] "Means for matching information on found and lost items using a generative artificial intelligence model" refers to a means for a server to analyze information on found and lost items obtained from a database, and use a generative artificial intelligence model to compare the type, characteristics, location, date, image data, etc. of the items to detect matching items.

[0108] "Means for sending an in-system notification to the finder and the loser upon successful matching" means means for sending a notification through the system to the finder and the loser when a suitable match is detected, informing them of the match and providing a means of contact.

[0109] "Means for collecting rewards based on matching" refers to means for providing procedures and functions for collecting a predetermined flat fee from a user when matching is successful and it is confirmed that the item has been safely returned to its owner.

[0110] "Means for providing a function that allows the finder and the loser to communicate directly using communication means within the system" means means for providing a function that allows the owners of found and lost items to discuss details about the delivery of the items through communication means such as a chat function within the system.

[0111] "Information verification and spam filtering means" means means that provides verification and filtering functions to check the accuracy of the format and content of entered information and to eliminate fraudulent or spam information.

[0112] "Means for collecting a fixed fee based on payment information when the return of the item is confirmed" refers to a means for collecting a set fee based on the user's pre-registered payment information when the system confirms that the lost item has been returned to its original owner.

[0113] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative artificial intelligence model, and a means for collecting performance-based rewards.

[0114] System configuration and operation:

[0115] Hardware and software configuration:

[0116] This system uses the following hardware and software:

[0117] Devices: Mobile devices (iOS, ANDROID (registered trademark)), personal computers

[0118] Server: Cloud-based server (e.g., AWS (registered trademark), Azure (registered trademark))

[0119] Generative AI models: Generative AI models such as GPT-4 (registered trademark)

[0120] Database: MySQL (registered trademark), PostgreSQL

[0121] Detailed processing description:

[0122] Registering lost items

[0123] 1. User: The finder launches a web form or mobile application and logs in.

[0124] 2. Terminal: The terminal verifies the login information and authenticates the user.

[0125] 3. User: The finder enters detailed information about the found item (item type, characteristics, location, date of finding, photo, etc.).

[0126] 4. Terminal: The terminal sends the entered information to the server.

[0127] 5. Server: The server validates the information it receives, performing format checks and spam filtering as needed.

[0128] 6. Server: Checks that the information is accurate and stores it in a database.

[0129] 7. Server: Notifies the finder that the information has been registered.

[0130] Registering a lost item report

[0131] 1. User: The loser launches a web form or mobile application and logs in.

[0132] 2. Terminal: The terminal verifies the login information and authenticates the user.

[0133] 3. User: The person who lost the item enters detailed information about the lost item (item type, characteristics, location lost, date lost, photo, etc.).

[0134] 4. Terminal: The terminal sends the entered information to the server.

[0135] 5. Server: The server validates the information it receives, performing format checks and spam filtering as needed.

[0136] 6. Server: Checks that the information is accurate and stores it in a database.

[0137] 7. Server: Notifies the lost person that the information has been registered.

[0138] matching

[0139] 1. Server: Periodically retrieves lost and found information from the database.

[0140] 2. Server: Analyzes the acquired information using a generative artificial intelligence model (such as GPT-4).

[0141] 3. Server: Detects matching items based on item type, characteristics, location, date, and image data.

[0142] 4. Server: The matching results are logged internally.

[0143] Example: If finder A finds a "red wallet" in a park and loser B loses it near a train station on the same day, the AI ​​model analyzes this information and makes a match based on the type of wallet, color, and proximity of where it was found and lost.

[0144] Notification and communication

[0145] 1. Server: If a match is successful, it sends an in-system notification to the finder and the loser.

[0146] 2. Server: Open the chat function within the system for finders and losers to communicate with each other.

[0147] 3. User: The finder and the loser use the chat function to discuss how to hand over the item and what to check.

[0148] Performance-based billing

[0149] 1. Server: Once the match is successful and the item has been returned to its original owner, the server begins the process of claiming the reward.

[0150] 2. Server: Collects a predetermined flat fee (either 300 yen, 500 yen, or 800 yen) based on the user's payment information.

[0151] 3. User: Once the lost item is safely returned, the user receives a claim from the system and completes the payment.

[0152] 4. Server: Notifies the customer that the payment has been made and closes the transaction.

[0153] Examples of prompts:

[0154] "I found a red wallet in the park. It was found at XX Park on XX / XX. It is made of leather, is medium in size, and has the manufacturer's name written on the inside. Please check to see if it matches the lost item information."

[0155] "I lost a red wallet near the station. It was lost at XX Station on XX / XX / XX. It is made of leather, is medium in size, and has the manufacturer's name written on the inside. Please check to see if it matches the lost property information."

[0156] In this way, the system of the present invention utilizes diverse hardware and advanced generative AI models to streamline the matching process between lost and found items, providing users with a reliable service.

[0157] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0158] Step 1:

[0159] Enter and submit details of your lost item

[0160] User: The finder launches a web form or mobile app and logs in.

[0161] Terminal: The terminal verifies the login information and authenticates the user.

[0162] User: The finder enters detailed information about the found item (item type, characteristics, location, date of finding, photos, etc.). The entered data is then imported into the terminal in the form of text or images.

[0163] Terminal: The terminal sends the entered information to the server. The data sent includes details of the lost item.

[0164] Step 2:

[0165] Found item information verification and registration

[0166] Server: The server validates the information it receives, performing format checks and spam filtering as needed. Format checks verify required fields and that data has been entered correctly. Spam filtering filters out invalid entries.

[0167] Server: Checks that the information is accurate and stores it in a database, including details of the found item.

[0168] Server: Notifies the finder that the information has been registered. The notification includes a message indicating that registration was successful.

[0169] Step 3:

[0170] Enter and submit your lost item report details

[0171] User: The loser launches a web form or mobile app and logs in.

[0172] Terminal: The terminal verifies the login information and authenticates the user.

[0173] User: The person who lost the item enters detailed information about the lost item (item type, characteristics, location, date of loss, photo, etc.). The entered data is imported into the device as text or images.

[0174] Device: The device sends the entered information to the server. The data sent includes details of the lost item.

[0175] Step 4:

[0176] Lost property verification and registration

[0177] Server: The server validates the information it receives, performing format checks and spam filtering as needed. Format checks verify required fields and that data has been entered correctly. Spam filtering filters out invalid entries.

[0178] Server: Checks that the information is accurate and stores it in a database, which contains details of the lost item.

[0179] Server: Notifies the lost person that the registration of the information has been completed. The notification includes a message indicating that the registration was successful.

[0180] Step 5:

[0181] Data matching of lost and found items

[0182] Server: The server periodically retrieves information about lost and found items from the database, including the type of item, its characteristics, the location where it was found, and the date it was found.

[0183] Server: Analyzes the acquired information using a generative AI model. Specifically, it compares information such as the type of item, characteristics, location, date, and image data to find matching items. The AI ​​model analyzes the data to find similarities and matches.

[0184] Server: Internally logs the match results, including which lost and found items were matched.

[0185] For example, if finder A finds a red wallet in a park and loser B loses it near a train station on the same day, the AI ​​model analyzes this information and matches the wallets based on their type, color, and the proximity of where they were found and lost.

[0186] Step 6:

[0187] Notification and contact method when matching is successful

[0188] Server: If a match is successful, send an in-system notification to the finder and the loser. The notification contains information about the successful match and next steps.

[0189] Server: Opens the chat function within the system for finders and losers to communicate with each other. The chat function includes the ability to send and receive messages.

[0190] Users: The finder and the loser use the chat function to discuss how to hand over the item and what to check. Users exchange necessary information through chat within the system.

[0191] Step 7:

[0192] Performance-based billing processing

[0193] Server: Once the matching is successful and it is confirmed that the item has been returned to its original owner, the server will begin the process of claiming the reward. If the return is confirmed, the server will automatically process the claim.

[0194] Server: A predetermined flat fee (either 300 yen, 500 yen, or 800 yen) is collected based on the user's payment information, using credit card information or other payment methods.

[0195] User: When the lost item is safely returned, the user receives a claim from the system and completes the payment. The user then follows the notification to complete the payment procedure.

[0196] Server: Notifies the user that the payment has been completed and completes the transaction. The completion notification includes a message that the transaction was successful.

[0197] This allows the system to efficiently and accurately match information on found and lost items, facilitate communication between users, and enable reliable item returns through performance-based billing.

[0198] (Application example 1)

[0199] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0200] The management of found and lost items in public places is often inefficient, resulting in long wait times for items to be returned to their owners. Furthermore, information on the type and characteristics of items, as well as the locations where they were found or lost, is fragmented, making it difficult to effectively match them. Furthermore, there is a need for a means to register information on found and lost items, as well as an efficient system for analyzing and matching them.

[0201] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0202] In this invention, the server includes means for registering detailed information on found items, means for registering detailed information on lost items, and means for matching information on found and lost items using a generative artificial intelligence model. This makes it possible to efficiently manage lost and found items in public places and to perform more accurate matching by analyzing the type, characteristics, location, date, and image data of the item.

[0203] "Detailed information about lost items" refers to information such as the type of item, its characteristics, the location where it was found, the date it was found, and photographs.

[0204] "Detailed information about the lost item" refers to information such as the type of item, its characteristics, the location where it was lost, the date it was lost, and photographs.

[0205] A "generative artificial intelligence model" refers to an artificial intelligence algorithm that analyzes input data and finds correlations.

[0206] "Means for notifying the finder and the loser if a match is successful" refers to a method for notifying both parties of the discovery and match using the notification function within the system.

[0207] "Means for collecting performance-based rewards" refers to a method of charging system users a fixed fee when an item is returned to its owner.

[0208] "A smartphone-based security service that provides management of lost and found items in public places" refers to a service that uses smartphones to manage and match lost and found items in public areas such as train stations and commercial facilities.

[0209] "Feature-analyzing generative artificial intelligence model" refers to an artificial intelligence algorithm that analyzes item type, characteristics, location, date, and image data to find matches to lost and found items.

[0210] "Dedicated chat function" refers to a means of communication within the system that allows the finder and the loser to directly contact each other and discuss how to return the item.

[0211] System Overview

[0212] This invention provides a system for managing information on lost and found items and efficiently matching them. This system has a series of functions for registering detailed information on found and lost items, matching them using a generative artificial intelligence model, and notifying the user of the results. Specifically, this is a smartphone-based security service that provides management of lost and found items in public places.

[0213] Required Hardware and Software

[0214] Hardware: Smartphones, servers

[0215] Software: databases (e.g., SQLite), artificial intelligence models (e.g., OpenAI® API), web frameworks (e.g., Flask)

[0216] Registering details of lost items

[0217] The user, or finder, uses their smartphone to input detailed information about the found item, such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo, and then sends this information to the server. The server then stores the received information in a database.

[0218] Registering details of lost items

[0219] The user, the person who lost the item, uses their smartphone to input detailed information about the lost item, such as the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo, and then sends this information to the server, which then stores the received information in a database.

[0220] Information Matching

[0221] The server retrieves information about lost and found items from the database and analyzes it using a generative artificial intelligence model, which compares item type, characteristics, location, date, and image data to find matching items.

[0222] Notification of matching results

[0223] If the match is successful, the server sends a notification to the finder and the loser. The notification is sent via the system's communication means (such as a chat function). The finder and the loser can use the provided communication means to discuss how to hand over the item and any necessary confirmations.

[0224] Collection of performance-based rewards

[0225] If the match is successful and the item is confirmed to have been returned to its owner, the server will charge the user a reward. The system collects a predetermined flat fee based on the user's payment information.

[0226] Examples of concrete examples and prompts

[0227] Specific examples

[0228] The finder registers the information as lost property at the station: "iPhone (registered trademark) 12, black, with scratches on the back, found on October 12, 2023."

[0229] The loser registers a lost item report stating, "I lost my black iPhone 12 at a station on October 12th. There is a scratch on the back."

[0230] A generative AI model analyzes this data and makes matches.

[0231] Example prompt

[0232] Found: iPhone 12, black, with scratches on the back, found on October 12, 2023.

[0233] Lost item: Lost a black iPhone 12 at a station on October 12th. There is a scratch on the back.

[0234] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0235] Step 1:

[0236] The user (the finder) uses a smartphone to input detailed information about the found item. Specifically, the type of item, its characteristics, the location where it was found, the date it was found, and a photo are entered, and then sent to the server. The input data is sent to the server in JSON format. The server verifies the received information and saves it in a database. Here, the input is the detailed information about the found item, and the output is saving it to the database.

[0237] Step 2:

[0238] The user (the person who lost the item) uses their smartphone to input detailed information about the lost item, including the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo, and then sends this information to the server. The server then verifies the information it receives and stores it in a database. Again, the input is the detailed information about the lost item, and the output is storage in the database.

[0239] Step 3:

[0240] The server periodically retrieves information about lost and found items from the database. This information includes the item type, characteristics, location, date, and photo. The retrieved data is input into a generative artificial intelligence model. The input is the lost and found item information from the database, which is then analyzed by the generative artificial intelligence model.

[0241] Step 4:

[0242] The generative AI model analyzes the acquired information and compares the item type, characteristics, location, date, and image data. Specific data processing includes text data feature extraction, image data feature extraction, and geographic proximity assessment. The model identifies matching lost and found items. The output is a successful match.

[0243] Step 5:

[0244] If the match is successful, the server sends a notification to the finder and the loser. The notification is sent via a smartphone app. The user receives the notification and uses the system's in-system communication method (dedicated chat) to confirm details and discuss how to hand over the item. The input is information about the successful match, and the output is the notification and provision of communication methods.

[0245] Step 6:

[0246] If the match is successful and the item has been returned to its owner, the server will claim the reward from the user. Based on the user's payment information, the system collects a pre-determined fixed fee. The input is the confirmation of the item's return, and the output is the claim and collection of the reward.

[0247] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0248] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative AI model, and a means for providing user support and collecting rewards using an emotion engine. This system improves the user experience by recognizing the user's emotions and providing appropriate support during the management and return process of lost and found items.

[0249] System configuration and operation

[0250] Registering lost items

[0251] 1. Terminal: The finder enters the details of the lost item.

[0252] The finder launches a web form or mobile app and enters information such as the type of item, its characteristics, where it was found, the date it was found, and a photo.

[0253] Once the input is complete, the send button is pressed to send the information to the server.

[0254] 2. Server: Receives and verifies the found item information.

[0255] The server validates the format and content of the received data to ensure there is no missing or invalid data.

[0256] Once verification is complete, the found item information is stored in a database.

[0257] 3. Server: Confirms that the found item information has been saved and notifies the finder.

[0258] A message indicating successful registration is generated and sent back to the finder's terminal.

[0259] The finder will receive a notification that the lost item has been registered.

[0260] Registering a lost item report

[0261] 1. Terminal: The loser enters the details of the lost item.

[0262] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and a photo.

[0263] Once the input is complete, the send button is pressed to send the information to the server.

[0264] 2. Server: Receives and verifies the lost item information.

[0265] The server validates the format and content of the received data to ensure there is no missing or invalid data.

[0266] Once verification is complete, the lost item information is stored in a database.

[0267] 3. Server: Confirms that the lost item information has been saved and notifies the loser.

[0268] A message indicating successful registration is generated and sent back to the lost device.

[0269] The loser will receive a notification that their lost item has been registered.

[0270] matching

[0271] 1. Server: Retrieves lost and found data from the database.

[0272] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[0273] 2. Server: Matches lost and found items using a generative AI model.

[0274] The server inputs information about lost and found items into a generative artificial intelligence model, comparing the item's characteristics, where it was found, where it was lost, the date, image data, etc.

[0275] If the match is successful, the results are stored in an internal system.

[0276] Examples:

[0277] Suppose finder A finds a "red wallet" in a park, and loser B loses it near a station on the same day. A generative AI model analyzes this information, matches the wallet type, color, and the proximity of where it was found and lost, and sends a notification.

[0278] Notification and communication

[0279] 1. Server: Notifies the finder and the loser of a successful match.

[0280] A notification message is created based on the matching results and sent to the devices of the finder and the lost person.

[0281] The notification will also include a link to any contact methods within the system (such as chat functionality).

[0282] 2. User: The finder and the loser exchange information using the communication means within the system.

[0283] The finder and loser click on a link in the notification to access the chat function within the system.

[0284] Discuss the details and method of delivery of the items through communication channels.

[0285] Introducing the Emotion Engine

[0286] 1. Terminal: User registration and contact

[0287] To recognize a user's feelings when registering a lost or found item and provide user support as needed.

[0288] When registering an item, the system analyzes the user's emotional state and displays guide messages and support to reduce stress and anxiety.

[0289] 2. Server: When matching is successful

[0290] When a match is successful, the emotions of the finder and loser are analyzed to generate appropriate notification and support messages.

[0291] For example, if the finder is feeling anxious, add a message or explanation that will provide reassurance.

[0292] Performance-based billing

[0293] 1. Server: Handles the billing process for performance-based rewards.

[0294] After verifying that the match was successful and the item was returned to its owner, the server begins the process of collecting the appropriate reward.

[0295] Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, or 800 yen) will be charged.

[0296] 2. User: The loser pays the reward.

[0297] The loser confirms the claim from the system and pays a fixed fee.

[0298] You will receive a notification that your payment has been made and the process is complete.

[0299] This system streamlines the matching process between lost and found items, returning more items to their owners and contributing to environmental conservation. Furthermore, by using a generative AI model and emotion engine, the system improves the user experience and increases matching accuracy. This system benefits both the finder and the lost item, supporting reliable item return.

[0300] The processing flow will be explained below.

[0301] Step 1:

[0302] Terminal: The finder enters details of the lost item.

[0303] The finder opens a web form or mobile app and enters information such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[0304] Once you have completed the input, click the send button to send the information to the server.

[0305] Step 2:

[0306] Server: Receives and verifies the found item information.

[0307] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[0308] Once verification is complete, the found item information will be saved in the database.

[0309] Step 3:

[0310] Server: Confirms that the found item information has been saved and notifies the finder.

[0311] A message indicating successful registration is generated and sent back to the finder's device.

[0312] The finder will receive a notification that the lost item has been registered.

[0313] Step 4:

[0314] Terminal: The loser enters the details of the lost item.

[0315] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and photo.

[0316] Once you have completed the input, click the send button to send the information to the server.

[0317] Step 5:

[0318] Server: Receives and verifies the lost item information.

[0319] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[0320] Once verification is complete, we will store the lost item information in our database.

[0321] Step 6:

[0322] Server: Confirms that the lost item information has been saved and notifies the loser.

[0323] A message indicating successful registration is generated and sent back to the lost device.

[0324] The person who lost the item will receive a notification that their lost item has been registered.

[0325] Step 7:

[0326] Server: Retrieves lost and found data from the database.

[0327] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[0328] Step 8:

[0329] Server: Matches lost and found items using a generative AI model.

[0330] The server inputs information about lost and found items into a generative AI model, comparing the item's characteristics, where it was found, where it was lost, the date, and image data.

[0331] If the match is successful, the result is stored in an internal system.

[0332] Step 9:

[0333] Server: Notifies the finder and the lost person that the match was successful.

[0334] - Create a notification message based on the matching results and send it to the devices of the finder and the lost person.

[0335] The notification will also include a link to the system's contact methods (such as chat functionality).

[0336] Step 10:

[0337] User: The finder and the loser exchange information using the communication means within the system.

[0338] · The finder and loser can click on the link in the notification to access the chat function within the system.

[0339] · Discuss details and delivery methods of items through communication channels.

[0340] Step 11:

[0341] Terminal: Analyzes the emotional state of users who are in trouble.

[0342] As users interact, the emotion engine analyzes their emotional state (stress, anxiety, relief, joy, etc.).

[0343] · Providing supportive messages and advice when needed.

[0344] Step 12:

[0345] Server: Generates appropriate notification content based on the emotional state.

[0346] -When a match is successful, the system recognizes the emotions of the finder and loser and generates appropriate notification and support messages.

[0347] For example, if the finder is feeling anxious, add a message to provide reassurance.

[0348] Step 13:

[0349] Server: Handles the billing process for performance-based rewards.

[0350] After confirming that the match was successful and the item was returned to its owner, the server will begin the process of collecting the appropriate reward.

[0351] - Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, 800 yen) will be charged.

[0352] Step 14:

[0353] User: The loser pays the reward.

[0354] The loser will check the claim from the system and pay a fixed fee.

[0355] You will receive a notification that your payment has been made and the process is complete.

[0356] Example 2

[0357] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0358] The management of lost and found items requires a lot of time and effort. Current systems have difficulty effectively linking information on the finders and losers, and lack support to alleviate users' anxiety and stress. Furthermore, the success rate of matching is low, and items are often not returned smoothly. Therefore, there is a need for efficient matching of found and lost items and an improved user experience.

[0359] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0360] In this invention, the server includes: [means for registering detailed information on found items;] [means for registering detailed information on lost items;] [means for matching information on found items and lost items using a generative artificial intelligence model;] [means for notifying the finder and the loser if the match is successful;] [means for verifying information on found items and lost items and checking for missing or incorrect data; and [means for using an emotion engine that recognizes the user's emotions and provides support messages as needed.] This makes it possible [to efficiently match found items with lost items and provide appropriate support according to the user's emotional state, thereby improving the user experience and enabling smooth return of items].

[0361] "Detailed information about a lost item" refers to specific information about the item found by the finder, such as the type, characteristics, location, date of finding, and photographs.

[0362] "Detailed information about lost items" refers to specific information about the item lost by the loser, such as the type, characteristics, location, date of loss, and photographs.

[0363] A "generative artificial intelligence model" is an artificial intelligence system that analyzes the characteristics and information of found and lost items and performs matching.

[0364] "Means for notifying" refers to the means for notifying the finder and the loser of the result when matching is successful. Specifically, it refers to the system that generates and sends messages.

[0365] "Means for verifying" means the means by which lost and found information is received to verify that the information is accurate and that there are no omissions or irregularities.

[0366] An "emotion engine" is a system that recognizes the user's emotional state and generates appropriate support messages based on that information.

[0367] "Means for collecting a reward" refers to a means for collecting a set fee from a user when matching is successful and the item is returned.

[0368] The present invention relates to a system for managing information on lost and found items and efficiently matching them. Users register items, a generative AI model is used to perform matching, and an emotion engine is used to support users and collect rewards.

[0369] Registering lost items

[0370] 1. Terminal

[0371] The finder enters detailed information about the found item. The finder launches a web form or mobile app on their device (smartphone or PC) and enters details about the found item (item type, characteristics, location found, date found, photo). For example, if they found a red wallet in a park, they would enter "Type: Wallet," "Characteristics: Red, with side zipper," "Location found: Park," "Date found: October 10, 2023," and "Photo: Photograph taken." Once they have completed entering the information, they press the send button to send the data to the server.

[0372] 2. Server

[0373] The server collects data on lost items received from the device. The web server receives an HTTP request and receives detailed information on the lost item in JSON format. It then validates the format and content of the received data. Specifically, it checks whether all required fields have been filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the device. Once validation is complete, it saves the lost item information in the database.

[0374] 3. Notification

[0375] The server notifies the finder that the data has been successfully saved, including specific information such as "Type: wallet, Characteristics: red, with side zipper, found in a park on October 10, 2023."

[0376] Registering a lost item report

[0377] 1. Terminal

[0378] The loser enters detailed information about the lost item. The loser launches a web form or mobile app on their device (smartphone or PC) and enters details about the lost item (item type, characteristics, location lost, date lost, photo). For example, if they lost a red wallet near a station, they would enter "Type: Wallet," "Characteristics: Red, with side zipper," "Location lost: Near the station," "Date lost: October 10, 2023," and "Photo: Photo taken previously." Once they have completed entering the information, they press the send button to send the data to the server.

[0379] 2. Server

[0380] The server collects the lost item data received from the device. The web server receives the HTTP request and receives the lost item details in JSON format. It then validates the format and content of the received data. Specifically, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and sends it back to the device. Once validation is complete, it saves the lost item information in the database.

[0381] 3. Notification

[0382] The server notifies the loser that the data has been successfully saved, including specific information such as "Type: wallet, Characteristics: red, with a side zipper, lost near a station on October 10, 2023."

[0383] matching

[0384] 1. Server

[0385] The server periodically or upon request extracts newly registered lost and found items from the database. Specifically, it executes an SQL query to retrieve recently added data. The retrieved information on lost and found items is then input into a generative AI model. Matching is performed by comparing items such as the item's characteristics, where it was found, where it was lost, the date, and image data. For example, the following information could be input: "Red wallet, with a side zipper, where it was found in a park, where it was lost near a station, and the date it was found on October 10, 2023."

[0386] 2. Server

[0387] If the match is successful, the results are saved in the internal system. For example, "Finder A's red wallet with a side zipper matches the wallet of loser B." This is saved in the database.

[0388] Notification and communication

[0389] 1. Server

[0390] The server notifies the finder and the lost person that the match was successful. Specifically, it generates a notification message based on the matching result and sends it to the finder and the lost person's devices. It provides a message saying "Your red wallet has been found" and a link to the system's contact method (such as a chat function).

[0391] 2. Users

[0392] The finder and the loser click on the link in the notification to access the chat function within the system. Specifically, they use the chat screen to discuss details such as how to hand over the item. They make specific arrangements, such as "Let's meet at XX Station on October 15th at 2:00 PM."

[0393] Introducing the Emotion Engine

[0394] 1. Terminal

[0395] When registering lost or found items, the system recognizes the user's emotions. It uses the device's camera and voice data to analyze the user's emotional state (anxiety, stress, joy, etc.). For example, it uses facial recognition technology to determine whether the user is smiling or looking serious.

[0396] 2. Server

[0397] Based on the information obtained from the emotion engine, appropriate notification content and support messages are generated. For example, if the finder is feeling anxious, a message such as "Don't worry, your information is being kept safe" will be generated.

[0398] Performance-based billing

[0399] 1. Server

[0400] After confirming that the matching was successful and the item was returned, the process of collecting the appropriate reward will begin. Specifically, a scenario will be started in which payment is processed using credit card information.

[0401] 2. Users

[0402] The lost person checks the request from the system and pays the fixed fee. For example, they pay the appropriate fee of 300 yen, 500 yen, or 800 yen with their credit card. They receive a notification that the payment has been completed, and the process is complete. A message such as "Your payment has been completed. Thank you for letting us know" is displayed.

[0403] Example prompts for generative AI models

[0404] "I found a red wallet in the park. Date found: October 10, 2023. Features: It has a zipper on the side. Please use this information to find someone who lost a red wallet on the same day."

[0405] This enables efficient matching of found and lost items, and also provides appropriate support according to the user's emotional state, improving the user experience and enabling smooth return of items.

[0406] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0407] Step 1:

[0408] Enter details of the lost item (device)

[0409] Input: The finder launches a web form or mobile app on their device (smartphone or PC) and enters details about the lost item (item type, characteristics, location, date of finding, and photo).

[0410] Specific operation: If the finder finds a red wallet in a park, they will enter the following: "Type: Wallet", "Characteristics: Red, with side zipper", "Place of Found: Park", "Date of Found: October 10, 2023", and "Photo: Photo taken".

[0411] Output: Once the input is complete, press the send button to send the data to the server.

[0412] Step 2:

[0413] Receiving and verifying data on lost items (server)

[0414] Input: Found item data received from the device.

[0415] Specific operation: The server receives an HTTP request and receives the details of the lost item in JSON format.

[0416] Data processing: The server validates the format and content of the data received. For example, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the terminal.

[0417] Output: Once the verification is complete, save the found item information to the database.

[0418] Step 3:

[0419] Notification of lost item registration completion (server)

[0420] Input: Information about lost items stored in the database.

[0421] Specific operation: The server verifies that the found item information has been saved successfully.

[0422] Data output: A notification message containing specific details such as "Type: wallet, Characteristics: red, with side zipper, found in park on October 10, 2023" is generated and sent to the finder's device.

[0423] Step 4:

[0424] Enter the details of the lost item (on your device)

[0425] Input: The lost person launches a web form or mobile app on their device (smartphone or PC) and enters details of the lost item (item type, characteristics, location lost, date lost, photo).

[0426] Specific operation: If the loser loses a red wallet near a station, they will enter the following: "Type: Wallet", "Characteristics: Red, with a side zipper", "Location of loss: Near the station", "Date of loss: October 10, 2023", and "Photo: Previously taken photo".

[0427] Output: Once the input is complete, press the send button to send the data to the server.

[0428] Step 5:

[0429] Receiving and verifying lost item data (server)

[0430] Input: Lost item data received from the device.

[0431] Specific operation: The server receives an HTTP request and receives the details of the lost item in JSON format.

[0432] Data processing: The server validates the format and content of the data received. For example, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the terminal.

[0433] Output: Save the lost item information in the database once verification is complete.

[0434] Step 6:

[0435] Lost item registration completion notification (server)

[0436] Input: Lost item information stored in the database.

[0437] Specific operation: The server verifies that the lost item information has been saved successfully.

[0438] Data output: A notification message containing specific details such as "Type: wallet, characteristics: red, with side zipper, lost near a station on October 10, 2023" is generated and sent to the device of the loser.

[0439] Step 7:

[0440] Data extraction (server)

[0441] Input: Lost and found data from the database.

[0442] What happens: The server runs an SQL query to extract recently added data.

[0443] Output: Retrieved lost and found information.

[0444] Step 8:

[0445] AI matching (server)

[0446] Input: Extracted lost and found information.

[0447] Specific operation: Input the item's characteristics, where it was found, where it was lost, date, image data, etc. into the generative artificial intelligence model and attempt to match it.

[0448] Data calculation: The AI ​​model analyzes the input information and performs feature extraction and comparative matching.

[0449] Output: Successfully matched data is stored in an internal system.

[0450] Step 9:

[0451] Notification of matching results (server)

[0452] Input: A successful match result.

[0453] Specific operation: The server generates a notification message based on the matching result and sends it to the finder and the lost person's devices, for example, a message saying "Your red wallet has been found."

[0454] Output: Notification messages are sent to the finder and the loser.

[0455] Step 10:

[0456] Information exchange and coordination (users)

[0457] Input: The link to be included in the notification message.

[0458] Specific operation: The finder and the loser click on the link in the notification to access the chat function within the system, where they can discuss details and how to hand over the item.

[0459] Output: As a result of the discussion, a specific date, time and location for delivery will be decided.

[0460] Step 11:

[0461] Emotion Recognition and Analysis (Device)

[0462] Input: User's video and audio data.

[0463] Specific operation: Recognizes the user's emotional state (anxiety, stress, joy, etc.) using the device's camera and microphone. For example, it uses facial recognition technology to determine whether the user is smiling or looking serious.

[0464] Output: Emotion recognition data.

[0465] Step 12:

[0466] Emotion response message generation (server)

[0467] Input: Emotion recognition data.

[0468] Specific operation: The server generates appropriate notification and support messages based on the information obtained by the emotion engine. For example, if the finder feels anxious, the server will generate a message such as "Don't worry, your information is kept safe."

[0469] Output: An emotional response message is sent to the device.

[0470] Step 13:

[0471] Performance-based reward billing procedure (server)

[0472] Input: Successful match and item return information.

[0473] Specific operation: The server starts the process of charging the appropriate reward (e.g., 300 yen, 500 yen, 800 yen) to the user. Payment is made based on the credit card information.

[0474] Output: A successful charge message is sent to the user.

[0475] Step 14:

[0476] Payment of performance rewards (user)

[0477] Input: Billing message.

[0478] Specific operation: The person who lost the item checks the bill from the system and pays the fixed fee by credit card, for example, 300 yen, 500 yen, or 800 yen.

[0479] Output: A notification of successful payment is sent to the user and the process is complete.

[0480] (Application example 2)

[0481] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0482] Lost and found items frequently occur in physical stores, making their management cumbersome and time-consuming for staff and customers. In particular, if lost or found items are not promptly returned to their owners, customer satisfaction declines and in-store confusion occurs. Furthermore, matching between lost and found items is often done manually, resulting in low efficiency and a high risk of errors. Furthermore, it is difficult to appropriately consider the user's emotional state when communicating and responding to the match, which can increase stress and anxiety.

[0483] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0484] In this invention, the server includes a means for registering detailed information on found items, a means for registering detailed information on lost items, a means for matching information on found items and lost items using a generative artificial intelligence model, a means including an emotion engine that analyzes user emotions and provides appropriate support messages, and a means for registering, notifying, and contacting users about found and lost items using a smartphone or tablet device. This enables efficient management and rapid return of found and lost items in physical stores, thereby improving customer satisfaction and reducing the burden on staff.

[0485] The "means for registering detailed information about found items" is an interface that allows the user to input the type, characteristics, location, date of finding, photograph, etc. of the found item and send them to the server.

[0486] The "means for registering detailed information about a lost item" is an interface that allows a user to input the type, characteristics, location, date of loss, photograph, etc. of the lost item and send them to the server.

[0487] "Means for matching information on found and lost items using generative artificial intelligence models" refers to a system that analyzes data on found and lost items and compares characteristics, locations, dates, etc. to identify items that are likely to match.

[0488] The "means for notifying the finder and the lost person when a match is successful" refers to a means for informing the users of the matching results, which is usually done via a notification message or email.

[0489] "Means including an emotion engine that analyzes the user's emotions and provides appropriate support messages" refers to a system that analyzes the user's emotional state at the time of registration or matching, and presents messages to reduce stress and anxiety.

[0490] The "means for collecting rewards based on matching" is a system for claiming and collecting appropriate rewards after a lost item is returned to the loser.

[0491] "Means for registering, notifying, and contacting lost and found items using a smartphone or tablet device" refers to an interface for using a mobile device to input and send information about lost and found items, and to make notifications and contact.

[0492] System configuration

[0493] In order to implement the present invention, the following hardware and software are used.

[0494] Hardware

[0495] 1. Smartphone or tablet:

[0496] Used as a user interface for registering, notifying, and contacting lost and found items. Customers and store staff use it to enter information and receive notifications.

[0497] 2. Server:

[0498] It collects information on lost and found items, analyzes and processes the data using a generative AI model and emotion engine, and notifies users when a match is successful and collects rewards.

[0499] software

[0500] 1. Generative AI models (e.g., TENSORFLOW (registered trademark)):

[0501] It analyzes the characteristics, location, date and image data of lost and found items to make appropriate matches, which is performed on the server.

[0502] 2. Emotion Engine:

[0503] It analyzes the user's emotional state and generates appropriate support messages, which are also performed on the server.

[0504] How it works

[0505] Registering lost items

[0506] The user enters details of the lost item using a smartphone or tablet device, and the entered data is sent to a server, which verifies the format and content and then stores it in a database.

[0507] Registering lost property

[0508] The user enters the details of the lost item using a smartphone or tablet device, and the entered data is sent to a server, which verifies the format and content and then stores it in a database.

[0509] matching

[0510] The server periodically retrieves information about lost and found items from the database and uses a generative AI model to match them, comparing item characteristics, location, dates, image data, and more to identify likely matches.

[0511] Notification and communication

[0512] If the match is successful, the server sends a notification to the finder and the loser. The notification includes a link to the system's communication tools (such as a chat function). The finder and the loser can use the system's communication tools to exchange information and discuss how to hand over the item.

[0513] Introducing the Emotion Engine

[0514] The server analyzes the user's emotions when registering lost or found items or when a match is successful, and generates appropriate support messages, thereby reducing the user's stress and anxiety.

[0515] Prompt Sentence Examples

[0516] 1. Please register your lost item. Please enter the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[0517] 2. Register the details of your lost item. Please enter the type of item, its characteristics, location, date of loss, and a photo.

[0518] 3. "Match successful. Please review the details of the found item."

[0519] Specific examples

[0520] For example, if a customer finds a wallet in a store, they can register it using the app by entering a photo and other characteristics and then pressing the send button, which transfers the data to a server. Similarly, if another customer registers a lost wallet, the generative AI model analyzes the information from both parties, and if there is a match, a notification is sent to both parties. At this time, the emotion engine also works, displaying messages to reduce stress and anxiety for the finder and the loser.

[0521] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0522] Step 1:

[0523] Registering lost items

[0524] The user inputs and submits details of the lost item using a smartphone or tablet device. The input information includes the type of item, its characteristics, the location where it was found, the date it was found, and a photo. This information is then sent from the device to a server. The server verifies the format and content of the received data and checks for missing or invalid data. Once verification is complete, the server stores the information in a database and notifies the user that the registration is complete.

[0525] Input: Type of item, characteristics, location of item, date of item, photo

[0526] Output: Information on lost items stored in the database, notification of registration completion

[0527] Step 2:

[0528] Registering lost property

[0529] The user inputs and submits details of the lost item using a smartphone or tablet device. The input information includes the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo. This information is then sent from the device to a server. The server verifies the format and content of the received data and checks for missing or invalid data. Once verification is complete, the server stores the information in a database and notifies the user that registration is complete.

[0530] Input: Type of item, characteristics, location of loss, date of loss, photo

[0531] Output: Information about lost items stored in the database, notification of registration completion

[0532] Step 3:

[0533] Matching process

[0534] The server periodically retrieves information about lost and found items from the database. Using a generative AI model, it analyzes the item type, characteristics, location, date, and image data to match found and lost items. It identifies candidates with high potential matches based on characteristics and proximity of location information.

[0535] Input: Lost and found information stored in the database

[0536] Output: Matching results

[0537] Step 4:

[0538] Notification and communication

[0539] If a match is successful, the server sends a notification to the finder and the loser, including a link to access the system's communication channels (such as a chat function), allowing the finder and the loser to communicate and discuss details of the item and how to return it.

[0540] Input: Matching results

[0541] Output: Notice to finder and loser, contact links

[0542] Step 5:

[0543] Supported by an emotional engine

[0544] The server analyzes the user's emotions when registering a lost or found item or when a match is successful, and generates a message to reduce the user's stress and anxiety using an emotion engine and includes it in the notification.

[0545] Input: User behavior data (at the time of registration, notification)

[0546] Output: Support message based on emotional state

[0547] Step 6:

[0548] Collection of performance-based rewards

[0549] After the lost item is successfully returned to the owner, the server collects the reward by processing the payment information based on a predetermined fixed fee (e.g., 300 yen, 500 yen, or 800 yen). Once completed, a notification is sent to the loser.

[0550] Input: Confirmation data of lost property return, payment information of the lost property owner

[0551] Output: Invoicing and collecting commissions, notification of completion

[0552] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0553] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0554] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0555] [Second embodiment]

[0556] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0557] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0558] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0559] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0560] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0561] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0562] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0563] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0564] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0565] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0566] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0567] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0568] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative artificial intelligence model, and a means for collecting performance-based rewards.

[0569] System configuration and operation:

[0570] Registering lost items

[0571] Device: The finder uses a web form or mobile app to enter details about the lost item (item type, characteristics, location, date found, photos, etc.) and sends the information to the server.

[0572] Server: The server verifies the received information, stores it in the database, and notifies the finder that the information has been registered.

[0573] Registering a lost item report

[0574] Device: The lost person uses a web form or mobile app to enter details of the lost item (item type, characteristics, location, date of loss, photo, etc.) and sends the information to the server.

[0575] Server: The server verifies the received information, stores it in the database, and notifies the lost person that the information has been registered.

[0576] matching

[0577] Server: The server retrieves lost and found items from the database and analyzes them using a generative artificial intelligence model to compare item types, characteristics, locations, dates, and image data to find matching items.

[0578] Example: Finder A finds a "red wallet" in a park, and loser B loses it near a train station on the same day. A generative AI model analyzes this information, matches the wallet type, color, where it was found, and the proximity of where it was lost, and sends a notification.

[0579] Notification and communication

[0580] Server: If the match is successful, the server sends an in-system notification to the finder and the loser, and provides a dedicated means of communication (such as a chat function) so that the finder and the loser can directly communicate and confirm details.

[0581] Users: The finder and the loser can use the system's communication tools to discuss how to hand over the item and what to check.

[0582] Performance-based billing

[0583] Server: If the match is successful and the item has been returned to its owner, the system processes the user to claim the reward. The system collects a predetermined flat fee (either 300 yen, 500 yen, or 800 yen) based on the user's payment information.

[0584] User: When an item is safely returned, the loser pays a fixed fee to the system and receives a notification of completion.

[0585] This system streamlines the matching process between lost and found items, returning more items to their owners and contributing to environmental conservation. Furthermore, by using a generative AI model, matching accuracy is improved and communication between users is facilitated. This system benefits both the finder and the lost item, supporting reliable item return.

[0586] The processing flow will be explained below.

[0587] Step 1:

[0588] Terminal: The finder enters details of the lost item.

[0589] The finder opens a web form or mobile app and enters information such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[0590] Once you have completed the input, click the send button to send the information to the server.

[0591] Step 2:

[0592] Server: Receives and verifies the found item information.

[0593] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[0594] Once verification is complete, the found item information will be saved in the database.

[0595] Step 3:

[0596] Server: Confirms that the found item information has been saved and notifies the finder.

[0597] A message indicating successful registration is generated and sent back to the finder's device.

[0598] The finder will receive a notification that the lost item has been registered.

[0599] Step 4:

[0600] Terminal: The loser enters the details of the lost item.

[0601] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and photo.

[0602] Once you have completed the input, click the send button to send the information to the server.

[0603] Step 5:

[0604] Server: Receives and verifies the lost item information.

[0605] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[0606] Once verification is complete, we will store the lost item information in our database.

[0607] Step 6:

[0608] Server: Confirms that the lost item information has been saved and notifies the loser.

[0609] A message indicating successful registration is generated and sent back to the lost device.

[0610] The person who lost the item will receive a notification that their lost item has been registered.

[0611] Step 7:

[0612] Server: Retrieves lost and found data from the database.

[0613] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[0614] Step 8:

[0615] Server: Matches lost and found items using a generative AI model.

[0616] The server inputs information about lost and found items into a generative AI model, comparing the item's characteristics, where it was found, where it was lost, the date, and image data.

[0617] If the match is successful, the result is stored in an internal system.

[0618] Step 9:

[0619] Server: Notifies the finder and the lost person that the match was successful.

[0620] - Create a notification message based on the matching results and send it to the devices of the finder and the lost person.

[0621] The notification will also include a link to the system's contact methods (such as chat functionality).

[0622] Step 10:

[0623] User: The finder and the loser exchange information using the communication means within the system.

[0624] · The finder and loser can click on the link in the notification to access the chat function within the system.

[0625] · Discuss details and delivery methods of items through communication channels.

[0626] Step 11:

[0627] Server: Handles the billing process for performance-based rewards.

[0628] After confirming that the match was successful and the item was returned to its owner, the server will begin the process of collecting the appropriate reward.

[0629] - Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, 800 yen) will be charged.

[0630] Step 12:

[0631] User: The loser pays the reward.

[0632] The loser will check the claim from the system and pay a fixed fee.

[0633] You will receive a notification that your payment has been made and the process is complete.

[0634] Example 1

[0635] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0636] There is a need for a system that can efficiently and accurately match found and lost items. However, conventional methods involve a series of complicated and inefficient processes, including information registration, matching, notification, contact, and billing. In addition, matching accuracy is low, and there is no guarantee that lost items will be returned to their owners safely. This has resulted in low trust among users and low user satisfaction.

[0637] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0638] In this invention, the server includes: [means for registering detailed information on found items]; [means for registering detailed information on lost items]; [means for matching information on found items and lost items using a generative artificial intelligence model]; [means for sending an in-system notification to the finder and the loser if the match is successful]; [means for collecting a performance-based reward based on the match]; [means for providing a function that allows the finder and the loser to communicate directly using communication means within the system]; [means for verifying information and filtering spam]; and [means for collecting a flat fee based on payment information if the return of the item is confirmed.] This allows for efficient and accurate matching of information on found items and lost items, smooth communication between users, and reliable return of items through performance-based reward charging.

[0639] "Means for registering detailed information about found items" refers to a means that provides a function for a user to input detailed information about a found item (item type, characteristics, location where found, date found, photograph, etc.), send it to a server, and register it in a database.

[0640] "Means for registering detailed information about lost items" refers to a means that provides a function for a user to input detailed information about a lost item (item type, characteristics, location lost, date lost, photo, etc.), send it to a server, and register it in a database.

[0641] "Means for matching information on found and lost items using a generative artificial intelligence model" refers to a means for a server to analyze information on found and lost items obtained from a database, and use a generative artificial intelligence model to compare the type, characteristics, location, date, image data, etc. of the items to detect matching items.

[0642] "Means for sending an in-system notification to the finder and the loser upon successful matching" means means for sending a notification through the system to the finder and the loser when a suitable match is detected, informing them of the match and providing a means of contact.

[0643] "Means for collecting rewards based on matching" refers to means for providing procedures and functions for collecting a predetermined flat fee from a user when matching is successful and it is confirmed that the item has been safely returned to its owner.

[0644] "Means for providing a function that allows the finder and the loser to communicate directly using communication means within the system" means means for providing a function that allows the owners of found and lost items to discuss details about the delivery of the items through communication means such as a chat function within the system.

[0645] "Information verification and spam filtering means" means means that provides verification and filtering functions to check the accuracy of the format and content of entered information and to eliminate fraudulent or spam information.

[0646] "Means for collecting a fixed fee based on payment information when the return of the item is confirmed" refers to a means for collecting a set fee based on the user's pre-registered payment information when the system confirms that the lost item has been returned to its original owner.

[0647] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative artificial intelligence model, and a means for collecting performance-based rewards.

[0648] System configuration and operation:

[0649] Hardware and software configuration:

[0650] This system uses the following hardware and software:

[0651] Devices: Mobile devices (iOS, Android), personal computers

[0652] Server: Cloud-based server (e.g. AWS, Azure)

[0653] Generative AI models: Generative AI models such as GPT-4

[0654] Database: MySQL, PostgreSQL

[0655] Detailed processing description:

[0656] Registering lost items

[0657] 1. User: The finder launches a web form or mobile application and logs in.

[0658] 2. Terminal: The terminal verifies the login information and authenticates the user.

[0659] 3. User: The finder enters detailed information about the found item (item type, characteristics, location, date of finding, photo, etc.).

[0660] 4. Terminal: The terminal sends the entered information to the server.

[0661] 5. Server: The server validates the information it receives, performing format checks and spam filtering as needed.

[0662] 6. Server: Checks that the information is accurate and stores it in a database.

[0663] 7. Server: Notifies the finder that the information has been registered.

[0664] Registering a lost item report

[0665] 1. User: The loser launches a web form or mobile application and logs in.

[0666] 2. Terminal: The terminal verifies the login information and authenticates the user.

[0667] 3. User: The person who lost the item enters detailed information about the lost item (item type, characteristics, location lost, date lost, photo, etc.).

[0668] 4. Terminal: The terminal sends the entered information to the server.

[0669] 5. Server: The server validates the information it receives, performing format checks and spam filtering as needed.

[0670] 6. Server: Checks that the information is accurate and stores it in a database.

[0671] 7. Server: Notifies the lost person that the information has been registered.

[0672] matching

[0673] 1. Server: Periodically retrieves lost and found information from the database.

[0674] 2. Server: Analyzes the acquired information using a generative artificial intelligence model (such as GPT-4).

[0675] 3. Server: Detects matching items based on item type, characteristics, location, date, and image data.

[0676] 4. Server: The matching results are logged internally.

[0677] Example: If finder A finds a "red wallet" in a park and loser B loses it near a train station on the same day, the AI ​​model analyzes this information and makes a match based on the type of wallet, color, and proximity of where it was found and lost.

[0678] Notification and communication

[0679] 1. Server: If a match is successful, it sends an in-system notification to the finder and the loser.

[0680] 2. Server: Open the chat function within the system for finders and losers to communicate with each other.

[0681] 3. User: The finder and the loser use the chat function to discuss how to hand over the item and what to check.

[0682] Performance-based billing

[0683] 1. Server: Once the match is successful and the item has been returned to its original owner, the server begins the process of claiming the reward.

[0684] 2. Server: Collects a predetermined flat fee (either 300 yen, 500 yen, or 800 yen) based on the user's payment information.

[0685] 3. User: Once the lost item is safely returned, the user receives a claim from the system and completes the payment.

[0686] 4. Server: Notifies the customer that the payment has been made and closes the transaction.

[0687] Examples of prompts:

[0688] "I found a red wallet in the park. It was found at XX Park on XX / XX. It is made of leather, is medium in size, and has the manufacturer's name written on the inside. Please check to see if it matches the lost item information."

[0689] "I lost a red wallet near the station. It was lost at XX Station on XX / XX / XX. It is made of leather, is medium in size, and has the manufacturer's name written on the inside. Please check to see if it matches the lost property information."

[0690] In this way, the system of the present invention utilizes diverse hardware and advanced generative AI models to streamline the matching process between lost and found items, providing users with a reliable service.

[0691] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0692] Step 1:

[0693] Enter and submit details of your lost item

[0694] User: The finder launches a web form or mobile app and logs in.

[0695] Terminal: The terminal verifies the login information and authenticates the user.

[0696] User: The finder enters detailed information about the found item (item type, characteristics, location, date of finding, photos, etc.). The entered data is then imported into the terminal in the form of text or images.

[0697] Terminal: The terminal sends the entered information to the server. The data sent includes details of the lost item.

[0698] Step 2:

[0699] Found item information verification and registration

[0700] Server: The server validates the information it receives, performing format checks and spam filtering as needed. Format checks verify required fields and that data has been entered correctly. Spam filtering filters out invalid entries.

[0701] Server: Checks that the information is accurate and stores it in a database, including details of the found item.

[0702] Server: Notifies the finder that the information has been registered. The notification includes a message indicating that registration was successful.

[0703] Step 3:

[0704] Enter and submit your lost item report details

[0705] User: The loser launches a web form or mobile app and logs in.

[0706] Terminal: The terminal verifies the login information and authenticates the user.

[0707] User: The person who lost the item enters detailed information about the lost item (item type, characteristics, location, date of loss, photo, etc.). The entered data is imported into the device as text or images.

[0708] Device: The device sends the entered information to the server. The data sent includes details of the lost item.

[0709] Step 4:

[0710] Lost property verification and registration

[0711] Server: The server validates the information it receives, performing format checks and spam filtering as needed. Format checks verify required fields and that data has been entered correctly. Spam filtering filters out invalid entries.

[0712] Server: Checks that the information is accurate and stores it in a database, which contains details of the lost item.

[0713] Server: Notifies the lost person that the registration of the information has been completed. The notification includes a message indicating that the registration was successful.

[0714] Step 5:

[0715] Data matching of lost and found items

[0716] Server: The server periodically retrieves information about lost and found items from the database, including the type of item, its characteristics, the location where it was found, and the date it was found.

[0717] Server: Analyzes the acquired information using a generative AI model. Specifically, it compares information such as the type of item, characteristics, location, date, and image data to find matching items. The AI ​​model analyzes the data to find similarities and matches.

[0718] Server: Internally logs the match results, including which lost and found items were matched.

[0719] For example, if finder A finds a red wallet in a park and loser B loses it near a train station on the same day, the AI ​​model analyzes this information and matches the wallets based on their type, color, and the proximity of where they were found and lost.

[0720] Step 6:

[0721] Notification and contact method when matching is successful

[0722] Server: If a match is successful, send an in-system notification to the finder and the loser. The notification contains information about the successful match and next steps.

[0723] Server: Opens the chat function within the system for finders and losers to communicate with each other. The chat function includes the ability to send and receive messages.

[0724] Users: The finder and the loser use the chat function to discuss how to hand over the item and what to check. Users exchange necessary information through chat within the system.

[0725] Step 7:

[0726] Performance-based billing processing

[0727] Server: Once the matching is successful and it is confirmed that the item has been returned to its original owner, the server will begin the process of claiming the reward. If the return is confirmed, the server will automatically process the claim.

[0728] Server: A predetermined flat fee (either 300 yen, 500 yen, or 800 yen) is collected based on the user's payment information, using credit card information or other payment methods.

[0729] User: When the lost item is safely returned, the user receives a claim from the system and completes the payment. The user then follows the notification to complete the payment procedure.

[0730] Server: Notifies the user that the payment has been completed and completes the transaction. The completion notification includes a message that the transaction was successful.

[0731] This allows the system to efficiently and accurately match information on found and lost items, facilitate communication between users, and enable reliable item returns through performance-based billing.

[0732] (Application example 1)

[0733] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0734] The management of found and lost items in public places is often inefficient, resulting in long wait times for items to be returned to their owners. Furthermore, information on the type and characteristics of items, as well as the locations where they were found or lost, is fragmented, making it difficult to effectively match them. Furthermore, there is a need for a means to register information on found and lost items, as well as an efficient system for analyzing and matching them.

[0735] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0736] In this invention, the server includes means for registering detailed information on found items, means for registering detailed information on lost items, and means for matching information on found and lost items using a generative artificial intelligence model. This makes it possible to efficiently manage lost and found items in public places and to perform more accurate matching by analyzing the type, characteristics, location, date, and image data of the item.

[0737] "Detailed information about lost items" refers to information such as the type of item, its characteristics, the location where it was found, the date it was found, and photographs.

[0738] "Detailed information about the lost item" refers to information such as the type of item, its characteristics, the location where it was lost, the date it was lost, and photographs.

[0739] A "generative artificial intelligence model" refers to an artificial intelligence algorithm that analyzes input data and finds correlations.

[0740] "Means for notifying the finder and the loser if a match is successful" refers to a method for notifying both parties of the discovery and match using the notification function within the system.

[0741] "Means for collecting performance-based rewards" refers to a method of charging system users a fixed fee when an item is returned to its owner.

[0742] "A smartphone-based security service that provides management of lost and found items in public places" refers to a service that uses smartphones to manage and match lost and found items in public areas such as train stations and commercial facilities.

[0743] "Feature-analyzing generative artificial intelligence model" refers to an artificial intelligence algorithm that analyzes item type, characteristics, location, date, and image data to find matches to lost and found items.

[0744] "Dedicated chat function" refers to a means of communication within the system that allows the finder and the loser to directly contact each other and discuss how to return the item.

[0745] System Overview

[0746] This invention provides a system for managing information on lost and found items and efficiently matching them. This system has a series of functions for registering detailed information on found and lost items, matching them using a generative artificial intelligence model, and notifying the user of the results. Specifically, this is a smartphone-based security service that provides management of lost and found items in public places.

[0747] Required Hardware and Software

[0748] Hardware: Smartphones, servers

[0749] Software: databases (e.g., SQLite), artificial intelligence models (e.g., OpenAI API), web frameworks (e.g., Flask)

[0750] Registering details of lost items

[0751] The user, or finder, uses their smartphone to input detailed information about the found item, such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo, and then sends this information to the server. The server then stores the received information in a database.

[0752] Registering details of lost items

[0753] The user, the person who lost the item, uses their smartphone to input detailed information about the lost item, such as the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo, and then sends this information to the server, which then stores the received information in a database.

[0754] Information Matching

[0755] The server retrieves information about lost and found items from the database and analyzes it using a generative artificial intelligence model, which compares item type, characteristics, location, date, and image data to find matching items.

[0756] Notification of matching results

[0757] If the match is successful, the server sends a notification to the finder and the loser. The notification is sent via the system's communication means (such as a chat function). The finder and the loser can use the provided communication means to discuss how to hand over the item and any necessary confirmations.

[0758] Collection of performance-based rewards

[0759] If the match is successful and the item is confirmed to have been returned to its owner, the server will charge the user a reward. The system collects a predetermined flat fee based on the user's payment information.

[0760] Examples of concrete examples and prompts

[0761] Specific examples

[0762] The finder registers the information as lost property at the station: "iPhone 12, black, scratches on the back, found on October 12, 2023."

[0763] The loser registers a lost item report stating, "I lost my black iPhone 12 at a station on October 12th. There is a scratch on the back."

[0764] A generative AI model analyzes this data and makes matches.

[0765] Example prompt

[0766] Found: iPhone 12, black, with scratches on the back, found on October 12, 2023.

[0767] Lost item: Lost a black iPhone 12 at a station on October 12th. There is a scratch on the back.

[0768] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0769] Step 1:

[0770] The user (the finder) uses a smartphone to input detailed information about the found item. Specifically, the type of item, its characteristics, the location where it was found, the date it was found, and a photo are entered, and then sent to the server. The input data is sent to the server in JSON format. The server verifies the received information and saves it in a database. Here, the input is the detailed information about the found item, and the output is saving it to the database.

[0771] Step 2:

[0772] The user (the person who lost the item) uses their smartphone to input detailed information about the lost item, including the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo, and then sends this information to the server. The server then verifies the information it receives and stores it in a database. Again, the input is the detailed information about the lost item, and the output is storage in the database.

[0773] Step 3:

[0774] The server periodically retrieves information about lost and found items from the database. This information includes the item type, characteristics, location, date, and photo. The retrieved data is input into a generative artificial intelligence model. The input is the lost and found item information from the database, which is then analyzed by the generative artificial intelligence model.

[0775] Step 4:

[0776] The generative AI model analyzes the acquired information and compares the item type, characteristics, location, date, and image data. Specific data processing includes text data feature extraction, image data feature extraction, and geographic proximity assessment. The model identifies matching lost and found items. The output is a successful match.

[0777] Step 5:

[0778] If the match is successful, the server sends a notification to the finder and the loser. The notification is sent via a smartphone app. The user receives the notification and uses the system's in-system communication method (dedicated chat) to confirm details and discuss how to hand over the item. The input is information about the successful match, and the output is the notification and provision of communication methods.

[0779] Step 6:

[0780] If the match is successful and the item has been returned to its owner, the server will claim the reward from the user. Based on the user's payment information, the system collects a pre-determined fixed fee. The input is the confirmation of the item's return, and the output is the claim and collection of the reward.

[0781] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0782] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative AI model, and a means for providing user support and collecting rewards using an emotion engine. This system improves the user experience by recognizing the user's emotions and providing appropriate support during the management and return process of lost and found items.

[0783] System configuration and operation

[0784] Registering lost items

[0785] 1. Terminal: The finder enters the details of the lost item.

[0786] The finder launches a web form or mobile app and enters information such as the type of item, its characteristics, where it was found, the date it was found, and a photo.

[0787] Once the input is complete, the send button is pressed to send the information to the server.

[0788] 2. Server: Receives and verifies the found item information.

[0789] The server validates the format and content of the received data to ensure there is no missing or invalid data.

[0790] Once verification is complete, the found item information is stored in a database.

[0791] 3. Server: Confirms that the found item information has been saved and notifies the finder.

[0792] A message indicating successful registration is generated and sent back to the finder's terminal.

[0793] The finder will receive a notification that the lost item has been registered.

[0794] Registering a lost item report

[0795] 1. Terminal: The loser enters the details of the lost item.

[0796] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and a photo.

[0797] Once the input is complete, the send button is pressed to send the information to the server.

[0798] 2. Server: Receives and verifies the lost item information.

[0799] The server validates the format and content of the received data to ensure there is no missing or invalid data.

[0800] Once verification is complete, the lost item information is stored in a database.

[0801] 3. Server: Confirms that the lost item information has been saved and notifies the loser.

[0802] A message indicating successful registration is generated and sent back to the lost device.

[0803] The loser will receive a notification that their lost item has been registered.

[0804] matching

[0805] 1. Server: Retrieves lost and found data from the database.

[0806] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[0807] 2. Server: Matches lost and found items using a generative AI model.

[0808] The server inputs information about lost and found items into a generative artificial intelligence model, comparing the item's characteristics, where it was found, where it was lost, the date, image data, etc.

[0809] If the match is successful, the results are stored in an internal system.

[0810] Examples:

[0811] Suppose finder A finds a "red wallet" in a park, and loser B loses it near a station on the same day. A generative AI model analyzes this information, matches the wallet type, color, and the proximity of where it was found and lost, and sends a notification.

[0812] Notification and communication

[0813] 1. Server: Notifies the finder and the loser of a successful match.

[0814] A notification message is created based on the matching results and sent to the devices of the finder and the lost person.

[0815] The notification will also include a link to any contact methods within the system (such as chat functionality).

[0816] 2. User: The finder and the loser exchange information using the communication means within the system.

[0817] The finder and loser click on a link in the notification to access the chat function within the system.

[0818] Discuss the details and method of delivery of the items through communication channels.

[0819] Introducing the Emotion Engine

[0820] 1. Terminal: User registration and contact

[0821] To recognize a user's feelings when registering a lost or found item and provide user support as needed.

[0822] When registering an item, the system analyzes the user's emotional state and displays guide messages and support to reduce stress and anxiety.

[0823] 2. Server: When matching is successful

[0824] When a match is successful, the emotions of the finder and loser are analyzed to generate appropriate notification and support messages.

[0825] For example, if the finder is feeling anxious, add a message or explanation that will provide reassurance.

[0826] Performance-based billing

[0827] 1. Server: Handles the billing process for performance-based rewards.

[0828] After verifying that the match was successful and the item was returned to its owner, the server begins the process of collecting the appropriate reward.

[0829] Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, or 800 yen) will be charged.

[0830] 2. User: The loser pays the reward.

[0831] The loser confirms the claim from the system and pays a fixed fee.

[0832] You will receive a notification that your payment has been made and the process is complete.

[0833] This system streamlines the matching process between lost and found items, returning more items to their owners and contributing to environmental conservation. Furthermore, by using a generative AI model and emotion engine, the system improves the user experience and increases matching accuracy. This system benefits both the finder and the lost item, supporting reliable item return.

[0834] The processing flow will be explained below.

[0835] Step 1:

[0836] Terminal: The finder enters details of the lost item.

[0837] The finder opens a web form or mobile app and enters information such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[0838] Once you have completed the input, click the send button to send the information to the server.

[0839] Step 2:

[0840] Server: Receives and verifies the found item information.

[0841] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[0842] Once verification is complete, the found item information will be saved in the database.

[0843] Step 3:

[0844] Server: Confirms that the found item information has been saved and notifies the finder.

[0845] A message indicating successful registration is generated and sent back to the finder's device.

[0846] The finder will receive a notification that the lost item has been registered.

[0847] Step 4:

[0848] Terminal: The loser enters the details of the lost item.

[0849] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and photo.

[0850] Once you have completed the input, click the send button to send the information to the server.

[0851] Step 5:

[0852] Server: Receives and verifies the lost item information.

[0853] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[0854] Once verification is complete, we will store the lost item information in our database.

[0855] Step 6:

[0856] Server: Confirms that the lost item information has been saved and notifies the loser.

[0857] A message indicating successful registration is generated and sent back to the lost device.

[0858] The person who lost the item will receive a notification that their lost item has been registered.

[0859] Step 7:

[0860] Server: Retrieves lost and found data from the database.

[0861] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[0862] Step 8:

[0863] Server: Matches lost and found items using a generative AI model.

[0864] The server inputs information about lost and found items into a generative AI model, comparing the item's characteristics, where it was found, where it was lost, the date, and image data.

[0865] If the match is successful, the result is stored in an internal system.

[0866] Step 9:

[0867] Server: Notifies the finder and the lost person that the match was successful.

[0868] - Create a notification message based on the matching results and send it to the devices of the finder and the lost person.

[0869] The notification will also include a link to the system's contact methods (such as chat functionality).

[0870] Step 10:

[0871] User: The finder and the loser exchange information using the communication means within the system.

[0872] · The finder and loser can click on the link in the notification to access the chat function within the system.

[0873] · Discuss details and delivery methods of items through communication channels.

[0874] Step 11:

[0875] Terminal: Analyzes the emotional state of users who are in trouble.

[0876] As users interact, the emotion engine analyzes their emotional state (stress, anxiety, relief, joy, etc.).

[0877] · Providing supportive messages and advice when needed.

[0878] Step 12:

[0879] Server: Generates appropriate notification content based on the emotional state.

[0880] -When a match is successful, the system recognizes the emotions of the finder and loser and generates appropriate notification and support messages.

[0881] For example, if the finder is feeling anxious, add a message to provide reassurance.

[0882] Step 13:

[0883] Server: Handles the billing process for performance-based rewards.

[0884] After confirming that the match was successful and the item was returned to its owner, the server will begin the process of collecting the appropriate reward.

[0885] - Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, 800 yen) will be charged.

[0886] Step 14:

[0887] User: The loser pays the reward.

[0888] The loser will check the claim from the system and pay a fixed fee.

[0889] You will receive a notification that your payment has been made and the process is complete.

[0890] Example 2

[0891] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0892] The management of lost and found items requires a lot of time and effort. Current systems have difficulty effectively linking information on the finders and losers, and lack support to alleviate users' anxiety and stress. Furthermore, the success rate of matching is low, and items are often not returned smoothly. Therefore, there is a need for efficient matching of found and lost items and an improved user experience.

[0893] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0894] In this invention, the server includes: [means for registering detailed information on found items;] [means for registering detailed information on lost items;] [means for matching information on found items and lost items using a generative artificial intelligence model;] [means for notifying the finder and the loser if the match is successful;] [means for verifying information on found items and lost items and checking for missing or incorrect data; and [means for using an emotion engine that recognizes the user's emotions and provides support messages as needed.] This makes it possible [to efficiently match found items with lost items and provide appropriate support according to the user's emotional state, thereby improving the user experience and enabling smooth return of items].

[0895] "Detailed information about a lost item" refers to specific information about the item found by the finder, such as the type, characteristics, location, date of finding, and photographs.

[0896] "Detailed information about lost items" refers to specific information about the item lost by the loser, such as the type, characteristics, location, date of loss, and photographs.

[0897] A "generative artificial intelligence model" is an artificial intelligence system that analyzes the characteristics and information of found and lost items and performs matching.

[0898] "Means for notifying" refers to the means for notifying the finder and the loser of the result when matching is successful. Specifically, it refers to the system that generates and sends messages.

[0899] "Means for verifying" means the means by which lost and found information is received to verify that the information is accurate and that there are no omissions or irregularities.

[0900] An "emotion engine" is a system that recognizes the user's emotional state and generates appropriate support messages based on that information.

[0901] "Means for collecting a reward" refers to a means for collecting a set fee from a user when matching is successful and the item is returned.

[0902] The present invention relates to a system for managing information on lost and found items and efficiently matching them. Users register items, a generative AI model is used to perform matching, and an emotion engine is used to support users and collect rewards.

[0903] Registering lost items

[0904] 1. Terminal

[0905] The finder enters detailed information about the found item. The finder launches a web form or mobile app on their device (smartphone or PC) and enters details about the found item (item type, characteristics, location found, date found, photo). For example, if they found a red wallet in a park, they would enter "Type: Wallet," "Characteristics: Red, with side zipper," "Location found: Park," "Date found: October 10, 2023," and "Photo: Photograph taken." Once they have completed entering the information, they press the send button to send the data to the server.

[0906] 2. Server

[0907] The server collects data on lost items received from the device. The web server receives an HTTP request and receives detailed information on the lost item in JSON format. It then validates the format and content of the received data. Specifically, it checks whether all required fields have been filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the device. Once validation is complete, it saves the lost item information in the database.

[0908] 3. Notification

[0909] The server notifies the finder that the data has been successfully saved, including specific information such as "Type: wallet, Characteristics: red, with side zipper, found in a park on October 10, 2023."

[0910] Registering a lost item report

[0911] 1. Terminal

[0912] The loser enters detailed information about the lost item. The loser launches a web form or mobile app on their device (smartphone or PC) and enters details about the lost item (item type, characteristics, location lost, date lost, photo). For example, if they lost a red wallet near a station, they would enter "Type: Wallet," "Characteristics: Red, with side zipper," "Location lost: Near the station," "Date lost: October 10, 2023," and "Photo: Photo taken previously." Once they have completed entering the information, they press the send button to send the data to the server.

[0913] 2. Server

[0914] The server collects the lost item data received from the device. The web server receives the HTTP request and receives the lost item details in JSON format. It then validates the format and content of the received data. Specifically, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and sends it back to the device. Once validation is complete, it saves the lost item information in the database.

[0915] 3. Notification

[0916] The server notifies the loser that the data has been successfully saved, including specific information such as "Type: wallet, Characteristics: red, with a side zipper, lost near a station on October 10, 2023."

[0917] matching

[0918] 1. Server

[0919] The server periodically or upon request extracts newly registered lost and found items from the database. Specifically, it executes an SQL query to retrieve recently added data. The retrieved information on lost and found items is then input into a generative AI model. Matching is performed by comparing items such as the item's characteristics, where it was found, where it was lost, the date, and image data. For example, the following information could be input: "Red wallet, with a side zipper, where it was found in a park, where it was lost near a station, and the date it was found on October 10, 2023."

[0920] 2. Server

[0921] If the match is successful, the results are saved in the internal system. For example, "Finder A's red wallet with a side zipper matches the wallet of loser B." This is saved in the database.

[0922] Notification and communication

[0923] 1. Server

[0924] The server notifies the finder and the lost person that the match was successful. Specifically, it generates a notification message based on the matching result and sends it to the finder and the lost person's devices. It provides a message saying "Your red wallet has been found" and a link to the system's contact method (such as a chat function).

[0925] 2. Users

[0926] The finder and the loser click on the link in the notification to access the chat function within the system. Specifically, they use the chat screen to discuss details such as how to hand over the item. They make specific arrangements, such as "Let's meet at XX Station on October 15th at 2:00 PM."

[0927] Introducing the Emotion Engine

[0928] 1. Terminal

[0929] When registering lost or found items, the system recognizes the user's emotions. It uses the device's camera and voice data to analyze the user's emotional state (anxiety, stress, joy, etc.). For example, it uses facial recognition technology to determine whether the user is smiling or looking serious.

[0930] 2. Server

[0931] Based on the information obtained from the emotion engine, appropriate notification content and support messages are generated. For example, if the finder is feeling anxious, a message such as "Don't worry, your information is being kept safe" will be generated.

[0932] Performance-based billing

[0933] 1. Server

[0934] After confirming that the matching was successful and the item was returned, the process of collecting the appropriate reward will begin. Specifically, a scenario will be started in which payment is processed using credit card information.

[0935] 2. Users

[0936] The lost person checks the request from the system and pays the fixed fee. For example, they pay the appropriate fee of 300 yen, 500 yen, or 800 yen with their credit card. They receive a notification that the payment has been completed, and the process is complete. A message such as "Your payment has been completed. Thank you for letting us know" is displayed.

[0937] Example prompts for generative AI models

[0938] "I found a red wallet in the park. Date found: October 10, 2023. Features: It has a zipper on the side. Please use this information to find someone who lost a red wallet on the same day."

[0939] This enables efficient matching of found and lost items, and also provides appropriate support according to the user's emotional state, improving the user experience and enabling smooth return of items.

[0940] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0941] Step 1:

[0942] Enter details of the lost item (device)

[0943] Input: The finder launches a web form or mobile app on their device (smartphone or PC) and enters details about the lost item (item type, characteristics, location, date of finding, and photo).

[0944] Specific operation: If the finder finds a red wallet in a park, they will enter the following: "Type: Wallet", "Characteristics: Red, with side zipper", "Place of Found: Park", "Date of Found: October 10, 2023", and "Photo: Photo taken".

[0945] Output: Once the input is complete, press the send button to send the data to the server.

[0946] Step 2:

[0947] Receiving and verifying data on lost items (server)

[0948] Input: Found item data received from the device.

[0949] Specific operation: The server receives an HTTP request and receives the details of the lost item in JSON format.

[0950] Data processing: The server validates the format and content of the data received. For example, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the terminal.

[0951] Output: Once the verification is complete, save the found item information to the database.

[0952] Step 3:

[0953] Notification of lost item registration completion (server)

[0954] Input: Information about lost items stored in the database.

[0955] Specific operation: The server verifies that the found item information has been saved successfully.

[0956] Data output: A notification message containing specific details such as "Type: wallet, Characteristics: red, with side zipper, found in park on October 10, 2023" is generated and sent to the finder's device.

[0957] Step 4:

[0958] Enter the details of the lost item (on your device)

[0959] Input: The lost person launches a web form or mobile app on their device (smartphone or PC) and enters details of the lost item (item type, characteristics, location lost, date lost, photo).

[0960] Specific operation: If the loser loses a red wallet near a station, they will enter the following: "Type: Wallet", "Characteristics: Red, with a side zipper", "Location of loss: Near the station", "Date of loss: October 10, 2023", and "Photo: Previously taken photo".

[0961] Output: Once the input is complete, press the send button to send the data to the server.

[0962] Step 5:

[0963] Receiving and verifying lost item data (server)

[0964] Input: Lost item data received from the device.

[0965] Specific operation: The server receives an HTTP request and receives the details of the lost item in JSON format.

[0966] Data processing: The server validates the format and content of the data received. For example, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the terminal.

[0967] Output: Save the lost item information in the database once verification is complete.

[0968] Step 6:

[0969] Lost item registration completion notification (server)

[0970] Input: Lost item information stored in the database.

[0971] Specific operation: The server verifies that the lost item information has been saved successfully.

[0972] Data output: A notification message containing specific details such as "Type: wallet, characteristics: red, with side zipper, lost near a station on October 10, 2023" is generated and sent to the device of the loser.

[0973] Step 7:

[0974] Data extraction (server)

[0975] Input: Lost and found data from the database.

[0976] What happens: The server runs an SQL query to extract recently added data.

[0977] Output: Retrieved lost and found information.

[0978] Step 8:

[0979] AI matching (server)

[0980] Input: Extracted lost and found information.

[0981] Specific operation: Input the item's characteristics, where it was found, where it was lost, date, image data, etc. into the generative artificial intelligence model and attempt to match it.

[0982] Data calculation: The AI ​​model analyzes the input information and performs feature extraction and comparative matching.

[0983] Output: Successfully matched data is stored in an internal system.

[0984] Step 9:

[0985] Notification of matching results (server)

[0986] Input: A successful match result.

[0987] Specific operation: The server generates a notification message based on the matching result and sends it to the finder and the lost person's devices, for example, a message saying "Your red wallet has been found."

[0988] Output: Notification messages are sent to the finder and the loser.

[0989] Step 10:

[0990] Information exchange and coordination (users)

[0991] Input: The link to be included in the notification message.

[0992] Specific operation: The finder and the loser click on the link in the notification to access the chat function within the system, where they can discuss details and how to hand over the item.

[0993] Output: As a result of the discussion, a specific date, time and location for delivery will be decided.

[0994] Step 11:

[0995] Emotion Recognition and Analysis (Device)

[0996] Input: User's video and audio data.

[0997] Specific operation: Recognizes the user's emotional state (anxiety, stress, joy, etc.) using the device's camera and microphone. For example, it uses facial recognition technology to determine whether the user is smiling or looking serious.

[0998] Output: Emotion recognition data.

[0999] Step 12:

[1000] Emotion response message generation (server)

[1001] Input: Emotion recognition data.

[1002] Specific operation: The server generates appropriate notification and support messages based on the information obtained by the emotion engine. For example, if the finder feels anxious, the server will generate a message such as "Don't worry, your information is kept safe."

[1003] Output: An emotional response message is sent to the device.

[1004] Step 13:

[1005] Performance-based reward billing procedure (server)

[1006] Input: Successful match and item return information.

[1007] Specific operation: The server starts the process of charging the appropriate reward (e.g., 300 yen, 500 yen, 800 yen) to the user. Payment is made based on the credit card information.

[1008] Output: A successful charge message is sent to the user.

[1009] Step 14:

[1010] Payment of performance rewards (user)

[1011] Input: Billing message.

[1012] Specific operation: The person who lost the item checks the bill from the system and pays the fixed fee by credit card, for example, 300 yen, 500 yen, or 800 yen.

[1013] Output: A notification of successful payment is sent to the user and the process is complete.

[1014] (Application example 2)

[1015] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1016] Lost and found items frequently occur in physical stores, making their management cumbersome and time-consuming for staff and customers. In particular, if lost or found items are not promptly returned to their owners, customer satisfaction declines and in-store confusion occurs. Furthermore, matching between lost and found items is often done manually, resulting in low efficiency and a high risk of errors. Furthermore, it is difficult to appropriately consider the user's emotional state when communicating and responding to the match, which can increase stress and anxiety.

[1017] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1018] In this invention, the server includes a means for registering detailed information on found items, a means for registering detailed information on lost items, a means for matching information on found items and lost items using a generative artificial intelligence model, a means including an emotion engine that analyzes user emotions and provides appropriate support messages, and a means for registering, notifying, and contacting users about found and lost items using a smartphone or tablet device. This enables efficient management and rapid return of found and lost items in physical stores, thereby improving customer satisfaction and reducing the burden on staff.

[1019] The "means for registering detailed information about found items" is an interface that allows the user to input the type, characteristics, location, date of finding, photograph, etc. of the found item and send them to the server.

[1020] The "means for registering detailed information about a lost item" is an interface that allows a user to input the type, characteristics, location, date of loss, photograph, etc. of the lost item and send them to the server.

[1021] "Means for matching information on found and lost items using generative artificial intelligence models" refers to a system that analyzes data on found and lost items and compares characteristics, locations, dates, etc. to identify items that are likely to match.

[1022] The "means for notifying the finder and the lost person when a match is successful" refers to a means for informing the users of the matching results, which is usually done via a notification message or email.

[1023] "Means including an emotion engine that analyzes the user's emotions and provides appropriate support messages" refers to a system that analyzes the user's emotional state at the time of registration or matching, and presents messages to reduce stress and anxiety.

[1024] The "means for collecting rewards based on matching" is a system for claiming and collecting appropriate rewards after a lost item is returned to the loser.

[1025] "Means for registering, notifying, and contacting lost and found items using a smartphone or tablet device" refers to an interface for using a mobile device to input and send information about lost and found items, and to make notifications and contact.

[1026] System configuration

[1027] In order to implement the present invention, the following hardware and software are used.

[1028] Hardware

[1029] 1. Smartphone or tablet:

[1030] Used as a user interface for registering, notifying, and contacting lost and found items. Customers and store staff use it to enter information and receive notifications.

[1031] 2. Server:

[1032] It collects information on lost and found items, analyzes and processes the data using a generative AI model and emotion engine, and notifies users when a match is successful and collects rewards.

[1033] software

[1034] 1. Generative AI models (e.g., TensorFlow):

[1035] It analyzes the characteristics, location, date and image data of lost and found items to make appropriate matches, which is performed on the server.

[1036] 2. Emotion Engine:

[1037] It analyzes the user's emotional state and generates appropriate support messages, which are also performed on the server.

[1038] How it works

[1039] Registering lost items

[1040] The user enters details of the lost item using a smartphone or tablet device, and the entered data is sent to a server, which verifies the format and content and then stores it in a database.

[1041] Registering lost property

[1042] The user enters the details of the lost item using a smartphone or tablet device, and the entered data is sent to a server, which verifies the format and content and then stores it in a database.

[1043] matching

[1044] The server periodically retrieves information about lost and found items from the database and uses a generative AI model to match them, comparing item characteristics, location, dates, image data, and more to identify likely matches.

[1045] Notification and communication

[1046] If the match is successful, the server sends a notification to the finder and the loser. The notification includes a link to the system's communication tools (such as a chat function). The finder and the loser can use the system's communication tools to exchange information and discuss how to hand over the item.

[1047] Introducing the Emotion Engine

[1048] The server analyzes the user's emotions when registering lost or found items or when a match is successful, and generates appropriate support messages, thereby reducing the user's stress and anxiety.

[1049] Prompt Sentence Examples

[1050] 1. Please register your lost item. Please enter the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[1051] 2. Register the details of your lost item. Please enter the type of item, its characteristics, location, date of loss, and a photo.

[1052] 3. "Match successful. Please review the details of the found item."

[1053] Specific examples

[1054] For example, if a customer finds a wallet in a store, they can register it using the app by entering a photo and other characteristics and then pressing the send button, which transfers the data to a server. Similarly, if another customer registers a lost wallet, the generative AI model analyzes the information from both parties, and if there is a match, a notification is sent to both parties. At this time, the emotion engine also works, displaying messages to reduce stress and anxiety for the finder and the loser.

[1055] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1056] Step 1:

[1057] Registering lost items

[1058] The user inputs and submits details of the lost item using a smartphone or tablet device. The input information includes the type of item, its characteristics, the location where it was found, the date it was found, and a photo. This information is then sent from the device to a server. The server verifies the format and content of the received data and checks for missing or invalid data. Once verification is complete, the server stores the information in a database and notifies the user that the registration is complete.

[1059] Input: Type of item, characteristics, location of item, date of item, photo

[1060] Output: Information on lost items stored in the database, notification of registration completion

[1061] Step 2:

[1062] Registering lost property

[1063] The user inputs and submits details of the lost item using a smartphone or tablet device. The input information includes the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo. This information is then sent from the device to a server. The server verifies the format and content of the received data and checks for missing or invalid data. Once verification is complete, the server stores the information in a database and notifies the user that registration is complete.

[1064] Input: Type of item, characteristics, location of loss, date of loss, photo

[1065] Output: Information about lost items stored in the database, notification of registration completion

[1066] Step 3:

[1067] Matching process

[1068] The server periodically retrieves information about lost and found items from the database. Using a generative AI model, it analyzes the item type, characteristics, location, date, and image data to match found and lost items. It identifies candidates with high potential matches based on characteristics and proximity of location information.

[1069] Input: Lost and found information stored in the database

[1070] Output: Matching results

[1071] Step 4:

[1072] Notification and communication

[1073] If a match is successful, the server sends a notification to the finder and the loser, including a link to access the system's communication channels (such as a chat function), allowing the finder and the loser to communicate and discuss details of the item and how to return it.

[1074] Input: Matching results

[1075] Output: Notice to finder and loser, contact links

[1076] Step 5:

[1077] Supported by an emotional engine

[1078] The server analyzes the user's emotions when registering a lost or found item or when a match is successful, and generates a message to reduce the user's stress and anxiety using an emotion engine and includes it in the notification.

[1079] Input: User behavior data (at the time of registration, notification)

[1080] Output: Support message based on emotional state

[1081] Step 6:

[1082] Collection of performance-based rewards

[1083] After the lost item is successfully returned to the owner, the server collects the reward by processing the payment information based on a predetermined fixed fee (e.g., 300 yen, 500 yen, or 800 yen). Once completed, a notification is sent to the loser.

[1084] Input: Confirmation data of lost property return, payment information of the lost property owner

[1085] Output: Invoicing and collecting commissions, notification of completion

[1086] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1087] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1088] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1089] [Third embodiment]

[1090] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1091] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1092] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1093] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1094] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1095] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1096] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1097] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1098] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1099] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1100] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1101] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1102] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative artificial intelligence model, and a means for collecting performance-based rewards.

[1103] System configuration and operation:

[1104] Registering lost items

[1105] Device: The finder uses a web form or mobile app to enter details about the lost item (item type, characteristics, location, date found, photos, etc.) and sends the information to the server.

[1106] Server: The server verifies the received information, stores it in the database, and notifies the finder that the information has been registered.

[1107] Registering a lost item report

[1108] Device: The lost person uses a web form or mobile app to enter details of the lost item (item type, characteristics, location, date of loss, photo, etc.) and sends the information to the server.

[1109] Server: The server verifies the received information, stores it in the database, and notifies the lost person that the information has been registered.

[1110] matching

[1111] Server: The server retrieves lost and found items from the database and analyzes them using a generative artificial intelligence model to compare item types, characteristics, locations, dates, and image data to find matching items.

[1112] Example: Finder A finds a "red wallet" in a park, and loser B loses it near a train station on the same day. A generative AI model analyzes this information, matches the wallet type, color, where it was found, and the proximity of where it was lost, and sends a notification.

[1113] Notification and communication

[1114] Server: If the match is successful, the server sends an in-system notification to the finder and the loser, and provides a dedicated means of communication (such as a chat function) so that the finder and the loser can directly communicate and confirm details.

[1115] Users: The finder and the loser can use the system's communication tools to discuss how to hand over the item and what to check.

[1116] Performance-based billing

[1117] Server: If the match is successful and the item has been returned to its owner, the system processes the user to claim the reward. The system collects a predetermined flat fee (either 300 yen, 500 yen, or 800 yen) based on the user's payment information.

[1118] User: When an item is safely returned, the loser pays a fixed fee to the system and receives a notification of completion.

[1119] This system streamlines the matching process between lost and found items, returning more items to their owners and contributing to environmental conservation. Furthermore, by using a generative AI model, matching accuracy is improved and communication between users is facilitated. This system benefits both the finder and the lost item, supporting reliable item return.

[1120] The processing flow will be explained below.

[1121] Step 1:

[1122] Terminal: The finder enters details of the lost item.

[1123] The finder opens a web form or mobile app and enters information such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[1124] Once you have completed the input, click the send button to send the information to the server.

[1125] Step 2:

[1126] Server: Receives and verifies the found item information.

[1127] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[1128] Once verification is complete, the found item information will be saved in the database.

[1129] Step 3:

[1130] Server: Confirms that the found item information has been saved and notifies the finder.

[1131] A message indicating successful registration is generated and sent back to the finder's device.

[1132] The finder will receive a notification that the lost item has been registered.

[1133] Step 4:

[1134] Terminal: The loser enters the details of the lost item.

[1135] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and photo.

[1136] Once you have completed the input, click the send button to send the information to the server.

[1137] Step 5:

[1138] Server: Receives and verifies the lost item information.

[1139] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[1140] Once verification is complete, we will store the lost item information in our database.

[1141] Step 6:

[1142] Server: Confirms that the lost item information has been saved and notifies the loser.

[1143] A message indicating successful registration is generated and sent back to the lost device.

[1144] The person who lost the item will receive a notification that their lost item has been registered.

[1145] Step 7:

[1146] Server: Retrieves lost and found data from the database.

[1147] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[1148] Step 8:

[1149] Server: Matches lost and found items using a generative AI model.

[1150] The server inputs information about lost and found items into a generative AI model, comparing the item's characteristics, where it was found, where it was lost, the date, and image data.

[1151] If the match is successful, the result is stored in an internal system.

[1152] Step 9:

[1153] Server: Notifies the finder and the lost person that the match was successful.

[1154] - Create a notification message based on the matching results and send it to the devices of the finder and the lost person.

[1155] The notification will also include a link to the system's contact methods (such as chat functionality).

[1156] Step 10:

[1157] User: The finder and the loser exchange information using the communication means within the system.

[1158] · The finder and loser can click on the link in the notification to access the chat function within the system.

[1159] · Discuss details and delivery methods of items through communication channels.

[1160] Step 11:

[1161] Server: Handles the billing process for performance-based rewards.

[1162] After confirming that the match was successful and the item was returned to its owner, the server will begin the process of collecting the appropriate reward.

[1163] - Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, 800 yen) will be charged.

[1164] Step 12:

[1165] User: The loser pays the reward.

[1166] The loser will check the claim from the system and pay a fixed fee.

[1167] You will receive a notification that your payment has been made and the process is complete.

[1168] Example 1

[1169] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1170] There is a need for a system that can efficiently and accurately match found and lost items. However, conventional methods involve a series of complicated and inefficient processes, including information registration, matching, notification, contact, and billing. In addition, matching accuracy is low, and there is no guarantee that lost items will be returned to their owners safely. This has resulted in low trust among users and low user satisfaction.

[1171] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1172] In this invention, the server includes: [means for registering detailed information on found items]; [means for registering detailed information on lost items]; [means for matching information on found items and lost items using a generative artificial intelligence model]; [means for sending an in-system notification to the finder and the loser if the match is successful]; [means for collecting a performance-based reward based on the match]; [means for providing a function that allows the finder and the loser to communicate directly using communication means within the system]; [means for verifying information and filtering spam]; and [means for collecting a flat fee based on payment information if the return of the item is confirmed.] This allows for efficient and accurate matching of information on found items and lost items, smooth communication between users, and reliable return of items through performance-based reward charging.

[1173] "Means for registering detailed information about found items" refers to a means that provides a function for a user to input detailed information about a found item (item type, characteristics, location where found, date found, photograph, etc.), send it to a server, and register it in a database.

[1174] "Means for registering detailed information about lost items" refers to a means that provides a function for a user to input detailed information about a lost item (item type, characteristics, location lost, date lost, photo, etc.), send it to a server, and register it in a database.

[1175] "Means for matching information on found and lost items using a generative artificial intelligence model" refers to a means for a server to analyze information on found and lost items obtained from a database, and use a generative artificial intelligence model to compare the type, characteristics, location, date, image data, etc. of the items to detect matching items.

[1176] "Means for sending an in-system notification to the finder and the loser upon successful matching" means means for sending a notification through the system to the finder and the loser when a suitable match is detected, informing them of the match and providing a means of contact.

[1177] "Means for collecting rewards based on matching" refers to means for providing procedures and functions for collecting a predetermined flat fee from a user when matching is successful and it is confirmed that the item has been safely returned to its owner.

[1178] "Means for providing a function that allows the finder and the loser to communicate directly using communication means within the system" means means for providing a function that allows the owners of found and lost items to discuss details about the delivery of the items through communication means such as a chat function within the system.

[1179] "Information verification and spam filtering means" means means that provides verification and filtering functions to check the accuracy of the format and content of entered information and to eliminate fraudulent or spam information.

[1180] "Means for collecting a fixed fee based on payment information when the return of the item is confirmed" refers to a means for collecting a set fee based on the user's pre-registered payment information when the system confirms that the lost item has been returned to its original owner.

[1181] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative artificial intelligence model, and a means for collecting performance-based rewards.

[1182] System configuration and operation:

[1183] Hardware and software configuration:

[1184] This system uses the following hardware and software:

[1185] Devices: Mobile devices (iOS, Android), personal computers

[1186] Server: Cloud-based server (e.g. AWS, Azure)

[1187] Generative AI models: Generative AI models such as GPT-4

[1188] Database: MySQL, PostgreSQL

[1189] Detailed processing description:

[1190] Registering lost items

[1191] 1. User: The finder launches a web form or mobile application and logs in.

[1192] 2. Terminal: The terminal verifies the login information and authenticates the user.

[1193] 3. User: The finder enters detailed information about the found item (item type, characteristics, location, date of finding, photo, etc.).

[1194] 4. Terminal: The terminal sends the entered information to the server.

[1195] 5. Server: The server validates the information it receives, performing format checks and spam filtering as needed.

[1196] 6. Server: Checks that the information is accurate and stores it in a database.

[1197] 7. Server: Notifies the finder that the information has been registered.

[1198] Registering a lost item report

[1199] 1. User: The loser launches a web form or mobile application and logs in.

[1200] 2. Terminal: The terminal verifies the login information and authenticates the user.

[1201] 3. User: The person who lost the item enters detailed information about the lost item (item type, characteristics, location lost, date lost, photo, etc.).

[1202] 4. Terminal: The terminal sends the entered information to the server.

[1203] 5. Server: The server validates the information it receives, performing format checks and spam filtering as needed.

[1204] 6. Server: Checks that the information is accurate and stores it in a database.

[1205] 7. Server: Notifies the lost person that the information has been registered.

[1206] matching

[1207] 1. Server: Periodically retrieves lost and found information from the database.

[1208] 2. Server: Analyzes the acquired information using a generative artificial intelligence model (such as GPT-4).

[1209] 3. Server: Detects matching items based on item type, characteristics, location, date, and image data.

[1210] 4. Server: The matching results are logged internally.

[1211] Example: If finder A finds a "red wallet" in a park and loser B loses it near a train station on the same day, the AI ​​model analyzes this information and makes a match based on the type of wallet, color, and proximity of where it was found and lost.

[1212] Notification and communication

[1213] 1. Server: If a match is successful, it sends an in-system notification to the finder and the loser.

[1214] 2. Server: Open the chat function within the system for finders and losers to communicate with each other.

[1215] 3. User: The finder and the loser use the chat function to discuss how to hand over the item and what to check.

[1216] Performance-based billing

[1217] 1. Server: Once the match is successful and the item has been returned to its original owner, the server begins the process of claiming the reward.

[1218] 2. Server: Collects a predetermined flat fee (either 300 yen, 500 yen, or 800 yen) based on the user's payment information.

[1219] 3. User: Once the lost item is safely returned, the user receives a claim from the system and completes the payment.

[1220] 4. Server: Notifies the customer that the payment has been made and closes the transaction.

[1221] Examples of prompts:

[1222] "I found a red wallet in the park. It was found at XX Park on XX / XX. It is made of leather, is medium in size, and has the manufacturer's name written on the inside. Please check to see if it matches the lost item information."

[1223] "I lost a red wallet near the station. It was lost at XX Station on XX / XX / XX. It is made of leather, is medium in size, and has the manufacturer's name written on the inside. Please check to see if it matches the lost property information."

[1224] In this way, the system of the present invention utilizes diverse hardware and advanced generative AI models to streamline the matching process between lost and found items, providing users with a reliable service.

[1225] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1226] Step 1:

[1227] Enter and submit details of your lost item

[1228] User: The finder launches a web form or mobile app and logs in.

[1229] Terminal: The terminal verifies the login information and authenticates the user.

[1230] User: The finder enters detailed information about the found item (item type, characteristics, location, date of finding, photos, etc.). The entered data is then imported into the terminal in the form of text or images.

[1231] Terminal: The terminal sends the entered information to the server. The data sent includes details of the lost item.

[1232] Step 2:

[1233] Found item information verification and registration

[1234] Server: The server validates the information it receives, performing format checks and spam filtering as needed. Format checks verify required fields and that data has been entered correctly. Spam filtering filters out invalid entries.

[1235] Server: Checks that the information is accurate and stores it in a database, including details of the found item.

[1236] Server: Notifies the finder that the information has been registered. The notification includes a message indicating that registration was successful.

[1237] Step 3:

[1238] Enter and submit your lost item report details

[1239] User: The loser launches a web form or mobile app and logs in.

[1240] Terminal: The terminal verifies the login information and authenticates the user.

[1241] User: The person who lost the item enters detailed information about the lost item (item type, characteristics, location, date of loss, photo, etc.). The entered data is imported into the device as text or images.

[1242] Device: The device sends the entered information to the server. The data sent includes details of the lost item.

[1243] Step 4:

[1244] Lost property verification and registration

[1245] Server: The server validates the information it receives, performing format checks and spam filtering as needed. Format checks verify required fields and that data has been entered correctly. Spam filtering filters out invalid entries.

[1246] Server: Checks that the information is accurate and stores it in a database, which contains details of the lost item.

[1247] Server: Notifies the lost person that the registration of the information has been completed. The notification includes a message indicating that the registration was successful.

[1248] Step 5:

[1249] Data matching of lost and found items

[1250] Server: The server periodically retrieves information about lost and found items from the database, including the type of item, its characteristics, the location where it was found, and the date it was found.

[1251] Server: Analyzes the acquired information using a generative AI model. Specifically, it compares information such as the type of item, characteristics, location, date, and image data to find matching items. The AI ​​model analyzes the data to find similarities and matches.

[1252] Server: Internally logs the match results, including which lost and found items were matched.

[1253] For example, if finder A finds a red wallet in a park and loser B loses it near a train station on the same day, the AI ​​model analyzes this information and matches the wallets based on their type, color, and the proximity of where they were found and lost.

[1254] Step 6:

[1255] Notification and contact method when matching is successful

[1256] Server: If a match is successful, send an in-system notification to the finder and the loser. The notification contains information about the successful match and next steps.

[1257] Server: Opens the chat function within the system for finders and losers to communicate with each other. The chat function includes the ability to send and receive messages.

[1258] Users: The finder and the loser use the chat function to discuss how to hand over the item and what to check. Users exchange necessary information through chat within the system.

[1259] Step 7:

[1260] Performance-based billing processing

[1261] Server: Once the matching is successful and it is confirmed that the item has been returned to its original owner, the server will begin the process of claiming the reward. If the return is confirmed, the server will automatically process the claim.

[1262] Server: A predetermined flat fee (either 300 yen, 500 yen, or 800 yen) is collected based on the user's payment information, using credit card information or other payment methods.

[1263] User: When the lost item is safely returned, the user receives a claim from the system and completes the payment. The user then follows the notification to complete the payment procedure.

[1264] Server: Notifies the user that the payment has been completed and completes the transaction. The completion notification includes a message that the transaction was successful.

[1265] This allows the system to efficiently and accurately match information on found and lost items, facilitate communication between users, and enable reliable item returns through performance-based billing.

[1266] (Application example 1)

[1267] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1268] The management of found and lost items in public places is often inefficient, resulting in long wait times for items to be returned to their owners. Furthermore, information on the type and characteristics of items, as well as the locations where they were found or lost, is fragmented, making it difficult to effectively match them. Furthermore, there is a need for a means to register information on found and lost items, as well as an efficient system for analyzing and matching them.

[1269] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1270] In this invention, the server includes means for registering detailed information on found items, means for registering detailed information on lost items, and means for matching information on found and lost items using a generative artificial intelligence model. This makes it possible to efficiently manage lost and found items in public places and to perform more accurate matching by analyzing the type, characteristics, location, date, and image data of the item.

[1271] "Detailed information about lost items" refers to information such as the type of item, its characteristics, the location where it was found, the date it was found, and photographs.

[1272] "Detailed information about the lost item" refers to information such as the type of item, its characteristics, the location where it was lost, the date it was lost, and photographs.

[1273] A "generative artificial intelligence model" refers to an artificial intelligence algorithm that analyzes input data and finds correlations.

[1274] "Means for notifying the finder and the loser if a match is successful" refers to a method for notifying both parties of the discovery and match using the notification function within the system.

[1275] "Means for collecting performance-based rewards" refers to a method of charging system users a fixed fee when an item is returned to its owner.

[1276] "A smartphone-based security service that provides management of lost and found items in public places" refers to a service that uses smartphones to manage and match lost and found items in public areas such as train stations and commercial facilities.

[1277] "Feature-analyzing generative artificial intelligence model" refers to an artificial intelligence algorithm that analyzes item type, characteristics, location, date, and image data to find matches to lost and found items.

[1278] "Dedicated chat function" refers to a means of communication within the system that allows the finder and the loser to directly contact each other and discuss how to return the item.

[1279] System Overview

[1280] This invention provides a system for managing information on lost and found items and efficiently matching them. This system has a series of functions for registering detailed information on found and lost items, matching them using a generative artificial intelligence model, and notifying the user of the results. Specifically, this is a smartphone-based security service that provides management of lost and found items in public places.

[1281] Required Hardware and Software

[1282] Hardware: Smartphones, servers

[1283] Software: databases (e.g., SQLite), artificial intelligence models (e.g., OpenAI API), web frameworks (e.g., Flask)

[1284] Registering details of lost items

[1285] The user, or finder, uses their smartphone to input detailed information about the found item, such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo, and then sends this information to the server. The server then stores the received information in a database.

[1286] Registering details of lost items

[1287] The user, the person who lost the item, uses their smartphone to input detailed information about the lost item, such as the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo, and then sends this information to the server, which then stores the received information in a database.

[1288] Information Matching

[1289] The server retrieves information about lost and found items from the database and analyzes it using a generative artificial intelligence model, which compares item type, characteristics, location, date, and image data to find matching items.

[1290] Notification of matching results

[1291] If the match is successful, the server sends a notification to the finder and the loser. The notification is sent via the system's communication means (such as a chat function). The finder and the loser can use the provided communication means to discuss how to hand over the item and any necessary confirmations.

[1292] Collection of performance-based rewards

[1293] If the match is successful and the item is confirmed to have been returned to its owner, the server will charge the user a reward. The system collects a predetermined flat fee based on the user's payment information.

[1294] Examples of concrete examples and prompts

[1295] Specific examples

[1296] The finder registers the information as lost property at the station: "iPhone 12, black, scratches on the back, found on October 12, 2023."

[1297] The loser registers a lost item report stating, "I lost my black iPhone 12 at a station on October 12th. There is a scratch on the back."

[1298] A generative AI model analyzes this data and makes matches.

[1299] Example prompt

[1300] Found: iPhone 12, black, with scratches on the back, found on October 12, 2023.

[1301] Lost item: Lost a black iPhone 12 at a station on October 12th. There is a scratch on the back.

[1302] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1303] Step 1:

[1304] The user (the finder) uses a smartphone to input detailed information about the found item. Specifically, the type of item, its characteristics, the location where it was found, the date it was found, and a photo are entered, and then sent to the server. The input data is sent to the server in JSON format. The server verifies the received information and saves it in a database. Here, the input is the detailed information about the found item, and the output is saving it to the database.

[1305] Step 2:

[1306] The user (the person who lost the item) uses their smartphone to input detailed information about the lost item, including the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo, and then sends this information to the server. The server then verifies the information it receives and stores it in a database. Again, the input is the detailed information about the lost item, and the output is storage in the database.

[1307] Step 3:

[1308] The server periodically retrieves information about lost and found items from the database. This information includes the item type, characteristics, location, date, and photo. The retrieved data is input into a generative artificial intelligence model. The input is the lost and found item information from the database, which is then analyzed by the generative artificial intelligence model.

[1309] Step 4:

[1310] The generative AI model analyzes the acquired information and compares the item type, characteristics, location, date, and image data. Specific data processing includes text data feature extraction, image data feature extraction, and geographic proximity assessment. The model identifies matching lost and found items. The output is a successful match.

[1311] Step 5:

[1312] If the match is successful, the server sends a notification to the finder and the loser. The notification is sent via a smartphone app. The user receives the notification and uses the system's in-system communication method (dedicated chat) to confirm details and discuss how to hand over the item. The input is information about the successful match, and the output is the notification and provision of communication methods.

[1313] Step 6:

[1314] If the match is successful and the item has been returned to its owner, the server will claim the reward from the user. Based on the user's payment information, the system collects a pre-determined fixed fee. The input is the confirmation of the item's return, and the output is the claim and collection of the reward.

[1315] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1316] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative AI model, and a means for providing user support and collecting rewards using an emotion engine. This system improves the user experience by recognizing the user's emotions and providing appropriate support during the management and return process of lost and found items.

[1317] System configuration and operation

[1318] Registering lost items

[1319] 1. Terminal: The finder enters the details of the lost item.

[1320] The finder launches a web form or mobile app and enters information such as the type of item, its characteristics, where it was found, the date it was found, and a photo.

[1321] Once the input is complete, the send button is pressed to send the information to the server.

[1322] 2. Server: Receives and verifies the found item information.

[1323] The server validates the format and content of the received data to ensure there is no missing or invalid data.

[1324] Once verification is complete, the found item information is stored in a database.

[1325] 3. Server: Confirms that the found item information has been saved and notifies the finder.

[1326] A message indicating successful registration is generated and sent back to the finder's terminal.

[1327] The finder will receive a notification that the lost item has been registered.

[1328] Registering a lost item report

[1329] 1. Terminal: The loser enters the details of the lost item.

[1330] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and a photo.

[1331] Once the input is complete, the send button is pressed to send the information to the server.

[1332] 2. Server: Receives and verifies the lost item information.

[1333] The server validates the format and content of the received data to ensure there is no missing or invalid data.

[1334] Once verification is complete, the lost item information is stored in a database.

[1335] 3. Server: Confirms that the lost item information has been saved and notifies the loser.

[1336] A message indicating successful registration is generated and sent back to the lost device.

[1337] The loser will receive a notification that their lost item has been registered.

[1338] matching

[1339] 1. Server: Retrieves lost and found data from the database.

[1340] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[1341] 2. Server: Matches lost and found items using a generative AI model.

[1342] The server inputs information about lost and found items into a generative artificial intelligence model, comparing the item's characteristics, where it was found, where it was lost, the date, image data, etc.

[1343] If the match is successful, the results are stored in an internal system.

[1344] Examples:

[1345] Suppose finder A finds a "red wallet" in a park, and loser B loses it near a station on the same day. A generative AI model analyzes this information, matches the wallet type, color, and the proximity of where it was found and lost, and sends a notification.

[1346] Notification and communication

[1347] 1. Server: Notifies the finder and the loser of a successful match.

[1348] A notification message is created based on the matching results and sent to the devices of the finder and the lost person.

[1349] The notification will also include a link to any contact methods within the system (such as chat functionality).

[1350] 2. User: The finder and the loser exchange information using the communication means within the system.

[1351] The finder and loser click on a link in the notification to access the chat function within the system.

[1352] Discuss the details and method of delivery of the items through communication channels.

[1353] Introducing the Emotion Engine

[1354] 1. Terminal: User registration and contact

[1355] To recognize a user's feelings when registering a lost or found item and provide user support as needed.

[1356] When registering an item, the system analyzes the user's emotional state and displays guide messages and support to reduce stress and anxiety.

[1357] 2. Server: When matching is successful

[1358] When a match is successful, the emotions of the finder and loser are analyzed to generate appropriate notification and support messages.

[1359] For example, if the finder is feeling anxious, add a message or explanation that will provide reassurance.

[1360] Performance-based billing

[1361] 1. Server: Handles the billing process for performance-based rewards.

[1362] After verifying that the match was successful and the item was returned to its owner, the server begins the process of collecting the appropriate reward.

[1363] Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, or 800 yen) will be charged.

[1364] 2. User: The loser pays the reward.

[1365] The loser confirms the claim from the system and pays a fixed fee.

[1366] You will receive a notification that your payment has been made and the process is complete.

[1367] This system streamlines the matching process between lost and found items, returning more items to their owners and contributing to environmental conservation. Furthermore, by using a generative AI model and emotion engine, the system improves the user experience and increases matching accuracy. This system benefits both the finder and the lost item, supporting reliable item return.

[1368] The processing flow will be explained below.

[1369] Step 1:

[1370] Terminal: The finder enters details of the lost item.

[1371] The finder opens a web form or mobile app and enters information such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[1372] Once you have completed the input, click the send button to send the information to the server.

[1373] Step 2:

[1374] Server: Receives and verifies the found item information.

[1375] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[1376] Once verification is complete, the found item information will be saved in the database.

[1377] Step 3:

[1378] Server: Confirms that the found item information has been saved and notifies the finder.

[1379] A message indicating successful registration is generated and sent back to the finder's device.

[1380] The finder will receive a notification that the lost item has been registered.

[1381] Step 4:

[1382] Terminal: The loser enters the details of the lost item.

[1383] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and photo.

[1384] Once you have completed the input, click the send button to send the information to the server.

[1385] Step 5:

[1386] Server: Receives and verifies the lost item information.

[1387] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[1388] Once verification is complete, we will store the lost item information in our database.

[1389] Step 6:

[1390] Server: Confirms that the lost item information has been saved and notifies the loser.

[1391] A message indicating successful registration is generated and sent back to the lost device.

[1392] The person who lost the item will receive a notification that their lost item has been registered.

[1393] Step 7:

[1394] Server: Retrieves lost and found data from the database.

[1395] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[1396] Step 8:

[1397] Server: Matches lost and found items using a generative AI model.

[1398] The server inputs information about lost and found items into a generative AI model, comparing the item's characteristics, where it was found, where it was lost, the date, and image data.

[1399] If the match is successful, the result is stored in an internal system.

[1400] Step 9:

[1401] Server: Notifies the finder and the lost person that the match was successful.

[1402] - Create a notification message based on the matching results and send it to the devices of the finder and the lost person.

[1403] The notification will also include a link to the system's contact methods (such as chat functionality).

[1404] Step 10:

[1405] User: The finder and the loser exchange information using the communication means within the system.

[1406] · The finder and loser can click on the link in the notification to access the chat function within the system.

[1407] · Discuss details and delivery methods of items through communication channels.

[1408] Step 11:

[1409] Terminal: Analyzes the emotional state of users who are in trouble.

[1410] As users interact, the emotion engine analyzes their emotional state (stress, anxiety, relief, joy, etc.).

[1411] · Providing supportive messages and advice when needed.

[1412] Step 12:

[1413] Server: Generates appropriate notification content based on the emotional state.

[1414] -When a match is successful, the system recognizes the emotions of the finder and loser and generates appropriate notification and support messages.

[1415] For example, if the finder is feeling anxious, add a message to provide reassurance.

[1416] Step 13:

[1417] Server: Handles the billing process for performance-based rewards.

[1418] After confirming that the match was successful and the item was returned to its owner, the server will begin the process of collecting the appropriate reward.

[1419] - Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, 800 yen) will be charged.

[1420] Step 14:

[1421] User: The loser pays the reward.

[1422] The loser will check the claim from the system and pay a fixed fee.

[1423] You will receive a notification that your payment has been made and the process is complete.

[1424] Example 2

[1425] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1426] The management of lost and found items requires a lot of time and effort. Current systems have difficulty effectively linking information on the finders and losers, and lack support to alleviate users' anxiety and stress. Furthermore, the success rate of matching is low, and items are often not returned smoothly. Therefore, there is a need for efficient matching of found and lost items and an improved user experience.

[1427] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1428] In this invention, the server includes: [means for registering detailed information on found items;] [means for registering detailed information on lost items;] [means for matching information on found items and lost items using a generative artificial intelligence model;] [means for notifying the finder and the loser if the match is successful;] [means for verifying information on found items and lost items and checking for missing or incorrect data; and [means for using an emotion engine that recognizes the user's emotions and provides support messages as needed.] This makes it possible [to efficiently match found items with lost items and provide appropriate support according to the user's emotional state, thereby improving the user experience and enabling smooth return of items].

[1429] "Detailed information about a lost item" refers to specific information about the item found by the finder, such as the type, characteristics, location, date of finding, and photographs.

[1430] "Detailed information about lost items" refers to specific information about the item lost by the loser, such as the type, characteristics, location, date of loss, and photographs.

[1431] A "generative artificial intelligence model" is an artificial intelligence system that analyzes the characteristics and information of found and lost items and performs matching.

[1432] "Means for notifying" refers to the means for notifying the finder and the loser of the result when matching is successful. Specifically, it refers to the system that generates and sends messages.

[1433] "Means for verifying" means the means by which lost and found information is received to verify that the information is accurate and that there are no omissions or irregularities.

[1434] An "emotion engine" is a system that recognizes the user's emotional state and generates appropriate support messages based on that information.

[1435] "Means for collecting a reward" refers to a means for collecting a set fee from a user when matching is successful and the item is returned.

[1436] The present invention relates to a system for managing information on lost and found items and efficiently matching them. Users register items, a generative AI model is used to perform matching, and an emotion engine is used to support users and collect rewards.

[1437] Registering lost items

[1438] 1. Terminal

[1439] The finder enters detailed information about the found item. The finder launches a web form or mobile app on their device (smartphone or PC) and enters details about the found item (item type, characteristics, location found, date found, photo). For example, if they found a red wallet in a park, they would enter "Type: Wallet," "Characteristics: Red, with side zipper," "Location found: Park," "Date found: October 10, 2023," and "Photo: Photograph taken." Once they have completed entering the information, they press the send button to send the data to the server.

[1440] 2. Server

[1441] The server collects data on lost items received from the device. The web server receives an HTTP request and receives detailed information on the lost item in JSON format. It then validates the format and content of the received data. Specifically, it checks whether all required fields have been filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the device. Once validation is complete, it saves the lost item information in the database.

[1442] 3. Notification

[1443] The server notifies the finder that the data has been successfully saved, including specific information such as "Type: wallet, Characteristics: red, with side zipper, found in a park on October 10, 2023."

[1444] Registering a lost item report

[1445] 1. Terminal

[1446] The loser enters detailed information about the lost item. The loser launches a web form or mobile app on their device (smartphone or PC) and enters details about the lost item (item type, characteristics, location lost, date lost, photo). For example, if they lost a red wallet near a station, they would enter "Type: Wallet," "Characteristics: Red, with side zipper," "Location lost: Near the station," "Date lost: October 10, 2023," and "Photo: Photo taken previously." Once they have completed entering the information, they press the send button to send the data to the server.

[1447] 2. Server

[1448] The server collects the lost item data received from the device. The web server receives the HTTP request and receives the lost item details in JSON format. It then validates the format and content of the received data. Specifically, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and sends it back to the device. Once validation is complete, it saves the lost item information in the database.

[1449] 3. Notification

[1450] The server notifies the loser that the data has been successfully saved, including specific information such as "Type: wallet, Characteristics: red, with a side zipper, lost near a station on October 10, 2023."

[1451] matching

[1452] 1. Server

[1453] The server periodically or upon request extracts newly registered lost and found items from the database. Specifically, it executes an SQL query to retrieve recently added data. The retrieved information on lost and found items is then input into a generative AI model. Matching is performed by comparing items such as the item's characteristics, where it was found, where it was lost, the date, and image data. For example, the following information could be input: "Red wallet, with a side zipper, where it was found in a park, where it was lost near a station, and the date it was found on October 10, 2023."

[1454] 2. Server

[1455] If the match is successful, the results are saved in the internal system. For example, "Finder A's red wallet with a side zipper matches the wallet of loser B." This is saved in the database.

[1456] Notification and communication

[1457] 1. Server

[1458] The server notifies the finder and the lost person that the match was successful. Specifically, it generates a notification message based on the matching result and sends it to the finder and the lost person's devices. It provides a message saying "Your red wallet has been found" and a link to the system's contact method (such as a chat function).

[1459] 2. Users

[1460] The finder and the loser click on the link in the notification to access the chat function within the system. Specifically, they use the chat screen to discuss details such as how to hand over the item. They make specific arrangements, such as "Let's meet at XX Station on October 15th at 2:00 PM."

[1461] Introducing the Emotion Engine

[1462] 1. Terminal

[1463] When registering lost or found items, the system recognizes the user's emotions. It uses the device's camera and voice data to analyze the user's emotional state (anxiety, stress, joy, etc.). For example, it uses facial recognition technology to determine whether the user is smiling or looking serious.

[1464] 2. Server

[1465] Based on the information obtained from the emotion engine, appropriate notification content and support messages are generated. For example, if the finder is feeling anxious, a message such as "Don't worry, your information is being kept safe" will be generated.

[1466] Performance-based billing

[1467] 1. Server

[1468] After confirming that the matching was successful and the item was returned, the process of collecting the appropriate reward will begin. Specifically, a scenario will be started in which payment is processed using credit card information.

[1469] 2. Users

[1470] The lost person checks the request from the system and pays the fixed fee. For example, they pay the appropriate fee of 300 yen, 500 yen, or 800 yen with their credit card. They receive a notification that the payment has been completed, and the process is complete. A message such as "Your payment has been completed. Thank you for letting us know" is displayed.

[1471] Example prompts for generative AI models

[1472] "I found a red wallet in the park. Date found: October 10, 2023. Features: It has a zipper on the side. Please use this information to find someone who lost a red wallet on the same day."

[1473] This enables efficient matching of found and lost items, and also provides appropriate support according to the user's emotional state, improving the user experience and enabling smooth return of items.

[1474] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1475] Step 1:

[1476] Enter details of the lost item (device)

[1477] Input: The finder launches a web form or mobile app on their device (smartphone or PC) and enters details about the lost item (item type, characteristics, location, date of finding, and photo).

[1478] Specific operation: If the finder finds a red wallet in a park, they will enter the following: "Type: Wallet", "Characteristics: Red, with side zipper", "Place of Found: Park", "Date of Found: October 10, 2023", and "Photo: Photo taken".

[1479] Output: Once the input is complete, press the send button to send the data to the server.

[1480] Step 2:

[1481] Receiving and verifying data on lost items (server)

[1482] Input: Found item data received from the device.

[1483] Specific operation: The server receives an HTTP request and receives the details of the lost item in JSON format.

[1484] Data processing: The server validates the format and content of the data received. For example, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the terminal.

[1485] Output: Once the verification is complete, save the found item information to the database.

[1486] Step 3:

[1487] Notification of lost item registration completion (server)

[1488] Input: Information about lost items stored in the database.

[1489] Specific operation: The server verifies that the found item information has been saved successfully.

[1490] Data output: A notification message containing specific details such as "Type: wallet, Characteristics: red, with side zipper, found in park on October 10, 2023" is generated and sent to the finder's device.

[1491] Step 4:

[1492] Enter the details of the lost item (on your device)

[1493] Input: The lost person launches a web form or mobile app on their device (smartphone or PC) and enters details of the lost item (item type, characteristics, location lost, date lost, photo).

[1494] Specific operation: If the loser loses a red wallet near a station, they will enter the following: "Type: Wallet", "Characteristics: Red, with a side zipper", "Location of loss: Near the station", "Date of loss: October 10, 2023", and "Photo: Previously taken photo".

[1495] Output: Once the input is complete, press the send button to send the data to the server.

[1496] Step 5:

[1497] Receiving and verifying lost item data (server)

[1498] Input: Lost item data received from the device.

[1499] Specific operation: The server receives an HTTP request and receives the details of the lost item in JSON format.

[1500] Data processing: The server validates the format and content of the data received. For example, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the terminal.

[1501] Output: Save the lost item information in the database once verification is complete.

[1502] Step 6:

[1503] Lost item registration completion notification (server)

[1504] Input: Lost item information stored in the database.

[1505] Specific operation: The server verifies that the lost item information has been saved successfully.

[1506] Data output: A notification message containing specific details such as "Type: wallet, characteristics: red, with side zipper, lost near a station on October 10, 2023" is generated and sent to the device of the loser.

[1507] Step 7:

[1508] Data extraction (server)

[1509] Input: Lost and found data from the database.

[1510] What happens: The server runs an SQL query to extract recently added data.

[1511] Output: Retrieved lost and found information.

[1512] Step 8:

[1513] AI matching (server)

[1514] Input: Extracted lost and found information.

[1515] Specific operation: Input the item's characteristics, where it was found, where it was lost, date, image data, etc. into the generative artificial intelligence model and attempt to match it.

[1516] Data calculation: The AI ​​model analyzes the input information and performs feature extraction and comparative matching.

[1517] Output: Successfully matched data is stored in an internal system.

[1518] Step 9:

[1519] Notification of matching results (server)

[1520] Input: A successful match result.

[1521] Specific operation: The server generates a notification message based on the matching result and sends it to the finder and the lost person's devices, for example, a message saying "Your red wallet has been found."

[1522] Output: Notification messages are sent to the finder and the loser.

[1523] Step 10:

[1524] Information exchange and coordination (users)

[1525] Input: The link to be included in the notification message.

[1526] Specific operation: The finder and the loser click on the link in the notification to access the chat function within the system, where they can discuss details and how to hand over the item.

[1527] Output: As a result of the discussion, a specific date, time and location for delivery will be decided.

[1528] Step 11:

[1529] Emotion Recognition and Analysis (Device)

[1530] Input: User's video and audio data.

[1531] Specific operation: Recognizes the user's emotional state (anxiety, stress, joy, etc.) using the device's camera and microphone. For example, it uses facial recognition technology to determine whether the user is smiling or looking serious.

[1532] Output: Emotion recognition data.

[1533] Step 12:

[1534] Emotion response message generation (server)

[1535] Input: Emotion recognition data.

[1536] Specific operation: The server generates appropriate notification and support messages based on the information obtained by the emotion engine. For example, if the finder feels anxious, the server will generate a message such as "Don't worry, your information is kept safe."

[1537] Output: An emotional response message is sent to the device.

[1538] Step 13:

[1539] Performance-based reward billing procedure (server)

[1540] Input: Successful match and item return information.

[1541] Specific operation: The server starts the process of charging the appropriate reward (e.g., 300 yen, 500 yen, 800 yen) to the user. Payment is made based on the credit card information.

[1542] Output: A successful charge message is sent to the user.

[1543] Step 14:

[1544] Payment of performance rewards (user)

[1545] Input: Billing message.

[1546] Specific operation: The person who lost the item checks the bill from the system and pays the fixed fee by credit card, for example, 300 yen, 500 yen, or 800 yen.

[1547] Output: A notification of successful payment is sent to the user and the process is complete.

[1548] (Application example 2)

[1549] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1550] Lost and found items frequently occur in physical stores, making their management cumbersome and time-consuming for staff and customers. In particular, if lost or found items are not promptly returned to their owners, customer satisfaction declines and in-store confusion occurs. Furthermore, matching between lost and found items is often done manually, resulting in low efficiency and a high risk of errors. Furthermore, it is difficult to appropriately consider the user's emotional state when communicating and responding to the match, which can increase stress and anxiety.

[1551] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1552] In this invention, the server includes a means for registering detailed information on found items, a means for registering detailed information on lost items, a means for matching information on found items and lost items using a generative artificial intelligence model, a means including an emotion engine that analyzes user emotions and provides appropriate support messages, and a means for registering, notifying, and contacting users about found and lost items using a smartphone or tablet device. This enables efficient management and rapid return of found and lost items in physical stores, thereby improving customer satisfaction and reducing the burden on staff.

[1553] The "means for registering detailed information about found items" is an interface that allows the user to input the type, characteristics, location, date of finding, photograph, etc. of the found item and send them to the server.

[1554] The "means for registering detailed information about a lost item" is an interface that allows a user to input the type, characteristics, location, date of loss, photograph, etc. of the lost item and send them to the server.

[1555] "Means for matching information on found and lost items using generative artificial intelligence models" refers to a system that analyzes data on found and lost items and compares characteristics, locations, dates, etc. to identify items that are likely to match.

[1556] The "means for notifying the finder and the lost person when a match is successful" refers to a means for informing the users of the matching results, which is usually done via a notification message or email.

[1557] "Means including an emotion engine that analyzes the user's emotions and provides appropriate support messages" refers to a system that analyzes the user's emotional state at the time of registration or matching, and presents messages to reduce stress and anxiety.

[1558] The "means for collecting rewards based on matching" is a system for claiming and collecting appropriate rewards after a lost item is returned to the loser.

[1559] "Means for registering, notifying, and contacting lost and found items using a smartphone or tablet device" refers to an interface for using a mobile device to input and send information about lost and found items, and to make notifications and contact.

[1560] System configuration

[1561] In order to implement the present invention, the following hardware and software are used.

[1562] Hardware

[1563] 1. Smartphone or tablet:

[1564] Used as a user interface for registering, notifying, and contacting lost and found items. Customers and store staff use it to enter information and receive notifications.

[1565] 2. Server:

[1566] It collects information on lost and found items, analyzes and processes the data using a generative AI model and emotion engine, and notifies users when a match is successful and collects rewards.

[1567] software

[1568] 1. Generative AI models (e.g., TensorFlow):

[1569] It analyzes the characteristics, location, date and image data of lost and found items to make appropriate matches, which is performed on the server.

[1570] 2. Emotion Engine:

[1571] It analyzes the user's emotional state and generates appropriate support messages, which are also performed on the server.

[1572] How it works

[1573] Registering lost items

[1574] The user enters details of the lost item using a smartphone or tablet device, and the entered data is sent to a server, which verifies the format and content and then stores it in a database.

[1575] Registering lost property

[1576] The user enters the details of the lost item using a smartphone or tablet device, and the entered data is sent to a server, which verifies the format and content and then stores it in a database.

[1577] matching

[1578] The server periodically retrieves information about lost and found items from the database and uses a generative AI model to match them, comparing item characteristics, location, dates, image data, and more to identify likely matches.

[1579] Notification and communication

[1580] If the match is successful, the server sends a notification to the finder and the loser. The notification includes a link to the system's communication tools (such as a chat function). The finder and the loser can use the system's communication tools to exchange information and discuss how to hand over the item.

[1581] Introducing the Emotion Engine

[1582] The server analyzes the user's emotions when registering lost or found items or when a match is successful, and generates appropriate support messages, thereby reducing the user's stress and anxiety.

[1583] Prompt Sentence Examples

[1584] 1. Please register your lost item. Please enter the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[1585] 2. Register the details of your lost item. Please enter the type of item, its characteristics, location, date of loss, and a photo.

[1586] 3. "Match successful. Please review the details of the found item."

[1587] Specific examples

[1588] For example, if a customer finds a wallet in a store, they can register it using the app by entering a photo and other characteristics and then pressing the send button, which transfers the data to a server. Similarly, if another customer registers a lost wallet, the generative AI model analyzes the information from both parties, and if there is a match, a notification is sent to both parties. At this time, the emotion engine also works, displaying messages to reduce stress and anxiety for the finder and the loser.

[1589] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1590] Step 1:

[1591] Registering lost items

[1592] The user inputs and submits details of the lost item using a smartphone or tablet device. The input information includes the type of item, its characteristics, the location where it was found, the date it was found, and a photo. This information is then sent from the device to a server. The server verifies the format and content of the received data and checks for missing or invalid data. Once verification is complete, the server stores the information in a database and notifies the user that the registration is complete.

[1593] Input: Type of item, characteristics, location of item, date of item, photo

[1594] Output: Information on lost items stored in the database, notification of registration completion

[1595] Step 2:

[1596] Registering lost property

[1597] The user inputs and submits details of the lost item using a smartphone or tablet device. The input information includes the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo. This information is then sent from the device to a server. The server verifies the format and content of the received data and checks for missing or invalid data. Once verification is complete, the server stores the information in a database and notifies the user that registration is complete.

[1598] Input: Type of item, characteristics, location of loss, date of loss, photo

[1599] Output: Information about lost items stored in the database, notification of registration completion

[1600] Step 3:

[1601] Matching process

[1602] The server periodically retrieves information about lost and found items from the database. Using a generative AI model, it analyzes the item type, characteristics, location, date, and image data to match found and lost items. It identifies candidates with high potential matches based on characteristics and proximity of location information.

[1603] Input: Lost and found information stored in the database

[1604] Output: Matching results

[1605] Step 4:

[1606] Notification and communication

[1607] If a match is successful, the server sends a notification to the finder and the loser, including a link to access the system's communication channels (such as a chat function), allowing the finder and the loser to communicate and discuss details of the item and how to return it.

[1608] Input: Matching results

[1609] Output: Notice to finder and loser, contact links

[1610] Step 5:

[1611] Supported by an emotional engine

[1612] The server analyzes the user's emotions when registering a lost or found item or when a match is successful, and generates a message to reduce the user's stress and anxiety using an emotion engine and includes it in the notification.

[1613] Input: User behavior data (at the time of registration, notification)

[1614] Output: Support message based on emotional state

[1615] Step 6:

[1616] Collection of performance-based rewards

[1617] After the lost item is successfully returned to the owner, the server collects the reward by processing the payment information based on a predetermined fixed fee (e.g., 300 yen, 500 yen, or 800 yen). Once completed, a notification is sent to the loser.

[1618] Input: Confirmation data of lost property return, payment information of the lost property owner

[1619] Output: Invoicing and collecting commissions, notification of completion

[1620] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1621] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1622] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1623] [Fourth embodiment]

[1624] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1625] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1626] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1627] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1628] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1629] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1630] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1631] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1632] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1633] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1634] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1635] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1636] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1637] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative artificial intelligence model, and a means for collecting performance-based rewards.

[1638] System configuration and operation:

[1639] Registering lost items

[1640] Device: The finder uses a web form or mobile app to enter details about the lost item (item type, characteristics, location, date found, photos, etc.) and sends the information to the server.

[1641] Server: The server verifies the received information, stores it in the database, and notifies the finder that the information has been registered.

[1642] Registering a lost item report

[1643] Device: The lost person uses a web form or mobile app to enter details of the lost item (item type, characteristics, location, date of loss, photo, etc.) and sends the information to the server.

[1644] Server: The server verifies the received information, stores it in the database, and notifies the lost person that the information has been registered.

[1645] matching

[1646] Server: The server retrieves lost and found items from the database and analyzes them using a generative artificial intelligence model to compare item types, characteristics, locations, dates, and image data to find matching items.

[1647] Example: Finder A finds a "red wallet" in a park, and loser B loses it near a train station on the same day. A generative AI model analyzes this information, matches the wallet type, color, where it was found, and the proximity of where it was lost, and sends a notification.

[1648] Notification and communication

[1649] Server: If the match is successful, the server sends an in-system notification to the finder and the loser, and provides a dedicated means of communication (such as a chat function) so that the finder and the loser can directly communicate and confirm details.

[1650] Users: The finder and the loser can use the system's communication tools to discuss how to hand over the item and what to check.

[1651] Performance-based billing

[1652] Server: If the match is successful and the item has been returned to its owner, the system processes the user to claim the reward. The system collects a predetermined flat fee (either 300 yen, 500 yen, or 800 yen) based on the user's payment information.

[1653] User: When an item is safely returned, the loser pays a fixed fee to the system and receives a notification of completion.

[1654] This system streamlines the matching process between lost and found items, returning more items to their owners and contributing to environmental conservation. Furthermore, by using a generative AI model, matching accuracy is improved and communication between users is facilitated. This system benefits both the finder and the lost item, supporting reliable item return.

[1655] The processing flow will be explained below.

[1656] Step 1:

[1657] Terminal: The finder enters details of the lost item.

[1658] The finder opens a web form or mobile app and enters information such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[1659] Once you have completed the input, click the send button to send the information to the server.

[1660] Step 2:

[1661] Server: Receives and verifies the found item information.

[1662] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[1663] Once verification is complete, the found item information will be saved in the database.

[1664] Step 3:

[1665] Server: Confirms that the found item information has been saved and notifies the finder.

[1666] A message indicating successful registration is generated and sent back to the finder's device.

[1667] The finder will receive a notification that the lost item has been registered.

[1668] Step 4:

[1669] Terminal: The loser enters the details of the lost item.

[1670] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and photo.

[1671] Once you have completed the input, click the send button to send the information to the server.

[1672] Step 5:

[1673] Server: Receives and verifies the lost item information.

[1674] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[1675] Once verification is complete, we will store the lost item information in our database.

[1676] Step 6:

[1677] Server: Confirms that the lost item information has been saved and notifies the loser.

[1678] A message indicating successful registration is generated and sent back to the lost device.

[1679] The person who lost the item will receive a notification that their lost item has been registered.

[1680] Step 7:

[1681] Server: Retrieves lost and found data from the database.

[1682] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[1683] Step 8:

[1684] Server: Matches lost and found items using a generative AI model.

[1685] The server inputs information about lost and found items into a generative AI model, comparing the item's characteristics, where it was found, where it was lost, the date, and image data.

[1686] If the match is successful, the result is stored in an internal system.

[1687] Step 9:

[1688] Server: Notifies the finder and the lost person that the match was successful.

[1689] - Create a notification message based on the matching results and send it to the devices of the finder and the lost person.

[1690] The notification will also include a link to the system's contact methods (such as chat functionality).

[1691] Step 10:

[1692] User: The finder and the loser exchange information using the communication means within the system.

[1693] · The finder and loser can click on the link in the notification to access the chat function within the system.

[1694] · Discuss details and delivery methods of items through communication channels.

[1695] Step 11:

[1696] Server: Handles the billing process for performance-based rewards.

[1697] After confirming that the match was successful and the item was returned to its owner, the server will begin the process of collecting the appropriate reward.

[1698] - Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, 800 yen) will be charged.

[1699] Step 12:

[1700] User: The loser pays the reward.

[1701] The loser will check the claim from the system and pay a fixed fee.

[1702] You will receive a notification that your payment has been made and the process is complete.

[1703] Example 1

[1704] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1705] There is a need for a system that can efficiently and accurately match found and lost items. However, conventional methods involve a series of complicated and inefficient processes, including information registration, matching, notification, contact, and billing. In addition, matching accuracy is low, and there is no guarantee that lost items will be returned to their owners safely. This has resulted in low trust among users and low user satisfaction.

[1706] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1707] In this invention, the server includes: [means for registering detailed information on found items]; [means for registering detailed information on lost items]; [means for matching information on found items and lost items using a generative artificial intelligence model]; [means for sending an in-system notification to the finder and the loser if the match is successful]; [means for collecting a performance-based reward based on the match]; [means for providing a function that allows the finder and the loser to communicate directly using communication means within the system]; [means for verifying information and filtering spam]; and [means for collecting a flat fee based on payment information if the return of the item is confirmed.] This allows for efficient and accurate matching of information on found items and lost items, smooth communication between users, and reliable return of items through performance-based reward charging.

[1708] "Means for registering detailed information about found items" refers to a means that provides a function for a user to input detailed information about a found item (item type, characteristics, location where found, date found, photograph, etc.), send it to a server, and register it in a database.

[1709] "Means for registering detailed information about lost items" refers to a means that provides a function for a user to input detailed information about a lost item (item type, characteristics, location lost, date lost, photo, etc.), send it to a server, and register it in a database.

[1710] "Means for matching information on found and lost items using a generative artificial intelligence model" refers to a means for a server to analyze information on found and lost items obtained from a database, and use a generative artificial intelligence model to compare the type, characteristics, location, date, image data, etc. of the items to detect matching items.

[1711] "Means for sending an in-system notification to the finder and the loser upon successful matching" means means for sending a notification through the system to the finder and the loser when a suitable match is detected, informing them of the match and providing a means of contact.

[1712] "Means for collecting rewards based on matching" refers to means for providing procedures and functions for collecting a predetermined flat fee from a user when matching is successful and it is confirmed that the item has been safely returned to its owner.

[1713] "Means for providing a function that allows the finder and the loser to communicate directly using communication means within the system" means means for providing a function that allows the owners of found and lost items to discuss details about the delivery of the items through communication means such as a chat function within the system.

[1714] "Information verification and spam filtering means" means means that provides verification and filtering functions to check the accuracy of the format and content of entered information and to eliminate fraudulent or spam information.

[1715] "Means for collecting a fixed fee based on payment information when the return of the item is confirmed" refers to a means for collecting a set fee based on the user's pre-registered payment information when the system confirms that the lost item has been returned to its original owner.

[1716] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative artificial intelligence model, and a means for collecting performance-based rewards.

[1717] System configuration and operation:

[1718] Hardware and software configuration:

[1719] This system uses the following hardware and software:

[1720] Devices: Mobile devices (iOS, Android), personal computers

[1721] Server: Cloud-based server (e.g. AWS, Azure)

[1722] Generative AI models: Generative AI models such as GPT-4

[1723] Database: MySQL, PostgreSQL

[1724] Detailed processing description:

[1725] Registering lost items

[1726] 1. User: The finder launches a web form or mobile application and logs in.

[1727] 2. Terminal: The terminal verifies the login information and authenticates the user.

[1728] 3. User: The finder enters detailed information about the found item (item type, characteristics, location, date of finding, photo, etc.).

[1729] 4. Terminal: The terminal sends the entered information to the server.

[1730] 5. Server: The server validates the information it receives, performing format checks and spam filtering as needed.

[1731] 6. Server: Checks that the information is accurate and stores it in a database.

[1732] 7. Server: Notifies the finder that the information has been registered.

[1733] Registering a lost item report

[1734] 1. User: The loser launches a web form or mobile application and logs in.

[1735] 2. Terminal: The terminal verifies the login information and authenticates the user.

[1736] 3. User: The person who lost the item enters detailed information about the lost item (item type, characteristics, location lost, date lost, photo, etc.).

[1737] 4. Terminal: The terminal sends the entered information to the server.

[1738] 5. Server: The server validates the information it receives, performing format checks and spam filtering as needed.

[1739] 6. Server: Checks that the information is accurate and stores it in a database.

[1740] 7. Server: Notifies the lost person that the information has been registered.

[1741] matching

[1742] 1. Server: Periodically retrieves lost and found information from the database.

[1743] 2. Server: Analyzes the acquired information using a generative artificial intelligence model (such as GPT-4).

[1744] 3. Server: Detects matching items based on item type, characteristics, location, date, and image data.

[1745] 4. Server: The matching results are logged internally.

[1746] Example: If finder A finds a "red wallet" in a park and loser B loses it near a train station on the same day, the AI ​​model analyzes this information and makes a match based on the type of wallet, color, and proximity of where it was found and lost.

[1747] Notification and communication

[1748] 1. Server: If a match is successful, it sends an in-system notification to the finder and the loser.

[1749] 2. Server: Open the chat function within the system for finders and losers to communicate with each other.

[1750] 3. User: The finder and the loser use the chat function to discuss how to hand over the item and what to check.

[1751] Performance-based billing

[1752] 1. Server: Once the match is successful and the item has been returned to its original owner, the server begins the process of claiming the reward.

[1753] 2. Server: Collects a predetermined flat fee (either 300 yen, 500 yen, or 800 yen) based on the user's payment information.

[1754] 3. User: Once the lost item is safely returned, the user receives a claim from the system and completes the payment.

[1755] 4. Server: Notifies the customer that the payment has been made and closes the transaction.

[1756] Examples of prompts:

[1757] "I found a red wallet in the park. It was found at XX Park on XX / XX. It is made of leather, is medium in size, and has the manufacturer's name written on the inside. Please check to see if it matches the lost item information."

[1758] "I lost a red wallet near the station. It was lost at XX Station on XX / XX / XX. It is made of leather, is medium in size, and has the manufacturer's name written on the inside. Please check to see if it matches the lost property information."

[1759] In this way, the system of the present invention utilizes diverse hardware and advanced generative AI models to streamline the matching process between lost and found items, providing users with a reliable service.

[1760] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1761] Step 1:

[1762] Enter and submit details of your lost item

[1763] User: The finder launches a web form or mobile app and logs in.

[1764] Terminal: The terminal verifies the login information and authenticates the user.

[1765] User: The finder enters detailed information about the found item (item type, characteristics, location, date of finding, photos, etc.). The entered data is then imported into the terminal in the form of text or images.

[1766] Terminal: The terminal sends the entered information to the server. The data sent includes details of the lost item.

[1767] Step 2:

[1768] Found item information verification and registration

[1769] Server: The server validates the information it receives, performing format checks and spam filtering as needed. Format checks verify required fields and that data has been entered correctly. Spam filtering filters out invalid entries.

[1770] Server: Checks that the information is accurate and stores it in a database, including details of the found item.

[1771] Server: Notifies the finder that the information has been registered. The notification includes a message indicating that registration was successful.

[1772] Step 3:

[1773] Enter and submit your lost item report details

[1774] User: The loser launches a web form or mobile app and logs in.

[1775] Terminal: The terminal verifies the login information and authenticates the user.

[1776] User: The person who lost the item enters detailed information about the lost item (item type, characteristics, location, date of loss, photo, etc.). The entered data is imported into the device as text or images.

[1777] Device: The device sends the entered information to the server. The data sent includes details of the lost item.

[1778] Step 4:

[1779] Lost property verification and registration

[1780] Server: The server validates the information it receives, performing format checks and spam filtering as needed. Format checks verify required fields and that data has been entered correctly. Spam filtering filters out invalid entries.

[1781] Server: Checks that the information is accurate and stores it in a database, which contains details of the lost item.

[1782] Server: Notifies the lost person that the registration of the information has been completed. The notification includes a message indicating that the registration was successful.

[1783] Step 5:

[1784] Data matching of lost and found items

[1785] Server: The server periodically retrieves information about lost and found items from the database, including the type of item, its characteristics, the location where it was found, and the date it was found.

[1786] Server: Analyzes the acquired information using a generative AI model. Specifically, it compares information such as the type of item, characteristics, location, date, and image data to find matching items. The AI ​​model analyzes the data to find similarities and matches.

[1787] Server: Internally logs the match results, including which lost and found items were matched.

[1788] For example, if finder A finds a red wallet in a park and loser B loses it near a train station on the same day, the AI ​​model analyzes this information and matches the wallets based on their type, color, and the proximity of where they were found and lost.

[1789] Step 6:

[1790] Notification and contact method when matching is successful

[1791] Server: If a match is successful, send an in-system notification to the finder and the loser. The notification contains information about the successful match and next steps.

[1792] Server: Opens the chat function within the system for finders and losers to communicate with each other. The chat function includes the ability to send and receive messages.

[1793] Users: The finder and the loser use the chat function to discuss how to hand over the item and what to check. Users exchange necessary information through chat within the system.

[1794] Step 7:

[1795] Performance-based billing processing

[1796] Server: Once the matching is successful and it is confirmed that the item has been returned to its original owner, the server will begin the process of claiming the reward. If the return is confirmed, the server will automatically process the claim.

[1797] Server: A predetermined flat fee (either 300 yen, 500 yen, or 800 yen) is collected based on the user's payment information, using credit card information or other payment methods.

[1798] User: When the lost item is safely returned, the user receives a claim from the system and completes the payment. The user then follows the notification to complete the payment procedure.

[1799] Server: Notifies the user that the payment has been completed and completes the transaction. The completion notification includes a message that the transaction was successful.

[1800] This allows the system to efficiently and accurately match information on found and lost items, facilitate communication between users, and enable reliable item returns through performance-based billing.

[1801] (Application example 1)

[1802] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1803] The management of found and lost items in public places is often inefficient, resulting in long wait times for items to be returned to their owners. Furthermore, information on the type and characteristics of items, as well as the locations where they were found or lost, is fragmented, making it difficult to effectively match them. Furthermore, there is a need for a means to register information on found and lost items, as well as an efficient system for analyzing and matching them.

[1804] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1805] In this invention, the server includes means for registering detailed information on found items, means for registering detailed information on lost items, and means for matching information on found and lost items using a generative artificial intelligence model. This makes it possible to efficiently manage lost and found items in public places and to perform more accurate matching by analyzing the type, characteristics, location, date, and image data of the item.

[1806] "Detailed information about lost items" refers to information such as the type of item, its characteristics, the location where it was found, the date it was found, and photographs.

[1807] "Detailed information about the lost item" refers to information such as the type of item, its characteristics, the location where it was lost, the date it was lost, and photographs.

[1808] A "generative artificial intelligence model" refers to an artificial intelligence algorithm that analyzes input data and finds correlations.

[1809] "Means for notifying the finder and the loser if a match is successful" refers to a method for notifying both parties of the discovery and match using the notification function within the system.

[1810] "Means for collecting performance-based rewards" refers to a method of charging system users a fixed fee when an item is returned to its owner.

[1811] "A smartphone-based security service that provides management of lost and found items in public places" refers to a service that uses smartphones to manage and match lost and found items in public areas such as train stations and commercial facilities.

[1812] "Feature-analyzing generative artificial intelligence model" refers to an artificial intelligence algorithm that analyzes item type, characteristics, location, date, and image data to find matches to lost and found items.

[1813] "Dedicated chat function" refers to a means of communication within the system that allows the finder and the loser to directly contact each other and discuss how to return the item.

[1814] System Overview

[1815] This invention provides a system for managing information on lost and found items and efficiently matching them. This system has a series of functions for registering detailed information on found and lost items, matching them using a generative artificial intelligence model, and notifying the user of the results. Specifically, this is a smartphone-based security service that provides management of lost and found items in public places.

[1816] Required Hardware and Software

[1817] Hardware: Smartphones, servers

[1818] Software: databases (e.g., SQLite), artificial intelligence models (e.g., OpenAI API), web frameworks (e.g., Flask)

[1819] Registering details of lost items

[1820] The user, or finder, uses their smartphone to input detailed information about the found item, such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo, and then sends this information to the server. The server then stores the received information in a database.

[1821] Registering details of lost items

[1822] The user, the person who lost the item, uses their smartphone to input detailed information about the lost item, such as the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo, and then sends this information to the server, which then stores the received information in a database.

[1823] Information Matching

[1824] The server retrieves information about lost and found items from the database and analyzes it using a generative artificial intelligence model, which compares item type, characteristics, location, date, and image data to find matching items.

[1825] Notification of matching results

[1826] If the match is successful, the server sends a notification to the finder and the loser. The notification is sent via the system's communication means (such as a chat function). The finder and the loser can use the provided communication means to discuss how to hand over the item and any necessary confirmations.

[1827] Collection of performance-based rewards

[1828] If the match is successful and the item is confirmed to have been returned to its owner, the server will charge the user a reward. The system collects a predetermined flat fee based on the user's payment information.

[1829] Examples of concrete examples and prompts

[1830] Specific examples

[1831] The finder registers the information as lost property at the station: "iPhone 12, black, scratches on the back, found on October 12, 2023."

[1832] The loser registers a lost item report stating, "I lost my black iPhone 12 at a station on October 12th. There is a scratch on the back."

[1833] A generative AI model analyzes this data and makes matches.

[1834] Example prompt

[1835] Found: iPhone 12, black, with scratches on the back, found on October 12, 2023.

[1836] Lost item: Lost a black iPhone 12 at a station on October 12th. There is a scratch on the back.

[1837] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1838] Step 1:

[1839] The user (the finder) uses a smartphone to input detailed information about the found item. Specifically, the type of item, its characteristics, the location where it was found, the date it was found, and a photo are entered, and then sent to the server. The input data is sent to the server in JSON format. The server verifies the received information and saves it in a database. Here, the input is the detailed information about the found item, and the output is saving it to the database.

[1840] Step 2:

[1841] The user (the person who lost the item) uses their smartphone to input detailed information about the lost item, including the type of item, its characteristics, the location where it was lost, the date it was lost, and a photo, and then sends this information to the server. The server then verifies the information it receives and stores it in a database. Again, the input is the detailed information about the lost item, and the output is storage in the database.

[1842] Step 3:

[1843] The server periodically retrieves information about lost and found items from the database. This information includes the item type, characteristics, location, date, and photo. The retrieved data is input into a generative artificial intelligence model. The input is the lost and found item information from the database, which is then analyzed by the generative artificial intelligence model.

[1844] Step 4:

[1845] The generative AI model analyzes the acquired information and compares the item type, characteristics, location, date, and image data. Specific data processing includes text data feature extraction, image data feature extraction, and geographic proximity assessment. The model identifies matching lost and found items. The output is a successful match.

[1846] Step 5:

[1847] If the match is successful, the server sends a notification to the finder and the loser. The notification is sent via a smartphone app. The user receives the notification and uses the system's in-system communication method (dedicated chat) to confirm details and discuss how to hand over the item. The input is information about the successful match, and the output is the notification and provision of communication methods.

[1848] Step 6:

[1849] If the match is successful and the item has been returned to its owner, the server will claim the reward from the user. Based on the user's payment information, the system collects a pre-determined fixed fee. The input is the confirmation of the item's return, and the output is the claim and collection of the reward.

[1850] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1851] The present invention relates to a system for managing information on lost and found items and efficiently matching them, and includes a means for users to register items, a means for matching using a generative AI model, and a means for providing user support and collecting rewards using an emotion engine. This system improves the user experience by recognizing the user's emotions and providing appropriate support during the management and return process of lost and found items.

[1852] System configuration and operation

[1853] Registering lost items

[1854] 1. Terminal: The finder enters the details of the lost item.

[1855] The finder launches a web form or mobile app and enters information such as the type of item, its characteristics, where it was found, the date it was found, and a photo.

[1856] Once the input is complete, the send button is pressed to send the information to the server.

[1857] 2. Server: Receives and verifies the found item information.

[1858] The server validates the format and content of the received data to ensure there is no missing or invalid data.

[1859] Once verification is complete, the found item information is stored in a database.

[1860] 3. Server: Confirms that the found item information has been saved and notifies the finder.

[1861] A message indicating successful registration is generated and sent back to the finder's terminal.

[1862] The finder will receive a notification that the lost item has been registered.

[1863] Registering a lost item report

[1864] 1. Terminal: The loser enters the details of the lost item.

[1865] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and a photo.

[1866] Once the input is complete, the send button is pressed to send the information to the server.

[1867] 2. Server: Receives and verifies the lost item information.

[1868] The server validates the format and content of the received data to ensure there is no missing or invalid data.

[1869] Once verification is complete, the lost item information is stored in a database.

[1870] 3. Server: Confirms that the lost item information has been saved and notifies the loser.

[1871] A message indicating successful registration is generated and sent back to the lost device.

[1872] The loser will receive a notification that their lost item has been registered.

[1873] matching

[1874] 1. Server: Retrieves lost and found data from the database.

[1875] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[1876] 2. Server: Matches lost and found items using a generative AI model.

[1877] The server inputs information about lost and found items into a generative artificial intelligence model, comparing the item's characteristics, where it was found, where it was lost, the date, image data, etc.

[1878] If the match is successful, the results are stored in an internal system.

[1879] Examples:

[1880] Suppose finder A finds a "red wallet" in a park, and loser B loses it near a station on the same day. A generative AI model analyzes this information, matches the wallet type, color, and the proximity of where it was found and lost, and sends a notification.

[1881] Notification and communication

[1882] 1. Server: Notifies the finder and the loser of a successful match.

[1883] A notification message is created based on the matching results and sent to the devices of the finder and the lost person.

[1884] The notification will also include a link to any contact methods within the system (such as chat functionality).

[1885] 2. User: The finder and the loser exchange information using the communication means within the system.

[1886] The finder and loser click on a link in the notification to access the chat function within the system.

[1887] Discuss the details and method of delivery of the items through communication channels.

[1888] Introducing the Emotion Engine

[1889] 1. Terminal: User registration and contact

[1890] To recognize a user's feelings when registering a lost or found item and provide user support as needed.

[1891] When registering an item, the system analyzes the user's emotional state and displays guide messages and support to reduce stress and anxiety.

[1892] 2. Server: When matching is successful

[1893] When a match is successful, the emotions of the finder and loser are analyzed to generate appropriate notification and support messages.

[1894] For example, if the finder is feeling anxious, add a message or explanation that will provide reassurance.

[1895] Performance-based billing

[1896] 1. Server: Handles the billing process for performance-based rewards.

[1897] After verifying that the match was successful and the item was returned to its owner, the server begins the process of collecting the appropriate reward.

[1898] Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, or 800 yen) will be charged.

[1899] 2. User: The loser pays the reward.

[1900] The loser confirms the claim from the system and pays a fixed fee.

[1901] You will receive a notification that your payment has been made and the process is complete.

[1902] This system streamlines the matching process between lost and found items, returning more items to their owners and contributing to environmental conservation. Furthermore, by using a generative AI model and emotion engine, the system improves the user experience and increases matching accuracy. This system benefits both the finder and the lost item, supporting reliable item return.

[1903] The processing flow will be explained below.

[1904] Step 1:

[1905] Terminal: The finder enters details of the lost item.

[1906] The finder opens a web form or mobile app and enters information such as the type of item, its characteristics, the location where it was found, the date it was found, and a photo.

[1907] Once you have completed the input, click the send button to send the information to the server.

[1908] Step 2:

[1909] Server: Receives and verifies the found item information.

[1910] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[1911] Once verification is complete, the found item information will be saved in the database.

[1912] Step 3:

[1913] Server: Confirms that the found item information has been saved and notifies the finder.

[1914] A message indicating successful registration is generated and sent back to the finder's device.

[1915] The finder will receive a notification that the lost item has been registered.

[1916] Step 4:

[1917] Terminal: The loser enters the details of the lost item.

[1918] The loser launches a web form or mobile app and enters information such as the type of item, characteristics, location of loss, date of loss, and photo.

[1919] Once you have completed the input, click the send button to send the information to the server.

[1920] Step 5:

[1921] Server: Receives and verifies the lost item information.

[1922] The server validates the format and content of the data received to ensure there is no missing or invalid data.

[1923] Once verification is complete, we will store the lost item information in our database.

[1924] Step 6:

[1925] Server: Confirms that the lost item information has been saved and notifies the loser.

[1926] A message indicating successful registration is generated and sent back to the lost device.

[1927] The person who lost the item will receive a notification that their lost item has been registered.

[1928] Step 7:

[1929] Server: Retrieves lost and found data from the database.

[1930] Periodically or on request, the server retrieves newly registered lost and found items from the database.

[1931] Step 8:

[1932] Server: Matches lost and found items using a generative AI model.

[1933] The server inputs information about lost and found items into a generative AI model, comparing the item's characteristics, where it was found, where it was lost, the date, and image data.

[1934] If the match is successful, the result is stored in an internal system.

[1935] Step 9:

[1936] Server: Notifies the finder and the lost person that the match was successful.

[1937] - Create a notification message based on the matching results and send it to the devices of the finder and the lost person.

[1938] The notification will also include a link to the system's contact methods (such as chat functionality).

[1939] Step 10:

[1940] User: The finder and the loser exchange information using the communication means within the system.

[1941] · The finder and loser can click on the link in the notification to access the chat function within the system.

[1942] · Discuss details and delivery methods of items through communication channels.

[1943] Step 11:

[1944] Terminal: Analyzes the emotional state of users who are in trouble.

[1945] As users interact, the emotion engine analyzes their emotional state (stress, anxiety, relief, joy, etc.).

[1946] · Providing supportive messages and advice when needed.

[1947] Step 12:

[1948] Server: Generates appropriate notification content based on the emotional state.

[1949] -When a match is successful, the system recognizes the emotions of the finder and loser and generates appropriate notification and support messages.

[1950] For example, if the finder is feeling anxious, add a message to provide reassurance.

[1951] Step 13:

[1952] Server: Handles the billing process for performance-based rewards.

[1953] After confirming that the match was successful and the item was returned to its owner, the server will begin the process of collecting the appropriate reward.

[1954] - Based on the user's payment information, a predetermined flat rate (300 yen, 500 yen, 800 yen) will be charged.

[1955] Step 14:

[1956] User: The loser pays the reward.

[1957] The loser will check the claim from the system and pay a fixed fee.

[1958] You will receive a notification that your payment has been made and the process is complete.

[1959] Example 2

[1960] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1961] The management of lost and found items requires a lot of time and effort. Current systems have difficulty effectively linking information on the finders and losers, and lack support to alleviate users' anxiety and stress. Furthermore, the success rate of matching is low, and items are often not returned smoothly. Therefore, there is a need for efficient matching of found and lost items and an improved user experience.

[1962] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1963] In this invention, the server includes: [means for registering detailed information on found items;] [means for registering detailed information on lost items;] [means for matching information on found items and lost items using a generative artificial intelligence model;] [means for notifying the finder and the loser if the match is successful;] [means for verifying information on found items and lost items and checking for missing or incorrect data; and [means for using an emotion engine that recognizes the user's emotions and provides support messages as needed.] This makes it possible [to efficiently match found items with lost items and provide appropriate support according to the user's emotional state, thereby improving the user experience and enabling smooth return of items].

[1964] "Detailed information about a lost item" refers to specific information about the item found by the finder, such as the type, characteristics, location, date of finding, and photographs.

[1965] "Detailed information about lost items" refers to specific information about the item lost by the loser, such as the type, characteristics, location, date of loss, and photographs.

[1966] A "generative artificial intelligence model" is an artificial intelligence system that analyzes the characteristics and information of found and lost items and performs matching.

[1967] "Means for notifying" refers to the means for notifying the finder and the loser of the result when matching is successful. Specifically, it refers to the system that generates and sends messages.

[1968] "Means for verifying" means the means by which lost and found information is received to verify that the information is accurate and that there are no omissions or irregularities.

[1969] An "emotion engine" is a system that recognizes the user's emotional state and generates appropriate support messages based on that information.

[1970] "Means for collecting a reward" refers to a means for collecting a set fee from a user when matching is successful and the item is returned.

[1971] The present invention relates to a system for managing information on lost and found items and efficiently matching them. Users register items, a generative AI model is used to perform matching, and an emotion engine is used to support users and collect rewards.

[1972] Registering lost items

[1973] 1. Terminal

[1974] The finder enters detailed information about the found item. The finder launches a web form or mobile app on their device (smartphone or PC) and enters details about the found item (item type, characteristics, location found, date found, photo). For example, if they found a red wallet in a park, they would enter "Type: Wallet," "Characteristics: Red, with side zipper," "Location found: Park," "Date found: October 10, 2023," and "Photo: Photograph taken." Once they have completed entering the information, they press the send button to send the data to the server.

[1975] 2. Server

[1976] The server collects data on lost items received from the device. The web server receives an HTTP request and receives detailed information on the lost item in JSON format. It then validates the format and content of the received data. Specifically, it checks whether all required fields have been filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the device. Once validation is complete, it saves the lost item information in the database.

[1977] 3. Notification

[1978] The server notifies the finder that the data has been successfully saved, including specific information such as "Type: wallet, Characteristics: red, with side zipper, found in a park on October 10, 2023."

[1979] Registering a lost item report

[1980] 1. Terminal

[1981] The loser enters detailed information about the lost item. The loser launches a web form or mobile app on their device (smartphone or PC) and enters details about the lost item (item type, characteristics, location lost, date lost, photo). For example, if they lost a red wallet near a station, they would enter "Type: Wallet," "Characteristics: Red, with side zipper," "Location lost: Near the station," "Date lost: October 10, 2023," and "Photo: Photo taken previously." Once they have completed entering the information, they press the send button to send the data to the server.

[1982] 2. Server

[1983] The server collects the lost item data received from the device. The web server receives the HTTP request and receives the lost item details in JSON format. It then validates the format and content of the received data. Specifically, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and sends it back to the device. Once validation is complete, it saves the lost item information in the database.

[1984] 3. Notification

[1985] The server notifies the loser that the data has been successfully saved, including specific information such as "Type: wallet, Characteristics: red, with a side zipper, lost near a station on October 10, 2023."

[1986] matching

[1987] 1. Server

[1988] The server periodically or upon request extracts newly registered lost and found items from the database. Specifically, it executes an SQL query to retrieve recently added data. The retrieved information on lost and found items is then input into a generative AI model. Matching is performed by comparing items such as the item's characteristics, where it was found, where it was lost, the date, and image data. For example, the following information could be input: "Red wallet, with a side zipper, where it was found in a park, where it was lost near a station, and the date it was found on October 10, 2023."

[1989] 2. Server

[1990] If the match is successful, the results are saved in the internal system. For example, "Finder A's red wallet with a side zipper matches the wallet of loser B." This is saved in the database.

[1991] Notification and communication

[1992] 1. Server

[1993] The server notifies the finder and the lost person that the match was successful. Specifically, it generates a notification message based on the matching result and sends it to the finder and the lost person's devices. It provides a message saying "Your red wallet has been found" and a link to the system's contact method (such as a chat function).

[1994] 2. Users

[1995] The finder and the loser click on the link in the notification to access the chat function within the system. Specifically, they use the chat screen to discuss details such as how to hand over the item. They make specific arrangements, such as "Let's meet at XX Station on October 15th at 2:00 PM."

[1996] Introducing the Emotion Engine

[1997] 1. Terminal

[1998] When registering lost or found items, the system recognizes the user's emotions. It uses the device's camera and voice data to analyze the user's emotional state (anxiety, stress, joy, etc.). For example, it uses facial recognition technology to determine whether the user is smiling or looking serious.

[1999] 2. Server

[2000] Based on the information obtained from the emotion engine, appropriate notification content and support messages are generated. For example, if the finder is feeling anxious, a message such as "Don't worry, your information is being kept safe" will be generated.

[2001] Performance-based billing

[2002] 1. Server

[2003] After confirming that the matching was successful and the item was returned, the process of collecting the appropriate reward will begin. Specifically, a scenario will be started in which payment is processed using credit card information.

[2004] 2. Users

[2005] The lost person checks the request from the system and pays the fixed fee. For example, they pay the appropriate fee of 300 yen, 500 yen, or 800 yen with their credit card. They receive a notification that the payment has been completed, and the process is complete. A message such as "Your payment has been completed. Thank you for letting us know" is displayed.

[2006] Example prompts for generative AI models

[2007] "I found a red wallet in the park. Date found: October 10, 2023. Features: It has a zipper on the side. Please use this information to find someone who lost a red wallet on the same day."

[2008] This enables efficient matching of found and lost items, and also provides appropriate support according to the user's emotional state, improving the user experience and enabling smooth return of items.

[2009] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2010] Step 1:

[2011] Enter details of the lost item (device)

[2012] Input: The finder launches a web form or mobile app on their device (smartphone or PC) and enters details about the lost item (item type, characteristics, location, date of finding, and photo).

[2013] Specific operation: If the finder finds a red wallet in a park, they will enter the following: "Type: Wallet", "Characteristics: Red, with side zipper", "Place of Found: Park", "Date of Found: October 10, 2023", and "Photo: Photo taken".

[2014] Output: Once the input is complete, press the send button to send the data to the server.

[2015] Step 2:

[2016] Receiving and verifying data on lost items (server)

[2017] Input: Found item data received from the device.

[2018] Specific operation: The server receives an HTTP request and receives the details of the lost item in JSON format.

[2019] Data processing: The server validates the format and content of the data received. For example, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the terminal.

[2020] Output: Once the verification is complete, save the found item information to the database.

[2021] Step 3:

[2022] Notification of lost item registration completion (server)

[2023] Input: Information about lost items stored in the database.

[2024] Specific operation: The server verifies that the found item information has been saved successfully.

[2025] Data output: A notification message containing specific details such as "Type: wallet, Characteristics: red, with side zipper, found in park on October 10, 2023" is generated and sent to the finder's device.

[2026] Step 4:

[2027] Enter the details of the lost item (on your device)

[2028] Input: The lost person launches a web form or mobile app on their device (smartphone or PC) and enters details of the lost item (item type, characteristics, location lost, date lost, photo).

[2029] Specific operation: If the loser loses a red wallet near a station, they will enter the following: "Type: Wallet", "Characteristics: Red, with a side zipper", "Location of loss: Near the station", "Date of loss: October 10, 2023", and "Photo: Previously taken photo".

[2030] Output: Once the input is complete, press the send button to send the data to the server.

[2031] Step 5:

[2032] Receiving and verifying lost item data (server)

[2033] Input: Lost item data received from the device.

[2034] Specific operation: The server receives an HTTP request and receives the details of the lost item in JSON format.

[2035] Data processing: The server validates the format and content of the data received. For example, it checks whether all required fields are filled in and whether image files are in the correct format (JPEG, PNG, etc.). If there is missing or invalid data, it generates an error message and returns it to the terminal.

[2036] Output: Save the lost item information in the database once verification is complete.

[2037] Step 6:

[2038] Lost item registration completion notification (server)

[2039] Input: Lost item information stored in the database.

[2040] Specific operation: The server verifies that the lost item information has been saved successfully.

[2041] Data output: A notification message containing specific details such as "Type: wallet, characteristics: red, with side zipper, lost near a station on October 10, 2023" is generated and sent to the device of the loser.

[2042] Step 7:

[2043] Data extraction (server)

[2044] Input: Lost and found data from the database.

[2045] What happens: The server runs an SQL query to extract recently added data.

[2046] Output: Retrieved lost and found information.

[2047] Step 8:

[2048] AI matching (server)

[2049] Input: Extracted lost and found information.

[2050] Specific operation: Input the item's characteristics, where it was found, where it was lost, date, image data, etc. into the generative artificial intelligence model and attempt to match it.

[2051] Data calculation: The AI ​​model analyzes the input information and performs feature extraction and comparative matching.

[2052] Output: Successfully matched data is stored in an internal system.

[2053] Step 9:

[2054] Notification of matching results (server)

[2055] Input: A successful match result.

[2056] Specific operation: The server generates a notification message based on the matching result and sends it to the finder and the lost person's devices, for example, a message saying "Your red wallet has been found."

[2057] Output: Notification messages are sent to the finder and the loser.

[2058] Step 10:

[2059] Information exchange and coordination (users)

[2060] Input: The link to be included in the notification message.

[2061] Specific operation: The finder and the loser click on the link in the notification to access the chat function within the system, where they can discuss details and how to hand over the item.

[2062] Output: As a result of the discussion, a specific date, time and location for delivery will be decided.

[2063] Step 11:

[2064] Emotion Recognition and Analysis (Device)

[2065] Input: User's video and audio data.

[2066] Specific operation: Recognizes the user's emotional state (anxiety, stress, joy, etc.) using the device's camera and microphone. For example, it uses facial recognition technology to determine whether the user is smiling or looking serious.

[2067] Output: Emotion recognition data.

[2068] Step 12:

[2069] Emotion response message generation (server)

[2070] Input: Emotion recognition data.

[2071] Specific operation: The server generates appropriate notification and support messages based on the information obtained by the emotion engine. For example, if the finder feels anxious, the server will generate a message such as "Don't worry, your information is kept safe."

[2072] Output: An emotional response message is sent to the device.

[2073] Step 13:

[2074] Performance-based reward billing procedure (server)

[2075] Input: Successful match and item return information.

[2076] Specific operation: The server starts the process of charging the appropriate reward (e.g., 300 yen, 500 yen, 800 yen) to the user. Payment is made based on the credit card information.

[2077] Output: A successful charge message is sent to the user.

[2078] Step 14:

[2079] Payment of performance rewards (user)

[2080] Input: Billing message.

[2081] Specific operation: The person who lost the item checks the bill from the system and pays the fixed fee by credit card, for example, 300 yen, 500 yen, or 800 yen.

[2082] Output: A notification of successful payment is sent to the user and the process is complete.

[2083] (Application example 2)

[2084] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2085] Lost and found items frequently occur in physical stores, making their management cumbersome and time-consuming for staff and customers. In particular, if lost or found items are not promptly returned to their owners, customer satisfaction declines and in-store confusion occurs. Furthermore, matching between lost and found items is often done manually, resulting in low efficiency and a high risk of errors. Furthermore, it is difficult to appropriately consider the user's emotional state when communicating and responding to the match, which can increase stress and anxiety.

[2086] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2087] In this invention, the server includes a means for registering detailed information on found items, a means for registering detailed information on lost items, a means for matching information on found items and lost items using a generative artificial intelligence model, a means including an emotion engine that ana...

Claims

1. a means for registering detailed information about lost items; a means for registering details of lost items; a means for matching information about lost and found items using a generative artificial intelligence model; means for notifying the finder and loser upon successful matching; The system includes a means for collecting a performance fee based on the match.

2. 10. The system of claim 1, including a generative artificial intelligence model that performs characteristic analysis based on the found and lost information, analyzing item type, characteristics, location, date, and image data.

3. 2. The system according to claim 1, wherein if matching is successful, a means of contacting the finder and the loser is provided.

Images