System

Abstract

To provide a system.SOLUTION: A system includes: means for finding a lost item by receiving an alert by a terminal when a user passes near an object equipped with a wireless communication module, and by the user picking up the object and delivering it to a specific location; means for describing characteristics from an image of the lost item and compiling the characteristics into a database; and means for recognizing the emotional state of the user using an emotion recognition engine and changing methods by which advertisements are displayed on the terminal in accordance with the emotional state.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Receiving and managing lost items is a challenge, and there is a need for a system to do this efficiently. [Means for solving the problem]

[0005] We provide BLE chips to end users and provide a system that alerts them when they pass by an object with the BLE chip attached. Furthermore, we will build a system that describes features from images and instantly creates a database to streamline the collection and management of lost items. And, instead of charging users, the revenue source will be advertising revenue, creating a win-win model for both companies and users. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] The present invention provides end users with a BLE chip. This BLE chip is attached to an item that is easily lost, such as keys or a wallet. When a user passes by an item with the chip attached, an alert is sent to the user's device, such as a smartphone. The alert is communicated to the user by, for example, sound, vibration, or a notification on the screen. When the user receives the alert, they pick up the item and deliver it to a specific location (for example, the nearest store or public facility).

[0029] "Example 2"

[0030] The system of the present invention describes features from images and instantly creates a database to streamline the collection and management of lost items. Specifically, when a lost item is collected, an image of the item is taken and image analysis technology is used to extract the item's features (e.g., color, shape, size, brand logo, etc.). The extracted features are registered in a database, making it easier to search for and manage lost items.

[0031] "Example 3"

[0032] The system of this invention is not charged to the user, and its revenue comes from advertising. Specifically, advertisements are displayed on each screen of the system, such as the alert notification screen and the lost property database screen. The advertisements provide useful information to the user, such as coupons for the store where the lost item was delivered, or advertisements related to the characteristics of the lost item (for example, an advertisement for a key duplication service for a key). This creates a win-win model for both the company and the user.

[0033] The processing flow of each embodiment will be described below.

[0034] "Example 1"

[0035] Step 1: Provide the end user with a BLE chip, which they attach to an easily lost item, such as a key or wallet.

[0036] Step 2: When a user passes by an object equipped with a chip, an alert is sent to the user's smartphone or other device. The alert can be conveyed to the user through a sound, vibration, or on-screen notification, for example.

[0037] Step 3: When the user receives the alert, they pick up the item and deliver it to a specific location (e.g., the nearest store or public facility).

[0038] "Example 2"

[0039] Step 1: To streamline the collection and management of lost items, we take a photo of the item and instantly create a database based on its characteristics.

[0040] Step 2: Image analysis technology is used to extract the features of the item (e.g., color, shape, size, brand logo, etc.). The extracted features are registered in a database to facilitate the search and management of lost property.

[0041] "Example 3"

[0042] Step 1: The system of the present invention is not charged to users, and its revenue source is advertising revenue. Specifically, advertisements are displayed on each screen of the system, such as the alert notification screen and the lost property database screen.

[0043] Step 2: Advertisements provide useful information to users, such as coupons for the store where the lost item was delivered or advertisements related to the characteristics of the lost item (for example, an advertisement for a key duplication service for a key). This creates a win-win situation for both companies and users.

[0044] Example 1

[0045] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0046] Conventional lost property management systems require users to manually enter information when an item is lost or found, which is time-consuming and often inaccurate. Furthermore, the process of receiving and managing lost items is cumbersome, placing a heavy burden on users. Furthermore, the system's operating costs are high, and there is no established revenue model, making sustainable operation difficult.

[0047] The identification process by the identification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes means for providing a wireless communication chip to an end user and issuing a warning to the terminal when the user passes near an item equipped with the wireless communication chip, means for picking up the item and delivering it to a specific location, means for the terminal to scan the signal from the wireless communication chip and transmit signal information to the server, and means for the server to transmit a warning to the terminal based on the signal information. This allows the user to automatically receive a warning when the item is lost and respond quickly. In addition, the collection and management of lost items are made more efficient, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, sustainable operation is possible.

[0048] "End user" means the final user of the system.

[0049] A "wireless communication chip" is a small electronic device that transmits signals using wireless communication technologies such as Bluetooth Low Energy (BLE).

[0050] "Items" are personal belongings or possessions that are easily lost by the user, such as keys or wallets.

[0051] A "terminal" is an electronic device such as a smartphone or tablet that a user owns.

[0052] An "alert" is an alert such as a sound, vibration, or on-screen notification that appears on the device.

[0053] A "server" is a computer system for receiving and analyzing signal information and sending alerts to terminals.

[0054] "Signal information" refers to data such as the ID, detection time, and location information transmitted from the wireless communication chip.

[0055] A "specific location" is a designated location such as a store or public facility where a user can return a found item.

[0056] "Advertising revenue" refers to revenue from advertising received from companies to cover the operating costs of the system.

[0057] The "profit sharing model" is a business model in which companies and users mutually benefit.

[0058] This invention provides a system in which an end user is provided with a wireless communication chip, and when the user passes near an article to which the wireless communication chip is attached, a warning is issued on a terminal. Specific embodiments of this system will be described below.

[0059] Hardware and software used

[0060] This system uses the following hardware and software:

[0061] Hardware: Wireless communication chips (e.g., Bluetooth Low Energy chips), smartphones (e.g., iPhone (registered trademark), ANDROID (registered trademark) devices)

[0062] Software: Smartphone applications (e.g., dedicated app "FindMyItem"), servers (e.g., cloud services)

[0063] Program processing

[0064] The server maintains a database that manages the ID and location information of the wireless communication chip. The device (user's smartphone) runs an application that receives signals from the wireless communication chip. When this application detects a signal from the wireless communication chip, it sends the information to the server. The server then sends a warning to the user's smartphone based on the received information.

[0065] Specifically, the following process occurs:

[0066] 1. The user attaches a wireless communication chip to an item such as a key or wallet.

[0067] 2. An application installed on the user's smartphone scans for signals from the wireless communication chip.

[0068] 3. When the smartphone detects the signal from the wireless communication chip, it sends the information to the server.

[0069] 4. The server sends an alert to the user's smartphone based on the received information.

[0070] 5. Once the user receives the alert, they can pick up the item and deliver it to a specific location.

[0071] Specific examples

[0072] As a concrete example, consider the case where a user has attached a wireless communication chip to a key. If the user drops the key, and another user passes by the key, a warning message will appear on the user's smartphone. The message will read, "Your key has been dropped. Please return it to the nearest store."

[0073] Example prompts for generative AI models

[0074] "Please create a program for an item tracking system that uses a wireless communication chip. In this system, a user attaches a wireless communication chip to an item such as a key or wallet, and the signal is received by the user's smartphone and sent to a server. The server then sends an alert to the user's smartphone based on the received information. The hardware used is a Bluetooth Low Energy chip, and the smartphone is an iPhone or Android device. The smartphone application is "FindMyItem," and the server uses a cloud service."

[0075] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0076] Step 1:

[0077] A user attaches a wireless communication chip to an item such as a key or wallet. The wireless communication chip periodically transmits location information of the attached item. The input is the attachment of the wireless communication chip, and the output is the state in which the item has the wireless communication chip.

[0078] Step 2:

[0079] The user installs the dedicated app "FindMyItem" on their smartphone and launches it. The app performs pairing settings for the wireless communication chip when launched for the first time. The input is the installation and launch of the app, and the output is the completion of pairing between the wireless communication chip and smartphone.

[0080] Step 3:

[0081] The device (smartphone) periodically scans for signals from the wireless communication chip through the app. The scan is performed in the background and does not require user interaction. The input is the signal from the wireless communication chip, and the output is the signal detection information.

[0082] Step 4:

[0083] When a terminal detects a signal from a wireless communication chip, it sends the signal information (chip ID, detection time, location information, etc.) to the server. The input is the signal detection information, and the output is the transmission of the signal information to the server.

[0084] Step 5:

[0085] The server generates a warning message for the user's smartphone based on the received signal information. The warning message includes the type of item and its location. The input is the signal information, and the output is a warning message.

[0086] Step 6:

[0087] The terminal (smartphone) receives a warning from the server. The warning is communicated to the user by sound, vibration, on-screen notification, etc. The input is the warning message, and the output is the notification to the user.

[0088] Step 7:

[0089] The user confirms the warning, picks up the item, and delivers it to a specific location (e.g., the nearest store or public facility). The input is confirmation of the warning, and the output is picking up and reporting the item.

[0090] (Application example 1)

[0091] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0092] The present invention relates to a system that tracks items that are easily lost, such as keys or wallets, and sends an alert when a user passes near the item. Conventional systems have insufficient notification when an item leaves a specific area or management of the item's location history, making it difficult for users to respond when they lose an item. Furthermore, there are issues with the cumbersome process of receiving and managing lost items, which places a heavy burden on users. Furthermore, limited revenue sources make it difficult to build a sustainable business model.

[0093] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0094] In this invention, the server provides an end user with a BLE chip, and includes a means for alerting the user's device when the user passes near an item equipped with the BLE chip; a means for picking up the item and delivering it to a specific location; a means for notifying the user when the item leaves a specific area; and a means for storing the item's location history in the cloud and enabling the user to check its past location. This reduces the risk of losing an item, enables the user to track the item's location in real time, and allows for quick response when the item leaves a specific area. Furthermore, the system streamlines the collection and management of lost items, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, a sustainable business model can be realized that balances the interests of both the company and the user.

[0095] "End User" means the individual or organization that ultimately uses a product or service.

[0096] A "BLE chip" is a small communication device that uses Bluetooth Low Energy technology and is capable of wireless communication with low power consumption.

[0097] An "item" refers to a concrete object, such as a key or a wallet, that has a particular purpose or value.

[0098] A "terminal" refers to an electronic device such as a smartphone or tablet, which is a device that allows a user to receive and operate information.

[0099] An "alert" is a notification to alert the user, and is provided in the form of a sound, vibration, on-screen notification, or the like.

[0100] A "specific location" refers to the location where the item should be returned after being picked up, such as the nearest store or public facility.

[0101] A "specific area" refers to the location where the item is normally located, such as a home or office.

[0102] A "notification" is a message that conveys information to the user and is provided via the terminal.

[0103] "Location history" is data that records the past location information of an item and is stored in the cloud.

[0104] The "cloud" is a collection of remote servers provided over the Internet, and is an infrastructure for storing and processing data.

[0105] "Advertising revenue" refers to revenue earned by displaying advertisements and is used as part of a business model.

[0106] A "profit-making model" refers to a business model that benefits both the company and the users, and is operated in a sustainable manner.

[0107] A system for implementing this invention includes a BLE chip provided to an end user, a terminal such as a user's smartphone, and a cloud server. The specific configuration and operation of the system are described below.

[0108] Hardware and Software Configuration

[0109] 1. Hardware:

[0110] Smartphone: iOS or Android device

[0111] BLE chip: For example, Nordic Semiconductor's nRF52840

[0112] Cloud Server: A remote server for data storage and processing

[0113] 2. Software:

[0114] Smartphone applications: developed in Swift for iOS and Kotlin for Android

[0115] BLE communication library: CoreBluetooth for iOS, Android BLE API for Android

[0116] Cloud backend: For example, using Firebase

[0117] System Operation

[0118] 1. Providing and installing the BLE chip

[0119] The server provides BLE chips to end users, who then attach them to items that are easily lost, such as keys or wallets.

[0120] 2. Item tracking and alert notifications

[0121] When a user passes near an item equipped with a BLE chip, the device receives the signal from the BLE chip and measures the signal strength (RSSI). Based on the signal strength, the device estimates the distance to the item and sends an alert to the device if the item is nearby. The alert can be in the form of a sound, vibration, or on-screen notification.

[0122] 3. Notifications when you leave a specific area

[0123] When an item leaves a specific area (e.g., home or office), the device sends location information to a cloud server, and the server notifies the user.

[0124] 4. Location History Management

[0125] The location history of the item is stored on a cloud server, allowing users to check its past location, thereby reducing the risk of losing the item.

[0126] Specific examples

[0127] For example, if a user loses their keys, an alert will be sent to their smartphone when they pass by a key equipped with a BLE chip. The alert will be communicated to the user through audio, vibration, and on-screen notifications. It will also notify the user if the key is left at home or in the office.

[0128] Prompt Sentence Examples

[0129] If a user loses their keys, develop an application that sends an alert to their smartphone when they pass by a key equipped with a BLE chip. The alert will be communicated to the user through sound, vibration, and on-screen notification. It will also notify the user if the key is left at home or office.

[0130] This system significantly reduces the risk of losing important items for users. It also streamlines the collection and management of lost items, reducing the burden on users. Furthermore, by using advertising revenue as a source of income, it is possible to realize a sustainable business model that balances the interests of both the company and users.

[0131] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0132] Step 1:

[0133] The server provides the BLE chip to the end user, who then attaches the BLE chip to an easily lost item such as a key or wallet. The inputs are the BLE chip and the item, and the output is the item with the BLE chip attached.

[0134] Step 2:

[0135] The device receives signals from the BLE chip. The input is the signal from the BLE chip, and the output is the signal strength (RSSI). The device receives signals using a BLE communication library (CoreBluetooth for iOS, Android BLE API for Android).

[0136] Step 3:

[0137] The terminal estimates the distance of the item based on the signal strength. The input is the signal strength (RSSI) and the output is the estimated distance of the item. The terminal analyzes the signal strength and determines whether the item is nearby.

[0138] Step 4:

[0139] If an item is nearby, the device sends an alert to the user. The input is the estimated distance of the item, and the output is the alert notification. The alert can be in the form of a sound, vibration, or on-screen notification.

[0140] Step 5:

[0141] When an item leaves a specific area, the device sends its location information to the cloud server. The input is the item's location information, and the output is data transmission to the cloud server. The device determines the location of the item using location services such as GPS and Wi-Fi.

[0142] Step 6:

[0143] The cloud server notifies the user when an item leaves a specific area. The input is the item's location information, and the output is a notification message. The server generates a notification based on the user's settings and sends it to the device.

[0144] Step 7:

[0145] The cloud server stores the location history of the item. The input is the location information of the item, and the output is the location history data. The server stores the location information in a database, allowing users to check the past locations.

[0146] Step 8:

[0147] The user checks the location history of an item through a smartphone application. The input is the location history data, and the output is a display of the location history. The user can view past location information using the application interface.

[0148] In this way, the system reduces the risk of losing items and helps users find them quickly. It also streamlines the collection and management of lost items, reducing the burden on users. Furthermore, by using advertising revenue as a revenue source, it can realize a sustainable business model that balances the interests of both the company and users.

[0149] Example 2

[0150] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0151] In conventional lost property management systems, the process of receiving and managing lost items was cumbersome, making efficient search and management difficult. The burden on users to find lost items was also heavy, making the overall system operation inefficient. Furthermore, revenue sources were limited, and a sustainable operating model had not been established.

[0152] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server provides a wireless communication module to an end user. When the user passes near an item equipped with the wireless communication module, an alert is generated on the terminal. The user then picks up the item and returns it to a specific location to find the lost item. It also includes: a means for taking an image of the item using the terminal when the lost item is received; a means for the server to analyze the received image and extract features of the item; a means for registering the extracted features in a database; and a means for the user to send search criteria from the terminal to the server when searching for a lost item, and for the server to search the database and return information on lost items matching the criteria to the terminal. This improves the efficiency of receiving and managing lost items, allowing users to easily search for and find lost items. Furthermore, by using advertising revenue as a source of income, a sustainable operational model is realized, enabling companies and users to share profits.

[0153] A "wireless communication module" is an electronic component for transmitting and receiving data using short-range wireless communication.

[0154] A "terminal" is an electronic device that can be operated by a user and that has a camera and communication functions.

[0155] A "server" is a computer system that processes and stores data over a network.

[0156] "Image analysis" is a technique for extracting specific information or features from captured image data.

[0157] "Feature extraction" is the process of identifying characteristics such as the color, shape, size, and brand logo of an object from information obtained through image analysis.

[0158] A "database" is a system for efficiently storing, searching, and managing data.

[0159] "Search criteria" are the particular criteria or parameters a user specifies when searching for lost property.

[0160] An "alert" is a notification or warning that appears on a device when certain conditions are met.

[0161] "Advertising revenue" refers to revenue earned by displaying advertisements.

[0162] The "profit sharing model" is a business model in which companies and users can mutually benefit from each other.

[0163] The present invention is a system for efficiently receiving and managing lost property. A specific embodiment of this system will be described below.

[0164] Hardware and Software Configuration

[0165] Terminal

[0166] The device operated by the user is equipped with a high-resolution camera and internet connectivity, and serves the purpose of taking pictures of lost items and sending the image data to a server.

[0167] server

[0168] The server has image analysis software such as "OpenCV" and "TENSORFLOW (registered trademark)" installed. Using this software, the server analyzes the received image data and extracts the features of the item. In addition, the server has database management systems such as "MySQL (registered trademark)" and "PostgreSQL" installed, and the extracted features are registered in a database.

[0169] Data processing and calculation

[0170] Image analysis

[0171] When the server analyzes the received image data, it first pre-processes the image. Specifically, it removes noise from the image and emphasizes the outlines of the item. Next, it uses image analysis software to extract the item's features. These features include color, shape, size, brand logo, etc.

[0172] Feature Extraction

[0173] The server identifies the features of the item from the information obtained through image analysis, such as the wallet's color (black), shape (rectangle), and brand logo (specific brand name).

[0174] Registering in the database

[0175] The server registers the extracted features in a database, which makes it easier to search and manage lost property. The database efficiently stores the item's feature information and allows it to be searched as needed.

[0176] Specific examples

[0177] Receiving and registering lost property

[0178] Suppose a user finds a black, rectangular brand-name wallet at a train station. The user takes a picture of the wallet using the device's camera, and the device sends the image to a server. The server uses image analysis software to extract the wallet's color (black), shape (rectangle), and brand logo, and registers these features in a database.

[0179] Lost property search

[0180] Suppose a user is looking for a black rectangular brand wallet. The user sends the search criteria "black rectangular brand wallet" to the server from their device. The server searches the database and returns information about lost property that matches the criteria to the device. For example, the server verifies that "black rectangular brand wallet" is registered and provides that information to the user.

[0181] Prompt Sentence Examples

[0182] Examples of prompts to be input to a generative AI model include:

[0183] "I'm looking for a black rectangular designer wallet. It may have been recently found at a station. Could you please tell me the details of the lost property?"

[0184] By inputting this prompt into the generative AI model, information about the relevant lost item can be efficiently obtained.

[0185] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0186] Step 1: Take a photo of the lost item

[0187] When a user receives a lost item, they use the device to take a picture of the item. The device is equipped with a high-resolution camera that can capture detailed images of the item. For example, if a user finds a wallet at a train station, they can use the device's camera to take a picture of the wallet. The input is the actual item, and the output is high-resolution image data.

[0188] Step 2: Sending image data

[0189] The device sends the captured image data to the server. The device has an internet connection and can quickly upload the image data to the server. For example, the device sends the image data to the server using Wi-Fi or mobile data communication. The input is high-resolution image data, and the output is the image data sent to the server.

[0190] Step 3: Image analysis

[0191] The server analyzes the image data it receives. Image analysis software such as "OpenCV" and "TensorFlow" is installed on the server. This software is used to perform preprocessing to extract the features of the item from the image. For example, the server removes noise from the image and emphasizes the outline of the item. The input is the image data sent to the server, and the output is the preprocessed image data.

[0192] Step 4: Feature extraction

[0193] The server uses image analysis software to extract features of an item. Specifically, it obtains information such as color, shape, size, and brand logo. For example, the server extracts the color (black), shape (rectangle), and brand logo of a wallet. The input is preprocessed image data, and the output is extracted feature data.

[0194] Step 5: Register with the database

[0195] The server registers the extracted features in a database. "MySQL" or "PostgreSQL" is used for the database. The registered data is used to search for and manage lost property. For example, the server stores the feature "black rectangular brand wallet" in the database. The input is the extracted feature data, and the output is the feature data registered in the database.

[0196] Step 6: Search for lost property

[0197] When a user searches for lost property, they send search criteria from their device to the server. The server searches the database and returns information about lost property that matches the criteria to the device. For example, if a user enters "black rectangular brand wallet" as a search criterion, the server searches the database and returns information about the corresponding lost property. The input is the search criteria specified by the user, and the output is information about lost property that matches the criteria.

[0198] (Application example 2)

[0199] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0200] In conventional lost property management systems, the process of receiving and managing lost items is cumbersome, and it is particularly difficult to accurately grasp the characteristics of the items and quickly search and identify them.In addition, the burden on users to find lost items is heavy, so efficient management is required.

[0201] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a wireless communication chip to an end user, an alert being issued to the terminal when the user passes near an item equipped with the wireless communication chip, and the device picking up the item and delivering it to a specific location, means for taking an image of the lost item and extracting characteristics of the item using image analysis technology, means for registering the extracted characteristics in a cloud database, means for providing a lost item search function and for quickly identifying the lost item based on the characteristics, and means for providing a function for notifying the location and time of collection of the lost item. This improves the efficiency of collection and management of lost items, reduces the burden on users, and enables the lost item to be identified quickly and accurately.

[0202] A "wireless communication chip" is a small electronic component that transmits and receives data using short-range wireless communication.

[0203] An "article" is a physical object that has certain characteristics.

[0204] A "terminal" is an electronic device that is operated by a user, and includes smartphones, tablets, and the like.

[0205] An "alert" is a warning or caution signal that notifies the user when a specific condition is met.

[0206] "Image analysis technology" is a technology for extracting specific information or features from image data.

[0207] A "cloud database" is a database that can be accessed via the Internet and is a system for storing and managing data.

[0208] A "search function" is a function for finding information within a database based on specific conditions or keywords.

[0209] The "notification function" is a function for notifying the user of information when a specific event or condition occurs.

[0210] A system for implementing the present invention is configured as follows.

[0211] First, the user carries an item equipped with a wireless communication chip, and when the user passes by the item, an alert appears on the device, allowing the user to pick up the item and deliver it to a specific location.

[0212] Next, when the lost item is delivered to a specific location, the device takes a picture of the lost item. This picture is analyzed using image analysis technology to extract the item's features (e.g., color, shape, size, brand logo, etc.). Image analysis is performed using OpenCV and TensorFlow.

[0213] The extracted features are registered in a cloud database using Firebase, and are later used to search for lost items.

[0214] When a user searches for a lost item, the device accesses the cloud database and quickly identifies the lost item based on its characteristics. The search function allows users to find information in the database based on specific criteria or keywords.

[0215] Additionally, a notification function for the location and time of lost property pickup is also provided, allowing users to know the best place and time to pick up their lost property.

[0216] As a concrete example, consider the case where a medium-sized, round, red brand-name hat is reported as lost property. The user takes a picture of the lost item with their device and extracts its features using image analysis technology. The extracted features are registered in a cloud database, and the user can quickly identify the lost item by searching for "red hat."

[0217] An example of a prompt is as follows:

[0218] "Please upload an image of your lost item. Please also provide details about the item (color, shape, size, brand)."

[0219] In this way, the receipt and management of lost items is made more efficient, reducing the burden on users and enabling lost items to be identified quickly and accurately.

[0220] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0221] Step 1:

[0222] A user carries an item equipped with a wireless communication chip. The wireless communication chip is a small electronic component that transmits and receives data using short-range wireless communication. When the user passes near the item, an alert is displayed on the terminal. The input is a signal from the wireless communication chip, and the output is the alert displayed on the terminal.

[0223] Step 2:

[0224] The user receives an alert, picks up an item, and delivers it to a specific location. The input is the alert displayed on the terminal, and the output is that the item has been delivered to a specific location. The user picks up the item and takes it to the specified location.

[0225] Step 3:

[0226] The device takes an image of the lost item. The input is the item picked up by the user, and the output is the captured image. The device's camera function is used to take an image of the lost item.

[0227] Step 4:

[0228] The device uses image analysis technology to extract features of an item. The input is the captured image, and the output is the extracted features. OpenCV and TensorFlow are used for image analysis. The image is preprocessed, and data processing and calculation are performed to extract features.

[0229] Step 5:

[0230] The server registers the extracted features in a cloud database. The input is the extracted features, and the output is the data registered in the cloud database. Firebase is used to save the feature data in the database.

[0231] Step 6:

[0232] When a user searches for a lost item, the device accesses the cloud database and quickly identifies the lost item based on its characteristics. The input is the search criteria entered by the user, and the output is the search results. The search function is used to find information in the database based on specific criteria or keywords.

[0233] Step 7:

[0234] The server provides a notification function for the location and time of collection of lost items. The input is the search result, and the output is the information of the location and time of collection notified to the user. The notification function is used to inform the user of the optimal location and time of collection.

[0235] In this way, the receipt and management of lost items is made more efficient, reducing the burden on users and enabling lost items to be identified quickly and accurately.

[0236] Example 3

[0237] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0238] Conventional lost property management systems lacked the functionality to display relevant advertisements when users reported or searched for lost items, making it impossible to provide useful information to users. Furthermore, the process of receiving and managing lost items was cumbersome, placing a heavy burden on users. Furthermore, many systems required users to bear the system's operating costs, making it difficult to promote user adoption.

[0239] The identification process by the identification processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means. In this invention, the server includes: means for providing an interface for a user to report a lost item; means for the server to store lost item information in a database; means for the server to select relevant advertisements based on the characteristics of the lost item; means for the terminal to display advertisements on a lost item report screen; means for providing an interface for a user to search for a lost item; means for the server to obtain search results from the database; means for the server to select relevant advertisements based on search keywords; and means for the terminal to display advertisements on a search result screen. This allows relevant advertisements to be displayed when a user reports or searches for a lost item, providing useful information to the user. Furthermore, the efficiency of receiving and managing lost items is improved, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, the burden on the user is reduced, and a profit-sharing model between the company and the user can be realized.

[0240] A "wireless communication module" is an electronic component for short-range wireless communication, and when attached to an item, has the function of transmitting its location information to a terminal.

[0241] "Item" means any object owned by a User that may be reported as lost or found.

[0242] A "terminal" is an electronic device used by a user, such as a smartphone or a personal computer.

[0243] An "alert" is a signal or message that notifies the user that a lost item is nearby.

[0244] "Interface" refers to the screens and controls that allow users to interact with the system, such as reporting lost items and searching for them.

[0245] A "server" is a computer system for storing and processing data, and for managing lost property information and advertising information.

[0246] A "database" is a system for systematically storing and managing information, and stores lost property information and advertising information.

[0247] "Advertisement" means commercial information provided to the user that advertises services or products related to the characteristics of the lost item.

[0248] "Search keywords" are words or phrases that a user enters when searching for lost property, and which allow the server to retrieve relevant information from the database.

[0249] The "profit sharing model" is a business model that uses advertising revenue as a source of income in operating a system, reducing the burden on users while bringing benefits to both companies and users.

[0250] The present invention provides a system for displaying related advertisements when a user reports or searches for lost items. The system includes a wireless communication module, a terminal, a server, a database, and an advertisement management function.

[0251] First, a user owns an item equipped with a wireless communication module. The wireless communication module is an electronic component for short-range wireless communication and has the function of transmitting the item's location information to a terminal. If the user loses the item, an alert will be displayed on the terminal.

[0252] The user uses a terminal to access the lost item report screen and enters detailed information about the lost item (e.g., black wallet, location, date and time, etc.). The terminal refers to a device such as a smartphone or PC. The information entered by the user is sent to the server.

[0253] The server receives lost property information sent by users and stores it in a database. The database is a system for systematically storing and managing information, and stores lost property information and advertising information. The server uses Amazon Web Services (AWS (registered trademark)) and Amazon RDS as its database.

[0254] The server then selects a relevant advertisement based on the characteristics of the lost item. For example, if the lost item is a key, it selects an advertisement for a key duplication service. The server retrieves the appropriate advertisement from the advertisement database and sends it to the device. The device then displays the advertisement on the lost item report screen.

[0255] When a user searches for a lost item, they use their terminal to access the lost item search screen and enter a search keyword (e.g., a black wallet). The server receives the user's search keyword and retrieves the corresponding lost item information from the database. The server then sends the search results to the terminal.

[0256] The server then selects relevant advertisements based on the search keywords. For example, if the search keyword is "black wallet," it will select advertisements for wallet repair services. The server retrieves the appropriate advertisements from the advertisement database and sends them to the device. The device then displays the advertisements on the search results screen.

[0257] As a concrete example, consider the case where a user reports "I lost my black wallet." The user uses their smartphone to access the lost property report screen and enters "black wallet." The server receives the "black wallet" information and stores it in Amazon RDS. The server then selects an advertisement related to "black wallet," for example, an advertisement for a "wallet repair service," and sends it to the device. Once the user has completed the report, an advertisement for the "wallet repair service" is displayed on the device.

[0258] An example of a prompt to input to a generative AI model might be, "Generate an advertisement that will be displayed when a user reports a lost item."

[0259] This system allows relevant advertisements to be displayed when a user reports or searches for lost items, providing useful information to the user. It also streamlines the collection and management of lost items, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, it is possible to reduce the burden on the user and realize a profit-sharing model between the company and the user. The flow of the identification process in Example 3 will be described with reference to FIG. 15.

[0260] Step 1:

[0261] User reports lost property

[0262] The user uses the terminal to access a lost item report screen and enters detailed information about the lost item (e.g., black wallet, location, date and time, etc.).

[0263] Input: Lost property details

[0264] Output: Lost item information is sent to the server

[0265] Step 2:

[0266] The server stores the lost property information in a database

[0267] The server receives the lost property information sent by the user and stores it in a database.

[0268] Input: Lost property information sent by the user

[0269] Output: Lost property information stored in the database

[0270] Step 3:

[0271] The server selects relevant ads

[0272] The server selects relevant advertisements based on the characteristics of the lost item, for example, if the lost item is a key, it selects advertisements for key duplication services.

[0273] Input: Lost property characteristics

[0274] Output: Selected advertising information

[0275] Step 4:

[0276] The device displays advertisements on the lost item report screen

[0277] The terminal displays the advertising information received from the server.

[0278] Input: Advertising information sent from the server

[0279] Output: Advertisement displayed on the lost property report screen

[0280] Step 5:

[0281] User searches for lost property

[0282] The user uses the terminal to access the lost property search screen and enters a search keyword (e.g., black wallet).

[0283] Input: Search keyword

[0284] Output: Search keywords sent to the server

[0285] Step 6:

[0286] The server retrieves the search results from the database

[0287] The server receives the user's search keywords and retrieves the corresponding lost property information from the database.

[0288] Input: Search keyword

[0289] Output: Lost property information retrieved from the database

[0290] Step 7:

[0291] The server selects relevant ads

[0292] The server selects relevant ads based on the search keywords, for example, if the search keyword is "black wallet," it will select ads for wallet repair services.

[0293] Input: Search keyword

[0294] Output: Selected advertising information

[0295] Step 8:

[0296] The device displays ads on the search results screen

[0297] The terminal displays the search results and advertising information received from the server.

[0298] Input: Search results and advertising information sent from the server

[0299] Output: Ad displayed on search results page

[0300] (Application example 3)

[0301] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0302] The present invention relates to lost property management and notification, and aims to provide a system that balances the interests of both companies and users by using advertising revenue as a source of income while reducing the burden on users. Another objective is to improve the user experience by providing useful information to users when lost property is found.

[0303] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server provides a wireless communication chip to an end user, and when the user passes near an item equipped with the wireless communication chip, a notification is sent to the terminal, and the item is picked up and delivered to a specific location. The server also includes a means for instantly describing characteristics from an image and creating a database, which addresses the issue of receiving and managing lost items. A revenue source is advertising revenue, rather than a user fee, and this balances the interests of both the company and the user. A means for sending a notification to the user when a lost item is found and displaying a related advertisement on the notification screen. This allows for efficient management and notification of lost items, making it possible to provide useful information to users while earning advertising revenue.

[0304] A "wireless communication chip" is an electronic component for short-range wireless communication, which is attached to an item and has the function of sending notifications to the terminal of a user passing nearby.

[0305] An "article" is an object that may be owned by a user and to which a wireless communication chip is attached.

[0306] A "terminal" is an electronic device such as a smartphone or tablet carried by a user, and is a device for receiving notifications from a wireless communication chip.

[0307] A "notification" is an alert or message sent from the wireless communication chip to the terminal, informing the user of the presence of an item.

[0308] A "specific location" is a location where a lost item should be returned after it is found, such as a store's lost and found center.

[0309] "A means of describing features from images and instantly creating a database" is a technology that analyzes images of lost items, extracts their features, and registers them in a database, thereby making lost items management more efficient.

[0310] "Advertising revenue" refers to revenue obtained from advertisements displayed by the system, and serves as a source of income to reduce the burden on users.

[0311] "Means to balance the interests of both companies and users" refers to a method of using advertising revenue to operate the system, bringing profits to companies while providing useful information to users.

[0312] The "notification screen" is a screen displayed on the terminal that notifies the user that a lost item has been found and displays related advertisements.

[0313] "Relevant advertisements" are advertisements that are displayed depending on the characteristics of the lost item and the user's situation, such as key duplication services and store coupons.

[0314] An embodiment of the present invention will be described.

[0315] First, the system provides end users with a wireless communication chip. The wireless communication chip is attached to an item, and when the user passes by the item, a notification is sent to the user's terminal. The terminal is an electronic device such as a smartphone or tablet, and is a device that receives the notification from the wireless communication chip.

[0316] Next, to streamline the collection and management of lost items, a method is used to describe features from images and instantly create a database. Specifically, images of lost items are analyzed, their features are extracted, and the database is registered. This process is carried out using image analysis software and a database management system.

[0317] Furthermore, the system's revenue source is advertising revenue, reducing the burden on users. When a lost item is found, a notification is sent to the user, and a relevant advertisement is displayed on the notification screen. The advertisement is displayed according to the characteristics of the lost item and the user's situation, such as a key duplication service or store coupons.

[0318] The server is responsible for overseeing these processes. It receives notifications from the wireless communication chip, analyzes images of lost items, registers them in a database, and sends notifications to users. It also selects advertisements to display on the notification screen and provides useful information to users.

[0319] As a concrete example, consider the case where a user loses their keys in a store. When a key equipped with a wireless communication chip is found in the store, the server receives the information, analyzes the image of the key, and registers it in a database. Next, the server sends a notification to the user's device, displaying an advertisement for a key duplication service on the notification screen. This advertisement contains useful information, such as "You can also take advantage of a 20% off coupon right now!"

[0320] Examples of prompts include:

[0321] "A user lost their key in a store. Show them an ad for a key duplication service."

[0322] In this way, the system can efficiently manage and notify lost items, provide useful information to users, and earn advertising revenue.

[0323] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0324] Step 1:

[0325] A user carries an item equipped with a wireless communication chip. The wireless communication chip transmits the item's location information. The input is the location information of the wireless communication chip, and the output is the transmission of the item's location information.

[0326] Step 2:

[0327] If a user loses an item, the wireless communication chip sends a notification to the terminals of other users who pass nearby. The input is the signal from the wireless communication chip, and the output is the notification to the terminals of other users.

[0328] Step 3:

[0329] The terminal receives the notification from the wireless communication chip and transmits the information to the server. The input is the notification from the wireless communication chip, and the output is the transmission of the notification information to the server.

[0330] Step 4:

[0331] The server analyzes the image of the lost item based on the received notification information, extracts its features, and registers them in a database. The input is the notification information and the image of the lost item, and the output is the feature information of the lost item registered in the database.

[0332] Step 5:

[0333] The server notifies the user that the lost item has been found and displays a related advertisement on the notification screen. The input is the characteristic information of the lost item registered in the database and the advertisement information, and the output is the notification to the user's terminal and the display of the advertisement.

[0334] Step 6:

[0335] The user receives the notification and goes to the location where the lost item is to be collected. The input is the notification and advertisement displayed on the terminal, and the output is the user's behavior.

[0336] Step 7:

[0337] When a user receives a lost item, the server updates the information and deletes the corresponding lost item from the database. The input is the user's receipt confirmation information, and the output is an update to the database.

[0338] In this way, the system can efficiently manage and notify lost items, provide useful information to users, and earn advertising revenue.

[0339] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0340] "Example 1"

[0341] One embodiment of the present invention is a system that combines an emotion engine that recognizes a user's emotions. This system changes the alert notification method depending on the user's emotional state. Specifically, if the user feels happy or excited, the alert is notified using bright colors and cheerful music. On the other hand, if the user feels sad or anxious, the alert is notified using calm colors and gentle music. This enables a more appropriate notification method that takes the user's emotional state into consideration.

[0342] "Example 2"

[0343] Another embodiment is a system that combines an emotion engine that recognizes the user's emotions and optimizes the process of describing features from images and instantly creating a database based on the user's emotional state. Specifically, if the user feels excited or surprised, the system reflects that emotion and extracts more detailed features to create a database. On the other hand, if the user feels relaxed or at ease, the system reflects that emotion and extracts only the minimum necessary features to create a database. This enables more efficient database creation that takes the user's emotional state into account.

[0344] "Example 3"

[0345] Furthermore, as another embodiment, there is a system that combines an emotion engine that recognizes a user's emotions and changes the way advertisements are displayed depending on the user's emotional state, thereby improving the user experience. Specifically, if the user feels happy or excited, the system reflects that emotion by displaying advertisements using more vivid colors and dynamic animations. On the other hand, if the user feels sad or anxious, the system reflects that emotion by displaying advertisements using more muted colors and static animations. This enables more appropriate advertisement display that takes into account the user's emotional state, improving the user experience.

[0346] The processing flow of each embodiment will be described below.

[0347] "Example 1"

[0348] Step 1: Recognize the user's emotional state with the emotion engine.

[0349] Step 2: Determine how you want to be alerted based on your emotional state: bright colors and cheerful music for joyful or excited states, and calm colors and gentle music for sad or anxious states.

[0350] Step 3: Notify the user of the alert using the determined notification method.

[0351] "Example 2"

[0352] Step 1: Recognize the user's emotional state with the emotion engine.

[0353] Step 2: Optimize the process of describing features from images and instantly creating a database based on the recognized emotional state. More detailed features are extracted when the subject is excited or surprised, while only the minimum necessary features are extracted when the subject is relaxed or at ease.

[0354] Step 3: Optimized processing is used to extract features from the image and instantly create a database.

[0355] "Example 3"

[0356] Step 1: Recognize the user's emotional state with the emotion engine.

[0357] Step 2: Decide how to display the ad depending on the perceived emotional state: more vibrant colors and dynamic animations for happy and excited states, and more muted colors and static animations for sad and anxious states.

[0358] Step 3: The advertisement is displayed to the user in the determined display method.

[0359] Example 1

[0360] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0361] Conventional lost item discovery systems do not take into account the user's emotional state when finding an item, and do not provide appropriate notification methods. Furthermore, the process of receiving and managing lost items is cumbersome, placing a heavy burden on users. Furthermore, many systems require users to cover the system's operating costs, and a sustainable revenue model has not been established.

[0362] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0363] In this invention, the server includes: means for providing a wireless communication chip to an end user; means for issuing an alert to a terminal when the user passes near an item equipped with the wireless communication chip; means for locating the lost item by picking up the item and returning it to a specific location; and means for using an emotion recognition engine to recognize the emotional state of the user and changing the alert notification method according to the emotional state. This provides an appropriate notification method that takes the user's emotional state into consideration, improves the efficiency of collection and management of lost items, and enables the establishment of a sustainable revenue model.

[0364] A "wireless communication chip" is a small electronic component that operates with low power consumption and is used for wireless communication.

[0365] "Items" refers to personal items that are easily lost, such as keys and wallets.

[0366] "Terminal" refers to a mobile information terminal such as a smartphone or tablet used by a user.

[0367] An "alert" is a means of notifying the user, such as by sound, vibration, or on-screen notification.

[0368] An "emotion recognition engine" is software or hardware that analyzes a user's facial expressions and tone of voice to recognize their emotional state.

[0369] "Notification method" refers to the specific means or format for notifying the user of an alert.

[0370] A "specific location" is a designated location where the user can return the item they found, and includes, for example, the nearest store or public facility.

[0371] A "revenue model" is a business model for obtaining the income necessary to operate the system, including advertising revenue.

[0372] This invention is a system that provides end users with wireless communication chips, and when the user passes near an item with the wireless communication chip attached, an alert is sent to the terminal.Furthermore, by using an emotion recognition engine that recognizes the user's emotional state, the alert notification method can be changed depending on the emotional state, making it possible to provide more appropriate notifications to the user.

[0373] Hardware and Software Configuration

[0374] Wireless communication chip

[0375] The wireless communication chip is a small electronic component that operates with low power consumption and communicates via Bluetooth Low Energy (BLE), which enables the regular transmission of location information of an item.

[0376] Terminal

[0377] The device is a mobile information terminal such as a smartphone or tablet used by the user. A dedicated app is installed on the device, and this app receives signals from the wireless communication chip and generates an alert.

[0378] Emotion Recognition Engine

[0379] The emotion recognition engine analyzes the user's facial expressions and tone of voice using the camera and microphone installed on the user's smartphone. The emotion recognition engine uses, for example, a general emotion recognition API (for example, Microsoft's Azure Cognitive Services or Google's Cloud Vision API).

[0380] Data processing and calculation

[0381] Configuring and installing the wireless communication chip

[0382] Users attach a wireless communication chip to an item that is easily lost, such as keys or a wallet, and the wireless communication chip periodically transmits the item's location information to a terminal.

[0383] Installing and setting up the smartphone app

[0384] Users install a dedicated app on their smartphones, which receives signals from the wireless communication chip and generates alerts. The app is compatible with major mobile operating systems such as iOS and Android.

[0385] How the emotion recognition engine works

[0386] The device uses the camera and microphone on the user's smartphone to analyze the user's facial expressions and tone of voice. The emotion recognition engine sends this data to the emotion recognition API to analyze the user's emotional state.

[0387] Alert generation and notification

[0388] The device determines how to notify the alert based on the analysis results of the emotion recognition engine. For example, if the user is in a happy state, the alert will be notified with bright colors and cheerful music. Conversely, if the user is in a sad state, the alert will be notified with calm colors and gentle music.

[0389] Specific examples

[0390] Example 1: If you find a key

[0391] A user attaches a wireless communication chip to their house key. If the user drops the key while out and about, the device receives an alert when they pass by. The device uses an emotion recognition engine to analyze the user's facial expressions, and if it determines that the user is in a hurry, the device issues an alert with soft music and calming colors. The user receives the alert and picks up the key.

[0392] Example 2: If you find your wallet

[0393] A user installs a wireless communication chip in their wallet. The user forgets their wallet at a cafe, but when they return to the cafe, the device receives an alert. The device uses an emotion recognition engine to analyze the user's facial expressions, and if it determines that the user is happy, the alert is announced with bright colors and fun music. The user receives the alert and finds their wallet.

[0394] Prompt Sentence Examples

[0395] "Describe a system in which an emotion recognition engine analyzes the user's emotional state and provides appropriate alerts when the user loses their keys."

[0396] In this way, the system can provide alert notifications that take the user's emotional state into account, encouraging them to take more appropriate action.

[0397] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0398] Step 1:

[0399] The user attaches the wireless communication chip to an item that is easily lost, such as keys or a wallet. The user then turns on the wireless communication chip and pairs it with a smartphone app. The input requires the chip's ID and item information, and the output indicates that pairing is complete. Specifically, the user opens the Bluetooth settings on their smartphone, selects the wireless communication chip, and completes pairing.

[0400] Step 2:

[0401] The user installs a dedicated app on their smartphone. The app receives signals from the wireless communication chip and generates an alert. The input requires the app's download link and installation instructions, and the output is the app installed and initial setup completed. Specifically, the user downloads the app from the app store, installs it, and then performs initial setup.

[0402] Step 3:

[0403] The terminal receives a signal from the wireless communication chip. The input is a Bluetooth signal from the wireless communication chip, and the output is the location information of the item. Specifically, the terminal periodically scans for Bluetooth signals and receives signals from the wireless communication chip.

[0404] Step 4:

[0405] The device uses the camera and microphone installed on the user's smartphone to analyze the user's facial expressions and tone of voice. The input requires camera footage and audio data, and the output is the user's emotional state. Specifically, the device captures the user's face with the camera, records audio with the microphone, and sends this data to the emotion recognition API.

[0406] Step 5:

[0407] The device determines the alert notification method based on the analysis results of the emotion recognition engine. The input requires the user's emotional state and the location information of the item, and the output is an appropriate alert notification. Specifically, the device receives the results of the emotion recognition engine and follows the notification method set within the app, such as audio notification, vibration, or a pop-up notification on the screen.

[0408] Step 6:

[0409] When the user receives an alert from the device, they check the item in question. The input is the alert notification and the item's location information, and the output is the discovery and retrieval of the item. Specifically, the user checks the alert, searches the surrounding area to identify the item's location, and after finding the item, delivers it to the specified location.

[0410] (Application example 1)

[0411] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0412] Conventional lost property tracking systems have the problem that they do not take into account the user's emotional state when finding an item, and do not provide appropriate notification methods. There are also issues with the cumbersome process of receiving and managing lost items, which places a heavy burden on users. Furthermore, it was necessary to build a sustainable revenue model without imposing system operating costs on users.

[0413] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0414] In this invention, the server provides the end user with a wireless communication chip, and when the user passes near an item equipped with the wireless communication chip, a warning is issued to the terminal, allowing the user to pick up the item and return it to a specific location, thereby locating the lost item; a means for changing the method of issuing the warning notification depending on the user's emotional state using an emotion engine that recognizes the user's emotional state; a means for solving the issue of receiving and managing lost items by building a system that describes features from images and instantly creates a database; and a means for realizing a profit-sharing model between the company and the user, with revenue coming from advertising revenue rather than at the user's expense. This enables appropriate notifications based on the user's emotional state, streamlines the management of lost items, and enables the creation of a sustainable revenue model.

[0415] A "wireless communication chip" is a small device that uses wireless communication technology such as Bluetooth Low Energy (BLE) to transmit the location information of an item to a terminal.

[0416] "Articles" refer to objects that users use on a daily basis and that are easily lost, such as keys and wallets.

[0417] A "terminal" is an electronic device carried by a user, such as a smartphone or tablet, that has the function of receiving signals from a wireless communication chip and displaying a warning.

[0418] An "alert" is a notification that is displayed on the terminal, and notifies the user of the presence of an item in the form of a sound, vibration, on-screen message, or the like.

[0419] An "emotion engine" is software or hardware that recognizes a user's emotional state from facial expressions, voice, etc., and selects an appropriate notification method based on that information.

[0420] The "notification method" refers to the means by which the warning is communicated to the user, and includes formats such as sound, vibration, and on-screen messages.

[0421] "Database creation" is the process of extracting features from images and storing and managing that information as digital data.

[0422] "Advertising revenue" is a model that uses advertising fees from companies as a source of revenue to cover the system's operating costs.

[0423] The "profit sharing model" is a business model that aims to enable companies and users to mutually benefit from the operation of the system.

[0424] The following system configuration will be described as an embodiment of the present invention.

[0425] First, a user attaches a wireless communication chip to an item such as a key or wallet. This wireless communication chip uses Bluetooth Low Energy (BLE) technology to transmit the item's location information to a terminal. The terminal is a portable electronic device such as a smartphone or tablet that has the ability to receive signals from the wireless communication chip.

[0426] When the device receives a signal from the wireless communication chip, it notifies the user of a warning. This warning is displayed in the form of sound, vibration, or a message on the screen. Furthermore, the device is equipped with an emotion engine that recognizes the user's emotional state from facial expressions and voice. This emotion engine has the function of changing the method of warning notification depending on the user's emotional state.

[0427] For example, if the user is in a state of joy or excitement, the alert will be notified with bright colors and cheerful music. On the other hand, if the user is in a state of sadness or anxiety, the alert will be notified with calm colors and gentle music. This allows for appropriate notifications according to the user's emotional state.

[0428] In addition, for the collection and management of lost items, a system will be built that extracts features from images and instantly creates a database, which will make lost item management more efficient and reduce the burden on users.

[0429] Furthermore, this system uses a profit-sharing model, with advertising revenue as its revenue source. Users do not incur any fees for using the system, and the system is run by advertising revenue from companies. This allows both companies and users to benefit.

[0430] As a concrete example, consider a case where a user leaves their keys behind. When the user passes by the keys, the smartphone detects their presence and notifies them, "You forgot your keys." If the user is happy, the notification will be presented in bright colors and cheerful music. If the user is sad, the notification will be presented in calm colors and gentle music.

[0431] An example prompt is, "If a user leaves their keys behind, create a Python program that sends a notification when the smartphone passes near the keys. The notification will change depending on the user's emotional state. If the emotional state is joy, the notification will be in bright colors and cheerful music, and if the emotional state is sad, the notification will be in calm colors and gentle music."

[0432] The above is a specific embodiment for carrying out the present invention.

[0433] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0434] Step 1:

[0435] The terminal scans for signals from the wireless communication chip.

[0436] Input: BLE signal from wireless communication chip

[0437] Output: Wireless communication chip detection results

[0438] Specific operation: The terminal uses the Bluetooth module to scan surrounding BLE devices and detects signals from the wireless communication chip.

[0439] Step 2:

[0440] When the terminal receives the signal from the wireless communication chip, it activates an emotion engine to recognize the user's emotional state.

[0441] Input: Detection results from wireless communication chip, user facial expressions and voice data

[0442] Output: User's emotional state

[0443] How it works: The device uses a camera and microphone to capture the user's facial expressions and voice, and inputs them into the emotion engine, which then uses a generative AI model to analyze the user's emotional state.

[0444] Step 3:

[0445] The terminal selects an appropriate notification method depending on the user's emotional state.

[0446] Input: User's emotional state

[0447] Output: Notification method (audio, vibration, on-screen message, etc.)

[0448] Specific operation: Based on the analysis results of the emotion engine, the device decides how to notify the user. For example, if the user is happy, it will select bright colors and cheerful music, and if the user is sad, it will select calm colors and gentle music.

[0449] Step 4:

[0450] The terminal sends a warning to the user using the selected notification method.

[0451] Input: Notification method, detection result of wireless communication chip

[0452] Output: A warning notice to the user

[0453] Specific operation: The device will alert the user according to the selected notification method, such as sound, vibration, or a message on the screen. For example, it will display a message saying "You have forgotten your keys."

[0454] Step 5:

[0455] Once the user receives the alert, they can pick up the item and deliver it to a specific location.

[0456] Input: Warning Notification

[0457] Output: Collection and notification of items

[0458] Specific actions: The user checks the alert from the device, picks up the item, and delivers it to a specific location, such as the nearest store or public facility.

[0459] Step 6:

[0460] The server extracts features from the images and stores them in a database in order to receive and manage lost items.

[0461] Input: Image data of the item

[0462] Output: Database of lost property information

[0463] How it works: The server analyzes images of items, extracts features, and stores and manages them as digital data, making lost property management more efficient.

[0464] The above are the specific processing steps for carrying out the present invention.

[0465] Example 2

[0466] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0467] Conventional lost property management systems make it difficult to efficiently search and manage lost items, as receiving and managing lost items is time-consuming. Furthermore, no systems take into account the user's emotional state, leaving the user experience open to improvement. Furthermore, revenue sources are limited, making it difficult to build a sustainable business model.

[0468] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for taking an image of the lost item, a means for transmitting the taken image to the server, a means for the server to extract features of the item using image analysis technology, a means for registering the extracted features in a database, and a means for recognizing the emotional state of the user and adjusting the level of detail of the features extracted from the image depending on the emotional state. This enables efficient collection and management of lost items, feature extraction that takes the emotional state of the user into consideration, and the establishment of a sustainable business model.

[0469] "End user" means the final user of the system.

[0470] A "wireless communication chip" is a small electronic component that transmits and receives data using wireless communication technologies such as Bluetooth and Wi-Fi.

[0471] "Item" means any object that is treated as lost property.

[0472] A "terminal" is a device operated by a user, and includes smartphones, tablets, personal computers, etc.

[0473] An "alert" is a notification or warning that appears on a device when certain conditions are met.

[0474] A "server" is a computer system that processes and stores data on a network.

[0475] "Image analysis technology" refers to technology for extracting specific information from image data, and includes machine learning and computer vision.

[0476] "Features" are important attributes for identifying an item, such as its color, shape, size, brand logo, etc.

[0477] A "database" is a system for efficiently storing, searching, and managing data.

[0478] "Emotional state" refers to the user's psychological state, and includes excitement, surprise, relaxation, relief, and the like.

[0479] "Advertising revenue" refers to revenue earned by displaying advertisements.

[0480] A "profit-making model" is a business model that brings benefits to both the company and the users.

[0481] This invention is a system that improves the efficiency of receiving and managing lost items. It provides end users with a wireless communication chip, and when the user passes near an item with the wireless communication chip attached, an alert is sent to the terminal, and the lost item is found by picking up the item and returning it to a specific location. Furthermore, the system takes an image of the lost item, extracts the item's features using image analysis technology, and registers them in a database, making it easier to search for and manage lost items.

[0482] Hardware and software used

[0483] 1. Terminal

[0484] Use devices such as smartphones, tablets, and computers.

[0485] It is equipped with a camera that can take pictures.

[0486] It is equipped with wireless communication chips (Bluetooth and Wi-Fi).

[0487] 2. Server

[0488] A computer system is used for data processing and storage.

[0489] OpenCV and TensorFlow are used as image analysis software.

[0490] Use MySQL or MongoDB as the database.

[0491] 3. Software

[0492] Implement a program to extract features of an item using image analysis technology.

[0493] Uses emotion recognition engines (Microsoft Azure Emotion API and Google Cloud Vision API) to recognize the user's emotional state.

[0494] Specific operation of the system

[0495] 1. Receiving lost property

[0496] When a user brings in a lost item, the terminal takes a picture of the item.

[0497] For example, if a user brings a blue umbrella, the device will take a picture of the umbrella.

[0498] 2. Sending images

[0499] The device sends the captured image to the server.

[0500] Specifically, the image data is transmitted using an HTTP request.

[0501] 3. Image analysis and feature extraction

[0502] The server analyzes the image using OpenCV.

[0503] For example, features such as the color blue, the shape and size of the umbrella, and the brand logo are extracted from the image.

[0504] Organize the extracted features in JSON format.

[0505] 4. Registering in the database

[0506] The server connects to the MySQL database and registers the extracted features using INSERT statements.

[0507] 5. Search and Manage

[0508] A user inputs a search query on a terminal to search for lost property.

[0509] The server searches the database for the relevant lost property using a SELECT statement and sends the results to the terminal.

[0510] Specific operation of the system that combines the emotion engine

[0511] 1. User Emotion Recognition

[0512] The device analyzes the user's facial expressions using the Microsoft Azure Emotion API.

[0513] For example, if the user is excited, that information is acquired.

[0514] 2. Transmission of emotional information

[0515] The terminal transmits the user's emotion information to the server.

[0516] Specifically, emotion data is sent using HTTP requests.

[0517] 3. Emotion-based feature extraction

[0518] The server adjusts the level of detail of feature extraction depending on the user's emotional state.

[0519] For example, in the case of an excited state, more detailed features are extracted.

[0520] The server uses OpenCV to analyze the image and extract detailed features.

[0521] 4. Registering in the database

[0522] The server connects to a MongoDB database and registers the extracted features.

[0523] Specifically, we use the MongoDB insertOne method.

[0524] 5. Search and Manage

[0525] A user inputs a search query on a terminal to search for lost property.

[0526] The server searches the database for the relevant lost item using the find method and sends the results to the terminal.

[0527] Prompt Sentence Examples

[0528] "Generate a program that analyzes an image of a blue umbrella, extracts its color, shape, size, and brand logo, and stores them in a database."

[0529] "If a user brings a red wallet in an excited state, generate a program to extract detailed characteristics and register them in a database."

[0530] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0531] Step 1:

[0532] A user brings a lost item. For example, if the user brings a blue umbrella, the device takes a picture of the umbrella. The input is the physical shape of the lost item, and the output is the captured image data. Specifically, the device displays "Taking a picture of the umbrella," and the user presses the "Take" button.

[0533] Step 2:

[0534] The device sends the image it has taken to the server. The input is the captured image data, and the output is the image data sent to the server. Specifically, the device displays "Sending image" and sends the image data using an HTTP request.

[0535] Step 3:

[0536] The server analyzes the image using image analysis software (OpenCV or TensorFlow). The input is the image data sent to the server, and the output is the extracted feature data (color, shape, size, brand logo, etc.). Specifically, the server logs "Analyzing image" and uses image analysis technology to extract the features of the item.

[0537] Step 4:

[0538] The server registers the extracted features in a database (MySQL or MongoDB). The input is the extracted feature data, and the output is the feature data registered in the database. Specifically, the server logs "Registered in database" and registers the data in the database using the INSERT statement or insertOne method.

[0539] Step 5:

[0540] To search for lost items, a user inputs a search query into a terminal. The input is the search query entered by the user, and the output is the display of the search results. Specifically, the terminal displays "Please enter your search query," and the user inputs the search query.

[0541] Step 6:

[0542] The server searches the database for the relevant lost item and sends the results to the terminal. The input is the search query entered by the user, and the output is the search result data. Specifically, the server logs "Retrieving search results," retrieves the search results from the database using the SELECT statement or find method, and sends them to the terminal.

[0543] Step 7:

[0544] The terminal displays the search results to the user. The input is the search result data sent from the server, and the output is the search result displayed to the user. Specifically, the terminal displays "Search results are displayed" and displays a list of the relevant lost property information.

[0545] (Application example 2)

[0546] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0547] Conventional lost property management systems require complicated procedures for receiving and managing lost items, making efficient management particularly necessary in public places and businesses. Furthermore, the lack of database management that takes into account the user's emotional state places a significant burden on users. Furthermore, limited revenue sources make it difficult to build a sustainable business model.

[0548] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0549] In this invention, the server provides the end user with a wireless communication chip. When the user passes near an item equipped with the wireless communication chip, an alert is sent to the user's terminal. The user then picks up the item and returns it to a specific location, allowing the lost item to be found. The server also includes: a means for taking an image of the lost item upon receipt and extracting its characteristics (e.g., color, shape, size, brand logo, etc.) using image analysis technology; a means for registering the extracted characteristics in a database to facilitate the search and management of lost items; and a means for recognizing the user's emotional state and optimizing the process of instantly recording the characteristics from the image in accordance with the user's emotional state and creating a database. This enables efficient management of lost items and reduces the burden on users. Furthermore, by using advertising revenue as a revenue source, a profit-sharing model between the company and users can be realized, enabling the creation of a sustainable business model.

[0550] A "wireless communication chip" is a small electronic component that transmits and receives data using short-range wireless communication.

[0551] "Items" are objects that are managed as lost property and have characteristics such as color, shape, size, and brand logo.

[0552] A "terminal" is an electronic device used by a user, such as a smartphone or smart glasses, that receives a signal from the wireless communication chip and displays an alert.

[0553] An "alert" is a notification or warning that appears on a device, informing the user that a particular item is nearby.

[0554] "Image analysis technology" is a technology for extracting specific features from captured images, such as color, shape, size, and brand logos.

[0555] A "database" is a collection of information that registers extracted features and is used to search for and manage lost items.

[0556] "Emotional state" refers to the user's psychological state, and includes emotions such as excitement, surprise, relaxation, and relief.

[0557] "Advertising revenue" refers to the revenue earned by displaying advertisements provided by companies, and serves as operating funds for the system.

[0558] The "profit sharing model" is a business model in which companies and users mutually benefit, building a mutually beneficial relationship.

[0559] As an embodiment of the present invention, the following system is constructed.

[0560] System Overview

[0561] This system provides end users with a wireless communication chip. When the user passes near an item equipped with the chip, an alert is sent to the user's device, allowing the user to pick up the item and return it to a specific location, thereby finding the lost item. When the lost item is received, a photo of the item is taken and image analysis technology is used to extract the item's characteristics (color, shape, size, brand logo, etc.) and register them in a database. Furthermore, the system recognizes the user's emotional state, and optimizes the process of describing the characteristics from the image according to the user's emotional state and instantly creating a database.

[0562] Hardware and software used

[0563] Hardware:

[0564] Smartphones (e.g. iPhone, Android devices)

[0565] Smart glasses (e.g., Google Glass (registered trademark), Vuzix Blade)

[0566] software:

[0567] Image analysis libraries (e.g., OpenCV, TensorFlow)

[0568] Emotion recognition engine (e.g., Affectiva, Microsoft Azure Emotion API)

[0569] Database management systems (e.g. MySQL, PostgreSQL)

[0570] Data processing and calculation

[0571] Image capture and feature extraction

[0572] When a lost item is received, the device (smartphone or smart glasses) takes a picture of the item. The image is analyzed using OpenCV and TensorFlow to extract the item's features (color, shape, size, brand logo, etc.).

[0573] Database registration

[0574] The extracted features are then registered in a database management system such as MySQL or PostgreSQL, making it easier to search for and manage lost items.

[0575] Emotional state recognition and optimization

[0576] The system uses an emotion recognition engine (Affectiva or Microsoft Azure Emotion API) to analyze the user's emotional state. If the user is excited or surprised, the system extracts more detailed features and registers them in the database. On the other hand, if the user is relaxed or at ease, the system extracts only the minimum necessary features and registers them in the database.

[0577] Specific examples

[0578] For example, a station security officer can use smart glasses to take a photo of a lost bag. The system can then extract the bag's color, shape, and brand logo, and if the officer is excited, record the detailed characteristics into a database. When the owner returns to the station at a later date, they can enter the bag's characteristics using a smartphone app, which will identify a matching bag from the database and send a notification to the owner.

[0579] Prompt Sentence Examples

[0580] "Design a system where station security personnel use smart glasses to take a photo of a lost bag, and the system extracts the bag's color, shape, and brand logo and registers them in a database. When the owner visits, the system will input the bag's characteristics using a smartphone app, identify a matching bag from the database, and send a notification to the owner."

[0581] The above is an embodiment of the present invention.

[0582] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0583] Step 1:

[0584] When a lost item is received, the device (smartphone or smart glasses) takes an image of the item. The input is the image of the item, and the output is the captured image data. This image data is used for subsequent image analysis processing.

[0585] Step 2:

[0586] The device inputs the captured image data into an image analysis library (OpenCV or TensorFlow) to extract the features of the item (color, shape, size, brand logo, etc.). The input is the image data, and the output is the extracted feature data. This feature data is used to identify the item.

[0587] Step 3:

[0588] The device registers the extracted feature data in a database management system (MySQL or PostgreSQL). The input is feature data, and the output is feature information registered in the database. This makes it easier to search for and manage lost items.

[0589] Step 4:

[0590] The device uses an emotion recognition engine (Affectiva or Microsoft Azure Emotion API) to analyze the user's emotional state. The input is the user's facial expression and voice data, and the output is analyzed emotional state data. This emotional state data is used to optimize the subsequent feature extraction process.

[0591] Step 5:

[0592] The server optimizes the process of describing features from images and instantly creating a database based on emotional state data. The input is emotional state data and feature data, and the output is optimized feature data. When the user is excited or surprised, detailed features are extracted, and when the user is relaxed or at ease, only the minimum necessary features are extracted.

[0593] Step 6:

[0594] When a user searches for lost items, the device accesses the database and searches for lost items that match the input feature data. The input is the search query (feature data), and the output is the information of the matching lost items. This allows the user to quickly identify lost items.

[0595] Step 7:

[0596] If the owner is identified, the server sends a notification to the owner. The input is the matching lost item and the owner's contact information, and the output is a notification message so the owner can receive instructions on how to retrieve the lost item.

[0597] The above are the specific processing steps of the program of this system.

[0598] Example 3

[0599] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0600] In conventional lost property management systems, users are burdened with finding lost items, and the process of receiving and managing lost items is cumbersome. Furthermore, the system often requires users to bear the operating costs of the system, which results in a poor user experience. Furthermore, when advertising revenue is the source of income, advertisements are displayed without taking into account the user's emotional state, which can lead to a poor user experience.

[0601] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server provides a wireless communication module to an end user. When the user passes near an object equipped with the wireless communication module, an alert is sent to the terminal, and the lost item is found by the user picking up the object and returning it to a specific location. The server also includes a means for instantly creating a database by describing characteristics from an image, which is a key issue in the past when it comes to receiving and managing lost items. A means for balancing the interests of both companies and users by deriving revenue from advertising revenue rather than burdening the user. A means for recognizing the emotional state of the user using an emotion recognition engine and changing the display method of advertisements according to the emotional state. This reduces the burden on the user, streamlines lost item management, and improves the user experience while retaining advertising revenue as a source of income.

[0602] A "wireless communication module" is an electronic component for short-range wireless communication, which is attached to an object to transmit its location information.

[0603] A "terminal" is an electronic device used by a user, including a smartphone, tablet, or PC.

[0604] An "alert" is a notification or warning message that appears on a device when certain conditions are met.

[0605] The "Lost and Found Database" is a database system for storing and managing information about lost items.

[0606] An "emotion recognition engine" is software or hardware that analyzes a user's facial expressions, voice, and input data to recognize their emotional state.

[0607] "Advertising revenue" is revenue earned by displaying advertisements.

[0608] "Achieving a balance between the interests of companies and users" means that companies can earn profits while also providing information and services that are beneficial to users.

[0609] The "advertisement display method" refers to how the advertisement is displayed on the user's terminal, and includes visual elements such as color tone and animation.

[0610] The present invention provides a lost property management system that relies on advertising revenue as its revenue source, rather than on user fees, and improves the user experience by changing the way advertisements are displayed depending on the user's emotional state. The system includes a wireless communication module, a terminal, a server, and an emotion recognition engine.

[0611] First, a user carries an object equipped with a wireless communication module. The wireless communication module is an electronic component for short-range wireless communication, transmitting the object's location information. If the user loses the object, an alert will be displayed on the device when another user passes nearby. The device can be an electronic device such as a smartphone, tablet, or PC.

[0612] The server receives a request from a user and searches the lost property database. The lost property database is a database system for storing and managing information about lost items. The server selects appropriate advertisements based on the characteristics of the lost item and the user's search. Advertising revenue is the income earned by displaying advertisements.

[0613] Furthermore, the server recognizes the user's emotional state using an emotion recognition engine. An emotion recognition engine is software or hardware that analyzes the user's facial expressions, voice, and input data to recognize their emotional state. For example, Microsoft Azure's Emotion API or Google Cloud's Natural Language API can be used.

[0614] The server determines how to display the advertisement based on the results of the emotion recognition engine. If the user expresses joy, the server determines to display the advertisement with vibrant colors and dynamic animation. On the other hand, if the user expresses sadness or anxiety, the server determines to display the advertisement with muted colors and static animation.

[0615] As a concrete example, consider the case where a user accesses the system using a smartphone browser and searches for "keys." The server retrieves information related to "keys" from the lost property database and selects an advertisement for a key duplication service. When the emotion recognition engine recognizes the emotion of joy from the user's facial expression, the server decides to display the advertisement using vivid colors and dynamic animations. The server sends the advertisement to the user's smartphone, which then displays it on the screen.

[0616] An example of a prompt sentence might be:

[0617] "If a user visits your system to search for lost property, what kind of ads will be displayed? Also, explain how the ads will be displayed differently depending on the user's emotional state."

[0618] This system allows users to obtain useful information and companies to earn advertising revenue. Furthermore, the user experience is improved by displaying advertisements according to the user's emotional state. The flow of the identification process in Example 3 will be described with reference to FIG. 21.

[0619] Step 1:

[0620] A user accesses the system. The user accesses the system through a web browser or a mobile app. For example, the user opens a browser on their smartphone and enters the system's URL. The input is the user's access request, and the output is the system's homepage.

[0621] Step 2:

[0622] The server receives the user's request. The server receives the access request from the user and analyzes the information contained in the request. The input is the user's access request, and the output is the analyzed request information.

[0623] Step 3:

[0624] The server searches the lost property database. The server searches the lost property database based on the received request. For example, if a user searches for "key," the server retrieves lost property information related to "key" in the database. The input is the user's search query, and the output is the corresponding lost property information.

[0625] Step 4:

[0626] The server selects the advertisement. The server selects an appropriate advertisement based on the characteristics of the lost item and the user's search. For example, if a user searches for "key," an advertisement for a key duplication service will be selected. The input is the lost item information and the user's search query, and the output is the selected advertisement.

[0627] Step 5:

[0628] The server uses an emotion recognition engine to recognize the user's emotions. The server uses the emotion recognition engine to recognize the user's emotional state. The emotion recognition engine uses, for example, Microsoft Azure's Emotion API or Google Cloud's Natural Language API to analyze the user's facial expressions, voice, and input data. The input is the user's facial expression data and voice data, and the output is the recognized emotional state.

[0629] Step 6:

[0630] The server determines how to display an advertisement based on the emotion. The server determines how to display an advertisement based on the results of the emotion recognition engine. For example, if the user expresses the emotion of joy, the server determines to display an advertisement using vibrant colors and dynamic animations. The inputs are the recognized emotional state and the selected advertisement, and the output is the determined advertisement display method.

[0631] Step 7:

[0632] The server sends the advertisement to the terminal. The server then sends the determined advertisement and its display method to the user's terminal. The HTTP protocol is used for transmission. The input is the determined advertisement and display method, and the output is the advertisement sent to the user's terminal.

[0633] Step 8:

[0634] The terminal displays the advertisement. The terminal displays the advertisement received from the server on the screen. For example, an advertisement for a key duplication service is displayed on the screen of a user's smartphone in vivid colors and dynamic animation. The input is the advertisement sent from the server, and the output is the advertisement displayed on the screen.

[0635] (Application example 3)

[0636] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0637] In conventional lost property management systems, users had to bear a heavy burden in finding lost items, and the process of receiving and managing lost items was cumbersome. Furthermore, there was a lack of ingenuity to improve the user experience, and in particular, advertising effectiveness was limited because advertising was not displayed according to the user's emotional state.

[0638] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server provides an end user with a BLE chip, and when the user passes near an object with the BLE chip attached, an alert is issued to the terminal, and the object is picked up and delivered to a specific location. It also includes a means for describing characteristics from an image and instantly storing them in a database, a means for realizing a win-win model between the company and the user, with advertising revenue as the source of income rather than user burden, and a means for recognizing the user's emotional state and changing the display method of advertisements according to the emotion. This reduces the burden on the user, makes lost property management more efficient, and further improves the user experience by displaying advertisements according to the user's emotional state.

[0639] "End User" refers to the individual or organization that ultimately uses the system.

[0640] A "BLE chip" is a small wireless communication device that uses Bluetooth Low Energy technology and is used to provide location information for objects.

[0641] An "alert" is a warning or caution message that notifies the user when a specific condition is met.

[0642] "Terminal" refers to an electronic device used by a user, such as a computer, smartphone, or tablet.

[0643] "Database creation" refers to organizing information and registering it in a database so that it is easy to search and manage.

[0644] "Advertising revenue" refers to revenue earned by displaying advertisements.

[0645] A "win-win model" refers to a business model in which all parties involved can benefit.

[0646] "Emotional state" refers to a user's current psychological state or mood.

[0647] "Advertisement display method" refers to the specific method or format for displaying an advertisement to a user.

[0648] "User experience" refers to the overall satisfaction and ease of use that a user feels when using a system or service.

[0649] The following system configuration will be described as an embodiment of the present invention.

[0650] System Configuration

[0651] Hardware

[0652] Smartphone: A device carried by the user, equipped with a camera and BLE communication functions.

[0653] BLE chip: A small wireless communication device that can be attached to lost property.

[0654] Server: A central system that manages databases and distributes advertisements.

[0655] software

[0656] OpenCV: An image processing library used to preprocess the user's facial images.

[0657] Keras: A deep learning library used to run emotion recognition models.

[0658] Flask: A web application framework used to perform server-side processing.

[0659] Program processing explanation

[0660] emotion recognition

[0661] The server receives a user's facial image captured by the smartphone camera, converts the image to grayscale using OpenCV, resizes it to 48x48 pixels, and then runs a pre-trained emotion recognition model using Keras to predict the user's emotional state.

[0662] Advertisement display

[0663] The server selects an appropriate advertisement based on the results of emotion recognition. For example, if the user is excited, it selects an advertisement with vibrant colors and dynamic animations, and if the user is calm, it selects a static advertisement. The selected advertisement is then displayed on the smartphone screen.

[0664] Specific examples

[0665] When a user is browsing a product in a physical store, the system captures their face with a smartphone camera and performs emotion recognition: if the user is excited, it displays a vibrant coupon, and if the user is calm, it displays a static advertisement.

[0666] Prompt Sentence Examples

[0667] While a user is browsing a store, the system captures their face with a smartphone camera and performs emotion recognition: if the user is excited, it displays a brightly colored coupon; if the user is calm, it displays a static advertisement.

[0668] This reduces the burden on users, makes lost property management more efficient, and further improves the user experience by displaying advertisements according to the user's emotional state.

[0669] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0670] Step 1:

[0671] When a user is searching for a product in a physical store, a facial image is captured using the camera on the device (smartphone). The input is the user's facial image, and the output is the captured image data. Specifically, the device's camera app starts up and takes a picture of the user's face.

[0672] Step 2:

[0673] The device sends the captured facial image to the server. The input is the captured image data, and the output is the image data sent to the server. In concrete terms, the device application sends the image data to the server as an HTTP request.

[0674] Step 3:

[0675] The server converts the received facial image to grayscale using OpenCV and resizes it to 48x48 pixels. The input is the image data sent to the server, and the output is the preprocessed image data. Specifically, the server calls OpenCV functions to process the image.

[0676] Step 4:

[0677] The server inputs the preprocessed image data into an emotion recognition model using Keras to predict the user's emotional state. The input is the preprocessed image data, and the output is the emotion recognition result (emotion label). Specifically, the server loads the Keras model and performs prediction.

[0678] Step 5:

[0679] The server selects an appropriate advertisement based on the emotion recognition results. The input is the emotion recognition result (emotion label), and the output is the selected advertisement data. Specifically, the server performs conditional branching and retrieves advertisements corresponding to the emotion labels from the database.

[0680] Step 6:

[0681] The server sends the selected advertising data to the terminal. The input is the selected advertising data, and the output is the advertising data sent to the terminal. In concrete terms, the server application sends the advertising data to the terminal as an HTTP response.

[0682] Step 7:

[0683] The terminal displays the received advertising data to the user. The input is the advertising data sent from the server, and the output is the advertisement displayed on the terminal screen. Specifically, the terminal application analyzes the advertising data and displays it on the screen.

[0684] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0685] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0686] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[0687] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0688] [Second embodiment]

[0689] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0690] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0691] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0692] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0693] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0694] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0695] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0696] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0697] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0698] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0699] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0700] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0701] "Example 1"

[0702] The present invention provides end users with a BLE chip. This BLE chip is attached to an item that is easily lost, such as keys or a wallet. When a user passes by an item with the chip attached, an alert is sent to the user's device, such as a smartphone. The alert is communicated to the user by, for example, sound, vibration, or a notification on the screen. When the user receives the alert, they pick up the item and deliver it to a specific location (for example, the nearest store or public facility).

[0703] "Example 2"

[0704] The system of the present invention describes features from images and instantly creates a database to streamline the collection and management of lost items. Specifically, when a lost item is collected, an image of the item is taken and image analysis technology is used to extract the item's features (e.g., color, shape, size, brand logo, etc.). The extracted features are registered in a database, making it easier to search for and manage lost items.

[0705] "Example 3"

[0706] The system of this invention is not charged to the user, and its revenue comes from advertising. Specifically, advertisements are displayed on each screen of the system, such as the alert notification screen and the lost property database screen. The advertisements provide useful information to the user, such as coupons for the store where the lost item was delivered, or advertisements related to the characteristics of the lost item (for example, an advertisement for a key duplication service for a key). This creates a win-win model for both the company and the user.

[0707] The processing flow of each embodiment will be described below.

[0708] "Example 1"

[0709] Step 1: Provide the end user with a BLE chip, which they attach to an easily lost item, such as a key or wallet.

[0710] Step 2: When a user passes by an object equipped with a chip, an alert is sent to the user's smartphone or other device. The alert can be conveyed to the user through a sound, vibration, or on-screen notification, for example.

[0711] Step 3: When the user receives the alert, they pick up the item and deliver it to a specific location (e.g., the nearest store or public facility).

[0712] "Example 2"

[0713] Step 1: To streamline the collection and management of lost items, we take a photo of the item and instantly create a database based on its characteristics.

[0714] .

[0715] Step 2: Image analysis technology is used to extract the features of the item (e.g., color, shape, size, brand logo, etc.). The extracted features are registered in a database to facilitate the search and management of lost property.

[0716] "Example 3"

[0717] Step 1: The system of the present invention is not charged to users, and its revenue source is advertising revenue. Specifically, advertisements are displayed on each screen of the system, such as the alert notification screen and the lost property database screen.

[0718] Step 2: Advertisements provide useful information to users, such as coupons for the store where the lost item was delivered or advertisements related to the characteristics of the lost item (for example, an advertisement for a key duplication service for a key). This creates a win-win situation for both companies and users.

[0719] Example 1

[0720] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0721] Conventional lost property management systems require users to manually enter information when an item is lost or found, which is time-consuming and often inaccurate. Furthermore, the process of receiving and managing lost items is cumbersome, placing a heavy burden on users. Furthermore, the system's operating costs are high, and there is no established revenue model, making sustainable operation difficult.

[0722] The identification process by the identification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes means for providing a wireless communication chip to an end user and issuing a warning to the terminal when the user passes near an item equipped with the wireless communication chip, means for picking up the item and delivering it to a specific location, means for the terminal to scan the signal from the wireless communication chip and transmit signal information to the server, and means for the server to transmit a warning to the terminal based on the signal information. This allows the user to automatically receive a warning when the item is lost and respond quickly. In addition, the collection and management of lost items are made more efficient, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, sustainable operation is possible.

[0723] "End user" means the final user of the system.

[0724] A "wireless communication chip" is a small electronic device that transmits signals using wireless communication technologies such as Bluetooth Low Energy (BLE).

[0725] "Items" are personal belongings or possessions that are easily lost by the user, such as keys or wallets.

[0726] A "terminal" is an electronic device such as a smartphone or tablet that a user owns.

[0727] An "alert" is an alert such as a sound, vibration, or on-screen notification that appears on the device.

[0728] A "server" is a computer system for receiving and analyzing signal information and sending alerts to terminals.

[0729] "Signal information" refers to data such as the ID, detection time, and location information transmitted from the wireless communication chip.

[0730] A "specific location" is a designated location such as a store or public facility where a user can return a found item.

[0731] "Advertising revenue" refers to revenue from advertising received from companies to cover the operating costs of the system.

[0732] The "profit sharing model" is a business model in which companies and users mutually benefit.

[0733] This invention provides a system in which an end user is provided with a wireless communication chip, and when the user passes near an article to which the wireless communication chip is attached, a warning is issued on a terminal. Specific embodiments of this system will be described below.

[0734] Hardware and software used

[0735] This system uses the following hardware and software:

[0736] Hardware: Wireless communication chips (e.g., Bluetooth Low Energy chips), smartphones (e.g., iPhones, Android devices)

[0737] Software: Smartphone applications (e.g., dedicated app "FindMyItem"), servers (e.g., cloud services)

[0738] Program processing

[0739] The server maintains a database that manages the ID and location information of the wireless communication chip. The device (user's smartphone) runs an application that receives signals from the wireless communication chip. When this application detects a signal from the wireless communication chip, it sends the information to the server. The server then sends a warning to the user's smartphone based on the received information.

[0740] Specifically, the following process occurs:

[0741] 1. The user attaches a wireless communication chip to an item such as a key or wallet.

[0742] 2. An application installed on the user's smartphone scans for signals from the wireless communication chip.

[0743] 3. When the smartphone detects the signal from the wireless communication chip, it sends the information to the server.

[0744] 4. The server sends an alert to the user's smartphone based on the received information.

[0745] 5. Once the user receives the alert, they can pick up the item and deliver it to a specific location.

[0746] Specific examples

[0747] As a concrete example, consider the case where a user has attached a wireless communication chip to a key. If the user drops the key, and another user passes by the key, a warning message will appear on the user's smartphone. The message will read, "Your key has been dropped. Please return it to the nearest store."

[0748] Example prompts for generative AI models

[0749] "Please create a program for an item tracking system that uses a wireless communication chip. In this system, a user attaches a wireless communication chip to an item such as a key or wallet, and the signal is received by the user's smartphone and sent to a server. The server then sends an alert to the user's smartphone based on the received information. The hardware used is a Bluetooth Low Energy chip, and the smartphone is an iPhone or Android device. The smartphone application is "FindMyItem," and the server uses a cloud service."

[0750] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0751] Step 1:

[0752] A user attaches a wireless communication chip to an item such as a key or wallet. The wireless communication chip periodically transmits location information of the attached item. The input is the attachment of the wireless communication chip, and the output is the state in which the item has the wireless communication chip.

[0753] Step 2:

[0754] The user installs the dedicated app "FindMyItem" on their smartphone and launches it. The app performs pairing settings for the wireless communication chip when launched for the first time. The input is the installation and launch of the app, and the output is the completion of pairing between the wireless communication chip and smartphone.

[0755] Step 3:

[0756] The device (smartphone) periodically scans for signals from the wireless communication chip through the app. The scan is performed in the background and does not require user interaction. The input is the signal from the wireless communication chip, and the output is the signal detection information.

[0757] Step 4:

[0758] When a terminal detects a signal from a wireless communication chip, it sends the signal information (chip ID, detection time, location information, etc.) to the server. The input is the signal detection information, and the output is the transmission of the signal information to the server.

[0759] Step 5:

[0760] The server generates a warning message for the user's smartphone based on the received signal information. The warning message includes the type of item and its location. The input is the signal information, and the output is a warning message.

[0761] Step 6:

[0762] The terminal (smartphone) receives a warning from the server. The warning is communicated to the user by sound, vibration, on-screen notification, etc. The input is the warning message, and the output is the notification to the user.

[0763] Step 7:

[0764] The user confirms the warning, picks up the item, and delivers it to a specific location (e.g., the nearest store or public facility). The input is confirmation of the warning, and the output is picking up and reporting the item.

[0765] (Application example 1)

[0766] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0767] The present invention relates to a system that tracks items that are easily lost, such as keys or wallets, and sends an alert when a user passes near the item. Conventional systems have insufficient notification when an item leaves a specific area or management of the item's location history, making it difficult for users to respond when they lose an item. Furthermore, there are issues with the cumbersome process of receiving and managing lost items, which places a heavy burden on users. Furthermore, limited revenue sources make it difficult to build a sustainable business model.

[0768] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0769] In this invention, the server provides an end user with a BLE chip, and includes a means for alerting the user's device when the user passes near an item equipped with the BLE chip; a means for picking up the item and delivering it to a specific location; a means for notifying the user when the item leaves a specific area; and a means for storing the item's location history in the cloud and enabling the user to check its past location. This reduces the risk of losing an item, enables the user to track the item's location in real time, and allows for quick response when the item leaves a specific area. Furthermore, the system streamlines the collection and management of lost items, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, a sustainable business model can be realized that balances the interests of both the company and the user.

[0770] "End User" means the individual or organization that ultimately uses a product or service.

[0771] A "BLE chip" is a small communication device that uses Bluetooth Low Energy technology and is capable of wireless communication with low power consumption.

[0772] An "item" refers to a concrete object, such as a key or a wallet, that has a particular purpose or value.

[0773] A "terminal" refers to an electronic device such as a smartphone or tablet, which is a device that allows a user to receive and operate information.

[0774] An "alert" is a notification to alert the user, and is provided in the form of a sound, vibration, on-screen notification, or the like.

[0775] A "specific location" refers to the location where the item should be returned after being picked up, such as the nearest store or public facility.

[0776] A "specific area" refers to the location where the item is normally located, such as a home or office.

[0777] A "notification" is a message that conveys information to the user and is provided via the terminal.

[0778] "Location history" is data that records the past location information of an item and is stored in the cloud.

[0779] The "cloud" is a collection of remote servers provided over the Internet, and is an infrastructure for storing and processing data.

[0780] "Advertising revenue" refers to revenue earned by displaying advertisements and is used as part of a business model.

[0781] A "profit-making model" refers to a business model that benefits both the company and the users, and is operated in a sustainable manner.

[0782] A system for implementing this invention includes a BLE chip provided to an end user, a terminal such as a user's smartphone, and a cloud server. The specific configuration and operation of the system are described below.

[0783] Hardware and Software Configuration

[0784] 1. Hardware:

[0785] Smartphone: iOS or Android device

[0786] BLE chip: For example, Nordic Semiconductor's nRF52840

[0787] Cloud Server: A remote server for data storage and processing

[0788] 2. Software:

[0789] Smartphone applications: developed in Swift for iOS and Kotlin for Android

[0790] BLE communication library: CoreBluetooth for iOS, Android BLE API for Android

[0791] Cloud backend: For example, using Firebase

[0792] System Operation

[0793] 1. Providing and installing the BLE chip

[0794] The server provides BLE chips to end users, who then attach them to items that are easily lost, such as keys or wallets.

[0795] 2. Item tracking and alert notifications

[0796] When a user passes near an item equipped with a BLE chip, the device receives the signal from the BLE chip and measures the signal strength (RSSI). Based on the signal strength, the device estimates the distance to the item and sends an alert to the device if the item is nearby. The alert can be in the form of a sound, vibration, or on-screen notification.

[0797] 3. Notifications when you leave a specific area

[0798] When an item leaves a specific area (e.g., home or office), the device sends location information to a cloud server, and the server notifies the user.

[0799] 4. Location History Management

[0800] The location history of the item is stored on a cloud server, allowing users to check its past location, thereby reducing the risk of losing the item.

[0801] Specific examples

[0802] For example, if a user loses their keys, an alert will be sent to their smartphone when they pass by a key equipped with a BLE chip. The alert will be communicated to the user through audio, vibration, and on-screen notifications. It will also notify the user if the key is left at home or in the office.

[0803] Prompt Sentence Examples

[0804] If a user loses their keys, develop an application that sends an alert to their smartphone when they pass by a key equipped with a BLE chip. The alert will be communicated to the user through sound, vibration, and on-screen notification. It will also notify the user if the key is left at home or office.

[0805] This system significantly reduces the risk of losing important items for users. It also streamlines the collection and management of lost items, reducing the burden on users. Furthermore, by using advertising revenue as a source of income, it is possible to realize a sustainable business model that balances the interests of both the company and users.

[0806] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0807] Step 1:

[0808] The server provides the BLE chip to the end user, who then attaches the BLE chip to an easily lost item such as a key or wallet. The inputs are the BLE chip and the item, and the output is the item with the BLE chip attached.

[0809] Step 2:

[0810] The device receives signals from the BLE chip. The input is the signal from the BLE chip, and the output is the signal strength (RSSI). The device receives signals using a BLE communication library (CoreBluetooth for iOS, Android BLE API for Android).

[0811] Step 3:

[0812] The terminal estimates the distance of the item based on the signal strength. The input is the signal strength (RSSI) and the output is the estimated distance of the item. The terminal analyzes the signal strength and determines whether the item is nearby.

[0813] Step 4:

[0814] If an item is nearby, the device sends an alert to the user. The input is the estimated distance of the item, and the output is the alert notification. The alert can be in the form of a sound, vibration, or on-screen notification.

[0815] Step 5:

[0816] When an item leaves a specific area, the device sends its location information to the cloud server. The input is the item's location information, and the output is data transmission to the cloud server. The device determines the location of the item using location services such as GPS and Wi-Fi.

[0817] Step 6:

[0818] The cloud server notifies the user when an item leaves a specific area. The input is the item's location information, and the output is a notification message. The server generates a notification based on the user's settings and sends it to the device.

[0819] Step 7:

[0820] The cloud server stores the location history of the item. The input is the location information of the item, and the output is the location history data. The server stores the location information in a database, allowing users to check the past locations.

[0821] Step 8:

[0822] The user checks the location history of an item through a smartphone application. The input is the location history data, and the output is a display of the location history. The user can view past location information using the application interface.

[0823] In this way, the system reduces the risk of losing items and helps users find them quickly. It also streamlines the collection and management of lost items, reducing the burden on users. Furthermore, by using advertising revenue as a revenue source, it can realize a sustainable business model that balances the interests of both the company and users.

[0824] Example 2

[0825] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0826] In conventional lost property management systems, the process of receiving and managing lost items was cumbersome, making efficient search and management difficult. The burden on users to find lost items was also heavy, making the overall system operation inefficient. Furthermore, revenue sources were limited, and a sustainable operating model had not been established.

[0827] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server provides a wireless communication module to an end user. When the user passes near an item equipped with the wireless communication module, an alert is generated on the terminal. The user then picks up the item and returns it to a specific location to find the lost item. It also includes: a means for taking an image of the item using the terminal when the lost item is received; a means for the server to analyze the received image and extract features of the item; a means for registering the extracted features in a database; and a means for the user to send search criteria from the terminal to the server when searching for a lost item, and for the server to search the database and return information on lost items matching the criteria to the terminal. This improves the efficiency of receiving and managing lost items, allowing users to easily search for and find lost items. Furthermore, by using advertising revenue as a source of income, a sustainable operational model is realized, enabling companies and users to share profits.

[0828] A "wireless communication module" is an electronic component for transmitting and receiving data using short-range wireless communication.

[0829] A "terminal" is an electronic device that can be operated by a user and that has a camera and communication functions.

[0830] A "server" is a computer system that processes and stores data over a network.

[0831] "Image analysis" is a technique for extracting specific information or features from captured image data.

[0832] "Feature extraction" is the process of identifying characteristics such as the color, shape, size, and brand logo of an object from information obtained through image analysis.

[0833] A "database" is a system for efficiently storing, searching, and managing data.

[0834] "Search criteria" are the particular criteria or parameters a user specifies when searching for lost property.

[0835] An "alert" is a notification or warning that appears on a device when certain conditions are met.

[0836] "Advertising revenue" refers to revenue earned by displaying advertisements.

[0837] The "profit sharing model" is a business model in which companies and users can mutually benefit from each other.

[0838] The present invention is a system for efficiently receiving and managing lost property. A specific embodiment of this system will be described below.

[0839] Hardware and Software Configuration

[0840] Terminal

[0841] The device operated by the user is equipped with a high-resolution camera and internet connectivity, and serves the purpose of taking pictures of lost items and sending the image data to a server.

[0842] server

[0843] The server has image analysis software such as "OpenCV" and "TensorFlow" installed. Using this software, the server analyzes the received image data and extracts the features of the items. The server also has database management systems such as "MySQL" and "PostgreSQL" installed, and the extracted features are registered in a database.

[0844] Data processing and calculation

[0845] Image analysis

[0846] When the server analyzes the received image data, it first pre-processes the image. Specifically, it removes noise from the image and emphasizes the outlines of the item. Next, it uses image analysis software to extract the item's features. These features include color, shape, size, brand logo, etc.

[0847] Feature Extraction

[0848] The server identifies the features of the item from the information obtained through image analysis, such as the wallet's color (black), shape (rectangle), and brand logo (specific brand name).

[0849] Registering in the database

[0850] The server registers the extracted features in a database, which makes it easier to search and manage lost property. The database efficiently stores the item's feature information and allows it to be searched as needed.

[0851] Specific examples

[0852] Receiving and registering lost property

[0853] Suppose a user finds a black, rectangular brand-name wallet at a train station. The user takes a picture of the wallet using the device's camera, and the device sends the image to a server. The server uses image analysis software to extract the wallet's color (black), shape (rectangle), and brand logo, and registers these features in a database.

[0854] Lost property search

[0855] Suppose a user is looking for a black rectangular brand wallet. The user sends the search criteria "black rectangular brand wallet" to the server from their device. The server searches the database and returns information about lost property that matches the criteria to the device. For example, the server verifies that "black rectangular brand wallet" is registered and provides that information to the user.

[0856] Prompt Sentence Examples

[0857] Examples of prompts to be input to a generative AI model include:

[0858] "I'm looking for a black rectangular designer wallet. It may have been recently found at a station. Could you please tell me the details of the lost property?"

[0859] By inputting this prompt into the generative AI model, information about the relevant lost item can be efficiently obtained.

[0860] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0861] Step 1: Take a photo of the lost item

[0862] When a user receives a lost item, they use the device to take a picture of the item. The device is equipped with a high-resolution camera that can capture detailed images of the item. For example, if a user finds a wallet at a train station, they can use the device's camera to take a picture of the wallet. The input is the actual item, and the output is high-resolution image data.

[0863] Step 2: Sending image data

[0864] The device sends the captured image data to the server. The device has an internet connection and can quickly upload the image data to the server. For example, the device sends the image data to the server using Wi-Fi or mobile data communication. The input is high-resolution image data, and the output is the image data sent to the server.

[0865] Step 3: Image analysis

[0866] The server analyzes the image data it receives. Image analysis software such as "OpenCV" and "TensorFlow" is installed on the server. This software is used to perform preprocessing to extract the features of the item from the image. For example, the server removes noise from the image and emphasizes the outline of the item. The input is the image data sent to the server, and the output is the preprocessed image data.

[0867] Step 4: Feature extraction

[0868] The server uses image analysis software to extract features of an item. Specifically, it obtains information such as color, shape, size, and brand logo. For example, the server extracts the color (black), shape (rectangle), and brand logo of a wallet. The input is preprocessed image data, and the output is extracted feature data.

[0869] Step 5: Register with the database

[0870] The server registers the extracted features in a database. "MySQL" or "PostgreSQL" is used for the database. The registered data is used to search for and manage lost property. For example, the server stores the feature "black rectangular brand wallet" in the database. The input is the extracted feature data, and the output is the feature data registered in the database.

[0871] Step 6: Search for lost property

[0872] When a user searches for lost property, they send search criteria from their device to the server. The server searches the database and returns information about lost property that matches the criteria to the device. For example, if a user enters "black rectangular brand wallet" as a search criterion, the server searches the database and returns information about the corresponding lost property. The input is the search criteria specified by the user, and the output is information about lost property that matches the criteria.

[0873] (Application example 2)

[0874] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0875] In conventional lost property management systems, the process of receiving and managing lost items is cumbersome, and it is particularly difficult to accurately grasp the characteristics of the items and quickly search and identify them.In addition, the burden on users to find lost items is heavy, so efficient management is required.

[0876] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a wireless communication chip to an end user, an alert being issued to the terminal when the user passes near an item equipped with the wireless communication chip, and the device picking up the item and delivering it to a specific location, means for taking an image of the lost item and extracting characteristics of the item using image analysis technology, means for registering the extracted characteristics in a cloud database, means for providing a lost item search function and for quickly identifying the lost item based on the characteristics, and means for providing a function for notifying the location and time of collection of the lost item. This improves the efficiency of collection and management of lost items, reduces the burden on users, and enables the lost item to be identified quickly and accurately.

[0877] A "wireless communication chip" is a small electronic component that transmits and receives data using short-range wireless communication.

[0878] An "article" is a physical object that has certain characteristics.

[0879] A "terminal" is an electronic device that is operated by a user, and includes smartphones, tablets, and the like.

[0880] An "alert" is a warning or caution signal that notifies the user when a specific condition is met.

[0881] "Image analysis technology" is a technology for extracting specific information or features from image data.

[0882] A "cloud database" is a database that can be accessed via the Internet and is a system for storing and managing data.

[0883] A "search function" is a function for finding information within a database based on specific conditions or keywords.

[0884] The "notification function" is a function for notifying the user of information when a specific event or condition occurs.

[0885] A system for implementing the present invention is configured as follows.

[0886] First, the user carries an item equipped with a wireless communication chip, and when the user passes by the item, an alert appears on the device, allowing the user to pick up the item and deliver it to a specific location.

[0887] Next, when the lost item is delivered to a specific location, the device takes a picture of the lost item. This picture is analyzed using image analysis technology to extract the item's features (e.g., color, shape, size, brand logo, etc.). Image analysis is performed using OpenCV and TensorFlow.

[0888] The extracted features are registered in a cloud database using Firebase, and are later used to search for lost items.

[0889] When a user searches for a lost item, the device accesses the cloud database and quickly identifies the lost item based on its characteristics. The search function allows users to find information in the database based on specific criteria or keywords.

[0890] Additionally, a notification function for the location and time of lost property pickup is also provided, allowing users to know the best place and time to pick up their lost property.

[0891] As a concrete example, consider the case where a medium-sized, round, red brand-name hat is reported as lost property. The user takes a picture of the lost item with their device and extracts its features using image analysis technology. The extracted features are registered in a cloud database, and the user can quickly identify the lost item by searching for "red hat."

[0892] An example of a prompt is as follows:

[0893] "Please upload an image of your lost item. Please also provide details about the item (color, shape, size, brand)."

[0894] In this way, the receipt and management of lost items is made more efficient, reducing the burden on users and enabling lost items to be identified quickly and accurately.

[0895] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0896] Step 1:

[0897] A user carries an item equipped with a wireless communication chip. The wireless communication chip is a small electronic component that transmits and receives data using short-range wireless communication. When the user passes near the item, an alert is displayed on the terminal. The input is a signal from the wireless communication chip, and the output is the alert displayed on the terminal.

[0898] Step 2:

[0899] The user receives an alert, picks up an item, and delivers it to a specific location. The input is the alert displayed on the terminal, and the output is that the item has been delivered to a specific location. The user picks up the item and takes it to the specified location.

[0900] Step 3:

[0901] The device takes an image of the lost item. The input is the item picked up by the user, and the output is the captured image. The device's camera function is used to take an image of the lost item.

[0902] Step 4:

[0903] The device uses image analysis technology to extract features of an item. The input is the captured image, and the output is the extracted features. OpenCV and TensorFlow are used for image analysis. The image is preprocessed, and data processing and calculation are performed to extract features.

[0904] Step 5:

[0905] The server registers the extracted features in a cloud database. The input is the extracted features, and the output is the data registered in the cloud database. Firebase is used to save the feature data in the database.

[0906] Step 6:

[0907] When a user searches for a lost item, the device accesses the cloud database and quickly identifies the lost item based on its characteristics. The input is the search criteria entered by the user, and the output is the search results. The search function is used to find information in the database based on specific criteria or keywords.

[0908] Step 7:

[0909] The server provides a notification function for the location and time of collection of lost items. The input is the search result, and the output is the information of the location and time of collection notified to the user. The notification function is used to inform the user of the optimal location and time of collection.

[0910] In this way, the receipt and management of lost items is made more efficient, reducing the burden on users and enabling lost items to be identified quickly and accurately.

[0911] Example 3

[0912] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0913] Conventional lost property management systems lacked the functionality to display relevant advertisements when users reported or searched for lost items, making it impossible to provide useful information to users. Furthermore, the process of receiving and managing lost items was cumbersome, placing a heavy burden on users. Furthermore, many systems required users to bear the system's operating costs, making it difficult to promote user adoption.

[0914] The identification process by the identification processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means. In this invention, the server includes: means for providing an interface for a user to report a lost item; means for the server to store lost item information in a database; means for the server to select relevant advertisements based on the characteristics of the lost item; means for the terminal to display advertisements on a lost item report screen; means for providing an interface for a user to search for a lost item; means for the server to obtain search results from the database; means for the server to select relevant advertisements based on search keywords; and means for the terminal to display advertisements on a search result screen. This allows relevant advertisements to be displayed when a user reports or searches for a lost item, providing useful information to the user. Furthermore, the efficiency of receiving and managing lost items is improved, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, the burden on the user is reduced, and a profit-sharing model between the company and the user can be realized.

[0915] A "wireless communication module" is an electronic component for short-range wireless communication, and when attached to an item, has the function of transmitting its location information to a terminal.

[0916] "Item" means any object owned by a User that may be reported as lost or found.

[0917] A "terminal" is an electronic device used by a user, such as a smartphone or a personal computer.

[0918] An "alert" is a signal or message that notifies the user that a lost item is nearby.

[0919] "Interface" refers to the screens and controls that allow users to interact with the system, such as reporting lost items and searching for them.

[0920] A "server" is a computer system for storing and processing data, and for managing lost property information and advertising information.

[0921] A "database" is a system for systematically storing and managing information, and stores lost property information and advertising information.

[0922] "Advertisement" means commercial information provided to the user that advertises services or products related to the characteristics of the lost item.

[0923] "Search keywords" are words or phrases that a user enters when searching for lost property, and which allow the server to retrieve relevant information from the database.

[0924] The "profit sharing model" is a business model that uses advertising revenue as a source of income in operating a system, reducing the burden on users while bringing benefits to both companies and users.

[0925] The present invention provides a system for displaying related advertisements when a user reports or searches for lost items. The system includes a wireless communication module, a terminal, a server, a database, and an advertisement management function.

[0926] First, a user owns an item equipped with a wireless communication module. The wireless communication module is an electronic component for short-range wireless communication and has the function of transmitting the item's location information to a terminal. If the user loses the item, an alert will be displayed on the terminal.

[0927] The user uses a terminal to access the lost item report screen and enters detailed information about the lost item (e.g., black wallet, location, date and time, etc.). The terminal refers to a device such as a smartphone or PC. The information entered by the user is sent to the server.

[0928] The server receives lost property information sent by users and stores it in a database. The database is a system for systematically storing and managing information, and stores lost property information and advertising information. The server uses Amazon Web Services (AWS) and Amazon RDS as its database.

[0929] The server then selects a relevant advertisement based on the characteristics of the lost item. For example, if the lost item is a key, it selects an advertisement for a key duplication service. The server retrieves the appropriate advertisement from the advertisement database and sends it to the device. The device then displays the advertisement on the lost item report screen.

[0930] When a user searches for a lost item, they use their terminal to access the lost item search screen and enter a search keyword (e.g., a black wallet). The server receives the user's search keyword and retrieves the corresponding lost item information from the database. The server then sends the search results to the terminal.

[0931] The server then selects relevant advertisements based on the search keywords. For example, if the search keyword is "black wallet," it will select advertisements for wallet repair services. The server retrieves the appropriate advertisements from the advertisement database and sends them to the device. The device then displays the advertisements on the search results screen.

[0932] As a concrete example, consider the case where a user reports "I lost my black wallet." The user uses their smartphone to access the lost property report screen and enters "black wallet." The server receives the "black wallet" information and stores it in Amazon RDS. The server then selects an advertisement related to "black wallet," for example, an advertisement for a "wallet repair service," and sends it to the device. Once the user has completed the report, an advertisement for the "wallet repair service" is displayed on the device.

[0933] An example of a prompt to input to a generative AI model might be, "Generate an advertisement that will be displayed when a user reports a lost item."

[0934] This system allows relevant advertisements to be displayed when a user reports or searches for lost items, providing useful information to the user. It also streamlines the collection and management of lost items, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, it is possible to reduce the burden on the user and realize a profit-sharing model between the company and the user. The flow of the identification process in Example 3 will be described with reference to FIG. 15.

[0935] Step 1:

[0936] User reports lost property

[0937] The user uses the terminal to access a lost item report screen and enters detailed information about the lost item (e.g., black wallet, location, date and time, etc.).

[0938] Input: Lost property details

[0939] Output: Lost item information is sent to the server

[0940] Step 2:

[0941] The server stores the lost property information in a database

[0942] The server receives the lost property information sent by the user and stores it in a database.

[0943] Input: Lost property information sent by the user

[0944] Output: Lost property information stored in the database

[0945] Step 3:

[0946] The server selects relevant ads

[0947] The server selects relevant advertisements based on the characteristics of the lost item, for example, if the lost item is a key, it selects advertisements for key duplication services.

[0948] Input: Lost property characteristics

[0949] Output: Selected advertising information

[0950] Step 4:

[0951] The device displays advertisements on the lost item report screen

[0952] The terminal displays the advertising information received from the server.

[0953] Input: Advertising information sent from the server

[0954] Output: Advertisement displayed on the lost property report screen

[0955] Step 5:

[0956] User searches for lost property

[0957] The user uses the terminal to access the lost property search screen and enters a search keyword (e.g., black wallet).

[0958] Input: Search keyword

[0959] Output: Search keywords sent to the server

[0960] Step 6:

[0961] The server retrieves the search results from the database

[0962] The server receives the user's search keywords and retrieves the corresponding lost property information from the database.

[0963] Input: Search keyword

[0964] Output: Lost property information retrieved from the database

[0965] Step 7:

[0966] The server selects relevant ads

[0967] The server selects relevant ads based on the search keywords, for example, if the search keyword is "black wallet," it will select ads for wallet repair services.

[0968] Input: Search keyword

[0969] Output: Selected advertising information

[0970] Step 8:

[0971] The device displays ads on the search results screen

[0972] The terminal displays the search results and advertising information received from the server.

[0973] Input: Search results and advertising information sent from the server

[0974] Output: Ad displayed on search results page

[0975] (Application example 3)

[0976] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0977] The present invention relates to lost property management and notification, and aims to provide a system that balances the interests of both companies and users by using advertising revenue as a source of income while reducing the burden on users. Another objective is to improve the user experience by providing useful information to users when lost property is found.

[0978] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server provides a wireless communication chip to an end user, and when the user passes near an item equipped with the wireless communication chip, a notification is sent to the terminal, and the item is picked up and delivered to a specific location. The server also includes a means for instantly describing characteristics from an image and creating a database, which addresses the issue of receiving and managing lost items. A revenue source is advertising revenue, rather than a user fee, and this balances the interests of both the company and the user. A means for sending a notification to the user when a lost item is found and displaying a related advertisement on the notification screen. This allows for efficient management and notification of lost items, making it possible to provide useful information to users while earning advertising revenue.

[0979] A "wireless communication chip" is an electronic component for short-range wireless communication, which is attached to an item and has the function of sending notifications to the terminal of a user passing nearby.

[0980] An "article" is an object that may be owned by a user and to which a wireless communication chip is attached.

[0981] A "terminal" is an electronic device such as a smartphone or tablet carried by a user, and is a device for receiving notifications from a wireless communication chip.

[0982] A "notification" is an alert or message sent from the wireless communication chip to the terminal, informing the user of the presence of an item.

[0983] A "specific location" is a location where a lost item should be returned after it is found, such as a store's lost and found center.

[0984] "A means of describing features from images and instantly creating a database" is a technology that analyzes images of lost items, extracts their features, and registers them in a database, thereby making lost items management more efficient.

[0985] "Advertising revenue" refers to revenue obtained from advertisements displayed by the system, and serves as a source of income to reduce the burden on users.

[0986] "Means to balance the interests of both companies and users" refers to a method of using advertising revenue to operate the system, bringing profits to companies while providing useful information to users.

[0987] The "notification screen" is a screen displayed on the terminal that notifies the user that a lost item has been found and displays related advertisements.

[0988] "Relevant advertisements" are advertisements that are displayed depending on the characteristics of the lost item and the user's situation, such as key duplication services and store coupons.

[0989] An embodiment of the present invention will be described.

[0990] First, the system provides end users with a wireless communication chip. The wireless communication chip is attached to an item, and when the user passes by the item, a notification is sent to the user's terminal. The terminal is an electronic device such as a smartphone or tablet, and is a device that receives the notification from the wireless communication chip.

[0991] Next, to streamline the collection and management of lost items, a method is used to describe features from images and instantly create a database. Specifically, images of lost items are analyzed, their features are extracted, and the database is registered. This process is carried out using image analysis software and a database management system.

[0992] Furthermore, the system's revenue source is advertising revenue, reducing the burden on users. When a lost item is found, a notification is sent to the user, and a relevant advertisement is displayed on the notification screen. The advertisement is displayed according to the characteristics of the lost item and the user's situation, such as a key duplication service or store coupons.

[0993] The server is responsible for overseeing these processes. It receives notifications from the wireless communication chip, analyzes images of lost items, registers them in a database, and sends notifications to users. It also selects advertisements to display on the notification screen and provides useful information to users.

[0994] As a concrete example, consider the case where a user loses their keys in a store. When a key equipped with a wireless communication chip is found in the store, the server receives the information, analyzes the image of the key, and registers it in a database. Next, the server sends a notification to the user's device, displaying an advertisement for a key duplication service on the notification screen. This advertisement contains useful information, such as "You can also take advantage of a 20% off coupon right now!"

[0995] Examples of prompts include:

[0996] "A user lost their key in a store. Show them an ad for a key duplication service."

[0997] In this way, the system can efficiently manage and notify lost items, provide useful information to users, and earn advertising revenue.

[0998] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0999] Step 1:

[1000] A user carries an item equipped with a wireless communication chip. The wireless communication chip transmits the item's location information. The input is the location information of the wireless communication chip, and the output is the transmission of the item's location information.

[1001] Step 2:

[1002] If a user loses an item, the wireless communication chip sends a notification to the terminals of other users who pass nearby. The input is the signal from the wireless communication chip, and the output is the notification to the terminals of other users.

[1003] Step 3:

[1004] The terminal receives the notification from the wireless communication chip and transmits the information to the server. The input is the notification from the wireless communication chip, and the output is the transmission of the notification information to the server.

[1005] Step 4:

[1006] The server analyzes the image of the lost item based on the received notification information, extracts its features, and registers them in a database. The input is the notification information and the image of the lost item, and the output is the feature information of the lost item registered in the database.

[1007] Step 5:

[1008] The server notifies the user that the lost item has been found and displays a related advertisement on the notification screen. The input is the characteristic information of the lost item registered in the database and the advertisement information, and the output is the notification to the user's terminal and the display of the advertisement.

[1009] Step 6:

[1010] The user receives the notification and goes to the location where the lost item is to be collected. The input is the notification and advertisement displayed on the terminal, and the output is the user's behavior.

[1011] Step 7:

[1012] When a user receives a lost item, the server updates the information and deletes the corresponding lost item from the database. The input is the user's receipt confirmation information, and the output is an update to the database.

[1013] In this way, the system can efficiently manage and notify lost items, provide useful information to users, and earn advertising revenue.

[1014] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1015] "Example 1"

[1016] One embodiment of the present invention is a system that combines an emotion engine that recognizes a user's emotions. This system changes the alert notification method depending on the user's emotional state. Specifically, if the user feels happy or excited, the alert is notified using bright colors and cheerful music. On the other hand, if the user feels sad or anxious, the alert is notified using calm colors and gentle music. This enables a more appropriate notification method that takes the user's emotional state into consideration.

[1017] "Example 2"

[1018] Another embodiment is a system that combines an emotion engine that recognizes the user's emotions and optimizes the process of describing features from images and instantly creating a database based on the user's emotional state. Specifically, if the user feels excited or surprised, the system reflects that emotion and extracts more detailed features to create a database. On the other hand, if the user feels relaxed or at ease, the system reflects that emotion and extracts only the minimum necessary features to create a database. This enables more efficient database creation that takes the user's emotional state into account.

[1019] "Example 3"

[1020] Furthermore, as another embodiment, there is a system that combines an emotion engine that recognizes a user's emotions and changes the way advertisements are displayed depending on the user's emotional state, thereby improving the user experience. Specifically, if the user feels happy or excited, the system reflects that emotion by displaying advertisements using more vivid colors and dynamic animations. On the other hand, if the user feels sad or anxious, the system reflects that emotion by displaying advertisements using more muted colors and static animations. This enables more appropriate advertisement display that takes into account the user's emotional state, improving the user experience.

[1021] The processing flow of each embodiment will be described below.

[1022] "Example 1"

[1023] Step 1: Recognize the user's emotional state with the emotion engine.

[1024] Step 2: Determine how you want to be alerted based on your emotional state: bright colors and cheerful music for joyful or excited states, and calm colors and gentle music for sad or anxious states.

[1025] Step 3: Notify the user of the alert using the determined notification method.

[1026] "Example 2"

[1027] Step 1: Recognize the user's emotional state with the emotion engine.

[1028] Step 2: Optimize the process of describing features from images and instantly creating a database based on the recognized emotional state. More detailed features are extracted when the subject is excited or surprised, while only the minimum necessary features are extracted when the subject is relaxed or at ease.

[1029] Step 3: Optimized processing is used to extract features from the image and instantly create a database.

[1030] "Example 3"

[1031] Step 1: Recognize the user's emotional state with the emotion engine.

[1032] Step 2: Decide how to display the ad depending on the perceived emotional state: more vibrant colors and dynamic animations for happy and excited states, and more muted colors and static animations for sad and anxious states.

[1033] Step 3: The advertisement is displayed to the user in the determined display method.

[1034] Example 1

[1035] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1036] Conventional lost item discovery systems do not take into account the user's emotional state when finding an item, and do not provide appropriate notification methods. Furthermore, the process of receiving and managing lost items is cumbersome, placing a heavy burden on users. Furthermore, many systems require users to cover the system's operating costs, and a sustainable revenue model has not been established.

[1037] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1038] In this invention, the server includes: means for providing a wireless communication chip to an end user; means for issuing an alert to a terminal when the user passes near an item equipped with the wireless communication chip; means for locating the lost item by picking up the item and returning it to a specific location; and means for using an emotion recognition engine to recognize the emotional state of the user and changing the alert notification method according to the emotional state. This provides an appropriate notification method that takes the user's emotional state into consideration, improves the efficiency of collection and management of lost items, and enables the establishment of a sustainable revenue model.

[1039] A "wireless communication chip" is a small electronic component that operates with low power consumption and is used for wireless communication.

[1040] "Items" refers to personal items that are easily lost, such as keys and wallets.

[1041] "Terminal" refers to a mobile information terminal such as a smartphone or tablet used by a user.

[1042] An "alert" is a means of notifying the user, such as by sound, vibration, or on-screen notification.

[1043] An "emotion recognition engine" is software or hardware that analyzes a user's facial expressions and tone of voice to recognize their emotional state.

[1044] "Notification method" refers to the specific means or format for notifying the user of an alert.

[1045] A "specific location" is a designated location where the user can return the item they found, and includes, for example, the nearest store or public facility.

[1046] A "revenue model" is a business model for obtaining the income necessary to operate the system, including advertising revenue.

[1047] This invention is a system that provides end users with wireless communication chips, and when the user passes near an item with the wireless communication chip attached, an alert is sent to the terminal.Furthermore, by using an emotion recognition engine that recognizes the user's emotional state, the alert notification method can be changed depending on the emotional state, making it possible to provide more appropriate notifications to the user.

[1048] Hardware and Software Configuration

[1049] Wireless communication chip

[1050] The wireless communication chip is a small electronic component that operates with low power consumption and communicates via Bluetooth Low Energy (BLE), which enables the regular transmission of location information of an item.

[1051] Terminal

[1052] The device is a mobile information terminal such as a smartphone or tablet used by the user. A dedicated app is installed on the device, and this app receives signals from the wireless communication chip and generates an alert.

[1053] Emotion Recognition Engine

[1054] The emotion recognition engine uses the camera and microphone installed on the user's smartphone to analyze the user's facial expressions and tone of voice. The emotion recognition engine uses, for example, a general emotion recognition API (such as Microsoft's Azure Cognitive Services or Google's Cloud Vision API).

[1055] Data processing and calculation

[1056] Configuring and installing the wireless communication chip

[1057] Users attach a wireless communication chip to an item that is easily lost, such as keys or a wallet, and the wireless communication chip periodically transmits the item's location information to a terminal.

[1058] Installing and setting up the smartphone app

[1059] Users install a dedicated app on their smartphones, which receives signals from the wireless communication chip and generates alerts. The app is compatible with major mobile operating systems such as iOS and Android.

[1060] How the emotion recognition engine works

[1061] The device uses the camera and microphone on the user's smartphone to analyze the user's facial expressions and tone of voice. The emotion recognition engine sends this data to the emotion recognition API to analyze the user's emotional state.

[1062] Alert generation and notification

[1063] The device determines how to notify the alert based on the analysis results of the emotion recognition engine. For example, if the user is in a happy state, the alert will be notified with bright colors and cheerful music. Conversely, if the user is in a sad state, the alert will be notified with calm colors and gentle music.

[1064] Specific examples

[1065] Example 1: If you find a key

[1066] A user attaches a wireless communication chip to their house key. If the user drops the key while out and about, the device receives an alert when they pass by. The device uses an emotion recognition engine to analyze the user's facial expressions, and if it determines that the user is in a hurry, the device issues an alert with soft music and calming colors. The user receives the alert and picks up the key.

[1067] Example 2: If you find your wallet

[1068] A user installs a wireless communication chip in their wallet. The user forgets their wallet at a cafe, but when they return to the cafe, the device receives an alert. The device uses an emotion recognition engine to analyze the user's facial expressions, and if it determines that the user is happy, the alert is announced with bright colors and fun music. The user receives the alert and finds their wallet.

[1069] Prompt Sentence Examples

[1070] "Describe a system in which an emotion recognition engine analyzes the user's emotional state and provides appropriate alerts when the user loses their keys."

[1071] In this way, the system can provide alert notifications that take the user's emotional state into account, encouraging them to take more appropriate action.

[1072] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1073] Step 1:

[1074] The user attaches the wireless communication chip to an item that is easily lost, such as keys or a wallet. The user then turns on the wireless communication chip and pairs it with a smartphone app. The input requires the chip's ID and item information, and the output indicates that pairing is complete. Specifically, the user opens the Bluetooth settings on their smartphone, selects the wireless communication chip, and completes pairing.

[1075] Step 2:

[1076] The user installs a dedicated app on their smartphone. The app receives signals from the wireless communication chip and generates an alert. The input requires the app's download link and installation instructions, and the output is the app installed and initial setup completed. Specifically, the user downloads the app from the app store, installs it, and then performs initial setup.

[1077] Step 3:

[1078] The terminal receives a signal from the wireless communication chip. The input is a Bluetooth signal from the wireless communication chip, and the output is the location information of the item. Specifically, the terminal periodically scans for Bluetooth signals and receives signals from the wireless communication chip.

[1079] Step 4:

[1080] The device uses the camera and microphone installed on the user's smartphone to analyze the user's facial expressions and tone of voice. The input requires camera footage and audio data, and the output is the user's emotional state. Specifically, the device captures the user's face with the camera, records audio with the microphone, and sends this data to the emotion recognition API.

[1081] Step 5:

[1082] The device determines the alert notification method based on the analysis results of the emotion recognition engine. The input requires the user's emotional state and the location information of the item, and the output is an appropriate alert notification. Specifically, the device receives the results of the emotion recognition engine and follows the notification method set within the app, such as audio notification, vibration, or a pop-up notification on the screen.

[1083] Step 6:

[1084] When the user receives an alert from the device, they check the item in question. The input is the alert notification and the item's location information, and the output is the discovery and retrieval of the item. Specifically, the user checks the alert, searches the surrounding area to identify the item's location, and after finding the item, delivers it to the specified location.

[1085] (Application example 1)

[1086] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1087] Conventional lost property tracking systems have the problem that they do not take into account the user's emotional state when finding an item, and do not provide appropriate notification methods. There are also issues with the cumbersome process of receiving and managing lost items, which places a heavy burden on users. Furthermore, it was necessary to build a sustainable revenue model without imposing system operating costs on users.

[1088] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1089] In this invention, the server provides the end user with a wireless communication chip, and when the user passes near an item equipped with the wireless communication chip, a warning is issued to the terminal, allowing the user to pick up the item and return it to a specific location, thereby locating the lost item; a means for changing the method of issuing the warning notification depending on the user's emotional state using an emotion engine that recognizes the user's emotional state; a means for solving the issue of receiving and managing lost items by building a system that describes features from images and instantly creates a database; and a means for realizing a profit-sharing model between the company and the user, with revenue coming from advertising revenue rather than at the user's expense. This enables appropriate notifications based on the user's emotional state, streamlines the management of lost items, and enables the creation of a sustainable revenue model.

[1090] A "wireless communication chip" is a small device that uses wireless communication technology such as Bluetooth Low Energy (BLE) to transmit the location information of an item to a terminal.

[1091] "Articles" refer to objects that users use on a daily basis and that are easily lost, such as keys and wallets.

[1092] A "terminal" is an electronic device carried by a user, such as a smartphone or tablet, that has the function of receiving signals from a wireless communication chip and displaying a warning.

[1093] An "alert" is a notification that is displayed on the terminal, and notifies the user of the presence of an item in the form of a sound, vibration, on-screen message, or the like.

[1094] An "emotion engine" is software or hardware that recognizes a user's emotional state from facial expressions, voice, etc., and selects an appropriate notification method based on that information.

[1095] The "notification method" refers to the means by which the warning is communicated to the user, and includes formats such as sound, vibration, and on-screen messages.

[1096] "Database creation" is the process of extracting features from images and storing and managing that information as digital data.

[1097] "Advertising revenue" is a model that uses advertising fees from companies as a source of revenue to cover the system's operating costs.

[1098] The "profit sharing model" is a business model that aims to enable companies and users to mutually benefit from the operation of the system.

[1099] The following system configuration will be described as an embodiment of the present invention.

[1100] First, a user attaches a wireless communication chip to an item such as a key or wallet. This wireless communication chip uses Bluetooth Low Energy (BLE) technology to transmit the item's location information to a terminal. The terminal is a portable electronic device such as a smartphone or tablet that has the ability to receive signals from the wireless communication chip.

[1101] When the device receives a signal from the wireless communication chip, it notifies the user of a warning. This warning is displayed in the form of sound, vibration, or a message on the screen. Furthermore, the device is equipped with an emotion engine that recognizes the user's emotional state from facial expressions and voice. This emotion engine has the function of changing the method of warning notification depending on the user's emotional state.

[1102] For example, if the user is in a state of joy or excitement, the alert will be notified with bright colors and cheerful music. On the other hand, if the user is in a state of sadness or anxiety, the alert will be notified with calm colors and gentle music. This allows for appropriate notifications according to the user's emotional state.

[1103] In addition, for the collection and management of lost items, a system will be built that extracts features from images and instantly creates a database, which will make lost item management more efficient and reduce the burden on users.

[1104] Furthermore, this system uses a profit-sharing model, with advertising revenue as its revenue source. Users do not incur any fees for using the system, and the system is run by advertising revenue from companies. This allows both companies and users to benefit.

[1105] As a concrete example, consider a case where a user leaves their keys behind. When the user passes by the keys, the smartphone detects their presence and notifies them, "You forgot your keys." If the user is happy, the notification will be presented in bright colors and cheerful music. If the user is sad, the notification will be presented in calm colors and gentle music.

[1106] An example prompt is, "If a user leaves their keys behind, create a Python program that sends a notification when the smartphone passes near the keys. The notification will change depending on the user's emotional state. If the emotional state is joy, the notification will be in bright colors and cheerful music, and if the emotional state is sad, the notification will be in calm colors and gentle music."

[1107] The above is a specific embodiment for carrying out the present invention.

[1108] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1109] Step 1:

[1110] The terminal scans for signals from the wireless communication chip.

[1111] Input: BLE signal from wireless communication chip

[1112] Output: Wireless communication chip detection results

[1113] Specific operation: The terminal uses the Bluetooth module to scan surrounding BLE devices and detects signals from the wireless communication chip.

[1114] Step 2:

[1115] When the terminal receives the signal from the wireless communication chip, it activates an emotion engine to recognize the user's emotional state.

[1116] Input: Detection results from wireless communication chip, user facial expressions and voice data

[1117] Output: User's emotional state

[1118] How it works: The device uses a camera and microphone to capture the user's facial expressions and voice, and inputs them into the emotion engine, which then uses a generative AI model to analyze the user's emotional state.

[1119] Step 3:

[1120] The terminal selects an appropriate notification method depending on the user's emotional state.

[1121] Input: User's emotional state

[1122] Output: Notification method (audio, vibration, on-screen message, etc.)

[1123] Specific operation: Based on the analysis results of the emotion engine, the device decides how to notify the user. For example, if the user is happy, it will select bright colors and cheerful music, and if the user is sad, it will select calm colors and gentle music.

[1124] Step 4:

[1125] The terminal sends a warning to the user using the selected notification method.

[1126] Input: Notification method, detection result of wireless communication chip

[1127] Output: A warning notice to the user

[1128] Specific operation: The device will alert the user according to the selected notification method, such as sound, vibration, or a message on the screen. For example, it will display a message saying "You have forgotten your keys."

[1129] Step 5:

[1130] Once the user receives the alert, they can pick up the item and deliver it to a specific location.

[1131] Input: Warning Notification

[1132] Output: Collection and notification of items

[1133] Specific actions: The user checks the alert from the device, picks up the item, and delivers it to a specific location, such as the nearest store or public facility.

[1134] Step 6:

[1135] The server extracts features from the images and stores them in a database in order to receive and manage lost items.

[1136] Input: Image data of the item

[1137] Output: Database of lost property information

[1138] How it works: The server analyzes images of items, extracts features, and stores and manages them as digital data, making lost property management more efficient.

[1139] The above are the specific processing steps for carrying out the present invention.

[1140] Example 2

[1141] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1142] Conventional lost property management systems make it difficult to efficiently search and manage lost items, as receiving and managing lost items is time-consuming. Furthermore, no systems take into account the user's emotional state, leaving the user experience open to improvement. Furthermore, revenue sources are limited, making it difficult to build a sustainable business model.

[1143] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for taking an image of the lost item, a means for transmitting the taken image to the server, a means for the server to extract features of the item using image analysis technology, a means for registering the extracted features in a database, and a means for recognizing the emotional state of the user and adjusting the level of detail of the features extracted from the image depending on the emotional state. This enables efficient collection and management of lost items, feature extraction that takes the emotional state of the user into consideration, and the establishment of a sustainable business model.

[1144] "End user" means the final user of the system.

[1145] A "wireless communication chip" is a small electronic component that transmits and receives data using wireless communication technologies such as Bluetooth and Wi-Fi.

[1146] "Item" means any object that is treated as lost property.

[1147] A "terminal" is a device operated by a user, and includes smartphones, tablets, personal computers, etc.

[1148] An "alert" is a notification or warning that appears on a device when certain conditions are met.

[1149] A "server" is a computer system that processes and stores data on a network.

[1150] "Image analysis technology" refers to technology for extracting specific information from image data, and includes machine learning and computer vision.

[1151] "Features" are important attributes for identifying an item, such as its color, shape, size, brand logo, etc.

[1152] A "database" is a system for efficiently storing, searching, and managing data.

[1153] "Emotional state" refers to the user's psychological state, and includes excitement, surprise, relaxation, relief, and the like.

[1154] "Advertising revenue" refers to revenue earned by displaying advertisements.

[1155] A "profit-making model" is a business model that brings benefits to both the company and the users.

[1156] This invention is a system that improves the efficiency of receiving and managing lost items. It provides end users with a wireless communication chip, and when the user passes near an item with the wireless communication chip attached, an alert is sent to the terminal, and the lost item is found by picking up the item and returning it to a specific location. Furthermore, the system takes an image of the lost item, extracts the item's features using image analysis technology, and registers them in a database, making it easier to search for and manage lost items.

[1157] Hardware and software used

[1158] 1. Terminal

[1159] Use devices such as smartphones, tablets, and computers.

[1160] It is equipped with a camera that can take pictures.

[1161] It is equipped with wireless communication chips (Bluetooth and Wi-Fi).

[1162] 2. Server

[1163] A computer system is used for data processing and storage.

[1164] OpenCV and TensorFlow are used as image analysis software.

[1165] Use MySQL or MongoDB as the database.

[1166] 3. Software

[1167] Implement a program to extract features of an item using image analysis technology.

[1168] Uses emotion recognition engines (Microsoft Azure Emotion API and Google Cloud Vision API) to recognize the user's emotional state.

[1169] Specific operation of the system

[1170] 1. Receiving lost property

[1171] When a user brings in a lost item, the terminal takes a picture of the item.

[1172] For example, if a user brings a blue umbrella, the device will take a picture of the umbrella.

[1173] 2. Sending images

[1174] The device sends the captured image to the server.

[1175] Specifically, the image data is transmitted using an HTTP request.

[1176] 3. Image analysis and feature extraction

[1177] The server analyzes the image using OpenCV.

[1178] For example, features such as the color blue, the shape and size of the umbrella, and the brand logo are extracted from the image.

[1179] Organize the extracted features in JSON format.

[1180] 4. Registering in the database

[1181] The server connects to the MySQL database and registers the extracted features using INSERT statements.

[1182] 5. Search and Manage

[1183] A user inputs a search query on a terminal to search for lost property.

[1184] The server searches the database for the relevant lost property using a SELECT statement and sends the results to the terminal.

[1185] Specific operation of the system that combines the emotion engine

[1186] 1. User Emotion Recognition

[1187] The device analyzes the user's facial expressions using the Microsoft Azure Emotion API.

[1188] For example, if the user is excited, that information is acquired.

[1189] 2. Transmission of emotional information

[1190] The terminal transmits the user's emotion information to the server.

[1191] Specifically, emotion data is sent using HTTP requests.

[1192] 3. Emotion-based feature extraction

[1193] The server adjusts the level of detail of feature extraction depending on the user's emotional state.

[1194] For example, in the case of an excited state, more detailed features are extracted.

[1195] The server uses OpenCV to analyze the image and extract detailed features.

[1196] 4. Registering in the database

[1197] The server connects to a MongoDB database and registers the extracted features.

[1198] Specifically, we use the MongoDB insertOne method.

[1199] 5. Search and Manage

[1200] A user inputs a search query on a terminal to search for lost property.

[1201] The server searches the database for the relevant lost item using the find method and sends the results to the terminal.

[1202] Prompt Sentence Examples

[1203] "Generate a program that analyzes an image of a blue umbrella, extracts its color, shape, size, and brand logo, and stores them in a database."

[1204] "If a user brings a red wallet in an excited state, generate a program to extract detailed characteristics and register them in a database."

[1205] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1206] Step 1:

[1207] A user brings a lost item. For example, if the user brings a blue umbrella, the device takes a picture of the umbrella. The input is the physical shape of the lost item, and the output is the captured image data. Specifically, the device displays "Taking a picture of the umbrella," and the user presses the "Take" button.

[1208] Step 2:

[1209] The device sends the image it has taken to the server. The input is the captured image data, and the output is the image data sent to the server. Specifically, the device displays "Sending image" and sends the image data using an HTTP request.

[1210] Step 3:

[1211] The server analyzes the image using image analysis software (OpenCV or TensorFlow). The input is the image data sent to the server, and the output is the extracted feature data (color, shape, size, brand logo, etc.). Specifically, the server logs "Analyzing image" and uses image analysis technology to extract the features of the item.

[1212] Step 4:

[1213] The server registers the extracted features in a database (MySQL or MongoDB). The input is the extracted feature data, and the output is the feature data registered in the database. Specifically, the server logs "Registered in database" and registers the data in the database using the INSERT statement or insertOne method.

[1214] Step 5:

[1215] To search for lost items, a user inputs a search query into a terminal. The input is the search query entered by the user, and the output is the display of the search results. Specifically, the terminal displays "Please enter your search query," and the user inputs the search query.

[1216] Step 6:

[1217] The server searches the database for the relevant lost item and sends the results to the terminal. The input is the search query entered by the user, and the output is the search result data. Specifically, the server logs "Retrieving search results," retrieves the search results from the database using the SELECT statement or find method, and sends them to the terminal.

[1218] Step 7:

[1219] The terminal displays the search results to the user. The input is the search result data sent from the server, and the output is the search result displayed to the user. Specifically, the terminal displays "Search results are displayed" and displays a list of the relevant lost property information.

[1220] (Application example 2)

[1221] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1222] Conventional lost property management systems require complicated procedures for receiving and managing lost items, making efficient management particularly necessary in public places and businesses. Furthermore, the lack of database management that takes into account the user's emotional state places a significant burden on users. Furthermore, limited revenue sources make it difficult to build a sustainable business model.

[1223] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1224] In this invention, the server provides the end user with a wireless communication chip. When the user passes near an item equipped with the wireless communication chip, an alert is sent to the user's terminal. The user then picks up the item and returns it to a specific location, allowing the lost item to be found. The server also includes: a means for taking an image of the lost item upon receipt and extracting its characteristics (e.g., color, shape, size, brand logo, etc.) using image analysis technology; a means for registering the extracted characteristics in a database to facilitate the search and management of lost items; and a means for recognizing the user's emotional state and optimizing the process of instantly recording the characteristics from the image in accordance with the user's emotional state and creating a database. This enables efficient management of lost items and reduces the burden on users. Furthermore, by using advertising revenue as a revenue source, a profit-sharing model between the company and users can be realized, enabling the creation of a sustainable business model.

[1225] A "wireless communication chip" is a small electronic component that transmits and receives data using short-range wireless communication.

[1226] "Items" are objects that are managed as lost property and have characteristics such as color, shape, size, and brand logo.

[1227] A "terminal" is an electronic device used by a user, such as a smartphone or smart glasses, that receives a signal from the wireless communication chip and displays an alert.

[1228] An "alert" is a notification or warning that appears on a device, informing the user that a particular item is nearby.

[1229] "Image analysis technology" is a technology for extracting specific features from captured images, such as color, shape, size, and brand logos.

[1230] A "database" is a collection of information that registers extracted features and is used to search for and manage lost items.

[1231] "Emotional state" refers to the user's psychological state, and includes emotions such as excitement, surprise, relaxation, and relief.

[1232] "Advertising revenue" refers to the revenue earned by displaying advertisements provided by companies, and serves as operating funds for the system.

[1233] The "profit sharing model" is a business model in which companies and users mutually benefit, building a mutually beneficial relationship.

[1234] As an embodiment of the present invention, the following system is constructed.

[1235] System Overview

[1236] This system provides end users with a wireless communication chip. When the user passes near an item equipped with the chip, an alert is sent to the user's device, allowing the user to pick up the item and return it to a specific location, thereby finding the lost item. When the lost item is received, a photo of the item is taken and image analysis technology is used to extract the item's characteristics (color, shape, size, brand logo, etc.) and register them in a database. Furthermore, the system recognizes the user's emotional state, and optimizes the process of describing the characteristics from the image according to the user's emotional state and instantly creating a database.

[1237] Hardware and software used

[1238] Hardware:

[1239] Smartphones (e.g. iPhone, Android devices)

[1240] Smart glasses (e.g. Google Glass, Vuzix Blade)

[1241] software:

[1242] Image analysis libraries (e.g., OpenCV, TensorFlow)

[1243] Emotion recognition engine (e.g., Affectiva, Microsoft Azure Emotion API)

[1244] Database management systems (e.g. MySQL, PostgreSQL)

[1245] Data processing and calculation

[1246] Image capture and feature extraction

[1247] When a lost item is received, the device (smartphone or smart glasses) takes a picture of the item. The image is analyzed using OpenCV and TensorFlow to extract the item's features (color, shape, size, brand logo, etc.).

[1248] Database registration

[1249] The extracted features are then registered in a database management system such as MySQL or PostgreSQL, making it easier to search for and manage lost items.

[1250] Emotional state recognition and optimization

[1251] The system uses an emotion recognition engine (Affectiva or Microsoft Azure Emotion API) to analyze the user's emotional state. If the user is excited or surprised, the system extracts more detailed features and registers them in the database. On the other hand, if the user is relaxed or at ease, the system extracts only the minimum necessary features and registers them in the database.

[1252] Specific examples

[1253] For example, a station security officer can use smart glasses to take a photo of a lost bag. The system can then extract the bag's color, shape, and brand logo, and if the officer is excited, record the detailed characteristics into a database. When the owner returns to the station at a later date, they can enter the bag's characteristics using a smartphone app, which will identify a matching bag from the database and send a notification to the owner.

[1254] Prompt Sentence Examples

[1255] "Design a system where station security personnel use smart glasses to take a photo of a lost bag, and the system extracts the bag's color, shape, and brand logo and registers them in a database. When the owner visits, the system will input the bag's characteristics using a smartphone app, identify a matching bag from the database, and send a notification to the owner."

[1256] The above is an embodiment of the present invention.

[1257] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1258] Step 1:

[1259] When a lost item is received, the device (smartphone or smart glasses) takes an image of the item. The input is the image of the item, and the output is the captured image data. This image data is used for subsequent image analysis processing.

[1260] Step 2:

[1261] The device inputs the captured image data into an image analysis library (OpenCV or TensorFlow) to extract the features of the item (color, shape, size, brand logo, etc.). The input is the image data, and the output is the extracted feature data. This feature data is used to identify the item.

[1262] Step 3:

[1263] The device registers the extracted feature data in a database management system (MySQL or PostgreSQL). The input is feature data, and the output is feature information registered in the database. This makes it easier to search for and manage lost items.

[1264] Step 4:

[1265] The device uses an emotion recognition engine (Affectiva or Microsoft Azure Emotion API) to analyze the user's emotional state. The input is the user's facial expression and voice data, and the output is analyzed emotional state data. This emotional state data is used to optimize the subsequent feature extraction process.

[1266] Step 5:

[1267] The server optimizes the process of describing features from images and instantly creating a database based on emotional state data. The input is emotional state data and feature data, and the output is optimized feature data. When the user is excited or surprised, detailed features are extracted, and when the user is relaxed or at ease, only the minimum necessary features are extracted.

[1268] Step 6:

[1269] When a user searches for lost items, the device accesses the database and searches for lost items that match the input feature data. The input is the search query (feature data), and the output is the information of the matching lost items. This allows the user to quickly identify lost items.

[1270] Step 7:

[1271] If the owner is identified, the server sends a notification to the owner. The input is the matching lost item and the owner's contact information, and the output is a notification message so the owner can receive instructions on how to retrieve the lost item.

[1272] The above are the specific processing steps of the program of this system.

[1273] Example 3

[1274] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1275] In conventional lost property management systems, users are burdened with finding lost items, and the process of receiving and managing lost items is cumbersome. Furthermore, the system often requires users to bear the operating costs of the system, which results in a poor user experience. Furthermore, when advertising revenue is the source of income, advertisements are displayed without taking into account the user's emotional state, which can lead to a poor user experience.

[1276] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server provides a wireless communication module to an end user. When the user passes near an object equipped with the wireless communication module, an alert is sent to the terminal, and the lost item is found by the user picking up the object and returning it to a specific location. The server also includes a means for instantly creating a database by describing characteristics from an image, which is a key issue in the past when it comes to receiving and managing lost items. A means for balancing the interests of both companies and users by deriving revenue from advertising revenue rather than burdening the user. A means for recognizing the emotional state of the user using an emotion recognition engine and changing the display method of advertisements according to the emotional state. This reduces the burden on the user, streamlines lost item management, and improves the user experience while retaining advertising revenue as a source of income.

[1277] A "wireless communication module" is an electronic component for short-range wireless communication, which is attached to an object to transmit its location information.

[1278] A "terminal" is an electronic device used by a user, including a smartphone, tablet, or PC.

[1279] An "alert" is a notification or warning message that appears on a device when certain conditions are met.

[1280] The "Lost and Found Database" is a database system for storing and managing information about lost items.

[1281] An "emotion recognition engine" is software or hardware that analyzes a user's facial expressions, voice, and input data to recognize their emotional state.

[1282] "Advertising revenue" is revenue earned by displaying advertisements.

[1283] "Achieving a balance between the interests of companies and users" means that companies can earn profits while also providing information and services that are beneficial to users.

[1284] The "advertisement display method" refers to how the advertisement is displayed on the user's terminal, and includes visual elements such as color tone and animation.

[1285] The present invention provides a lost property management system that relies on advertising revenue as its revenue source, rather than on user fees, and improves the user experience by changing the way advertisements are displayed depending on the user's emotional state. The system includes a wireless communication module, a terminal, a server, and an emotion recognition engine.

[1286] First, a user carries an object equipped with a wireless communication module. The wireless communication module is an electronic component for short-range wireless communication, transmitting the object's location information. If the user loses the object, an alert will be displayed on the device when another user passes nearby. The device can be an electronic device such as a smartphone, tablet, or PC.

[1287] The server receives a request from a user and searches the lost property database. The lost property database is a database system for storing and managing information about lost items. The server selects appropriate advertisements based on the characteristics of the lost item and the user's search. Advertising revenue is the income earned by displaying advertisements.

[1288] Furthermore, the server recognizes the user's emotional state using an emotion recognition engine. An emotion recognition engine is software or hardware that analyzes the user's facial expressions, voice, and input data to recognize their emotional state. For example, Microsoft Azure's Emotion API or Google Cloud's Natural Language API can be used.

[1289] The server determines how to display the advertisement based on the results of the emotion recognition engine. If the user expresses joy, the server determines to display the advertisement with vibrant colors and dynamic animation. On the other hand, if the user expresses sadness or anxiety, the server determines to display the advertisement with muted colors and static animation.

[1290] As a concrete example, consider the case where a user accesses the system using a smartphone browser and searches for "keys." The server retrieves information related to "keys" from the lost property database and selects an advertisement for a key duplication service. When the emotion recognition engine recognizes the emotion of joy from the user's facial expression, the server decides to display the advertisement using vivid colors and dynamic animations. The server sends the advertisement to the user's smartphone, which then displays it on the screen.

[1291] An example of a prompt sentence might be:

[1292] "If a user visits your system to search for lost property, what kind of ads will be displayed? Also, explain how the ads will be displayed differently depending on the user's emotional state."

[1293] This system allows users to obtain useful information and companies to earn advertising revenue. Furthermore, the user experience is improved by displaying advertisements according to the user's emotional state. The flow of the identification process in Example 3 will be described with reference to FIG. 21.

[1294] Step 1:

[1295] A user accesses the system. The user accesses the system through a web browser or a mobile app. For example, the user opens a browser on their smartphone and enters the system's URL. The input is the user's access request, and the output is the system's homepage.

[1296] Step 2:

[1297] The server receives the user's request. The server receives the access request from the user and analyzes the information contained in the request. The input is the user's access request, and the output is the analyzed request information.

[1298] Step 3:

[1299] The server searches the lost property database. The server searches the lost property database based on the received request. For example, if a user searches for "key," the server retrieves lost property information related to "key" in the database. The input is the user's search query, and the output is the corresponding lost property information.

[1300] Step 4:

[1301] The server selects the advertisement. The server selects an appropriate advertisement based on the characteristics of the lost item and the user's search. For example, if a user searches for "key," an advertisement for a key duplication service will be selected. The input is the lost item information and the user's search query, and the output is the selected advertisement.

[1302] Step 5:

[1303] The server uses an emotion recognition engine to recognize the user's emotions. The server uses the emotion recognition engine to recognize the user's emotional state. The emotion recognition engine uses, for example, Microsoft Azure's Emotion API or Google Cloud's Natural Language API to analyze the user's facial expressions, voice, and input data. The input is the user's facial expression data and voice data, and the output is the recognized emotional state.

[1304] Step 6:

[1305] The server determines how to display an advertisement based on the emotion. The server determines how to display an advertisement based on the results of the emotion recognition engine. For example, if the user expresses the emotion of joy, the server determines to display an advertisement using vibrant colors and dynamic animations. The inputs are the recognized emotional state and the selected advertisement, and the output is the determined advertisement display method.

[1306] Step 7:

[1307] The server sends the advertisement to the terminal. The server then sends the determined advertisement and its display method to the user's terminal. The HTTP protocol is used for transmission. The input is the determined advertisement and display method, and the output is the advertisement sent to the user's terminal.

[1308] Step 8:

[1309] The terminal displays the advertisement. The terminal displays the advertisement received from the server on the screen. For example, an advertisement for a key duplication service is displayed on the screen of a user's smartphone in vivid colors and dynamic animation. The input is the advertisement sent from the server, and the output is the advertisement displayed on the screen.

[1310] (Application example 3)

[1311] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1312] In conventional lost property management systems, users had to bear a heavy burden in finding lost items, and the process of receiving and managing lost items was cumbersome. Furthermore, there was a lack of ingenuity to improve the user experience, and in particular, advertising effectiveness was limited because advertising was not displayed according to the user's emotional state.

[1313] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server provides an end user with a BLE chip, and when the user passes near an object with the BLE chip attached, an alert is issued to the terminal, and the object is picked up and delivered to a specific location. It also includes a means for describing characteristics from an image and instantly storing them in a database, a means for realizing a win-win model between the company and the user, with advertising revenue as the source of income rather than user burden, and a means for recognizing the user's emotional state and changing the display method of advertisements according to the emotion. This reduces the burden on the user, makes lost property management more efficient, and further improves the user experience by displaying advertisements according to the user's emotional state.

[1314] "End User" refers to the individual or organization that ultimately uses the system.

[1315] A "BLE chip" is a small wireless communication device that uses Bluetooth Low Energy technology and is used to provide location information for objects.

[1316] An "alert" is a warning or caution message that notifies the user when a specific condition is met.

[1317] "Terminal" refers to an electronic device used by a user, such as a computer, smartphone, or tablet.

[1318] "Database creation" refers to organizing information and registering it in a database so that it is easy to search and manage.

[1319] "Advertising revenue" refers to revenue earned by displaying advertisements.

[1320] A "win-win model" refers to a business model in which all parties involved can benefit.

[1321] "Emotional state" refers to a user's current psychological state or mood.

[1322] "Advertisement display method" refers to the specific method or format for displaying an advertisement to a user.

[1323] "User experience" refers to the overall satisfaction and ease of use that a user feels when using a system or service.

[1324] The following system configuration will be described as an embodiment of the present invention.

[1325] System Configuration

[1326] Hardware

[1327] Smartphone: A device carried by the user, equipped with a camera and BLE communication functions.

[1328] BLE chip: A small wireless communication device that can be attached to lost property.

[1329] Server: A central system that manages databases and distributes advertisements.

[1330] software

[1331] OpenCV: An image processing library used to preprocess the user's facial images.

[1332] Keras: A deep learning library used to run emotion recognition models.

[1333] Flask: A web application framework used to perform server-side processing.

[1334] Program processing explanation

[1335] emotion recognition

[1336] The server receives a user's facial image captured by the smartphone camera, converts the image to grayscale using OpenCV, resizes it to 48x48 pixels, and then runs a pre-trained emotion recognition model using Keras to predict the user's emotional state.

[1337] Advertisement display

[1338] The server selects an appropriate advertisement based on the results of emotion recognition. For example, if the user is excited, it selects an advertisement with vibrant colors and dynamic animations, and if the user is calm, it selects a static advertisement. The selected advertisement is then displayed on the smartphone screen.

[1339] Specific examples

[1340] When a user is browsing a product in a physical store, the system captures their face with a smartphone camera and performs emotion recognition: if the user is excited, it displays a vibrant coupon, and if the user is calm, it displays a static advertisement.

[1341] Prompt Sentence Examples

[1342] While a user is browsing a store, the system captures their face with a smartphone camera and performs emotion recognition: if the user is excited, it displays a brightly colored coupon; if the user is calm, it displays a static advertisement.

[1343] This reduces the burden on users, makes lost property management more efficient, and further improves the user experience by displaying advertisements according to the user's emotional state.

[1344] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1345] Step 1:

[1346] When a user is searching for a product in a physical store, a facial image is captured using the camera on the device (smartphone). The input is the user's facial image, and the output is the captured image data. Specifically, the device's camera app starts up and takes a picture of the user's face.

[1347] Step 2:

[1348] The device sends the captured facial image to the server. The input is the captured image data, and the output is the image data sent to the server. In concrete terms, the device application sends the image data to the server as an HTTP request.

[1349] Step 3:

[1350] The server converts the received facial image to grayscale using OpenCV and resizes it to 48x48 pixels. The input is the image data sent to the server, and the output is the preprocessed image data. Specifically, the server calls OpenCV functions to process the image.

[1351] Step 4:

[1352] The server inputs the preprocessed image data into an emotion recognition model using Keras to predict the user's emotional state. The input is the preprocessed image data, and the output is the emotion recognition result (emotion label). Specifically, the server loads the Keras model and performs prediction.

[1353] Step 5:

[1354] The server selects an appropriate advertisement based on the emotion recognition results. The input is the emotion recognition result (emotion label), and the output is the selected advertisement data. Specifically, the server performs conditional branching and retrieves advertisements corresponding to the emotion labels from the database.

[1355] Step 6:

[1356] The server sends the selected advertising data to the terminal. The input is the selected advertising data, and the output is the advertising data sent to the terminal. In concrete terms, the server application sends the advertising data to the terminal as an HTTP response.

[1357] Step 7:

[1358] The terminal displays the received advertising data to the user. The input is the advertising data sent from the server, and the output is the advertisement displayed on the terminal screen. Specifically, the terminal application analyzes the advertising data and displays it on the screen.

[1359] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1360] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1361] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[1362] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1363] [Third embodiment]

[1364] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1365] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1366] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1367] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1368] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1369] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1370] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1371] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1372] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1373] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1374] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1375] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1376] "Example 1"

[1377] The present invention provides end users with a BLE chip. This BLE chip is attached to an item that is easily lost, such as keys or a wallet. When a user passes by an item with the chip attached, an alert is sent to the user's device, such as a smartphone. The alert is communicated to the user by, for example, sound, vibration, or a notification on the screen. When the user receives the alert, they pick up the item and deliver it to a specific location (for example, the nearest store or public facility).

[1378] "Example 2"

[1379] The system of the present invention describes features from images and instantly creates a database to streamline the collection and management of lost items. Specifically, when a lost item is collected, an image of the item is taken and image analysis technology is used to extract the item's features (e.g., color, shape, size, brand logo, etc.). The extracted features are registered in a database, making it easier to search for and manage lost items.

[1380] "Example 3"

[1381] The system of this invention is not charged to the user, and its revenue comes from advertising. Specifically, advertisements are displayed on each screen of the system, such as the alert notification screen and the lost property database screen. The advertisements provide useful information to the user, such as coupons for the store where the lost item was delivered, or advertisements related to the characteristics of the lost item (for example, an advertisement for a key duplication service for a key). This creates a win-win model for both the company and the user.

[1382] The processing flow of each embodiment will be described below.

[1383] "Example 1"

[1384] Step 1: Provide the end user with a BLE chip, which they attach to an easily lost item, such as a key or wallet.

[1385] Step 2: When a user passes by an object equipped with a chip, an alert is sent to the user's smartphone or other device. The alert can be conveyed to the user through a sound, vibration, or on-screen notification, for example.

[1386] Step 3: When the user receives the alert, they pick up the item and deliver it to a specific location (e.g., the nearest store or public facility).

[1387] "Example 2"

[1388] Step 1: To streamline the collection and management of lost items, we take a photo of the item and instantly create a database based on its characteristics.

[1389] Step 2: Image analysis technology is used to extract the features of the item (e.g., color, shape, size, brand logo, etc.). The extracted features are registered in a database to facilitate the search and management of lost property.

[1390] "Example 3"

[1391] Step 1: The system of the present invention is not charged to users, and its revenue source is advertising revenue. Specifically, advertisements are displayed on each screen of the system, such as the alert notification screen and the lost property database screen.

[1392] Step 2: Advertisements provide useful information to users, such as coupons for the store where the lost item was delivered or advertisements related to the characteristics of the lost item (for example, an advertisement for a key duplication service for a key). This creates a win-win situation for both companies and users.

[1393] Example 1

[1394] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1395] Conventional lost property management systems require users to manually enter information when an item is lost or found, which is time-consuming and often inaccurate. Furthermore, the process of receiving and managing lost items is cumbersome, placing a heavy burden on users. Furthermore, the system's operating costs are high, and there is no established revenue model, making sustainable operation difficult.

[1396] The identification process by the identification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes means for providing a wireless communication chip to an end user and issuing a warning to the terminal when the user passes near an item equipped with the wireless communication chip, means for picking up the item and delivering it to a specific location, means for the terminal to scan the signal from the wireless communication chip and transmit signal information to the server, and means for the server to transmit a warning to the terminal based on the signal information. This allows the user to automatically receive a warning when the item is lost and respond quickly. In addition, the collection and management of lost items are made more efficient, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, sustainable operation is possible.

[1397] "End user" means the final user of the system.

[1398] A "wireless communication chip" is a small electronic device that transmits signals using wireless communication technologies such as Bluetooth Low Energy (BLE).

[1399] "Items" are personal belongings or possessions that are easily lost by the user, such as keys or wallets.

[1400] A "terminal" is an electronic device such as a smartphone or tablet that a user owns.

[1401] An "alert" is an alert such as a sound, vibration, or on-screen notification that appears on the device.

[1402] A "server" is a computer system for receiving and analyzing signal information and sending alerts to terminals.

[1403] "Signal information" refers to data such as the ID, detection time, and location information transmitted from the wireless communication chip.

[1404] A "specific location" is a designated location such as a store or public facility where a user can return a found item.

[1405] "Advertising revenue" refers to revenue from advertising received from companies to cover the operating costs of the system.

[1406] The "profit sharing model" is a business model in which companies and users mutually benefit.

[1407] This invention provides a system in which an end user is provided with a wireless communication chip, and when the user passes near an article to which the wireless communication chip is attached, a warning is issued on a terminal. Specific embodiments of this system will be described below.

[1408] Hardware and software used

[1409] This system uses the following hardware and software:

[1410] Hardware: Wireless communication chips (e.g., Bluetooth Low Energy chips), smartphones (e.g., iPhones, Android devices)

[1411] Software: Smartphone applications (e.g., dedicated app "FindMyItem"), servers (e.g., cloud services)

[1412] Program processing

[1413] The server maintains a database that manages the ID and location information of the wireless communication chip. The device (user's smartphone) runs an application that receives signals from the wireless communication chip. When this application detects a signal from the wireless communication chip, it sends the information to the server. The server then sends a warning to the user's smartphone based on the received information.

[1414] Specifically, the following process occurs:

[1415] 1. The user attaches a wireless communication chip to an item such as a key or wallet.

[1416] 2. An application installed on the user's smartphone scans for signals from the wireless communication chip.

[1417] 3. When the smartphone detects the signal from the wireless communication chip, it sends the information to the server.

[1418] 4. The server sends an alert to the user's smartphone based on the received information.

[1419] 5. Once the user receives the alert, they can pick up the item and deliver it to a specific location.

[1420] Specific examples

[1421] As a concrete example, consider the case where a user has attached a wireless communication chip to a key. If the user drops the key, and another user passes by the key, a warning message will appear on the user's smartphone. The message will read, "Your key has been dropped. Please return it to the nearest store."

[1422] Example prompts for generative AI models

[1423] "Please create a program for an item tracking system that uses a wireless communication chip. In this system, a user attaches a wireless communication chip to an item such as a key or wallet, and the signal is received by the user's smartphone and sent to a server. The server then sends an alert to the user's smartphone based on the received information. The hardware used is a Bluetooth Low Energy chip, and the smartphone is an iPhone or Android device. The smartphone application is "FindMyItem," and the server uses a cloud service."

[1424] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1425] Step 1:

[1426] A user attaches a wireless communication chip to an item such as a key or wallet. The wireless communication chip periodically transmits location information of the attached item. The input is the attachment of the wireless communication chip, and the output is the state in which the item has the wireless communication chip.

[1427] Step 2:

[1428] The user installs the dedicated app "FindMyItem" on their smartphone and launches it. The app performs pairing settings for the wireless communication chip when launched for the first time. The input is the installation and launch of the app, and the output is the completion of pairing between the wireless communication chip and smartphone.

[1429] Step 3:

[1430] The device (smartphone) periodically scans for signals from the wireless communication chip through the app. The scan is performed in the background and does not require user interaction. The input is the signal from the wireless communication chip, and the output is the signal detection information.

[1431] Step 4:

[1432] When a terminal detects a signal from a wireless communication chip, it sends the signal information (chip ID, detection time, location information, etc.) to the server. The input is the signal detection information, and the output is the transmission of the signal information to the server.

[1433] Step 5:

[1434] The server generates a warning message for the user's smartphone based on the received signal information. The warning message includes the type of item and its location. The input is the signal information, and the output is a warning message.

[1435] Step 6:

[1436] The terminal (smartphone) receives a warning from the server. The warning is communicated to the user by sound, vibration, on-screen notification, etc. The input is the warning message, and the output is the notification to the user.

[1437] Step 7:

[1438] The user confirms the warning, picks up the item, and delivers it to a specific location (e.g., the nearest store or public facility). The input is confirmation of the warning, and the output is picking up and reporting the item.

[1439] (Application example 1)

[1440] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1441] The present invention relates to a system that tracks items that are easily lost, such as keys or wallets, and sends an alert when a user passes near the item. Conventional systems have insufficient notification when an item leaves a specific area or management of the item's location history, making it difficult for users to respond when they lose an item. Furthermore, there are issues with the cumbersome process of receiving and managing lost items, which places a heavy burden on users. Furthermore, limited revenue sources make it difficult to build a sustainable business model.

[1442] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1443] In this invention, the server provides an end user with a BLE chip, and includes a means for alerting the user's device when the user passes near an item equipped with the BLE chip; a means for picking up the item and delivering it to a specific location; a means for notifying the user when the item leaves a specific area; and a means for storing the item's location history in the cloud and enabling the user to check its past location. This reduces the risk of losing an item, enables the user to track the item's location in real time, and allows for quick response when the item leaves a specific area. Furthermore, the system streamlines the collection and management of lost items, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, a sustainable business model can be realized that balances the interests of both the company and the user.

[1444] "End User" means the individual or organization that ultimately uses a product or service.

[1445] A "BLE chip" is a small communication device that uses Bluetooth Low Energy technology and is capable of wireless communication with low power consumption.

[1446] An "item" refers to a concrete object, such as a key or a wallet, that has a particular purpose or value.

[1447] A "terminal" refers to an electronic device such as a smartphone or tablet, which is a device that allows a user to receive and operate information.

[1448] An "alert" is a notification to alert the user, and is provided in the form of a sound, vibration, on-screen notification, or the like.

[1449] A "specific location" refers to the location where the item should be returned after being picked up, such as the nearest store or public facility.

[1450] A "specific area" refers to the location where the item is normally located, such as a home or office.

[1451] A "notification" is a message that conveys information to the user and is provided via the terminal.

[1452] "Location history" is data that records the past location information of an item and is stored in the cloud.

[1453] The "cloud" is a collection of remote servers provided over the Internet, and is an infrastructure for storing and processing data.

[1454] "Advertising revenue" refers to revenue earned by displaying advertisements and is used as part of a business model.

[1455] A "profit-making model" refers to a business model that benefits both the company and the users, and is operated in a sustainable manner.

[1456] A system for implementing this invention includes a BLE chip provided to an end user, a terminal such as a user's smartphone, and a cloud server. The specific configuration and operation of the system are described below.

[1457] Hardware and Software Configuration

[1458] 1. Hardware:

[1459] Smartphone: iOS or Android device

[1460] BLE chip: For example, Nordic Semiconductor's nRF52840

[1461] Cloud Server: A remote server for data storage and processing

[1462] 2. Software:

[1463] Smartphone applications: developed in Swift for iOS and Kotlin for Android

[1464] BLE communication library: CoreBluetooth for iOS, Android BLE API for Android

[1465] Cloud backend: For example, using Firebase

[1466] System Operation

[1467] 1. Providing and installing the BLE chip

[1468] The server provides BLE chips to end users, who then attach them to items that are easily lost, such as keys or wallets.

[1469] 2. Item tracking and alert notifications

[1470] When a user passes near an item equipped with a BLE chip, the device receives the signal from the BLE chip and measures the signal strength (RSSI). Based on the signal strength, the device estimates the distance to the item and sends an alert to the device if the item is nearby. The alert can be in the form of a sound, vibration, or on-screen notification.

[1471] 3. Notifications when you leave a specific area

[1472] When an item leaves a specific area (e.g., home or office), the device sends location information to a cloud server, and the server notifies the user.

[1473] 4. Location History Management

[1474] The location history of the item is stored on a cloud server, allowing users to check its past location, thereby reducing the risk of losing the item.

[1475] Specific examples

[1476] For example, if a user loses their keys, an alert will be sent to their smartphone when they pass by a key equipped with a BLE chip. The alert will be communicated to the user through audio, vibration, and on-screen notifications. It will also notify the user if the key is left at home or in the office.

[1477] Prompt Sentence Examples

[1478] If a user loses their keys, develop an application that sends an alert to their smartphone when they pass by a key equipped with a BLE chip. The alert will be communicated to the user through sound, vibration, and on-screen notification. It will also notify the user if the key is left at home or office.

[1479] This system significantly reduces the risk of losing important items for users. It also streamlines the collection and management of lost items, reducing the burden on users. Furthermore, by using advertising revenue as a source of income, it is possible to realize a sustainable business model that balances the interests of both the company and users.

[1480] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1481] Step 1:

[1482] The server provides the BLE chip to the end user, who then attaches the BLE chip to an easily lost item such as a key or wallet. The inputs are the BLE chip and the item, and the output is the item with the BLE chip attached.

[1483] Step 2:

[1484] The device receives signals from the BLE chip. The input is the signal from the BLE chip, and the output is the signal strength (RSSI). The device receives signals using a BLE communication library (CoreBluetooth for iOS, Android BLE API for Android).

[1485] Step 3:

[1486] The terminal estimates the distance of the item based on the signal strength. The input is the signal strength (RSSI) and the output is the estimated distance of the item. The terminal analyzes the signal strength and determines whether the item is nearby.

[1487] Step 4:

[1488] If an item is nearby, the device sends an alert to the user. The input is the estimated distance of the item, and the output is the alert notification. The alert can be in the form of a sound, vibration, or on-screen notification.

[1489] Step 5:

[1490] When an item leaves a specific area, the device sends its location information to the cloud server. The input is the item's location information, and the output is data transmission to the cloud server. The device determines the location of the item using location services such as GPS and Wi-Fi.

[1491] Step 6:

[1492] The cloud server notifies the user when an item leaves a specific area. The input is the item's location information, and the output is a notification message. The server generates a notification based on the user's settings and sends it to the device.

[1493] Step 7:

[1494] The cloud server stores the location history of the item. The input is the location information of the item, and the output is the location history data. The server stores the location information in a database, allowing users to check the past locations.

[1495] Step 8:

[1496] The user checks the location history of an item through a smartphone application. The input is the location history data, and the output is a display of the location history. The user can view past location information using the application interface.

[1497] In this way, the system reduces the risk of losing items and helps users find them quickly. It also streamlines the collection and management of lost items, reducing the burden on users. Furthermore, by using advertising revenue as a revenue source, it can realize a sustainable business model that balances the interests of both the company and users.

[1498] Example 2

[1499] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1500] In conventional lost property management systems, the process of receiving and managing lost items was cumbersome, making efficient search and management difficult. The burden on users to find lost items was also heavy, making the overall system operation inefficient. Furthermore, revenue sources were limited, and a sustainable operating model had not been established.

[1501] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server provides a wireless communication module to an end user. When the user passes near an item equipped with the wireless communication module, an alert is generated on the terminal. The user then picks up the item and returns it to a specific location to find the lost item. It also includes: a means for taking an image of the item using the terminal when the lost item is received; a means for the server to analyze the received image and extract features of the item; a means for registering the extracted features in a database; and a means for the user to send search criteria from the terminal to the server when searching for a lost item, and for the server to search the database and return information on lost items matching the criteria to the terminal. This improves the efficiency of receiving and managing lost items, allowing users to easily search for and find lost items. Furthermore, by using advertising revenue as a source of income, a sustainable operational model is realized, enabling companies and users to share profits.

[1502] A "wireless communication module" is an electronic component for transmitting and receiving data using short-range wireless communication.

[1503] A "terminal" is an electronic device that can be operated by a user and that has a camera and communication functions.

[1504] A "server" is a computer system that processes and stores data over a network.

[1505] "Image analysis" is a technique for extracting specific information or features from captured image data.

[1506] "Feature extraction" is the process of identifying characteristics such as the color, shape, size, and brand logo of an object from information obtained through image analysis.

[1507] A "database" is a system for efficiently storing, searching, and managing data.

[1508] "Search criteria" are the particular criteria or parameters a user specifies when searching for lost property.

[1509] An "alert" is a notification or warning that appears on a device when certain conditions are met.

[1510] "Advertising revenue" refers to revenue earned by displaying advertisements.

[1511] The "profit sharing model" is a business model in which companies and users can mutually benefit from each other.

[1512] The present invention is a system for efficiently receiving and managing lost property. A specific embodiment of this system will be described below.

[1513] Hardware and Software Configuration

[1514] Terminal

[1515] The device operated by the user is equipped with a high-resolution camera and internet connectivity, and serves the purpose of taking pictures of lost items and sending the image data to a server.

[1516] server

[1517] The server has image analysis software such as "OpenCV" and "TensorFlow" installed. Using this software, the server analyzes the received image data and extracts the features of the items. The server also has database management systems such as "MySQL" and "PostgreSQL" installed, and the extracted features are registered in a database.

[1518] Data processing and calculation

[1519] Image analysis

[1520] When the server analyzes the received image data, it first pre-processes the image. Specifically, it removes noise from the image and emphasizes the outlines of the item. Next, it uses image analysis software to extract the item's features. These features include color, shape, size, brand logo, etc.

[1521] Feature Extraction

[1522] The server identifies the features of the item from the information obtained through image analysis, such as the wallet's color (black), shape (rectangle), and brand logo (specific brand name).

[1523] Registering in the database

[1524] The server registers the extracted features in a database, which makes it easier to search and manage lost property. The database efficiently stores the item's feature information and allows it to be searched as needed.

[1525] Specific examples

[1526] Receiving and registering lost property

[1527] Suppose a user finds a black, rectangular brand-name wallet at a train station. The user takes a picture of the wallet using the device's camera, and the device sends the image to a server. The server uses image analysis software to extract the wallet's color (black), shape (rectangle), and brand logo, and registers these features in a database.

[1528] Lost property search

[1529] Suppose a user is looking for a black rectangular brand wallet. The user sends the search criteria "black rectangular brand wallet" to the server from their device. The server searches the database and returns information about lost property that matches the criteria to the device. For example, the server verifies that "black rectangular brand wallet" is registered and provides that information to the user.

[1530] Prompt Sentence Examples

[1531] Examples of prompts to be input to a generative AI model include:

[1532] "I'm looking for a black rectangular designer wallet. It may have been recently found at a station. Could you please tell me the details of the lost property?"

[1533] By inputting this prompt into the generative AI model, information about the relevant lost item can be efficiently obtained.

[1534] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1535] Step 1: Take a photo of the lost item

[1536] When a user receives a lost item, they use the device to take a picture of the item. The device is equipped with a high-resolution camera that can capture detailed images of the item. For example, if a user finds a wallet at a train station, they can use the device's camera to take a picture of the wallet. The input is the actual item, and the output is high-resolution image data.

[1537] Step 2: Sending image data

[1538] The device sends the captured image data to the server. The device has an internet connection and can quickly upload the image data to the server. For example, the device sends the image data to the server using Wi-Fi or mobile data communication. The input is high-resolution image data, and the output is the image data sent to the server.

[1539] Step 3: Image analysis

[1540] The server analyzes the image data it receives. Image analysis software such as "OpenCV" and "TensorFlow" is installed on the server. This software is used to perform preprocessing to extract the features of the item from the image. For example, the server removes noise from the image and emphasizes the outline of the item. The input is the image data sent to the server, and the output is the preprocessed image data.

[1541] Step 4: Feature extraction

[1542] The server uses image analysis software to extract features of an item. Specifically, it obtains information such as color, shape, size, and brand logo. For example, the server extracts the color (black), shape (rectangle), and brand logo of a wallet. The input is preprocessed image data, and the output is extracted feature data.

[1543] Step 5: Register with the database

[1544] The server registers the extracted features in a database. "MySQL" or "PostgreSQL" is used for the database. The registered data is used to search for and manage lost property. For example, the server stores the feature "black rectangular brand wallet" in the database. The input is the extracted feature data, and the output is the feature data registered in the database.

[1545] Step 6: Search for lost property

[1546] When a user searches for lost property, they send search criteria from their device to the server. The server searches the database and returns information about lost property that matches the criteria to the device. For example, if a user enters "black rectangular brand wallet" as a search criterion, the server searches the database and returns information about the corresponding lost property. The input is the search criteria specified by the user, and the output is information about lost property that matches the criteria.

[1547] (Application example 2)

[1548] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1549] In conventional lost property management systems, the process of receiving and managing lost items is cumbersome, and it is particularly difficult to accurately grasp the characteristics of the items and quickly search and identify them.In addition, the burden on users to find lost items is heavy, so efficient management is required.

[1550] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a wireless communication chip to an end user, an alert being issued to the terminal when the user passes near an item equipped with the wireless communication chip, and the device picking up the item and delivering it to a specific location, means for taking an image of the lost item and extracting characteristics of the item using image analysis technology, means for registering the extracted characteristics in a cloud database, means for providing a lost item search function and for quickly identifying the lost item based on the characteristics, and means for providing a function for notifying the location and time of collection of the lost item. This improves the efficiency of collection and management of lost items, reduces the burden on users, and enables the lost item to be identified quickly and accurately.

[1551] A "wireless communication chip" is a small electronic component that transmits and receives data using short-range wireless communication.

[1552] An "article" is a physical object that has certain characteristics.

[1553] A "terminal" is an electronic device that is operated by a user, and includes smartphones, tablets, and the like.

[1554] An "alert" is a warning or caution signal that notifies the user when a specific condition is met.

[1555] "Image analysis technology" is a technology for extracting specific information or features from image data.

[1556] A "cloud database" is a database that can be accessed via the Internet and is a system for storing and managing data.

[1557] A "search function" is a function for finding information within a database based on specific conditions or keywords.

[1558] The "notification function" is a function for notifying the user of information when a specific event or condition occurs.

[1559] A system for implementing the present invention is configured as follows.

[1560] First, the user carries an item equipped with a wireless communication chip, and when the user passes by the item, an alert appears on the device, allowing the user to pick up the item and deliver it to a specific location.

[1561] Next, when the lost item is delivered to a specific location, the device takes a picture of the lost item. This picture is analyzed using image analysis technology to extract the item's features (e.g., color, shape, size, brand logo, etc.). Image analysis is performed using OpenCV and TensorFlow.

[1562] The extracted features are registered in a cloud database using Firebase, and are later used to search for lost items.

[1563] When a user searches for a lost item, the device accesses the cloud database and quickly identifies the lost item based on its characteristics. The search function allows users to find information in the database based on specific criteria or keywords.

[1564] Additionally, a notification function for the location and time of lost property pickup is also provided, allowing users to know the best place and time to pick up their lost property.

[1565] As a concrete example, consider the case where a medium-sized, round, red brand-name hat is reported as lost property. The user takes a picture of the lost item with their device and extracts its features using image analysis technology. The extracted features are registered in a cloud database, and the user can quickly identify the lost item by searching for "red hat."

[1566] An example of a prompt is as follows:

[1567] "Please upload an image of your lost item. Please also provide details about the item (color, shape, size, brand)."

[1568] In this way, the receipt and management of lost items is made more efficient, reducing the burden on users and enabling lost items to be identified quickly and accurately.

[1569] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1570] Step 1:

[1571] A user carries an item equipped with a wireless communication chip. The wireless communication chip is a small electronic component that transmits and receives data using short-range wireless communication. When the user passes near the item, an alert is displayed on the terminal. The input is a signal from the wireless communication chip, and the output is the alert displayed on the terminal.

[1572] Step 2:

[1573] The user receives an alert, picks up an item, and delivers it to a specific location. The input is the alert displayed on the terminal, and the output is that the item has been delivered to a specific location. The user picks up the item and takes it to the specified location.

[1574] Step 3:

[1575] The device takes an image of the lost item. The input is the item picked up by the user, and the output is the captured image. The device's camera function is used to take an image of the lost item.

[1576] Step 4:

[1577] The device uses image analysis technology to extract features of an item. The input is the captured image, and the output is the extracted features. OpenCV and TensorFlow are used for image analysis. The image is preprocessed, and data processing and calculation are performed to extract features.

[1578] Step 5:

[1579] The server registers the extracted features in a cloud database. The input is the extracted features, and the output is the data registered in the cloud database. Firebase is used to save the feature data in the database.

[1580] Step 6:

[1581] When a user searches for a lost item, the device accesses the cloud database and quickly identifies the lost item based on its characteristics. The input is the search criteria entered by the user, and the output is the search results. The search function is used to find information in the database based on specific criteria or keywords.

[1582] Step 7:

[1583] The server provides a notification function for the location and time of collection of lost items. The input is the search result, and the output is the information of the location and time of collection notified to the user. The notification function is used to inform the user of the optimal location and time of collection.

[1584] In this way, the receipt and management of lost items is made more efficient, reducing the burden on users and enabling lost items to be identified quickly and accurately.

[1585] Example 3

[1586] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1587] Conventional lost property management systems lacked the functionality to display relevant advertisements when users reported or searched for lost items, making it impossible to provide useful information to users. Furthermore, the process of receiving and managing lost items was cumbersome, placing a heavy burden on users. Furthermore, many systems required users to bear the system's operating costs, making it difficult to promote user adoption.

[1588] The identification process by the identification processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means. In this invention, the server includes: means for providing an interface for a user to report a lost item; means for the server to store lost item information in a database; means for the server to select relevant advertisements based on the characteristics of the lost item; means for the terminal to display advertisements on a lost item report screen; means for providing an interface for a user to search for a lost item; means for the server to obtain search results from the database; means for the server to select relevant advertisements based on search keywords; and means for the terminal to display advertisements on a search result screen. This allows relevant advertisements to be displayed when a user reports or searches for a lost item, providing useful information to the user. Furthermore, the efficiency of receiving and managing lost items is improved, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, the burden on the user is reduced, and a profit-sharing model between the company and the user can be realized.

[1589] A "wireless communication module" is an electronic component for short-range wireless communication, and when attached to an item, has the function of transmitting its location information to a terminal.

[1590] "Item" means any object owned by a User that may be reported as lost or found.

[1591] A "terminal" is an electronic device used by a user, such as a smartphone or a personal computer.

[1592] An "alert" is a signal or message that notifies the user that a lost item is nearby.

[1593] "Interface" refers to the screens and controls that allow users to interact with the system, such as reporting lost items and searching for them.

[1594] A "server" is a computer system for storing and processing data, and for managing lost property information and advertising information.

[1595] A "database" is a system for systematically storing and managing information, and stores lost property information and advertising information.

[1596] "Advertisement" means commercial information provided to the user that advertises services or products related to the characteristics of the lost item.

[1597] "Search keywords" are words or phrases that a user enters when searching for lost property, and which allow the server to retrieve relevant information from the database.

[1598] The "profit sharing model" is a business model that uses advertising revenue as a source of income in operating a system, reducing the burden on users while bringing benefits to both companies and users.

[1599] The present invention provides a system for displaying related advertisements when a user reports or searches for lost items. The system includes a wireless communication module, a terminal, a server, a database, and an advertisement management function.

[1600] First, a user owns an item equipped with a wireless communication module. The wireless communication module is an electronic component for short-range wireless communication and has the function of transmitting the item's location information to a terminal. If the user loses the item, an alert will be displayed on the terminal.

[1601] The user uses a terminal to access the lost item report screen and enters detailed information about the lost item (e.g., black wallet, location, date and time, etc.). The terminal refers to a device such as a smartphone or PC. The information entered by the user is sent to the server.

[1602] The server receives lost property information sent by users and stores it in a database. The database is a system for systematically storing and managing information, and stores lost property information and advertising information. The server uses Amazon Web Services (AWS) and Amazon RDS as its database.

[1603] The server then selects a relevant advertisement based on the characteristics of the lost item. For example, if the lost item is a key, it selects an advertisement for a key duplication service. The server retrieves the appropriate advertisement from the advertisement database and sends it to the device. The device then displays the advertisement on the lost item report screen.

[1604] When a user searches for a lost item, they use their terminal to access the lost item search screen and enter a search keyword (e.g., a black wallet). The server receives the user's search keyword and retrieves the corresponding lost item information from the database. The server then sends the search results to the terminal.

[1605] The server then selects relevant advertisements based on the search keywords. For example, if the search keyword is "black wallet," it will select advertisements for wallet repair services. The server retrieves the appropriate advertisements from the advertisement database and sends them to the device. The device then displays the advertisements on the search results screen.

[1606] As a concrete example, consider the case where a user reports "I lost my black wallet." The user uses their smartphone to access the lost property report screen and enters "black wallet." The server receives the "black wallet" information and stores it in Amazon RDS. The server then selects an advertisement related to "black wallet," for example, an advertisement for a "wallet repair service," and sends it to the device. Once the user has completed the report, an advertisement for the "wallet repair service" is displayed on the device.

[1607] An example of a prompt to input to a generative AI model might be, "Generate an advertisement that will be displayed when a user reports a lost item."

[1608] This system allows relevant advertisements to be displayed when a user reports or searches for lost items, providing useful information to the user. It also streamlines the collection and management of lost items, reducing the burden on the user. Furthermore, by using advertising revenue as a source of income, it is possible to reduce the burden on the user and realize a profit-sharing model between the company and the user. The flow of the identification process in Example 3 will be described with reference to FIG. 15.

[1609] Step 1:

[1610] User reports lost property

[1611] The user uses the terminal to access a lost item report screen and enters detailed information about the lost item (e.g., black wallet, location, date and time, etc.).

[1612] Input: Lost property details

[1613] Output: Lost item information is sent to the server

[1614] Step 2:

[1615] The server stores the lost property information in a database

[1616] The server receives the lost property information sent by the user and stores it in a database.

[1617] Input: Lost property information sent by the user

[1618] Output: Lost property information stored in the database

[1619] Step 3:

[1620] The server selects relevant ads

[1621] The server selects relevant advertisements based on the characteristics of the lost item, for example, if the lost item is a key, it selects advertisements for key duplication services.

[1622] Input: Lost property characteristics

[1623] Output: Selected advertising information

[1624] Step 4:

[1625] The device displays advertisements on the lost item report screen

[1626] The terminal displays the advertising information received from the server.

[1627] Input: Advertising information sent from the server

[1628] Output: Advertisement displayed on the lost property report screen

[1629] Step 5:

[1630] User searches for lost property

[1631] The user uses the terminal to access the lost property search screen and enters a search keyword (e.g., black wallet).

[1632] Input: Search keyword

[1633] Output: Search keywords sent to the server

[1634] Step 6:

[1635] The server retrieves the search results from the database

[1636] The server receives the user's search keywords and retrieves the corresponding lost property information from the database.

[1637] Input: Search keyword

[1638] Output: Lost property information retrieved from the database

[1639] Step 7:

[1640] The server selects relevant ads

[1641] The server selects relevant ads based on the search keywords, for example, if the search keyword is "black wallet," it will select ads for wallet repair services.

[1642] Input: Search keyword

[1643] Output: Selected advertising information

[1644] Step 8:

[1645] The device displays ads on the search results screen

[1646] The terminal displays the search results and advertising information received from the server.

[1647] Input: Search results and advertising information sent from the server

[1648] Output: Ad displayed on search results page

[1649] (Application example 3)

[1650] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1651] The present invention relates to lost property management and notification, and aims to provide a system that balances the interests of both companies and users by using advertising revenue as a source of income while reducing the burden on users. Another objective is to improve the user experience by providing useful information to users when lost property is found.

[1652] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server provides a wireless communication chip to an end user, and when the user passes near an item equipped with the wireless communication chip, a notification is sent to the terminal, and the item is picked up and delivered to a specific location. The server also includes a means for instantly describing characteristics from an image and creating a database, which addresses the issue of receiving and managing lost items. A revenue source is advertising revenue, rather than a user fee, and this balances the interests of both the company and the user. A means for sending a notification to the user when a lost item is found and displaying a related advertisement on the notification screen. This allows for efficient management and notification of lost items, making it possible to provide useful information to users while earning advertising revenue.

[1653] A "wireless communication chip" is an electronic component for short-range wireless communication, which is attached to an item and has the function of sending notifications to the terminal of a user passing nearby.

[1654] An "article" is an object that may be owned by a user and to which a wireless communication ...

Claims

1. A means for finding a lost item by receiving an alert on a terminal when a user passes near an object equipped with a wireless communication module, and picking up the object and returning it to a specific location; A means for describing characteristics of the lost item from an image and storing the characteristics in a database; a means for recognizing an emotional state of the user using an emotion recognition engine and changing a method of displaying advertisements on the terminal in accordance with the emotional state; A system including:

2. The system of claim 1 , further comprising: determining how to display an advertisement based on the emotional state of the user recognized by the emotion recognition engine.

3. The system of claim 1 , wherein advertisements are dynamically displayed in response to the emotional state of the user recognized by the emotion recognition engine.

Images