System

Abstract

A system is provided.SOLUTION: The system for performing a procedure for easily assessing, selling and disposing of the unnecessary article owned by the user includes a terminal mounted with a camera for acquiring the video of the unnecessary article, a server for analyzing the acquired video data, recognizing the article and assessing the market value, and a means for presenting the assessment result and the choices of selling and disposal to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Many modern households tend to accumulate unnecessary items, and the complicated procedures for disposing of them place a heavy burden on users. Furthermore, since the market value of items cannot be accurately assessed, it is difficult to sell them appropriately. There is a need for a system that solves these issues and allows users to easily assess unwanted items and sell or dispose of them efficiently. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means. This system allows users to easily appraise unwanted items and handle the procedures for selling and disposing of them. The system includes a terminal equipped with a camera that captures video of the unwanted items, a server that analyzes the captured video data, recognizes the items, and assesses their market value, and a means for presenting the user with the appraisal results and options for selling or disposing of them. The system also includes a means for analyzing the video data transmitted from the terminal in real time, searching a database for characteristic information about the items, and calculating their market value. The system also includes a means for allowing the user to select whether to sell or dispose of the items based on the appraisal results presented by the terminal, and for transmitting the selection information to the server. This allows users to easily and appropriately appraise and dispose of their unwanted items.

[0006] "User" means an individual or organization that uses the System to appraise, sell, or dispose of unwanted items.

[0007] "Unwanted items" are physical items that a user owns but no longer needs and would like to sell or dispose of.

[0008] "Simple" refers to operations and procedures that users can easily perform without requiring time or effort.

[0009] "Appraisal" is the act of assessing the market value of unwanted items and estimating their value.

[0010] "Selling" means transferring unwanted items to a third party in exchange for money.

[0011] "Disposal" means taking steps to discard or reuse unwanted items.

[0012] "Procedure" refers to a series of operations, administrative procedures, delivery, and other processes related to the sale or disposal.

[0013] "System" means a combination of software and hardware that work together to conveniently appraise, sell, and dispose of a User's unwanted items.

[0014] A "camera" is a photographic device that captures images and processes them as digital data.

[0015] A "terminal" is a mobile device or computer equipped with a camera and used by a user.

[0016] "Video data" is digital information of images or videos captured by a camera.

[0017] The "server" is a computer system that analyzes the video data sent from the terminal, recognizes the item, and assesses its market value.

[0018] "Analysis" refers to the act of analyzing the received video data using a computer program and identifying unwanted items.

[0019] "Recognition" is the process of identifying the type and characteristics of unwanted items through video analysis.

[0020] "Market value" is the monetary value at which the assessed unwanted items are traded in the market.

[0021] "Presentation" refers to the act of visually displaying the appraisal results and options for selling or disposing of the property to the user.

[0022] "Characteristic information" is a collection of identifiable data including the type, condition, size, etc. of an item.

[0023] A "database" is an information management system that stores information on market value and past transaction data.

[0024] "Selection" is the act of a user deciding which of the options (sale or disposal) they wish to have presented. [Brief explanation of the drawings]

[0025] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0026] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0027] First, the terms used in the following description will be explained.

[0028] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0029] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0030] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0031] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0032] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0033] [First embodiment]

[0034] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0035] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0036] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0037] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0038] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0039] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0040] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0041] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0042] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0043] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0044] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0045] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0046] MODE FOR CARRYING OUT THE INVENTION

[0047] The present invention relates to a system for easily assessing unwanted items owned by users and efficiently selling or disposing of them. The system of the present invention includes a terminal equipped with a camera, a server that analyzes the video data, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[0048] System Overview

[0049] The system of the present invention includes a terminal equipped with a camera for capturing images of unwanted items, a server for analyzing the image data, recognizing the items, and assessing their market value, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[0050] The terminal is a mobile device such as a smartphone or tablet owned by the user, and captures images of unwanted items using a camera. The captured image data is then sent to a server in real time.

[0051] The server receives and analyzes the video data. Specifically, it uses a video analysis algorithm to recognize items in the video and searches a database for market value based on their characteristics. It then calculates the appraisal amount and sends it to the terminal.

[0052] The terminal presents the user with the received appraisal price and the option to sell or dispose of the item. When the user makes a selection, the selection information is sent to the server. The server then carries out the sale or disposal procedure based on the user's selection and notifies the terminal of the progress.

[0053] Natural language explanation of program processing

[0054] 1. Launching the smartphone app and accessing the camera

[0055] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The app requests permission to access the camera.

[0056] With the user's permission, the terminal prepares to acquire camera images in real time.

[0057] The user photographs the unwanted item on camera.

[0058] 2. Recognition and appraisal of items

[0059] The device transmits the video data captured by the camera to the server in real time.

[0060] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize unwanted items.

[0061] The server extracts the characteristic information of the recognized item, searches the market value in a database, and calculates the appraised amount.

[0062] 3. Display of assessment results

[0063] The server sends the calculated appraisal amount and detailed item information to the terminal.

[0064] The terminal displays the appraisal results to the user, showing a photo of the item, its name, the estimated value, and the option to sell or dispose of it.

[0065] 4. Sale or Disposal Procedures

[0066] The user chooses to sell or dispose of the property.

[0067] The terminal transmits the user's selection to the server.

[0068] The server will initiate the disposal procedure based on the selection, notify the logistics company of the information regarding the collection of the selected items, and arrange the date and time for collection.

[0069] The server sends the progress of the procedure to the terminal, and the terminal notifies the user.

[0070] Specific examples

[0071] Case: Selling your old smartphone

[0072] 1. A user wants to dispose of an old smartphone, so they launch the "Treasure Discovery! Appraisal & Disposal Agent AI" app. They allow camera access and point their old smartphone at the camera.

[0073] 2. The device sends the video data captured by the camera to the server in real time.

[0074] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[0075] 4. The server sends the appraisal results to the terminal, and the terminal displays the appraisal amount (2,000 yen) and selling options to the user.

[0076] 5. If the user chooses to sell, the selection is sent to the server.

[0077] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[0078] 7. The logistics company will pick up the old smartphone at the user's address.

[0079] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[0080] 9. The terminal displays a notification to the user that the transfer is complete.

[0081] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately.

[0082] The processing flow will be explained below.

[0083] Step 1:

[0084] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone, and the app requests permission to access the camera.

[0085] Step 2:

[0086] The user performs an operation to allow camera access.

[0087] Step 3:

[0088] The device prepares to acquire camera footage and makes it possible to acquire footage in real time.

[0089] Step 4:

[0090] The user takes a picture of unwanted items in their home with a camera.

[0091] Step 5:

[0092] The device transmits the video data captured by the camera to the server in real time, frame by frame.

[0093] Step 6:

[0094] The server analyzes the received video data and recognizes the objects in the video. Specifically, it uses a video analysis algorithm to identify the type and shape of the object.

[0095] Step 7:

[0096] The server extracts characteristic information (e.g., type, condition, size, etc.) of the recognized item.

[0097] Step 8:

[0098] The server searches the database for the relevant market value based on the characteristic information of the item.

[0099] Step 9:

[0100] The server calculates the market value based on the database search results and determines the assessed amount.

[0101] Step 10:

[0102] The server sends the appraisal results and detailed item information to the terminal.

[0103] Step 11:

[0104] The device displays the estimated value and the option to sell or dispose of the item to the user. Specifically, it presents a photo of the item, its name, the estimated value, etc.

[0105] Step 12:

[0106] The user checks the appraisal results and chooses whether to sell or dispose of the property.

[0107] Step 13:

[0108] The terminal transmits the user's selection (sale or disposal) to the server.

[0109] Step 14:

[0110] The server initiates the disposal procedure based on the user's selection. Specifically, it notifies the distribution company of the collection information for the selected items.

[0111] Step 15:

[0112] The server coordinates the pickup date and time with the logistics company and sends the confirmed pickup schedule to the terminal.

[0113] Step 16:

[0114] The terminal notifies the user of the pickup schedule, displaying the specific date and time and preparations.

[0115] Step 17:

[0116] The logistics company will pick up the item at the user's address.

[0117] Step 18:

[0118] The logistics company notifies the server that the pickup is complete.

[0119] Step 19:

[0120] The server confirms that the transaction has been completed and then transfers the sales amount.

[0121] Step 20:

[0122] The server transfers the sales amount to the account specified by the user and sends a notification of the completion of the transfer to the terminal.

[0123] Step 21:

[0124] The terminal displays a notification to the user that the transfer has been completed.

[0125] Example 1

[0126] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0127] In modern society, many users are seeking a means to easily appraise and efficiently sell or dispose of unwanted items. Conventional systems require users to manually appraise and sell or dispose of items themselves, which is time-consuming and labor-intensive. Furthermore, assessing the accurate market value of items requires specialized knowledge, making it difficult for users. The present invention aims to provide a system that allows users to easily appraise and efficiently sell or dispose of unwanted items.

[0128] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0129] In this invention, the server includes means for analyzing video data using an image analysis algorithm and a classification algorithm, extracting feature information of the item, and calculating the market value, means for transmitting the appraisal results to the user's terminal and presenting the option of selling or disposing of the item, and means for carrying out procedures based on the user's selection and notifying the user of the progress. This allows users to easily appraise unwanted items, accurately grasp their market value, and efficiently sell or dispose of them.

[0130] "Terminal" means a mobile device (such as a smartphone or tablet) equipped with a camera and used by a User.

[0131] A "server" is a computer system that receives video data and performs analysis and market value assessment.

[0132] "Unwanted items" refers to any items that the user no longer needs.

[0133] "Video data" is video information of an item captured through the camera of the terminal.

[0134] "Video analysis" is the process of analyzing video data to recognize objects and extract feature information.

[0135] "Characteristic information" is information about the specific attributes and characteristics of an item (e.g., manufacturer, model, condition).

[0136] "Market value" refers to the current market or trading price of an item.

[0137] A "database" is a data structure or system that stores information for retrieving the market value of an item.

[0138] The "valuation result" is the amount calculated based on the market value of the item and detailed information about the item.

[0139] "Options" are sale or disposal options offered to the User based on the results of the appraisal.

[0140] A "procedure" is a series of steps related to the sale or disposal that are carried out based on the user's selection.

[0141] "Notification" is information that informs the user about the progress and results of a procedure.

[0142] This invention relates to a system for easily assessing unwanted items owned by users and efficiently selling or disposing of them. The system of the present invention includes a terminal equipped with a camera, a server that analyzes the video data, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[0143] Hardware and Software Configuration

[0144] 1. Terminal

[0145] The terminal is a mobile device such as a smartphone or tablet, and is equipped with a camera.

[0146] A dedicated application installed on the device (e.g., the "Treasure Discovery! Appraisal & Disposal Agent AI" app) uses the camera to capture footage of unwanted items.

[0147] 2. Server

[0148] The server is a high-performance computer system that analyzes video data and assesses market value.

[0149] The server uses an image analysis library (e.g., OpenCV) and a machine learning model (e.g., TensorFlow) to analyze the video data and extract feature information about the item.

[0150] The server uses a database system (e.g., MySQL) to look up market value and calculate the appraisal amount.

[0151] 3. Means of communication

[0152] The terminal and the server communicate in real time via the Internet.

[0153] Usage and processing flow

[0154] 1. App launch and camera access

[0155] When the user launches the dedicated application and allows access to the camera, the app prepares to acquire camera footage in real time.

[0156] When a user captures an unwanted item on the camera, the device sends the video data to a server in real time.

[0157] 2. Recognition of the goods and assessment of their market value

[0158] The server receives the video data and uses image analysis algorithms and classification models to recognize the items.

[0159] The system extracts characteristic information about the item (e.g., manufacturer, model, condition), searches for market value in a database, and calculates the appraisal amount.

[0160] 3. Presenting the assessment results and offering options

[0161] The server transmits the calculated appraisal amount and detailed information about the item to the terminal.

[0162] The device displays the appraisal results to the user and offers the option of selling or disposing of the item.

[0163] 4. Execution of sale or disposal procedures

[0164] When the user selects to sell or dispose of the item, the selection information is sent from the terminal to the server.

[0165] The server starts the procedure based on the selection, notifies the logistics company of information regarding the collection of the selected items, and arranges the date and time of collection.

[0166] The server notifies the terminal of the progress of the procedure, and the terminal displays the progress to the user.

[0167] Specific examples

[0168] Case: Procedure for selling your old smartphone

[0169] 1. A user wants to dispose of their old smartphone, so they launch the dedicated app, allow camera access, and point their old smartphone at the camera.

[0170] 2. The device sends the video data captured by the camera to the server in real time.

[0171] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[0172] 4. The server sends the appraisal results to the terminal, which then displays the appraisal amount (2,000 yen) and selling options to the user.

[0173] 5. If the user chooses to sell, the selection is sent to the server.

[0174] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[0175] 7. The logistics company will pick up the old smartphone at the user's address.

[0176] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[0177] 9. The terminal will notify the user that the transfer is complete.

[0178] Example prompts for generative AI models

[0179] prompt:

[0180] I want to get rid of my old smartphone, and I want to use the camera in a dedicated app to request an appraisal. How can I go about this?

[0181] Example output:

[0182] 1. Launch the app and allow camera access.

[0183] 2. Point the old smartphone at the camera, and the device will send the video data to the server.

[0184] 3. The server analyzes the video data and assesses its market value.

[0185] 4. The server sends the assessment results to the terminal, which displays them to the user.

[0186] 5. Select Sell and your device will send your selection to the server.

[0187] 6. The server notifies the logistics company and arranges a pickup date and time.

[0188] 7. The logistics company will pick up your old smartphone at your address.

[0189] 8. The server will transfer the sales amount to the specified account.

[0190] 9. The terminal will notify the user that the transfer is complete.

[0191] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0192] Step 1:

[0193] The user launches the dedicated application and allows camera access.

[0194] Input: Camera access permission from user

[0195] Processing: The device initializes the camera.

[0196] Output: The camera is ready to capture video in real time.

[0197] Specific behavior: Launch the app and tap the "Launch Camera" button. The camera access permission dialog will be displayed and the user will select "Allow."

[0198] Step 2:

[0199] The user photographs the unwanted item on camera.

[0200] Input: Camera footage of unwanted items

[0201] Processing: The device captures the video in real time and converts it into video data.

[0202] Output: Video data

[0203] Specific operation: Operate the camera to display the unwanted item on the screen. The image will be displayed on the device screen in real time.

[0204] Step 3:

[0205] The device transmits the video data captured by the camera to the server in real time.

[0206] Input: Video data

[0207] Processing: Compresses the video data and divides it into data packets for transmission to the server

[0208] Output: Video data sent to the server

[0209] Specific operation: The device sends video data to the server using an HTTP request.

[0210] Step 4:

[0211] The server receives the video data and performs video analysis using an image analysis algorithm.

[0212] Input: Video data sent to the server

[0213] Processing: Recognize objects in the video using image analysis algorithms (e.g., OpenCV) and extract feature information of the objects.

[0214] Output: Item characteristics (e.g., make, model, condition)

[0215] How it works: The server analyzes the video data frame by frame and uses machine learning models (e.g., TensorFlow) to identify the objects.

[0216] Step 5:

[0217] The server searches the database for characteristic information about the item and assesses its market value.

[0218] Input: Item characteristics information

[0219] Processing: Issue an SQL query based on the feature information to obtain the market value from the database, then calculate the appraisal amount.

[0220] Output: Appraised amount and detailed item information

[0221] Specific operation: The server searches the database for data matching the item's characteristics and performs an appraisal based on information such as recent transaction prices.

[0222] Step 6:

[0223] The server sends the calculated appraisal amount and detailed item information to the terminal.

[0224] Input: Appraised amount and item details

[0225] Processing: Divide the data into packets and send them to the device

[0226] Output: The assessed value and detailed item information sent to the terminal

[0227] Specific operation: The server sends the assessment results to the terminal using an HTTP response.

[0228] Step 7:

[0229] The terminal displays the assessment results to the user.

[0230] Input: Estimated amount and detailed item information sent from the server

[0231] Processing: Parse the data and display it in the user interface

[0232] Output: The assessment results and options displayed to the user

[0233] What it does: The device screen will display a photo of the item, its name, its estimated value, and the option to sell or dispose of it.

[0234] Step 8:

[0235] The user chooses to sell or dispose of the property.

[0236] Input: User's choice (sale or disposal)

[0237] Processing: Converting user selections into data to send to the server

[0238] Output: User selections sent to the server

[0239] What happens: The user taps the sell or dispose option and then taps the "Confirm" button.

[0240] Step 9:

[0241] The terminal transmits the user's selection to the server.

[0242] Input: User selection

[0243] Processing: Convert the selection into a data packet and send it to the server

[0244] Output: Selections sent to the server

[0245] Specific operation: The device sends the selection to the server using an HTTP request.

[0246] Step 10:

[0247] The server performs the procedure based on the user's selection.

[0248] Input: User selection

[0249] Processing: Generate information to initiate a sale or disposal procedure

[0250] Output: Specific instructions and data for carrying out the procedure

[0251] Specific operation: The server notifies the logistics company of the selection and arranges the pickup date and time.

[0252] Step 11:

[0253] The server notifies the terminal of the progress of the procedure.

[0254] Input: Progress of procedure

[0255] Processing: Packetize progress data and send it to the device

[0256] Output: Progress notifications sent to the terminal

[0257] Specific operation: The server sends the procedure progress status to the terminal using an HTTP response.

[0258] Step 12:

[0259] The terminal notifies the user of the progress of the procedure.

[0260] Input: Progress notification sent by the server

[0261] Processing: Parse the notification data and display it in the user interface

[0262] Output: Progress notification displayed to the user

[0263] Specific operation: Messages such as "Disposal procedures have begun" and "Pickup date and time has been decided" will be displayed on the terminal screen.

[0264] (Application example 1)

[0265] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0266] Conventional procedures for appraising and disposing of unwanted items have been cumbersome and time-consuming for users. For example, when bringing unwanted items to a recycle shop, the appraisal often takes time and the process is tedious. Furthermore, because information on the market value of unwanted items is unclear, users may be dissatisfied with the appraisal amount. For these reasons, there is a demand for a system that allows users to easily appraise and dispose of unwanted items.

[0267] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0268] In this invention, the server includes a means for analyzing video data transmitted from the terminal in real time, a means for searching for characteristic information of the item from a sample collection to calculate the market value, and a means for initiating a purchase procedure at the store, thereby enabling users to easily carry out appraisals and purchase procedures for unwanted items in the store.

[0269] "Unwanted items" are items that a user no longer uses or has determined to be unnecessary.

[0270] "Appraisal" is the process of assessing and calculating the market value of a particular item.

[0271] "Consideration procedures" refers to the system's ability to act on behalf of all activities and procedures related to the acquisition, valuation, sale or disposal of an item.

[0272] "Device with a camera" refers to a smartphone, tablet, or other electronic device with a camera function that is used to capture video data of unwanted items.

[0273] "Video data" refers to visual information captured by a camera, and is data in the form of images or videos of items.

[0274] "Server" refers to a computer system that analyzes video data, identifies items, and calculates their market value.

[0275] "Market value" refers to the monetary value of an item when it is traded in the market, and means the price evaluation at that time.

[0276] "Selling" refers to the act of a user selling unwanted items to another person, meaning that the items are physically traded.

[0277] "Disposal" refers to the act of discarding unwanted items, including recycling, waste disposal, or otherwise relinquishing ownership of the items.

[0278] "Means for presenting options" refers to an interface for visually or audibly presenting the appraisal results and sale or disposal options to the user.

[0279] A "sample set" refers to a database that accumulates characteristic information about an item and calculates its market value based on that information.

[0280] "Purchase procedure" refers to all procedures carried out to sell an item, and is the process of acquiring the item based on the appraisal results and converting it into money.

[0281] "Real-time analysis" refers to the process of analyzing video data immediately upon transmission and providing results promptly.

[0282] "Characteristic information of an item" refers to information for specifically identifying the item, such as the shape, size, color, brand, and model of the item.

[0283] A specific embodiment of the present invention will now be described. In order to easily appraise unwanted items owned by a user and to handle procedures for selling or disposing of such items, the following system configuration is required.

[0284] System Configuration

[0285] 1. Hardware Configuration

[0286] Device: A mobile device equipped with a camera, such as a smartphone or tablet, used by the user. The device captures video of unwanted items and sends the video data to a server.

[0287] Server: A computer system for analyzing video data and assessing the recognition and market value of items. Specifically, it has a processor and database that runs video analysis algorithms.

[0288] 2. Software Configuration

[0289] Camera application: An application installed on a device that captures images of unwanted items and sends the image data to a server. It has a user interface that is easy for users to operate.

[0290] Video analysis algorithm: Software that runs on a server and recognizes objects from video data and extracts their characteristic information. This algorithm uses machine learning models and generative AI models.

[0291] Database: A database that stores information about the market value of items within the server. The database associates information such as the type, model, and condition of an item with its market value.

[0292] Operation explanation

[0293] 1. Video acquisition by device

[0294] The user launches the camera application on their smartphone and points the unwanted item at the camera, which captures the image of the unwanted item and sends the image data to the server in real time.

[0295] 2. Server Analysis and Assessment

[0296] The server receives the video data sent from the device and uses a video analysis algorithm to recognize the item, extracting characteristic information such as the shape, size, color, brand, and model of the item.

[0297] Based on the extracted feature information, the market value is searched for in the database and the appraisal amount is calculated. The appraisal results are sent back to the terminal from the server.

[0298] 3. Presentation and selection of assessment results

[0299] The terminal displays the estimated value and detailed information about the item to the user. The user confirms the estimated value and selects whether to sell or dispose of the item. The selection result is sent from the terminal to the server.

[0300] 4. Start the purchase procedure

[0301] If the user selects to sell, the server will begin the purchase procedure. Based on the user's selection, the server will notify the logistics company of the item's collection information and arrange a collection date and time. After confirming that the collection is complete, the sales amount will be paid to the user.

[0302] Specific examples

[0303] Case: Buying old cameras

[0304] 1. A user wants to sell an old camera, so they launch the camera application on their smartphone and point the camera at the camera.

[0305] 2. The device sends video data to the server in real time.

[0306] 3. The server analyzes the video data and assesses the market value at 10,000 yen.

[0307] 4. The appraisal result will be displayed on the device screen as "Appraisal result: 10,000 yen" and the user can confirm it.

[0308] 5. The user agrees to the estimated price and submits the information on their device regarding their choice to sell.

[0309] 6. The server starts the purchase procedure and notifies the logistics company of the pickup.

[0310] Example prompt sentence:

[0311] "I'd like you to appraise my old camera. I'll send you the footage so you can recognize it and tell me its market value."

[0312] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0313] Step 1:

[0314] Video acquisition by device

[0315] The user launches the camera application on the smartphone.

[0316] When a user captures an unwanted item on the camera, the device captures the video data in real time.

[0317] The acquired video data is transmitted from the terminal to the server.

[0318] Input: The unwanted item from which the user obtains footage.

[0319] Output: Video data sent to the server.

[0320] Data processing / calculation: The device's camera captures video data and sends it to a server via the network.

[0321] Step 2:

[0322] Video data reception and analysis by the server

[0323] The server receives the video data sent from the terminal.

[0324] The server uses a video analysis algorithm to recognize objects in the video and extract characteristic information about the objects.

[0325] Input: Video data sent from the device.

[0326] Output: Item characteristics information (shape, size, color, brand, model, etc.).

[0327] Data processing / calculation: The server analyzes the video data and uses machine learning models and generative AI models to identify the objects and extract their characteristic information.

[0328] Step 3:

[0329] Market value assessment by server

[0330] The server searches the database for characteristic information of the item and calculates the market value.

[0331] The calculated market value is recorded as an appraisal result and transmitted to the terminal.

[0332] Input: Extracted feature information of the item.

[0333] Output: Market value (appraisal result).

[0334] Data processing / calculation: The server searches the database, obtains relevant market value information, and calculates the assessed value.

[0335] Step 4:

[0336] Display of assessment results on the device

[0337] The terminal receives the assessment results sent from the server.

[0338] The appraisal results (appraisal amount, detailed item information, and options for selling or disposing of the item) are displayed to the user.

[0339] Input: Market value (valuation result) sent from the server.

[0340] Output: Display of assessment results (smartphone screen).

[0341] Data processing / calculation: The appraisal results received by the terminal are visually displayed on the screen.

[0342] Step 5:

[0343] User Selection and Submission

[0344] The user checks the displayed appraisal results and selects whether to sell or dispose of the property.

[0345] The terminal transmits the user's selection to the server.

[0346] Input: User's choice (Sell or Dispose).

[0347] Output: Sends the user's selection to the server.

[0348] Data processing / calculation: Takes user selection information as input and sends it to the server.

[0349] Step 6:

[0350] The server starts the purchase procedure.

[0351] The server receives the user's selection and begins the redemption process.

[0352] The server notifies the logistics company of information regarding the collection of the goods and arranges the date and time of collection.

[0353] The adjusted collection schedule is transmitted to the terminal and notified to the user.

[0354] Input: User selection information (sale).

[0355] Output: Notification of collection schedule (terminal and logistics provider).

[0356] Data processing / calculation: The server coordinates pickup dates and times with the logistics company and generates schedule information.

[0357] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0358] MODE FOR CARRYING OUT THE INVENTION

[0359] The present invention relates to a system for easily assessing unwanted items owned by a user, efficiently selling or disposing of them, and providing services by recognizing the user's emotions. The system of the present invention includes a terminal equipped with a camera, a server that analyzes video data to recognize the items and assess their market value, an emotion engine that recognizes the user's emotions, and a means for presenting the assessment results and options for selling or disposing of them to the user.

[0360] System Overview

[0361] The system according to the present invention includes a terminal equipped with a camera for capturing images of unwanted items, a server for analyzing the image data to recognize the items and assess their market value, an emotion engine for recognizing emotions from the user's facial expressions and voice, and means for presenting the assessment results and adjusting the method of presenting options to the user and the support proposals according to the emotions.

[0362] The device is a mobile device such as a smartphone or tablet owned by the user, and captures video of the unwanted items using a camera. The captured video data is sent to a server in real time. The device is also equipped with an emotion engine that analyzes the user's facial expressions and voice in real time to recognize their emotions.

[0363] The server receives and analyzes the video data. Specifically, it uses a video analysis algorithm to recognize items in the video, searches a database for their characteristic information, and assesses their market value. It then calculates the amount as the assessment result and sends it to the terminal.

[0364] The device then presents the user with the received appraisal amount and the options of selling or disposing of the item. Based on the user's emotions recognized by the emotion engine, the device adjusts the way the appraisal results are presented and the content of the disposal options. For example, if the user shows an anxious expression, it displays an assistant message or offers support.

[0365] Natural language explanation of program processing

[0366] 1. Launching the smartphone app and accessing the camera and emotion engine

[0367] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone. The app requests permission to access the camera and emotion engine.

[0368] With the user's permission, the terminal acquires camera images and prepares for emotion recognition.

[0369] The user takes a picture of the unwanted item with a camera.

[0370] 2. Recognition and appraisal of items

[0371] The device transmits the video data captured by the camera to the server in real time.

[0372] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize unwanted items.

[0373] The server extracts the characteristic information of the recognized item, searches the market value in a database, and calculates the appraised amount.

[0374] 3. Emotion recognition and assessment results display

[0375] The device analyzes the user's facial expressions and voice using an emotion engine, along with the assessment results received from the server, to recognize emotions.

[0376] The terminal displays the appraisal result, detailed information about the item, and the option to sell or dispose of the item based on the user's feelings. The terminal also displays a photo of the item, its name, and the estimated price.

[0377] 4. Sale or Disposal Procedures

[0378] The user checks the appraisal results and chooses whether to sell or dispose of the property while receiving emotion-based assistant messages.

[0379] The terminal transmits the user's selection (sale or disposal) to the server.

[0380] The server initiates the disposal procedure based on the user's selection. Specifically, it notifies the distribution company of the collection information for the selected items.

[0381] The server coordinates the pickup date and time with the logistics company and sends the confirmed pickup schedule to the terminal.

[0382] The terminal notifies the user of the pickup schedule, displaying the specific date and time and preparations.

[0383] Specific examples

[0384] Case: Selling your old smartphone

[0385] 1. A user wants to dispose of an old smartphone and launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The user allows access to the camera and emotion engine, and points the old smartphone at the camera.

[0386] 2. The device sends the video data captured by the camera to the server in real time.

[0387] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[0388] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed, providing a sense of security.

[0389] 5. If the user chooses to sell, the selection is sent to the server.

[0390] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[0391] 7. The logistics company will pick up the old smartphone at the user's address.

[0392] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[0393] 9. The terminal displays a notification to the user that the transfer is complete.

[0394] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately while receiving emotional support.

[0395] The processing flow will be explained below.

[0396] Step 1:

[0397] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone, and the app requests permission to access the camera and emotion engine.

[0398] Step 2:

[0399] The user approves camera access and emotion engine permissions.

[0400] Step 3:

[0401] The device prepares to acquire camera footage and recognize emotions, enabling real-time video acquisition and emotion analysis.

[0402] Step 4:

[0403] The user takes a picture of an unwanted item in their home with a camera, and an image of the unwanted item is captured.

[0404] Step 5:

[0405] The device transmits the video data captured by the camera to the server in real time, frame by frame.

[0406] Step 6:

[0407] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize objects in the video and extract their characteristic information.

[0408] Step 7:

[0409] The server searches the database for the market value of the item based on the extracted characteristic information.

[0410] Step 8:

[0411] The server calculates the market value based on the search results from the database and determines the assessed amount.

[0412] Step 9:

[0413] The server sends the assessment results and detailed item information (e.g., photo and name) to the terminal.

[0414] Step 10:

[0415] The device displays the estimated value and the option to sell or dispose of the item to the user, while the emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[0416] Step 11:

[0417] The device will tailor the presentation of assessment results and additional assistant messages based on the emotions it recognizes, for example, displaying reassuring messages if it recognizes anxiety.

[0418] Step 12:

[0419] The user checks the appraisal results and support messages and chooses whether to sell or dispose of the item.

[0420] Step 13:

[0421] The terminal transmits the user's selection (sale or disposal) to the server.

[0422] Step 14:

[0423] The server will start the disposal procedure based on the user's selection, notify the logistics company of the collection information for the selected items, and arrange the collection date and time.

[0424] Step 15:

[0425] The server transmits the collection schedule to the terminal.

[0426] Step 16:

[0427] The terminal notifies the user of the confirmed pickup schedule, displaying the specific date and time and preparations.

[0428] Step 17:

[0429] The logistics company will pick up the item at the user's address.

[0430] Step 18:

[0431] The logistics company notifies the server that the pickup is complete.

[0432] Step 19:

[0433] The server confirms the completion of the transaction and transfers the sales amount to the account specified by the user.

[0434] Step 20:

[0435] The server sends a notification of the completion of the transfer to the terminal.

[0436] Step 21:

[0437] The terminal displays a notification to the user that the transfer has been completed.

[0438] Example 2

[0439] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0440] The present invention aims to provide appropriate support that takes into account the user's emotions during the process of easily appraising unwanted items owned by the user and efficiently selling or disposing of them. Conventional systems make the appraisal and disposal procedures for items cumbersome, making it difficult to respond appropriately to the user's anxieties and questions. Furthermore, when the user makes an appraisal or disposal choice, support is not provided in accordance with the user's emotions, resulting in low user satisfaction.

[0441] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing acquired video data to recognize an item and assess its market value, means for analyzing video data transmitted from the terminal in real time and searching a database for characteristic information on the item to calculate its market value, emotion engine means for recognizing emotions from the user's facial expressions and voice, and means for presenting the user with the appraisal results and options for selling or disposing of the item. This enables the user to efficiently appraise unwanted items and appropriately sell or dispose of them while receiving support according to their emotions.

[0442] A "terminal" is a mobile device owned by a user, equipped with a camera and an emotion engine, that acquires and transmits video data of unwanted items and the user's emotion information.

[0443] A "camera" is an optical device installed on a terminal to capture video data of unwanted items.

[0444] "Video data" is digital information of images and videos of unwanted items captured by a camera.

[0445] "User" means any person who uses the System to appraise, sell, or dispose of unwanted items.

[0446] An "emotion engine" is software or hardware that is installed in a device and recognizes and analyzes emotions from the user's facial expressions and voice in real time.

[0447] The "server" is a computer system that receives the image data sent from the terminal, recognizes the item, and assesses its market value.

[0448] "Video analysis algorithm" refers to the computational methods and software used by the server to recognize objects in video data.

[0449] "Feature information of an article" is detailed attribute information such as the shape, color, and size of the recognized article.

[0450] A "database" is an information management system that stores information on product characteristics and corresponding market value information.

[0451] "Market value" is the current monetary value of the identified item, as assessed based on a database.

[0452] "Evaluation result" is information for notifying the user of the market value of the item calculated by the server.

[0453] "Options" refers to sale or disposition options presented to a user.

[0454] A "logistics provider" is a business or service provider that handles the collection of items that a user chooses to sell or dispose of.

[0455] "Pickup information" refers to detailed information about the items to be sold or disposed of and information about the pickup schedule.

[0456] The present invention is a system that allows users to easily appraise unwanted items they own and efficiently sell or dispose of them. This system includes a terminal equipped with a camera, a server that analyzes video data to identify the items and assess their market value, an emotion engine that recognizes the user's emotions, and a means for presenting the appraisal results and options for selling or disposing of the items to the user.

[0457] The device is a mobile device such as a smartphone or tablet owned by the user, and captures images of unwanted items using a camera. This camera captures the video data in real time and operates in conjunction with the emotion engine using a processing unit inside the device.

[0458] The emotion engine is software or hardware built into the device that analyzes the user's facial expressions and voice in real time to recognize their emotions. Specifically, emotion analysis is performed using video analysis algorithms such as OpenCV and TensorFlow, or the Google Speech-to-Text API.

[0459] The captured video data is sent to a server in real time via the Internet. The server analyzes the received video data, recognizes the items, and assesses their market value. Specifically, to recognize the items in the video, the server uses video analysis algorithms such as OpenCV and TensorFlow, and compares their feature information with existing data in a database. This allows the server to calculate the market value of the items and return the assessment results to the terminal.

[0460] The terminal receives the appraisal result and presents the appraisal result and the option of selling or disposing of the item to the user based on the user's emotions analyzed by the emotion engine. If the user's emotions are unstable, assistant messages and support suggestions can be displayed to provide reassurance.

[0461] As a concrete example, consider selling an old smartphone.

[0462] 1. A user wants to dispose of an old smartphone and launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The user allows access to the camera and emotion engine, and points the old smartphone at the camera.

[0463] 2. The device sends the video data captured by the camera to the server in real time.

[0464] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[0465] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed, providing a sense of security.

[0466] 5. If the user chooses to sell, the selection is sent to the server.

[0467] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[0468] 7. The logistics company will pick up the old smartphone at the user's address.

[0469] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[0470] 9. The terminal displays a notification to the user that the transfer is complete.

[0471] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately while receiving emotional support.

[0472] Example prompt sentence:

[0473] The user installs the "Treasure Discovery! Appraisal & Disposal Agent AI" app.

[0474] How do I launch the app, point the camera at my old smartphone, and have it automatically recognized and assessed?

[0475] Additionally, please explain how to use an emotion recognition engine to display support messages according to the user's emotions.

[0476] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0477] Step 1: Launch the smartphone app and grant access to the camera and emotion engine

[0478] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone.

[0479] When the app is launched, the device requests permission to access the camera and emotion engine. Specifically, it calls the device's operating system API to display a pop-up requesting permission.

[0480] The user approves the access permission in the popup that appears. The input here is the user's approval, and the output is permission to use the camera and emotion engine.

[0481] Step 2: Capture footage of unwanted items and send it in real time

[0482] The user photographs the unwanted item they want to have appraised using their smartphone camera.

[0483] The device captures video data with a camera and activates an emotion engine to analyze the user's facial expressions and voice in real time. The input is a video of the unwanted item and the user's facial expressions and voice, and the output is the captured video data and emotional data.

[0484] The video data acquired by the device is sent to the server in real time using WebSocket or HTTP POST requests.

[0485] Step 3: Analyzing video data and recognizing and assessing objects

[0486] The server analyzes the video data received from the device. Specifically, it uses a video analysis algorithm (using libraries such as OpenCV or TensorFlow) to recognize objects in the video. The input is the video data, and the output is feature information of the recognized objects.

[0487] The server extracts the feature information of the recognized item, including the shape, color, size, etc.

[0488] The server searches the database for this feature information and calculates the corresponding market value. The market value assessment utilizes machine learning models and existing price databases. The input is the feature information, and the output is the assessed amount.

[0489] The server sends the assessment result (specific assessment amount) to the terminal.

[0490] Step 4: Recognize emotions and display the assessment results

[0491] The device receives the assessment results from the server and then uses the emotion engine to analyze the user's facial expressions and voice in real time to recognize emotions. The input is the assessment results and the user's emotional data, and the output is an assistant message or support suggestion based on the emotion.

[0492] The terminal displays the appraisal results and detailed information about the item to the user, including a photo of the item, its name, and the appraised amount.

[0493] The device will adjust the way it presents appraisal results and the options for selling or disposing of the item based on the user's emotions. For example, if the user shows signs of anxiety, it will display an assistant message such as, "Don't worry, we're here to help."

[0494] Step 5: Execute the sale or disposal process

[0495] The user checks the appraisal result and selects either sale or disposal. The input is the choice of sale or disposal, and the output is the selection.

[0496] The terminal transmits the user's selection (sale or disposal) to the server.

[0497] The server initiates the disposal procedure based on the selection. Specifically, it notifies the logistics company of the item's collection information. The input is the selection, and the output is the collection information.

[0498] The server uses the logistics company's API to arrange the pickup date and time. The input is the pickup information, and the output is the confirmed pickup schedule.

[0499] The server transmits the confirmed pick-up schedule to the terminal.

[0500] The terminal notifies the user of the pickup schedule, including the specific date and time and preparations.

[0501] The logistics company will pick up the item at the user's address.

[0502] The server confirms the completion of the transaction and transfers the sales amount to the account specified by the user.

[0503] The terminal displays a notification to the user that the transfer is complete.

[0504] In this way, by clearly indicating the specific operations, inputs, and outputs for each step, the details of the assessment of unwanted items and the provision of emotionally based support by the system of the present invention become clear.

[0505] (Application example 2)

[0506] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0507] When selling or disposing of unwanted items, users have difficulty accurately understanding the market value of the items. Furthermore, when assessing items or choosing whether to sell or dispose of them, users' feelings are often not taken into consideration, which can lead to lower user satisfaction. Furthermore, if appraisal results and solutions are not provided in real time, users have to work harder and are unable to carry out efficient procedures. These issues need to be resolved.

[0508] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0509] In this invention, the server includes an emotion engine that recognizes emotions from the user's facial expressions and voice, a means for displaying the appraisal result and a response method based on the emotion via smart glasses or a head-mounted display, and a means for analyzing the acquired video data to recognize the item and assess its market value. This makes it possible to easily appraise the market value of unwanted items and provide appropriate responses that take the user's emotions into consideration in real time.

[0510] "Unwanted items" are items that a user no longer uses or determines are unnecessary.

[0511] A "device equipped with a camera" is a device that has a camera function and can capture images of unwanted items.

[0512] A "server" is a computer system with the computational resources to analyze captured video data and assess item recognition and market value.

[0513] An "emotion engine" is software that analyzes a user's facial expressions and voice data to recognize the user's emotional state.

[0514] "Smart glasses" are devices that can be worn by a user to visually display information.

[0515] A "head-mounted display" is a device that is worn on the user's head and has the function of visually displaying images and information.

[0516] The "assessment result" is information indicating the market value of the item calculated based on the acquired video data.

[0517] "Selling" is the act of selling unwanted items to someone else.

[0518] "Disposal" is the act of discarding or reusing unwanted items.

[0519] "Real-time" refers to a time frame in which data acquisition, analysis, and presentation of results occur almost immediately.

[0520] "Response methods" are appropriate response measures or suggestions that correspond to the user's emotions and situation.

[0521] To implement this invention, it is necessary to build a system that includes the following steps. This system assesses the user's unwanted items and provides options for selling or disposing of them. The terminal and server also cooperate to respond based on the user's emotional state.

[0522] Hardware and Software Configuration

[0523] Device: Use a smartphone, tablet, smart glasses, or head-mounted display with a camera.

[0524] Server: Uses a high performance computer system and acts as a computational resource for assessing the recognition and market value of items.

[0525] Emotion engine: Software for analyzing user facial expressions and voice data. It uses machine learning libraries such as TensorFlow and Keras.

[0526] Camera: Use the device's built-in camera to capture footage of unwanted items.

[0527] System Features

[0528] 1. Video capture: The device captures video of the unwanted item using a camera. Users can easily capture the video using smart glasses or a head-mounted display.

[0529] 2. Transmission of video data: The acquired video data is transmitted to the server in real time. The transmitted data must be high resolution.

[0530] 3. Item Recognition and Valuation: The server analyzes the video data, recognizes the item, searches the database for its characteristics, and calculates its market value.

[0531] 4. Emotion recognition: The emotion engine installed in the device analyzes the user's facial expressions and voice to recognize their emotional state.

[0532] 5. Display of response methods: The user is presented with the appraisal results and response methods based on their emotions through smart glasses or a head-mounted display. The appraisal results include the market value of the item and options for selling or disposing of it.

[0533] 6. Selection of sale or disposal: The user selects sale or disposal via smart glasses or a head-mounted display. The selection information is sent to the server, which then initiates the necessary procedures based on the selection.

[0534] Specific examples

[0535] For example, here's the process for valuing and selling an old smartphone:

[0536] 1. A user wants to get rid of their old smartphone and wears a pair of smart glasses equipped with a camera.

[0537] 2. The device sends the video data captured by the camera to the server in real time.

[0538] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[0539] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed to provide reassurance.

[0540] 5. If the user chooses to sell, the selection is sent to the server.

[0541] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[0542] Example prompt for generative AI model:

[0543] "Develop an application that displays the real-time appraisal value of unwanted items such as used books, miscellaneous goods, and home appliances, and suggests assistance messages based on the customer's emotions. The application will use smart glasses or a head-mounted display. It will perform facial and emotion recognition, and will send images of the unwanted items captured by a camera to a server to assess their market value. Display the appraisal results and support suggestions based on the customer's emotions."

[0544] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0545] Step 1:

[0546] The user prepares an unwanted item and wears smart glasses or a head-mounted display equipped with a camera. The user then activates the device and takes a picture of the unwanted item with the camera. The input in this step is a video of the unwanted item, and the output is video data.

[0547] Step 2:

[0548] The video data acquired by the device is sent to the server in real time. The device continues to capture video from the camera and send it to the server. The input in this step is the video data acquired in the previous step, and the output is data sent to the server.

[0549] Step 3:

[0550] The server receives the transmitted video data and uses an item recognition algorithm to recognize unwanted items. This algorithm extracts specific features of the items in the video and identifies them by comparing them with a pre-built database. The input in this step is the transmitted video data, and the output is the recognized item information.

[0551] Step 4:

[0552] The server assesses the market value based on the recognized item information. It searches the database for past transaction data and market trend information for the item and calculates the assessed amount based on this. The input in this step is the recognized item information, and the output is the assessed amount of the item.

[0553] Step 5:

[0554] The device receives the appraisal amount and simultaneously analyzes the user's facial expressions and voice acquired by the emotion engine to recognize their emotions. The device then presents the appraisal result of the item along with a response plan based on the user's emotional state. The input in this step is the appraisal amount and the user's facial and voice data, and the output is the appraisal result and a display of the response plan.

[0555] Step 6:

[0556] The user checks the presented appraisal results and the corresponding measures, and selects whether to sell or dispose of the property. Once the user makes a selection, the selection is sent from the terminal to the server. The input in this step is the user's selection, and the output is the transmission of the selection to the server.

[0557] Step 7:

[0558] The server notifies the distributor based on the user's selection and starts the collection procedure. Specifically, it coordinates the date and time of collection of the item with the distributor and sends the schedule to the terminal. The input in this step is the user's selection, and the output is the start of collection procedure and the transmission of the schedule.

[0559] Step 8:

[0560] The terminal notifies the user of the collection schedule. The terminal notifies the user of detailed information such as the collection date and time so that the user can prepare. The input in this step is the collection schedule, and the output is a notification to the user.

[0561] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0562] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0563] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0564] [Second embodiment]

[0565] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0566] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0567] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0568] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0569] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0570] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0571] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0572] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0573] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0574] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0575] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0576] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0577] MODE FOR CARRYING OUT THE INVENTION

[0578] The present invention relates to a system for easily assessing unwanted items owned by users and efficiently selling or disposing of them. The system of the present invention includes a terminal equipped with a camera, a server that analyzes the video data, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[0579] System Overview

[0580] The system of the present invention includes a terminal equipped with a camera for capturing images of unwanted items, a server for analyzing the image data, recognizing the items, and assessing their market value, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[0581] The terminal is a mobile device such as a smartphone or tablet owned by the user, and captures images of unwanted items using a camera. The captured image data is then sent to a server in real time.

[0582] The server receives and analyzes the video data. Specifically, it uses a video analysis algorithm to recognize items in the video and searches a database for market value based on their characteristics. It then calculates the appraisal amount and sends it to the terminal.

[0583] The terminal presents the user with the received appraisal price and the option to sell or dispose of the item. When the user makes a selection, the selection information is sent to the server. The server then carries out the sale or disposal procedure based on the user's selection and notifies the terminal of the progress.

[0584] Natural language explanation of program processing

[0585] 1. Launching the smartphone app and accessing the camera

[0586] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The app requests permission to access the camera.

[0587] With the user's permission, the terminal prepares to acquire camera images in real time.

[0588] The user photographs the unwanted item on camera.

[0589] 2. Recognition and appraisal of items

[0590] The device transmits the video data captured by the camera to the server in real time.

[0591] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize unwanted items.

[0592] The server extracts the characteristic information of the recognized item, searches the market value in a database, and calculates the appraised amount.

[0593] 3. Display of assessment results

[0594] The server sends the calculated appraisal amount and detailed item information to the terminal.

[0595] The terminal displays the appraisal results to the user, showing a photo of the item, its name, the estimated value, and the option to sell or dispose of it.

[0596] 4. Sale or Disposal Procedures

[0597] The user chooses to sell or dispose of the property.

[0598] The terminal transmits the user's selection to the server.

[0599] The server will initiate the disposal procedure based on the selection, notify the logistics company of the information regarding the collection of the selected items, and arrange the date and time for collection.

[0600] The server sends the progress of the procedure to the terminal, and the terminal notifies the user.

[0601] Specific examples

[0602] Case: Selling your old smartphone

[0603] 1. A user wants to dispose of an old smartphone, so they launch the "Treasure Discovery! Appraisal & Disposal Agent AI" app. They allow camera access and point their old smartphone at the camera.

[0604] 2. The device sends the video data captured by the camera to the server in real time.

[0605] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[0606] 4. The server sends the appraisal results to the terminal, and the terminal displays the appraisal amount (2,000 yen) and selling options to the user.

[0607] 5. If the user chooses to sell, the selection is sent to the server.

[0608] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[0609] 7. The logistics company will pick up the old smartphone at the user's address.

[0610] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[0611] 9. The terminal displays a notification to the user that the transfer is complete.

[0612] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately.

[0613] The processing flow will be explained below.

[0614] Step 1:

[0615] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone, and the app requests permission to access the camera.

[0616] Step 2:

[0617] The user performs an operation to allow camera access.

[0618] Step 3:

[0619] The device prepares to acquire camera footage and makes it possible to acquire footage in real time.

[0620] Step 4:

[0621] The user takes a picture of unwanted items in their home with a camera.

[0622] Step 5:

[0623] The device transmits the video data captured by the camera to the server in real time, frame by frame.

[0624] Step 6:

[0625] The server analyzes the received video data and recognizes the objects in the video. Specifically, it uses a video analysis algorithm to identify the type and shape of the object.

[0626] Step 7:

[0627] The server extracts characteristic information (e.g., type, condition, size, etc.) of the recognized item.

[0628] Step 8:

[0629] The server searches the database for the relevant market value based on the characteristic information of the item.

[0630] Step 9:

[0631] The server calculates the market value based on the database search results and determines the assessed amount.

[0632] Step 10:

[0633] The server sends the appraisal results and detailed item information to the terminal.

[0634] Step 11:

[0635] The device displays the estimated value and the option to sell or dispose of the item to the user. Specifically, it presents a photo of the item, its name, the estimated value, etc.

[0636] Step 12:

[0637] The user checks the appraisal results and chooses whether to sell or dispose of the property.

[0638] Step 13:

[0639] The terminal transmits the user's selection (sale or disposal) to the server.

[0640] Step 14:

[0641] The server initiates the disposal procedure based on the user's selection. Specifically, it notifies the distribution company of the collection information for the selected items.

[0642] Step 15:

[0643] The server coordinates the pickup date and time with the logistics company and sends the confirmed pickup schedule to the terminal.

[0644] Step 16:

[0645] The terminal notifies the user of the pickup schedule, displaying the specific date and time and preparations.

[0646] Step 17:

[0647] The logistics company will pick up the item at the user's address.

[0648] Step 18:

[0649] The logistics company notifies the server that the pickup is complete.

[0650] Step 19:

[0651] The server confirms that the transaction has been completed and then transfers the sales amount.

[0652] Step 20:

[0653] The server transfers the sales amount to the account specified by the user and sends a notification of the completion of the transfer to the terminal.

[0654] Step 21:

[0655] The terminal displays a notification to the user that the transfer has been completed.

[0656] Example 1

[0657] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0658] In modern society, many users are seeking a means to easily appraise and efficiently sell or dispose of unwanted items. Conventional systems require users to manually appraise and sell or dispose of items themselves, which is time-consuming and labor-intensive. Furthermore, assessing the accurate market value of items requires specialized knowledge, making it difficult for users. The present invention aims to provide a system that allows users to easily appraise and efficiently sell or dispose of unwanted items.

[0659] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0660] In this invention, the server includes means for analyzing video data using an image analysis algorithm and a classification algorithm, extracting feature information of the item, and calculating the market value, means for transmitting the appraisal results to the user's terminal and presenting the option of selling or disposing of the item, and means for carrying out procedures based on the user's selection and notifying the user of the progress. This allows users to easily appraise unwanted items, accurately grasp their market value, and efficiently sell or dispose of them.

[0661] "Terminal" means a mobile device (such as a smartphone or tablet) equipped with a camera and used by a User.

[0662] A "server" is a computer system that receives video data and performs analysis and market value assessment.

[0663] "Unwanted items" refers to any items that the user no longer needs.

[0664] "Video data" is video information of an item captured through the camera of the terminal.

[0665] "Video analysis" is the process of analyzing video data to recognize objects and extract feature information.

[0666] "Characteristic information" is information about the specific attributes and characteristics of an item (e.g., manufacturer, model, condition).

[0667] "Market value" refers to the current market or trading price of an item.

[0668] A "database" is a data structure or system that stores information for retrieving the market value of an item.

[0669] The "valuation result" is the amount calculated based on the market value of the item and detailed information about the item.

[0670] "Options" are sale or disposal options offered to the User based on the results of the appraisal.

[0671] A "procedure" is a series of steps related to the sale or disposal that are carried out based on the user's selection.

[0672] "Notification" is information that informs the user about the progress and results of a procedure.

[0673] This invention relates to a system for easily assessing unwanted items owned by users and efficiently selling or disposing of them. The system of the present invention includes a terminal equipped with a camera, a server that analyzes the video data, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[0674] Hardware and Software Configuration

[0675] 1. Terminal

[0676] The terminal is a mobile device such as a smartphone or tablet, and is equipped with a camera.

[0677] A dedicated application installed on the device (e.g., the "Treasure Discovery! Appraisal & Disposal Agent AI" app) uses the camera to capture footage of unwanted items.

[0678] 2. Server

[0679] The server is a high-performance computer system that analyzes video data and assesses market value.

[0680] The server uses an image analysis library (e.g., OpenCV) and a machine learning model (e.g., TensorFlow) to analyze the video data and extract feature information about the item.

[0681] The server uses a database system (e.g., MySQL) to look up market value and calculate the appraisal amount.

[0682] 3. Means of communication

[0683] The terminal and the server communicate in real time via the Internet.

[0684] Usage and processing flow

[0685] 1. App launch and camera access

[0686] When the user launches the dedicated application and allows access to the camera, the app prepares to acquire camera footage in real time.

[0687] When a user captures an unwanted item on the camera, the device sends the video data to a server in real time.

[0688] 2. Recognition of the goods and assessment of their market value

[0689] The server receives the video data and uses image analysis algorithms and classification models to recognize the items.

[0690] The system extracts characteristic information about the item (e.g., manufacturer, model, condition), searches for market value in a database, and calculates the appraisal amount.

[0691] 3. Presenting the assessment results and offering options

[0692] The server transmits the calculated appraisal amount and detailed information about the item to the terminal.

[0693] The device displays the appraisal results to the user and offers the option of selling or disposing of the item.

[0694] 4. Execution of sale or disposal procedures

[0695] When the user selects to sell or dispose of the item, the selection information is sent from the terminal to the server.

[0696] The server starts the procedure based on the selection, notifies the logistics company of information regarding the collection of the selected items, and arranges the date and time of collection.

[0697] The server notifies the terminal of the progress of the procedure, and the terminal displays the progress to the user.

[0698] Specific examples

[0699] Case: Procedure for selling your old smartphone

[0700] 1. A user wants to dispose of their old smartphone, so they launch the dedicated app, allow camera access, and point their old smartphone at the camera.

[0701] 2. The device sends the video data captured by the camera to the server in real time.

[0702] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[0703] 4. The server sends the appraisal results to the terminal, which then displays the appraisal amount (2,000 yen) and selling options to the user.

[0704] 5. If the user chooses to sell, the selection is sent to the server.

[0705] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[0706] 7. The logistics company will pick up the old smartphone at the user's address.

[0707] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[0708] 9. The terminal will notify the user that the transfer is complete.

[0709] Example prompts for generative AI models

[0710] prompt:

[0711] I want to get rid of my old smartphone, and I want to use the camera in a dedicated app to request an appraisal. How can I go about this?

[0712] Example output:

[0713] 1. Launch the app and allow camera access.

[0714] 2. Point the old smartphone at the camera, and the device will send the video data to the server.

[0715] 3. The server analyzes the video data and assesses its market value.

[0716] 4. The server sends the assessment results to the terminal, which displays them to the user.

[0717] 5. Select Sell and your device will send your selection to the server.

[0718] 6. The server notifies the logistics company and arranges a pickup date and time.

[0719] 7. The logistics company will pick up your old smartphone at your address.

[0720] 8. The server will transfer the sales amount to the specified account.

[0721] 9. The terminal will notify the user that the transfer is complete.

[0722] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0723] Step 1:

[0724] The user launches the dedicated application and allows camera access.

[0725] Input: Camera access permission from user

[0726] Processing: The device initializes the camera.

[0727] Output: The camera is ready to capture video in real time.

[0728] Specific behavior: Launch the app and tap the "Launch Camera" button. The camera access permission dialog will be displayed and the user will select "Allow."

[0729] Step 2:

[0730] The user photographs the unwanted item on camera.

[0731] Input: Camera footage of unwanted items

[0732] Processing: The device captures the video in real time and converts it into video data.

[0733] Output: Video data

[0734] Specific operation: Operate the camera to display the unwanted item on the screen. The image will be displayed on the device screen in real time.

[0735] Step 3:

[0736] The device transmits the video data captured by the camera to the server in real time.

[0737] Input: Video data

[0738] Processing: Compresses the video data and divides it into data packets for transmission to the server

[0739] Output: Video data sent to the server

[0740] Specific operation: The device sends video data to the server using an HTTP request.

[0741] Step 4:

[0742] The server receives the video data and performs video analysis using an image analysis algorithm.

[0743] Input: Video data sent to the server

[0744] Processing: Recognize objects in the video using image analysis algorithms (e.g., OpenCV) and extract feature information of the objects.

[0745] Output: Item characteristics (e.g., make, model, condition)

[0746] How it works: The server analyzes the video data frame by frame and uses machine learning models (e.g., TensorFlow) to identify the objects.

[0747] Step 5:

[0748] The server searches the database for characteristic information about the item and assesses its market value.

[0749] Input: Item characteristics information

[0750] Processing: Issue an SQL query based on the feature information to obtain the market value from the database, then calculate the appraisal amount.

[0751] Output: Appraised amount and detailed item information

[0752] Specific operation: The server searches the database for data matching the item's characteristics and performs an appraisal based on information such as recent transaction prices.

[0753] Step 6:

[0754] The server sends the calculated appraisal amount and detailed item information to the terminal.

[0755] Input: Appraised amount and item details

[0756] Processing: Divide the data into packets and send them to the device

[0757] Output: The assessed value and detailed item information sent to the terminal

[0758] Specific operation: The server sends the assessment results to the terminal using an HTTP response.

[0759] Step 7:

[0760] The terminal displays the assessment results to the user.

[0761] Input: Estimated amount and detailed item information sent from the server

[0762] Processing: Parse the data and display it in the user interface

[0763] Output: The assessment results and options displayed to the user

[0764] What it does: The device screen will display a photo of the item, its name, its estimated value, and the option to sell or dispose of it.

[0765] Step 8:

[0766] The user chooses to sell or dispose of the property.

[0767] Input: User's choice (sale or disposal)

[0768] Processing: Converting user selections into data to send to the server

[0769] Output: User selections sent to the server

[0770] What happens: The user taps the sell or dispose option and then taps the "Confirm" button.

[0771] Step 9:

[0772] The terminal transmits the user's selection to the server.

[0773] Input: User selection

[0774] Processing: Convert the selection into a data packet and send it to the server

[0775] Output: Selections sent to the server

[0776] Specific operation: The device sends the selection to the server using an HTTP request.

[0777] Step 10:

[0778] The server performs the procedure based on the user's selection.

[0779] Input: User selection

[0780] Processing: Generate information to initiate a sale or disposal procedure

[0781] Output: Specific instructions and data for carrying out the procedure

[0782] Specific operation: The server notifies the logistics company of the selection and arranges the pickup date and time.

[0783] Step 11:

[0784] The server notifies the terminal of the progress of the procedure.

[0785] Input: Progress of procedure

[0786] Processing: Packetize progress data and send it to the device

[0787] Output: Progress notifications sent to the terminal

[0788] Specific operation: The server sends the procedure progress status to the terminal using an HTTP response.

[0789] Step 12:

[0790] The terminal notifies the user of the progress of the procedure.

[0791] Input: Progress notification sent by the server

[0792] Processing: Parse the notification data and display it in the user interface

[0793] Output: Progress notification displayed to the user

[0794] Specific operation: Messages such as "Disposal procedures have begun" and "Pickup date and time has been decided" will be displayed on the terminal screen.

[0795] (Application example 1)

[0796] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0797] Conventional procedures for appraising and disposing of unwanted items have been cumbersome and time-consuming for users. For example, when bringing unwanted items to a recycle shop, the appraisal often takes time and the process is tedious. Furthermore, because information on the market value of unwanted items is unclear, users may be dissatisfied with the appraisal amount. For these reasons, there is a demand for a system that allows users to easily appraise and dispose of unwanted items.

[0798] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0799] In this invention, the server includes a means for analyzing video data transmitted from the terminal in real time, a means for searching for characteristic information of the item from a sample collection to calculate the market value, and a means for initiating a purchase procedure at the store, thereby enabling users to easily carry out appraisals and purchase procedures for unwanted items in the store.

[0800] "Unwanted items" are items that a user no longer uses or has determined to be unnecessary.

[0801] "Appraisal" is the process of assessing and calculating the market value of a particular item.

[0802] "Consideration procedures" refers to the system's ability to act on behalf of all activities and procedures related to the acquisition, valuation, sale or disposal of an item.

[0803] "Device with a camera" refers to a smartphone, tablet, or other electronic device with a camera function that is used to capture video data of unwanted items.

[0804] "Video data" refers to visual information captured by a camera, and is data in the form of images or videos of items.

[0805] "Server" refers to a computer system that analyzes video data, identifies items, and calculates their market value.

[0806] "Market value" refers to the monetary value of an item when it is traded in the market, and means the price evaluation at that time.

[0807] "Selling" refers to the act of a user selling unwanted items to another person, meaning that the items are physically traded.

[0808] "Disposal" refers to the act of discarding unwanted items, including recycling, waste disposal, or otherwise relinquishing ownership of the items.

[0809] "Means for presenting options" refers to an interface for visually or audibly presenting the appraisal results and sale or disposal options to the user.

[0810] A "sample set" refers to a database that accumulates characteristic information about an item and calculates its market value based on that information.

[0811] "Purchase procedure" refers to all procedures carried out to sell an item, and is the process of acquiring the item based on the appraisal results and converting it into money.

[0812] "Real-time analysis" refers to the process of analyzing video data immediately upon transmission and providing results promptly.

[0813] "Characteristic information of an item" refers to information for specifically identifying the item, such as the shape, size, color, brand, and model of the item.

[0814] A specific embodiment of the present invention will now be described. In order to easily appraise unwanted items owned by a user and to handle procedures for selling or disposing of such items, the following system configuration is required.

[0815] System Configuration

[0816] 1. Hardware Configuration

[0817] Device: A mobile device equipped with a camera, such as a smartphone or tablet, used by the user. The device captures video of unwanted items and sends the video data to a server.

[0818] Server: A computer system for analyzing video data and assessing the recognition and market value of items. Specifically, it has a processor and database that runs video analysis algorithms.

[0819] 2. Software Configuration

[0820] Camera application: An application installed on a device that captures images of unwanted items and sends the image data to a server. It has a user interface that is easy for users to operate.

[0821] Video analysis algorithm: Software that runs on a server and recognizes objects from video data and extracts their characteristic information. This algorithm uses machine learning models and generative AI models.

[0822] Database: A database that stores information about the market value of items within the server. The database associates information such as the type, model, and condition of an item with its market value.

[0823] Operation explanation

[0824] 1. Video acquisition by device

[0825] The user launches the camera application on their smartphone and points the unwanted item at the camera, which captures the image of the unwanted item and sends the image data to the server in real time.

[0826] 2. Server Analysis and Assessment

[0827] The server receives the video data sent from the device and uses a video analysis algorithm to recognize the item, extracting characteristic information such as the shape, size, color, brand, and model of the item.

[0828] Based on the extracted feature information, the market value is searched for in the database and the appraisal amount is calculated. The appraisal results are sent back to the terminal from the server.

[0829] 3. Presentation and selection of assessment results

[0830] The terminal displays the estimated value and detailed information about the item to the user. The user confirms the estimated value and selects whether to sell or dispose of the item. The selection result is sent from the terminal to the server.

[0831] 4. Start the purchase procedure

[0832] If the user selects to sell, the server will begin the purchase procedure. Based on the user's selection, the server will notify the logistics company of the item's collection information and arrange a collection date and time. After confirming that the collection is complete, the sales amount will be paid to the user.

[0833] Specific examples

[0834] Case: Buying old cameras

[0835] 1. A user wants to sell an old camera, so they launch the camera application on their smartphone and point the camera at the camera.

[0836] 2. The device sends video data to the server in real time.

[0837] 3. The server analyzes the video data and assesses the market value at 10,000 yen.

[0838] 4. The appraisal result will be displayed on the device screen as "Appraisal result: 10,000 yen" and the user can confirm it.

[0839] 5. The user agrees to the estimated price and submits the information on their device regarding their choice to sell.

[0840] 6. The server starts the purchase procedure and notifies the logistics company of the pickup.

[0841] Example prompt sentence:

[0842] "I'd like you to appraise my old camera. I'll send you the footage so you can recognize it and tell me its market value."

[0843] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0844] Step 1:

[0845] Video acquisition by device

[0846] The user launches the camera application on the smartphone.

[0847] When a user captures an unwanted item on the camera, the device captures the video data in real time.

[0848] The acquired video data is transmitted from the terminal to the server.

[0849] Input: The unwanted item from which the user obtains footage.

[0850] Output: Video data sent to the server.

[0851] Data processing / calculation: The device's camera captures video data and sends it to a server via the network.

[0852] Step 2:

[0853] Video data reception and analysis by the server

[0854] The server receives the video data sent from the terminal.

[0855] The server uses a video analysis algorithm to recognize objects in the video and extract characteristic information about the objects.

[0856] Input: Video data sent from the device.

[0857] Output: Item characteristics information (shape, size, color, brand, model, etc.).

[0858] Data processing / calculation: The server analyzes the video data and uses machine learning models and generative AI models to identify the objects and extract their characteristic information.

[0859] Step 3:

[0860] Market value assessment by server

[0861] The server searches the database for characteristic information of the item and calculates the market value.

[0862] The calculated market value is recorded as an appraisal result and transmitted to the terminal.

[0863] Input: Extracted feature information of the item.

[0864] Output: Market value (appraisal result).

[0865] Data processing / calculation: The server searches the database, obtains relevant market value information, and calculates the assessed value.

[0866] Step 4:

[0867] Display of assessment results on the device

[0868] The terminal receives the assessment results sent from the server.

[0869] The appraisal results (appraisal amount, detailed item information, and options for selling or disposing of the item) are displayed to the user.

[0870] Input: Market value (valuation result) sent from the server.

[0871] Output: Display of assessment results (smartphone screen).

[0872] Data processing / calculation: The appraisal results received by the terminal are visually displayed on the screen.

[0873] Step 5:

[0874] User Selection and Submission

[0875] The user checks the displayed appraisal results and selects whether to sell or dispose of the property.

[0876] The terminal transmits the user's selection to the server.

[0877] Input: User's choice (Sell or Dispose).

[0878] Output: Sends the user's selection to the server.

[0879] Data processing / calculation: Takes user selection information as input and sends it to the server.

[0880] Step 6:

[0881] The server starts the purchase procedure.

[0882] The server receives the user's selection and begins the redemption process.

[0883] The server notifies the logistics company of information regarding the collection of the goods and arranges the date and time of collection.

[0884] The adjusted collection schedule is transmitted to the terminal and notified to the user.

[0885] Input: User selection information (sale).

[0886] Output: Notification of collection schedule (terminal and logistics provider).

[0887] Data processing / calculation: The server coordinates pickup dates and times with the logistics company and generates schedule information.

[0888] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0889] MODE FOR CARRYING OUT THE INVENTION

[0890] The present invention relates to a system for easily assessing unwanted items owned by a user, efficiently selling or disposing of them, and providing services by recognizing the user's emotions. The system of the present invention includes a terminal equipped with a camera, a server that analyzes video data to recognize the items and assess their market value, an emotion engine that recognizes the user's emotions, and a means for presenting the assessment results and options for selling or disposing of them to the user.

[0891] System Overview

[0892] The system according to the present invention includes a terminal equipped with a camera for capturing images of unwanted items, a server for analyzing the image data to recognize the items and assess their market value, an emotion engine for recognizing emotions from the user's facial expressions and voice, and means for presenting the assessment results and adjusting the method of presenting options to the user and the support proposals according to the emotions.

[0893] The device is a mobile device such as a smartphone or tablet owned by the user, and captures video of the unwanted items using a camera. The captured video data is sent to a server in real time. The device is also equipped with an emotion engine that analyzes the user's facial expressions and voice in real time to recognize their emotions.

[0894] The server receives and analyzes the video data. Specifically, it uses a video analysis algorithm to recognize items in the video, searches a database for their characteristic information, and assesses their market value. It then calculates the amount as the assessment result and sends it to the terminal.

[0895] The device then presents the user with the received appraisal amount and the options of selling or disposing of the item. Based on the user's emotions recognized by the emotion engine, the device adjusts the way the appraisal results are presented and the content of the disposal options. For example, if the user shows an anxious expression, it displays an assistant message or offers support.

[0896] Natural language explanation of program processing

[0897] 1. Launching the smartphone app and accessing the camera and emotion engine

[0898] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone. The app requests permission to access the camera and emotion engine.

[0899] With the user's permission, the terminal acquires camera images and prepares for emotion recognition.

[0900] The user takes a picture of the unwanted item with a camera.

[0901] 2. Recognition and appraisal of items

[0902] The device transmits the video data captured by the camera to the server in real time.

[0903] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize unwanted items.

[0904] The server extracts the characteristic information of the recognized item, searches the market value in a database, and calculates the appraised amount.

[0905] 3. Emotion recognition and assessment results display

[0906] The device analyzes the user's facial expressions and voice using an emotion engine, along with the assessment results received from the server, to recognize emotions.

[0907] The terminal displays the appraisal result, detailed information about the item, and the option to sell or dispose of the item based on the user's feelings. The terminal also displays a photo of the item, its name, and the estimated price.

[0908] 4. Sale or Disposal Procedures

[0909] The user checks the appraisal results and chooses whether to sell or dispose of the property while receiving emotion-based assistant messages.

[0910] The terminal transmits the user's selection (sale or disposal) to the server.

[0911] The server initiates the disposal procedure based on the user's selection. Specifically, it notifies the distribution company of the collection information for the selected items.

[0912] The server coordinates the pickup date and time with the logistics company and sends the confirmed pickup schedule to the terminal.

[0913] The terminal notifies the user of the pickup schedule, displaying the specific date and time and preparations.

[0914] Specific examples

[0915] Case: Selling your old smartphone

[0916] 1. A user wants to dispose of an old smartphone and launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The user allows access to the camera and emotion engine, and points the old smartphone at the camera.

[0917] 2. The device sends the video data captured by the camera to the server in real time.

[0918] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[0919] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed, providing a sense of security.

[0920] 5. If the user chooses to sell, the selection is sent to the server.

[0921] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[0922] 7. The logistics company will pick up the old smartphone at the user's address.

[0923] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[0924] 9. The terminal displays a notification to the user that the transfer is complete.

[0925] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately while receiving emotional support.

[0926] The processing flow will be explained below.

[0927] Step 1:

[0928] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone, and the app requests permission to access the camera and emotion engine.

[0929] Step 2:

[0930] The user approves camera access and emotion engine permissions.

[0931] Step 3:

[0932] The device prepares to acquire camera footage and recognize emotions, enabling real-time video acquisition and emotion analysis.

[0933] Step 4:

[0934] The user takes a picture of an unwanted item in their home with a camera, and an image of the unwanted item is captured.

[0935] Step 5:

[0936] The device transmits the video data captured by the camera to the server in real time, frame by frame.

[0937] Step 6:

[0938] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize objects in the video and extract their characteristic information.

[0939] Step 7:

[0940] The server searches the database for the market value of the item based on the extracted characteristic information.

[0941] Step 8:

[0942] The server calculates the market value based on the search results from the database and determines the assessed amount.

[0943] Step 9:

[0944] The server sends the assessment results and detailed item information (e.g., photo and name) to the terminal.

[0945] Step 10:

[0946] The device displays the estimated value and the option to sell or dispose of the item to the user, while the emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[0947] Step 11:

[0948] The device will tailor the presentation of assessment results and additional assistant messages based on the emotions it recognizes, for example, displaying reassuring messages if it recognizes anxiety.

[0949] Step 12:

[0950] The user checks the appraisal results and support messages and chooses whether to sell or dispose of the item.

[0951] Step 13:

[0952] The terminal transmits the user's selection (sale or disposal) to the server.

[0953] Step 14:

[0954] The server will start the disposal procedure based on the user's selection, notify the logistics company of the collection information for the selected items, and arrange the collection date and time.

[0955] Step 15:

[0956] The server transmits the collection schedule to the terminal.

[0957] Step 16:

[0958] The terminal notifies the user of the confirmed pickup schedule, displaying the specific date and time and preparations.

[0959] Step 17:

[0960] The logistics company will pick up the item at the user's address.

[0961] Step 18:

[0962] The logistics company notifies the server that the pickup is complete.

[0963] Step 19:

[0964] The server confirms the completion of the transaction and transfers the sales amount to the account specified by the user.

[0965] Step 20:

[0966] The server sends a notification of the completion of the transfer to the terminal.

[0967] Step 21:

[0968] The terminal displays a notification to the user that the transfer has been completed.

[0969] Example 2

[0970] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0971] The present invention aims to provide appropriate support that takes into account the user's emotions during the process of easily appraising unwanted items owned by the user and efficiently selling or disposing of them. Conventional systems make the appraisal and disposal procedures for items cumbersome, making it difficult to respond appropriately to the user's anxieties and questions. Furthermore, when the user makes an appraisal or disposal choice, support is not provided in accordance with the user's emotions, resulting in low user satisfaction.

[0972] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing acquired video data to recognize an item and assess its market value, means for analyzing video data transmitted from the terminal in real time and searching a database for characteristic information on the item to calculate its market value, emotion engine means for recognizing emotions from the user's facial expressions and voice, and means for presenting the user with the appraisal results and options for selling or disposing of the item. This enables the user to efficiently appraise unwanted items and appropriately sell or dispose of them while receiving support according to their emotions.

[0973] A "terminal" is a mobile device owned by a user, equipped with a camera and an emotion engine, that acquires and transmits video data of unwanted items and the user's emotion information.

[0974] A "camera" is an optical device installed on a terminal to capture video data of unwanted items.

[0975] "Video data" is digital information of images and videos of unwanted items captured by a camera.

[0976] "User" means any person who uses the System to appraise, sell, or dispose of unwanted items.

[0977] An "emotion engine" is software or hardware that is installed in a device and recognizes and analyzes emotions from the user's facial expressions and voice in real time.

[0978] The "server" is a computer system that receives the image data sent from the terminal, recognizes the item, and assesses its market value.

[0979] "Video analysis algorithm" refers to the computational methods and software used by the server to recognize objects in video data.

[0980] "Feature information of an article" is detailed attribute information such as the shape, color, and size of the recognized article.

[0981] A "database" is an information management system that stores information on product characteristics and corresponding market value information.

[0982] "Market value" is the current monetary value of the identified item, as assessed based on a database.

[0983] "Evaluation result" is information for notifying the user of the market value of the item calculated by the server.

[0984] "Options" refers to sale or disposition options presented to a user.

[0985] A "logistics provider" is a business or service provider that handles the collection of items that a user chooses to sell or dispose of.

[0986] "Pickup information" refers to detailed information about the items to be sold or disposed of and information about the pickup schedule.

[0987] The present invention is a system that allows users to easily appraise unwanted items they own and efficiently sell or dispose of them. This system includes a terminal equipped with a camera, a server that analyzes video data to identify the items and assess their market value, an emotion engine that recognizes the user's emotions, and a means for presenting the appraisal results and options for selling or disposing of the items to the user.

[0988] The device is a mobile device such as a smartphone or tablet owned by the user, and captures images of unwanted items using a camera. This camera captures the video data in real time and operates in conjunction with the emotion engine using a processing unit inside the device.

[0989] The emotion engine is software or hardware built into the device that analyzes the user's facial expressions and voice in real time to recognize their emotions. Specifically, emotion analysis is performed using video analysis algorithms such as OpenCV and TensorFlow, or the Google Speech-to-Text API.

[0990] The captured video data is sent to a server in real time via the Internet. The server analyzes the received video data, recognizes the items, and assesses their market value. Specifically, to recognize the items in the video, the server uses video analysis algorithms such as OpenCV and TensorFlow, and compares their feature information with existing data in a database. This allows the server to calculate the market value of the items and return the assessment results to the terminal.

[0991] The terminal receives the appraisal result and presents the appraisal result and the option of selling or disposing of the item to the user based on the user's emotions analyzed by the emotion engine. If the user's emotions are unstable, assistant messages and support suggestions can be displayed to provide reassurance.

[0992] As a concrete example, consider selling an old smartphone.

[0993] 1. A user wants to dispose of an old smartphone and launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The user allows access to the camera and emotion engine, and points the old smartphone at the camera.

[0994] 2. The device sends the video data captured by the camera to the server in real time.

[0995] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[0996] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed, providing a sense of security.

[0997] 5. If the user chooses to sell, the selection is sent to the server.

[0998] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[0999] 7. The logistics company will pick up the old smartphone at the user's address.

[1000] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[1001] 9. The terminal displays a notification to the user that the transfer is complete.

[1002] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately while receiving emotional support.

[1003] Example prompt sentence:

[1004] The user installs the "Treasure Discovery! Appraisal & Disposal Agent AI" app.

[1005] How do I launch the app, point the camera at my old smartphone, and have it automatically recognized and assessed?

[1006] Additionally, please explain how to use an emotion recognition engine to display support messages according to the user's emotions.

[1007] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1008] Step 1: Launch the smartphone app and grant access to the camera and emotion engine

[1009] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone.

[1010] When the app is launched, the device requests permission to access the camera and emotion engine. Specifically, it calls the device's operating system API to display a pop-up requesting permission.

[1011] The user approves the access permission in the popup that appears. The input here is the user's approval, and the output is permission to use the camera and emotion engine.

[1012] Step 2: Capture footage of unwanted items and send it in real time

[1013] The user photographs the unwanted item they want to have appraised using their smartphone camera.

[1014] The device captures video data with a camera and activates an emotion engine to analyze the user's facial expressions and voice in real time. The input is a video of the unwanted item and the user's facial expressions and voice, and the output is the captured video data and emotional data.

[1015] The video data acquired by the device is sent to the server in real time using WebSocket or HTTP POST requests.

[1016] Step 3: Analyzing video data and recognizing and assessing objects

[1017] The server analyzes the video data received from the device. Specifically, it uses a video analysis algorithm (using libraries such as OpenCV or TensorFlow) to recognize objects in the video. The input is the video data, and the output is feature information of the recognized objects.

[1018] The server extracts the feature information of the recognized item, including the shape, color, size, etc.

[1019] The server searches the database for this feature information and calculates the corresponding market value. The market value assessment utilizes machine learning models and existing price databases. The input is the feature information, and the output is the assessed amount.

[1020] The server sends the assessment result (specific assessment amount) to the terminal.

[1021] Step 4: Recognize emotions and display the assessment results

[1022] The device receives the assessment results from the server and then uses the emotion engine to analyze the user's facial expressions and voice in real time to recognize emotions. The input is the assessment results and the user's emotional data, and the output is an assistant message or support suggestion based on the emotion.

[1023] The terminal displays the appraisal results and detailed information about the item to the user, including a photo of the item, its name, and the appraised amount.

[1024] The device will adjust the way it presents appraisal results and the options for selling or disposing of the item based on the user's emotions. For example, if the user shows signs of anxiety, it will display an assistant message such as, "Don't worry, we're here to help."

[1025] Step 5: Execute the sale or disposal process

[1026] The user checks the appraisal result and selects either sale or disposal. The input is the choice of sale or disposal, and the output is the selection.

[1027] The terminal transmits the user's selection (sale or disposal) to the server.

[1028] The server initiates the disposal procedure based on the selection. Specifically, it notifies the logistics company of the item's collection information. The input is the selection, and the output is the collection information.

[1029] The server uses the logistics company's API to arrange the pickup date and time. The input is the pickup information, and the output is the confirmed pickup schedule.

[1030] The server transmits the confirmed pick-up schedule to the terminal.

[1031] The terminal notifies the user of the pickup schedule, including the specific date and time and preparations.

[1032] The logistics company will pick up the item at the user's address.

[1033] The server confirms the completion of the transaction and transfers the sales amount to the account specified by the user.

[1034] The terminal displays a notification to the user that the transfer is complete.

[1035] In this way, by clearly indicating the specific operations, inputs, and outputs for each step, the details of the assessment of unwanted items and the provision of emotionally based support by the system of the present invention become clear.

[1036] (Application example 2)

[1037] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1038] When selling or disposing of unwanted items, users have difficulty accurately understanding the market value of the items. Furthermore, when assessing items or choosing whether to sell or dispose of them, users' feelings are often not taken into consideration, which can lead to lower user satisfaction. Furthermore, if appraisal results and solutions are not provided in real time, users have to work harder and are unable to carry out efficient procedures. These issues need to be resolved.

[1039] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1040] In this invention, the server includes an emotion engine that recognizes emotions from the user's facial expressions and voice, a means for displaying the appraisal result and a response method based on the emotion via smart glasses or a head-mounted display, and a means for analyzing the acquired video data to recognize the item and assess its market value. This makes it possible to easily appraise the market value of unwanted items and provide appropriate responses that take the user's emotions into consideration in real time.

[1041] "Unwanted items" are items that a user no longer uses or determines are unnecessary.

[1042] A "device equipped with a camera" is a device that has a camera function and can capture images of unwanted items.

[1043] A "server" is a computer system with the computational resources to analyze captured video data and assess item recognition and market value.

[1044] An "emotion engine" is software that analyzes a user's facial expressions and voice data to recognize the user's emotional state.

[1045] "Smart glasses" are devices that can be worn by a user to visually display information.

[1046] A "head-mounted display" is a device that is worn on the user's head and has the function of visually displaying images and information.

[1047] The "assessment result" is information indicating the market value of the item calculated based on the acquired video data.

[1048] "Selling" is the act of selling unwanted items to someone else.

[1049] "Disposal" is the act of discarding or reusing unwanted items.

[1050] "Real-time" refers to a time frame in which data acquisition, analysis, and presentation of results occur almost immediately.

[1051] "Response methods" are appropriate response measures or suggestions that correspond to the user's emotions and situation.

[1052] To implement this invention, it is necessary to build a system that includes the following steps. This system assesses the user's unwanted items and provides options for selling or disposing of them. The terminal and server also cooperate to respond based on the user's emotional state.

[1053] Hardware and Software Configuration

[1054] Device: Use a smartphone, tablet, smart glasses, or head-mounted display with a camera.

[1055] Server: Uses a high performance computer system and acts as a computational resource for assessing the recognition and market value of items.

[1056] Emotion engine: Software for analyzing user facial expressions and voice data. It uses machine learning libraries such as TensorFlow and Keras.

[1057] Camera: Use the device's built-in camera to capture footage of unwanted items.

[1058] System Features

[1059] 1. Video capture: The device captures video of the unwanted item using a camera. Users can easily capture the video using smart glasses or a head-mounted display.

[1060] 2. Transmission of video data: The acquired video data is transmitted to the server in real time. The transmitted data must be high resolution.

[1061] 3. Item Recognition and Valuation: The server analyzes the video data, recognizes the item, searches the database for its characteristics, and calculates its market value.

[1062] 4. Emotion recognition: The emotion engine installed in the device analyzes the user's facial expressions and voice to recognize their emotional state.

[1063] 5. Display of response methods: The user is presented with the appraisal results and response methods based on their emotions through smart glasses or a head-mounted display. The appraisal results include the market value of the item and options for selling or disposing of it.

[1064] 6. Selection of sale or disposal: The user selects sale or disposal via smart glasses or a head-mounted display. The selection information is sent to the server, which then initiates the necessary procedures based on the selection.

[1065] Specific examples

[1066] For example, here's the process for valuing and selling an old smartphone:

[1067] 1. A user wants to get rid of their old smartphone and wears a pair of smart glasses equipped with a camera.

[1068] 2. The device sends the video data captured by the camera to the server in real time.

[1069] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[1070] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed to provide reassurance.

[1071] 5. If the user chooses to sell, the selection is sent to the server.

[1072] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[1073] Example prompt for generative AI model:

[1074] "Develop an application that displays the real-time appraisal value of unwanted items such as used books, miscellaneous goods, and home appliances, and suggests assistance messages based on the customer's emotions. The application will use smart glasses or a head-mounted display. It will perform facial and emotion recognition, and will send images of the unwanted items captured by a camera to a server to assess their market value. Display the appraisal results and support suggestions based on the customer's emotions."

[1075] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1076] Step 1:

[1077] The user prepares an unwanted item and wears smart glasses or a head-mounted display equipped with a camera. The user then activates the device and takes a picture of the unwanted item with the camera. The input in this step is a video of the unwanted item, and the output is video data.

[1078] Step 2:

[1079] The video data acquired by the device is sent to the server in real time. The device continues to capture video from the camera and send it to the server. The input in this step is the video data acquired in the previous step, and the output is data sent to the server.

[1080] Step 3:

[1081] The server receives the transmitted video data and uses an item recognition algorithm to recognize unwanted items. This algorithm extracts specific features of the items in the video and identifies them by comparing them with a pre-built database. The input in this step is the transmitted video data, and the output is the recognized item information.

[1082] Step 4:

[1083] The server assesses the market value based on the recognized item information. It searches the database for past transaction data and market trend information for the item and calculates the assessed amount based on this. The input in this step is the recognized item information, and the output is the assessed amount of the item.

[1084] Step 5:

[1085] The device receives the appraisal amount and simultaneously analyzes the user's facial expressions and voice acquired by the emotion engine to recognize their emotions. The device then presents the appraisal result of the item along with a response plan based on the user's emotional state. The input in this step is the appraisal amount and the user's facial and voice data, and the output is the appraisal result and a display of the response plan.

[1086] Step 6:

[1087] The user checks the presented appraisal results and the corresponding measures, and selects whether to sell or dispose of the property. Once the user makes a selection, the selection is sent from the terminal to the server. The input in this step is the user's selection, and the output is the transmission of the selection to the server.

[1088] Step 7:

[1089] The server notifies the distributor based on the user's selection and starts the collection procedure. Specifically, it coordinates the date and time of collection of the item with the distributor and sends the schedule to the terminal. The input in this step is the user's selection, and the output is the start of collection procedure and the transmission of the schedule.

[1090] Step 8:

[1091] The terminal notifies the user of the collection schedule. The terminal notifies the user of detailed information such as the collection date and time so that the user can prepare. The input in this step is the collection schedule, and the output is a notification to the user.

[1092] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1093] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1094] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1095] [Third embodiment]

[1096] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1097] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1098] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1099] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1100] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1101] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1102] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1103] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1104] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1105] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1106] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1107] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1108] MODE FOR CARRYING OUT THE INVENTION

[1109] The present invention relates to a system for easily assessing unwanted items owned by users and efficiently selling or disposing of them. The system of the present invention includes a terminal equipped with a camera, a server that analyzes the video data, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[1110] System Overview

[1111] The system of the present invention includes a terminal equipped with a camera for capturing images of unwanted items, a server for analyzing the image data, recognizing the items, and assessing their market value, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[1112] The terminal is a mobile device such as a smartphone or tablet owned by the user, and captures images of unwanted items using a camera. The captured image data is then sent to a server in real time.

[1113] The server receives and analyzes the video data. Specifically, it uses a video analysis algorithm to recognize items in the video and searches a database for market value based on their characteristics. It then calculates the appraisal amount and sends it to the terminal.

[1114] The terminal presents the user with the received appraisal price and the option to sell or dispose of the item. When the user makes a selection, the selection information is sent to the server. The server then carries out the sale or disposal procedure based on the user's selection and notifies the terminal of the progress.

[1115] Natural language explanation of program processing

[1116] 1. Launching the smartphone app and accessing the camera

[1117] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The app requests permission to access the camera.

[1118] With the user's permission, the terminal prepares to acquire camera images in real time.

[1119] The user photographs the unwanted item on camera.

[1120] 2. Recognition and appraisal of items

[1121] The device transmits the video data captured by the camera to the server in real time.

[1122] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize unwanted items.

[1123] The server extracts the characteristic information of the recognized item, searches the market value in a database, and calculates the appraised amount.

[1124] 3. Display of assessment results

[1125] The server sends the calculated appraisal amount and detailed item information to the terminal.

[1126] The terminal displays the appraisal results to the user, showing a photo of the item, its name, the estimated value, and the option to sell or dispose of it.

[1127] 4. Sale or Disposal Procedures

[1128] The user chooses to sell or dispose of the property.

[1129] The terminal transmits the user's selection to the server.

[1130] The server will initiate the disposal procedure based on the selection, notify the logistics company of the information regarding the collection of the selected items, and arrange the date and time for collection.

[1131] The server sends the progress of the procedure to the terminal, and the terminal notifies the user.

[1132] Specific examples

[1133] Case: Selling your old smartphone

[1134] 1. A user wants to dispose of an old smartphone, so they launch the "Treasure Discovery! Appraisal & Disposal Agent AI" app. They allow camera access and point their old smartphone at the camera.

[1135] 2. The device sends the video data captured by the camera to the server in real time.

[1136] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[1137] 4. The server sends the appraisal results to the terminal, and the terminal displays the appraisal amount (2,000 yen) and selling options to the user.

[1138] 5. If the user chooses to sell, the selection is sent to the server.

[1139] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[1140] 7. The logistics company will pick up the old smartphone at the user's address.

[1141] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[1142] 9. The terminal displays a notification to the user that the transfer is complete.

[1143] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately.

[1144] The processing flow will be explained below.

[1145] Step 1:

[1146] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone, and the app requests permission to access the camera.

[1147] Step 2:

[1148] The user performs an operation to allow camera access.

[1149] Step 3:

[1150] The device prepares to acquire camera footage and makes it possible to acquire footage in real time.

[1151] Step 4:

[1152] The user takes a picture of unwanted items in their home with a camera.

[1153] Step 5:

[1154] The device transmits the video data captured by the camera to the server in real time, frame by frame.

[1155] Step 6:

[1156] The server analyzes the received video data and recognizes the objects in the video. Specifically, it uses a video analysis algorithm to identify the type and shape of the object.

[1157] Step 7:

[1158] The server extracts characteristic information (e.g., type, condition, size, etc.) of the recognized item.

[1159] Step 8:

[1160] The server searches the database for the relevant market value based on the characteristic information of the item.

[1161] Step 9:

[1162] The server calculates the market value based on the database search results and determines the assessed amount.

[1163] Step 10:

[1164] The server sends the appraisal results and detailed item information to the terminal.

[1165] Step 11:

[1166] The device displays the estimated value and the option to sell or dispose of the item to the user. Specifically, it presents a photo of the item, its name, the estimated value, etc.

[1167] Step 12:

[1168] The user checks the appraisal results and chooses whether to sell or dispose of the property.

[1169] Step 13:

[1170] The terminal transmits the user's selection (sale or disposal) to the server.

[1171] Step 14:

[1172] The server initiates the disposal procedure based on the user's selection. Specifically, it notifies the distribution company of the collection information for the selected items.

[1173] Step 15:

[1174] The server coordinates the pickup date and time with the logistics company and sends the confirmed pickup schedule to the terminal.

[1175] Step 16:

[1176] The terminal notifies the user of the pickup schedule, displaying the specific date and time and preparations.

[1177] Step 17:

[1178] The logistics company will pick up the item at the user's address.

[1179] Step 18:

[1180] The logistics company notifies the server that the pickup is complete.

[1181] Step 19:

[1182] The server confirms that the transaction has been completed and then transfers the sales amount.

[1183] Step 20:

[1184] The server transfers the sales amount to the account specified by the user and sends a notification of the completion of the transfer to the terminal.

[1185] Step 21:

[1186] The terminal displays a notification to the user that the transfer has been completed.

[1187] Example 1

[1188] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1189] In modern society, many users are seeking a means to easily appraise and efficiently sell or dispose of unwanted items. Conventional systems require users to manually appraise and sell or dispose of items themselves, which is time-consuming and labor-intensive. Furthermore, assessing the accurate market value of items requires specialized knowledge, making it difficult for users. The present invention aims to provide a system that allows users to easily appraise and efficiently sell or dispose of unwanted items.

[1190] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1191] In this invention, the server includes means for analyzing video data using an image analysis algorithm and a classification algorithm, extracting feature information of the item, and calculating the market value, means for transmitting the appraisal results to the user's terminal and presenting the option of selling or disposing of the item, and means for carrying out procedures based on the user's selection and notifying the user of the progress. This allows users to easily appraise unwanted items, accurately grasp their market value, and efficiently sell or dispose of them.

[1192] "Terminal" means a mobile device (such as a smartphone or tablet) equipped with a camera and used by a User.

[1193] A "server" is a computer system that receives video data and performs analysis and market value assessment.

[1194] "Unwanted items" refers to any items that the user no longer needs.

[1195] "Video data" is video information of an item captured through the camera of the terminal.

[1196] "Video analysis" is the process of analyzing video data to recognize objects and extract feature information.

[1197] "Characteristic information" is information about the specific attributes and characteristics of an item (e.g., manufacturer, model, condition).

[1198] "Market value" refers to the current market or trading price of an item.

[1199] A "database" is a data structure or system that stores information for retrieving the market value of an item.

[1200] The "valuation result" is the amount calculated based on the market value of the item and detailed information about the item.

[1201] "Options" are sale or disposal options offered to the User based on the results of the appraisal.

[1202] A "procedure" is a series of steps related to the sale or disposal that are carried out based on the user's selection.

[1203] "Notification" is information that informs the user about the progress and results of a procedure.

[1204] This invention relates to a system for easily assessing unwanted items owned by users and efficiently selling or disposing of them. The system of the present invention includes a terminal equipped with a camera, a server that analyzes the video data, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[1205] Hardware and Software Configuration

[1206] 1. Terminal

[1207] The terminal is a mobile device such as a smartphone or tablet, and is equipped with a camera.

[1208] A dedicated application installed on the device (e.g., the "Treasure Discovery! Appraisal & Disposal Agent AI" app) uses the camera to capture footage of unwanted items.

[1209] 2. Server

[1210] The server is a high-performance computer system that analyzes video data and assesses market value.

[1211] The server uses an image analysis library (e.g., OpenCV) and a machine learning model (e.g., TensorFlow) to analyze the video data and extract feature information about the item.

[1212] The server uses a database system (e.g., MySQL) to look up market value and calculate the appraisal amount.

[1213] 3. Means of communication

[1214] The terminal and the server communicate in real time via the Internet.

[1215] Usage and processing flow

[1216] 1. App launch and camera access

[1217] When the user launches the dedicated application and allows access to the camera, the app prepares to acquire camera footage in real time.

[1218] When a user captures an unwanted item on the camera, the device sends the video data to a server in real time.

[1219] 2. Recognition of the goods and assessment of their market value

[1220] The server receives the video data and uses image analysis algorithms and classification models to recognize the items.

[1221] The system extracts characteristic information about the item (e.g., manufacturer, model, condition), searches for market value in a database, and calculates the appraisal amount.

[1222] 3. Presenting the assessment results and offering options

[1223] The server transmits the calculated appraisal amount and detailed information about the item to the terminal.

[1224] The device displays the appraisal results to the user and offers the option of selling or disposing of the item.

[1225] 4. Execution of sale or disposal procedures

[1226] When the user selects to sell or dispose of the item, the selection information is sent from the terminal to the server.

[1227] The server starts the procedure based on the selection, notifies the logistics company of information regarding the collection of the selected items, and arranges the date and time of collection.

[1228] The server notifies the terminal of the progress of the procedure, and the terminal displays the progress to the user.

[1229] Specific examples

[1230] Case: Procedure for selling your old smartphone

[1231] 1. A user wants to dispose of their old smartphone, so they launch the dedicated app, allow camera access, and point their old smartphone at the camera.

[1232] 2. The device sends the video data captured by the camera to the server in real time.

[1233] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[1234] 4. The server sends the appraisal results to the terminal, which then displays the appraisal amount (2,000 yen) and selling options to the user.

[1235] 5. If the user chooses to sell, the selection is sent to the server.

[1236] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[1237] 7. The logistics company will pick up the old smartphone at the user's address.

[1238] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[1239] 9. The terminal will notify the user that the transfer is complete.

[1240] Example prompts for generative AI models

[1241] prompt:

[1242] I want to get rid of my old smartphone, and I want to use the camera in a dedicated app to request an appraisal. How can I go about this?

[1243] Example output:

[1244] 1. Launch the app and allow camera access.

[1245] 2. Point the old smartphone at the camera, and the device will send the video data to the server.

[1246] 3. The server analyzes the video data and assesses its market value.

[1247] 4. The server sends the assessment results to the terminal, which displays them to the user.

[1248] 5. Select Sell and your device will send your selection to the server.

[1249] 6. The server notifies the logistics company and arranges a pickup date and time.

[1250] 7. The logistics company will pick up your old smartphone at your address.

[1251] 8. The server will transfer the sales amount to the specified account.

[1252] 9. The terminal will notify the user that the transfer is complete.

[1253] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1254] Step 1:

[1255] The user launches the dedicated application and allows camera access.

[1256] Input: Camera access permission from user

[1257] Processing: The device initializes the camera.

[1258] Output: The camera is ready to capture video in real time.

[1259] Specific behavior: Launch the app and tap the "Launch Camera" button. The camera access permission dialog will be displayed and the user will select "Allow."

[1260] Step 2:

[1261] The user photographs the unwanted item on camera.

[1262] Input: Camera footage of unwanted items

[1263] Processing: The device captures the video in real time and converts it into video data.

[1264] Output: Video data

[1265] Specific operation: Operate the camera to display the unwanted item on the screen. The image will be displayed on the device screen in real time.

[1266] Step 3:

[1267] The device transmits the video data captured by the camera to the server in real time.

[1268] Input: Video data

[1269] Processing: Compresses the video data and divides it into data packets for transmission to the server

[1270] Output: Video data sent to the server

[1271] Specific operation: The device sends video data to the server using an HTTP request.

[1272] Step 4:

[1273] The server receives the video data and performs video analysis using an image analysis algorithm.

[1274] Input: Video data sent to the server

[1275] Processing: Recognize objects in the video using image analysis algorithms (e.g., OpenCV) and extract feature information of the objects.

[1276] Output: Item characteristics (e.g., make, model, condition)

[1277] How it works: The server analyzes the video data frame by frame and uses machine learning models (e.g., TensorFlow) to identify the objects.

[1278] Step 5:

[1279] The server searches the database for characteristic information about the item and assesses its market value.

[1280] Input: Item characteristics information

[1281] Processing: Issue an SQL query based on the feature information to obtain the market value from the database, then calculate the appraisal amount.

[1282] Output: Appraised amount and detailed item information

[1283] Specific operation: The server searches the database for data matching the item's characteristics and performs an appraisal based on information such as recent transaction prices.

[1284] Step 6:

[1285] The server sends the calculated appraisal amount and detailed item information to the terminal.

[1286] Input: Appraised amount and item details

[1287] Processing: Divide the data into packets and send them to the device

[1288] Output: The assessed value and detailed item information sent to the terminal

[1289] Specific operation: The server sends the assessment results to the terminal using an HTTP response.

[1290] Step 7:

[1291] The terminal displays the assessment results to the user.

[1292] Input: Estimated amount and detailed item information sent from the server

[1293] Processing: Parse the data and display it in the user interface

[1294] Output: The assessment results and options displayed to the user

[1295] What it does: The device screen will display a photo of the item, its name, its estimated value, and the option to sell or dispose of it.

[1296] Step 8:

[1297] The user chooses to sell or dispose of the property.

[1298] Input: User's choice (sale or disposal)

[1299] Processing: Converting user selections into data to send to the server

[1300] Output: User selections sent to the server

[1301] What happens: The user taps the sell or dispose option and then taps the "Confirm" button.

[1302] Step 9:

[1303] The terminal transmits the user's selection to the server.

[1304] Input: User selection

[1305] Processing: Convert the selection into a data packet and send it to the server

[1306] Output: Selections sent to the server

[1307] Specific operation: The device sends the selection to the server using an HTTP request.

[1308] Step 10:

[1309] The server performs the procedure based on the user's selection.

[1310] Input: User selection

[1311] Processing: Generate information to initiate a sale or disposal procedure

[1312] Output: Specific instructions and data for carrying out the procedure

[1313] Specific operation: The server notifies the logistics company of the selection and arranges the pickup date and time.

[1314] Step 11:

[1315] The server notifies the terminal of the progress of the procedure.

[1316] Input: Progress of procedure

[1317] Processing: Packetize progress data and send it to the device

[1318] Output: Progress notifications sent to the terminal

[1319] Specific operation: The server sends the procedure progress status to the terminal using an HTTP response.

[1320] Step 12:

[1321] The terminal notifies the user of the progress of the procedure.

[1322] Input: Progress notification sent by the server

[1323] Processing: Parse the notification data and display it in the user interface

[1324] Output: Progress notification displayed to the user

[1325] Specific operation: Messages such as "Disposal procedures have begun" and "Pickup date and time has been decided" will be displayed on the terminal screen.

[1326] (Application example 1)

[1327] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1328] Conventional procedures for appraising and disposing of unwanted items have been cumbersome and time-consuming for users. For example, when bringing unwanted items to a recycle shop, the appraisal often takes time and the process is tedious. Furthermore, because information on the market value of unwanted items is unclear, users may be dissatisfied with the appraisal amount. For these reasons, there is a demand for a system that allows users to easily appraise and dispose of unwanted items.

[1329] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1330] In this invention, the server includes a means for analyzing video data transmitted from the terminal in real time, a means for searching for characteristic information of the item from a sample collection to calculate the market value, and a means for initiating a purchase procedure at the store, thereby enabling users to easily carry out appraisals and purchase procedures for unwanted items in the store.

[1331] "Unwanted items" are items that a user no longer uses or has determined to be unnecessary.

[1332] "Appraisal" is the process of assessing and calculating the market value of a particular item.

[1333] "Consideration procedures" refers to the system's ability to act on behalf of all activities and procedures related to the acquisition, valuation, sale or disposal of an item.

[1334] "Device with a camera" refers to a smartphone, tablet, or other electronic device with a camera function that is used to capture video data of unwanted items.

[1335] "Video data" refers to visual information captured by a camera, and is data in the form of images or videos of items.

[1336] "Server" refers to a computer system that analyzes video data, identifies items, and calculates their market value.

[1337] "Market value" refers to the monetary value of an item when it is traded in the market, and means the price evaluation at that time.

[1338] "Selling" refers to the act of a user selling unwanted items to another person, meaning that the items are physically traded.

[1339] "Disposal" refers to the act of discarding unwanted items, including recycling, waste disposal, or otherwise relinquishing ownership of the items.

[1340] "Means for presenting options" refers to an interface for visually or audibly presenting the appraisal results and sale or disposal options to the user.

[1341] A "sample set" refers to a database that accumulates characteristic information about an item and calculates its market value based on that information.

[1342] "Purchase procedure" refers to all procedures carried out to sell an item, and is the process of acquiring the item based on the appraisal results and converting it into money.

[1343] "Real-time analysis" refers to the process of analyzing video data immediately upon transmission and providing results promptly.

[1344] "Characteristic information of an item" refers to information for specifically identifying the item, such as the shape, size, color, brand, and model of the item.

[1345] A specific embodiment of the present invention will now be described. In order to easily appraise unwanted items owned by a user and to handle procedures for selling or disposing of such items, the following system configuration is required.

[1346] System Configuration

[1347] 1. Hardware Configuration

[1348] Device: A mobile device equipped with a camera, such as a smartphone or tablet, used by the user. The device captures video of unwanted items and sends the video data to a server.

[1349] Server: A computer system for analyzing video data and assessing the recognition and market value of items. Specifically, it has a processor and database that runs video analysis algorithms.

[1350] 2. Software Configuration

[1351] Camera application: An application installed on a device that captures images of unwanted items and sends the image data to a server. It has a user interface that is easy for users to operate.

[1352] Video analysis algorithm: Software that runs on a server and recognizes objects from video data and extracts their characteristic information. This algorithm uses machine learning models and generative AI models.

[1353] Database: A database that stores information about the market value of items within the server. The database associates information such as the type, model, and condition of an item with its market value.

[1354] Operation explanation

[1355] 1. Video acquisition by device

[1356] The user launches the camera application on their smartphone and points the unwanted item at the camera, which captures the image of the unwanted item and sends the image data to the server in real time.

[1357] 2. Server Analysis and Assessment

[1358] The server receives the video data sent from the device and uses a video analysis algorithm to recognize the item, extracting characteristic information such as the shape, size, color, brand, and model of the item.

[1359] Based on the extracted feature information, the market value is searched for in the database and the appraisal amount is calculated. The appraisal results are sent back to the terminal from the server.

[1360] 3. Presentation and selection of assessment results

[1361] The terminal displays the estimated value and detailed information about the item to the user. The user confirms the estimated value and selects whether to sell or dispose of the item. The selection result is sent from the terminal to the server.

[1362] 4. Start the purchase procedure

[1363] If the user selects to sell, the server will begin the purchase procedure. Based on the user's selection, the server will notify the logistics company of the item's collection information and arrange a collection date and time. After confirming that the collection is complete, the sales amount will be paid to the user.

[1364] Specific examples

[1365] Case: Buying old cameras

[1366] 1. A user wants to sell an old camera, so they launch the camera application on their smartphone and point the camera at the camera.

[1367] 2. The device sends video data to the server in real time.

[1368] 3. The server analyzes the video data and assesses the market value at 10,000 yen.

[1369] 4. The appraisal result will be displayed on the device screen as "Appraisal result: 10,000 yen" and the user can confirm it.

[1370] 5. The user agrees to the estimated price and submits the information on their device regarding their choice to sell.

[1371] 6. The server starts the purchase procedure and notifies the logistics company of the pickup.

[1372] Example prompt sentence:

[1373] "I'd like you to appraise my old camera. I'll send you the footage so you can recognize it and tell me its market value."

[1374] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1375] Step 1:

[1376] Video acquisition by device

[1377] The user launches the camera application on the smartphone.

[1378] When a user captures an unwanted item on the camera, the device captures the video data in real time.

[1379] The acquired video data is transmitted from the terminal to the server.

[1380] Input: The unwanted item from which the user obtains footage.

[1381] Output: Video data sent to the server.

[1382] Data processing / calculation: The device's camera captures video data and sends it to a server via the network.

[1383] Step 2:

[1384] Video data reception and analysis by the server

[1385] The server receives the video data sent from the terminal.

[1386] The server uses a video analysis algorithm to recognize objects in the video and extract characteristic information about the objects.

[1387] Input: Video data sent from the device.

[1388] Output: Item characteristics information (shape, size, color, brand, model, etc.).

[1389] Data processing / calculation: The server analyzes the video data and uses machine learning models and generative AI models to identify the objects and extract their characteristic information.

[1390] Step 3:

[1391] Market value assessment by server

[1392] The server searches the database for characteristic information of the item and calculates the market value.

[1393] The calculated market value is recorded as an appraisal result and transmitted to the terminal.

[1394] Input: Extracted feature information of the item.

[1395] Output: Market value (appraisal result).

[1396] Data processing / calculation: The server searches the database, obtains relevant market value information, and calculates the assessed value.

[1397] Step 4:

[1398] Display of assessment results on the device

[1399] The terminal receives the assessment results sent from the server.

[1400] The appraisal results (appraisal amount, detailed item information, and options for selling or disposing of the item) are displayed to the user.

[1401] Input: Market value (valuation result) sent from the server.

[1402] Output: Display of assessment results (smartphone screen).

[1403] Data processing / calculation: The appraisal results received by the terminal are visually displayed on the screen.

[1404] Step 5:

[1405] User Selection and Submission

[1406] The user checks the displayed appraisal results and selects whether to sell or dispose of the property.

[1407] The terminal transmits the user's selection to the server.

[1408] Input: User's choice (Sell or Dispose).

[1409] Output: Sends the user's selection to the server.

[1410] Data processing / calculation: Takes user selection information as input and sends it to the server.

[1411] Step 6:

[1412] The server starts the purchase procedure.

[1413] The server receives the user's selection and begins the redemption process.

[1414] The server notifies the logistics company of information regarding the collection of the goods and arranges the date and time of collection.

[1415] The adjusted collection schedule is transmitted to the terminal and notified to the user.

[1416] Input: User selection information (sale).

[1417] Output: Notification of collection schedule (terminal and logistics provider).

[1418] Data processing / calculation: The server coordinates pickup dates and times with the logistics company and generates schedule information.

[1419] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1420] MODE FOR CARRYING OUT THE INVENTION

[1421] The present invention relates to a system for easily assessing unwanted items owned by a user, efficiently selling or disposing of them, and providing services by recognizing the user's emotions. The system of the present invention includes a terminal equipped with a camera, a server that analyzes video data to recognize the items and assess their market value, an emotion engine that recognizes the user's emotions, and a means for presenting the assessment results and options for selling or disposing of them to the user.

[1422] System Overview

[1423] The system according to the present invention includes a terminal equipped with a camera for capturing images of unwanted items, a server for analyzing the image data to recognize the items and assess their market value, an emotion engine for recognizing emotions from the user's facial expressions and voice, and means for presenting the assessment results and adjusting the method of presenting options to the user and the support proposals according to the emotions.

[1424] The device is a mobile device such as a smartphone or tablet owned by the user, and captures video of the unwanted items using a camera. The captured video data is sent to a server in real time. The device is also equipped with an emotion engine that analyzes the user's facial expressions and voice in real time to recognize their emotions.

[1425] The server receives and analyzes the video data. Specifically, it uses a video analysis algorithm to recognize items in the video, searches a database for their characteristic information, and assesses their market value. It then calculates the amount as the assessment result and sends it to the terminal.

[1426] The device then presents the user with the received appraisal amount and the options of selling or disposing of the item. Based on the user's emotions recognized by the emotion engine, the device adjusts the way the appraisal results are presented and the content of the disposal options. For example, if the user shows an anxious expression, it displays an assistant message or offers support.

[1427] Natural language explanation of program processing

[1428] 1. Launching the smartphone app and accessing the camera and emotion engine

[1429] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone. The app requests permission to access the camera and emotion engine.

[1430] With the user's permission, the terminal acquires camera images and prepares for emotion recognition.

[1431] The user takes a picture of the unwanted item with a camera.

[1432] 2. Recognition and appraisal of items

[1433] The device transmits the video data captured by the camera to the server in real time.

[1434] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize unwanted items.

[1435] The server extracts the characteristic information of the recognized item, searches the market value in a database, and calculates the appraised amount.

[1436] 3. Emotion recognition and assessment results display

[1437] The device analyzes the user's facial expressions and voice using an emotion engine, along with the assessment results received from the server, to recognize emotions.

[1438] The terminal displays the appraisal result, detailed information about the item, and the option to sell or dispose of the item based on the user's feelings. The terminal also displays a photo of the item, its name, and the estimated price.

[1439] 4. Sale or Disposal Procedures

[1440] The user checks the appraisal results and chooses whether to sell or dispose of the property while receiving emotion-based assistant messages.

[1441] The terminal transmits the user's selection (sale or disposal) to the server.

[1442] The server initiates the disposal procedure based on the user's selection. Specifically, it notifies the distribution company of the collection information for the selected items.

[1443] The server coordinates the pickup date and time with the logistics company and sends the confirmed pickup schedule to the terminal.

[1444] The terminal notifies the user of the pickup schedule, displaying the specific date and time and preparations.

[1445] Specific examples

[1446] Case: Selling your old smartphone

[1447] 1. A user wants to dispose of an old smartphone and launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The user allows access to the camera and emotion engine, and points the old smartphone at the camera.

[1448] 2. The device sends the video data captured by the camera to the server in real time.

[1449] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[1450] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed, providing a sense of security.

[1451] 5. If the user chooses to sell, the selection is sent to the server.

[1452] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[1453] 7. The logistics company will pick up the old smartphone at the user's address.

[1454] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[1455] 9. The terminal displays a notification to the user that the transfer is complete.

[1456] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately while receiving emotional support.

[1457] The processing flow will be explained below.

[1458] Step 1:

[1459] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone, and the app requests permission to access the camera and emotion engine.

[1460] Step 2:

[1461] The user approves camera access and emotion engine permissions.

[1462] Step 3:

[1463] The device prepares to acquire camera footage and recognize emotions, enabling real-time video acquisition and emotion analysis.

[1464] Step 4:

[1465] The user takes a picture of an unwanted item in their home with a camera, and an image of the unwanted item is captured.

[1466] Step 5:

[1467] The device transmits the video data captured by the camera to the server in real time, frame by frame.

[1468] Step 6:

[1469] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize objects in the video and extract their characteristic information.

[1470] Step 7:

[1471] The server searches the database for the market value of the item based on the extracted characteristic information.

[1472] Step 8:

[1473] The server calculates the market value based on the search results from the database and determines the assessed amount.

[1474] Step 9:

[1475] The server sends the assessment results and detailed item information (e.g., photo and name) to the terminal.

[1476] Step 10:

[1477] The device displays the estimated value and the option to sell or dispose of the item to the user, while the emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[1478] Step 11:

[1479] The device will tailor the presentation of assessment results and additional assistant messages based on the emotions it recognizes, for example, displaying reassuring messages if it recognizes anxiety.

[1480] Step 12:

[1481] The user checks the appraisal results and support messages and chooses whether to sell or dispose of the item.

[1482] Step 13:

[1483] The terminal transmits the user's selection (sale or disposal) to the server.

[1484] Step 14:

[1485] The server will start the disposal procedure based on the user's selection, notify the logistics company of the collection information for the selected items, and arrange the collection date and time.

[1486] Step 15:

[1487] The server transmits the collection schedule to the terminal.

[1488] Step 16:

[1489] The terminal notifies the user of the confirmed pickup schedule, displaying the specific date and time and preparations.

[1490] Step 17:

[1491] The logistics company will pick up the item at the user's address.

[1492] Step 18:

[1493] The logistics company notifies the server that the pickup is complete.

[1494] Step 19:

[1495] The server confirms the completion of the transaction and transfers the sales amount to the account specified by the user.

[1496] Step 20:

[1497] The server sends a notification of the completion of the transfer to the terminal.

[1498] Step 21:

[1499] The terminal displays a notification to the user that the transfer has been completed.

[1500] Example 2

[1501] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1502] The present invention aims to provide appropriate support that takes into account the user's emotions during the process of easily appraising unwanted items owned by the user and efficiently selling or disposing of them. Conventional systems make the appraisal and disposal procedures for items cumbersome, making it difficult to respond appropriately to the user's anxieties and questions. Furthermore, when the user makes an appraisal or disposal choice, support is not provided in accordance with the user's emotions, resulting in low user satisfaction.

[1503] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing acquired video data to recognize an item and assess its market value, means for analyzing video data transmitted from the terminal in real time and searching a database for characteristic information on the item to calculate its market value, emotion engine means for recognizing emotions from the user's facial expressions and voice, and means for presenting the user with the appraisal results and options for selling or disposing of the item. This enables the user to efficiently appraise unwanted items and appropriately sell or dispose of them while receiving support according to their emotions.

[1504] A "terminal" is a mobile device owned by a user, equipped with a camera and an emotion engine, that acquires and transmits video data of unwanted items and the user's emotion information.

[1505] A "camera" is an optical device installed on a terminal to capture video data of unwanted items.

[1506] "Video data" is digital information of images and videos of unwanted items captured by a camera.

[1507] "User" means any person who uses the System to appraise, sell, or dispose of unwanted items.

[1508] An "emotion engine" is software or hardware that is installed in a device and recognizes and analyzes emotions from the user's facial expressions and voice in real time.

[1509] The "server" is a computer system that receives the image data sent from the terminal, recognizes the item, and assesses its market value.

[1510] "Video analysis algorithm" refers to the computational methods and software used by the server to recognize objects in video data.

[1511] "Feature information of an article" is detailed attribute information such as the shape, color, and size of the recognized article.

[1512] A "database" is an information management system that stores information on product characteristics and corresponding market value information.

[1513] "Market value" is the current monetary value of the identified item, as assessed based on a database.

[1514] "Evaluation result" is information for notifying the user of the market value of the item calculated by the server.

[1515] "Options" refers to sale or disposition options presented to a user.

[1516] A "logistics provider" is a business or service provider that handles the collection of items that a user chooses to sell or dispose of.

[1517] "Pickup information" refers to detailed information about the items to be sold or disposed of and information about the pickup schedule.

[1518] The present invention is a system that allows users to easily appraise unwanted items they own and efficiently sell or dispose of them. This system includes a terminal equipped with a camera, a server that analyzes video data to identify the items and assess their market value, an emotion engine that recognizes the user's emotions, and a means for presenting the appraisal results and options for selling or disposing of the items to the user.

[1519] The device is a mobile device such as a smartphone or tablet owned by the user, and captures images of unwanted items using a camera. This camera captures the video data in real time and operates in conjunction with the emotion engine using a processing unit inside the device.

[1520] The emotion engine is software or hardware built into the device that analyzes the user's facial expressions and voice in real time to recognize their emotions. Specifically, emotion analysis is performed using video analysis algorithms such as OpenCV and TensorFlow, or the Google Speech-to-Text API.

[1521] The captured video data is sent to a server in real time via the Internet. The server analyzes the received video data, recognizes the items, and assesses their market value. Specifically, to recognize the items in the video, the server uses video analysis algorithms such as OpenCV and TensorFlow, and compares their feature information with existing data in a database. This allows the server to calculate the market value of the items and return the assessment results to the terminal.

[1522] The terminal receives the appraisal result and presents the appraisal result and the option of selling or disposing of the item to the user based on the user's emotions analyzed by the emotion engine. If the user's emotions are unstable, assistant messages and support suggestions can be displayed to provide reassurance.

[1523] As a concrete example, consider selling an old smartphone.

[1524] 1. A user wants to dispose of an old smartphone and launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The user allows access to the camera and emotion engine, and points the old smartphone at the camera.

[1525] 2. The device sends the video data captured by the camera to the server in real time.

[1526] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[1527] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed, providing a sense of security.

[1528] 5. If the user chooses to sell, the selection is sent to the server.

[1529] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[1530] 7. The logistics company will pick up the old smartphone at the user's address.

[1531] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[1532] 9. The terminal displays a notification to the user that the transfer is complete.

[1533] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately while receiving emotional support.

[1534] Example prompt sentence:

[1535] The user installs the "Treasure Discovery! Appraisal & Disposal Agent AI" app.

[1536] How do I launch the app, point the camera at my old smartphone, and have it automatically recognized and assessed?

[1537] Additionally, please explain how to use an emotion recognition engine to display support messages according to the user's emotions.

[1538] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1539] Step 1: Launch the smartphone app and grant access to the camera and emotion engine

[1540] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone.

[1541] When the app is launched, the device requests permission to access the camera and emotion engine. Specifically, it calls the device's operating system API to display a pop-up requesting permission.

[1542] The user approves the access permission in the popup that appears. The input here is the user's approval, and the output is permission to use the camera and emotion engine.

[1543] Step 2: Capture footage of unwanted items and send it in real time

[1544] The user photographs the unwanted item they want to have appraised using their smartphone camera.

[1545] The device captures video data with a camera and activates an emotion engine to analyze the user's facial expressions and voice in real time. The input is a video of the unwanted item and the user's facial expressions and voice, and the output is the captured video data and emotional data.

[1546] The video data acquired by the device is sent to the server in real time using WebSocket or HTTP POST requests.

[1547] Step 3: Analyzing video data and recognizing and assessing objects

[1548] The server analyzes the video data received from the device. Specifically, it uses a video analysis algorithm (using libraries such as OpenCV or TensorFlow) to recognize objects in the video. The input is the video data, and the output is feature information of the recognized objects.

[1549] The server extracts the feature information of the recognized item, including the shape, color, size, etc.

[1550] The server searches the database for this feature information and calculates the corresponding market value. The market value assessment utilizes machine learning models and existing price databases. The input is the feature information, and the output is the assessed amount.

[1551] The server sends the assessment result (specific assessment amount) to the terminal.

[1552] Step 4: Recognize emotions and display the assessment results

[1553] The device receives the assessment results from the server and then uses the emotion engine to analyze the user's facial expressions and voice in real time to recognize emotions. The input is the assessment results and the user's emotional data, and the output is an assistant message or support suggestion based on the emotion.

[1554] The terminal displays the appraisal results and detailed information about the item to the user, including a photo of the item, its name, and the appraised amount.

[1555] The device will adjust the way it presents appraisal results and the options for selling or disposing of the item based on the user's emotions. For example, if the user shows signs of anxiety, it will display an assistant message such as, "Don't worry, we're here to help."

[1556] Step 5: Execute the sale or disposal process

[1557] The user checks the appraisal result and selects either sale or disposal. The input is the choice of sale or disposal, and the output is the selection.

[1558] The terminal transmits the user's selection (sale or disposal) to the server.

[1559] The server initiates the disposal procedure based on the selection. Specifically, it notifies the logistics company of the item's collection information. The input is the selection, and the output is the collection information.

[1560] The server uses the logistics company's API to arrange the pickup date and time. The input is the pickup information, and the output is the confirmed pickup schedule.

[1561] The server transmits the confirmed pick-up schedule to the terminal.

[1562] The terminal notifies the user of the pickup schedule, including the specific date and time and preparations.

[1563] The logistics company will pick up the item at the user's address.

[1564] The server confirms the completion of the transaction and transfers the sales amount to the account specified by the user.

[1565] The terminal displays a notification to the user that the transfer is complete.

[1566] In this way, by clearly indicating the specific operations, inputs, and outputs for each step, the details of the assessment of unwanted items and the provision of emotionally based support by the system of the present invention become clear.

[1567] (Application example 2)

[1568] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1569] When selling or disposing of unwanted items, users have difficulty accurately understanding the market value of the items. Furthermore, when assessing items or choosing whether to sell or dispose of them, users' feelings are often not taken into consideration, which can lead to lower user satisfaction. Furthermore, if appraisal results and solutions are not provided in real time, users have to work harder and are unable to carry out efficient procedures. These issues need to be resolved.

[1570] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1571] In this invention, the server includes an emotion engine that recognizes emotions from the user's facial expressions and voice, a means for displaying the appraisal result and a response method based on the emotion via smart glasses or a head-mounted display, and a means for analyzing the acquired video data to recognize the item and assess its market value. This makes it possible to easily appraise the market value of unwanted items and provide appropriate responses that take the user's emotions into consideration in real time.

[1572] "Unwanted items" are items that a user no longer uses or determines are unnecessary.

[1573] A "device equipped with a camera" is a device that has a camera function and can capture images of unwanted items.

[1574] A "server" is a computer system with the computational resources to analyze captured video data and assess item recognition and market value.

[1575] An "emotion engine" is software that analyzes a user's facial expressions and voice data to recognize the user's emotional state.

[1576] "Smart glasses" are devices that can be worn by a user to visually display information.

[1577] A "head-mounted display" is a device that is worn on the user's head and has the function of visually displaying images and information.

[1578] The "assessment result" is information indicating the market value of the item calculated based on the acquired video data.

[1579] "Selling" is the act of selling unwanted items to someone else.

[1580] "Disposal" is the act of discarding or reusing unwanted items.

[1581] "Real-time" refers to a time frame in which data acquisition, analysis, and presentation of results occur almost immediately.

[1582] "Response methods" are appropriate response measures or suggestions that correspond to the user's emotions and situation.

[1583] To implement this invention, it is necessary to build a system that includes the following steps. This system assesses the user's unwanted items and provides options for selling or disposing of them. The terminal and server also cooperate to respond based on the user's emotional state.

[1584] Hardware and Software Configuration

[1585] Device: Use a smartphone, tablet, smart glasses, or head-mounted display with a camera.

[1586] Server: Uses a high performance computer system and acts as a computational resource for assessing the recognition and market value of items.

[1587] Emotion engine: Software for analyzing user facial expressions and voice data. It uses machine learning libraries such as TensorFlow and Keras.

[1588] Camera: Use the device's built-in camera to capture footage of unwanted items.

[1589] System Features

[1590] 1. Video capture: The device captures video of the unwanted item using a camera. Users can easily capture the video using smart glasses or a head-mounted display.

[1591] 2. Transmission of video data: The acquired video data is transmitted to the server in real time. The transmitted data must be high resolution.

[1592] 3. Item Recognition and Valuation: The server analyzes the video data, recognizes the item, searches the database for its characteristics, and calculates its market value.

[1593] 4. Emotion recognition: The emotion engine installed in the device analyzes the user's facial expressions and voice to recognize their emotional state.

[1594] 5. Display of response methods: The user is presented with the appraisal results and response methods based on their emotions through smart glasses or a head-mounted display. The appraisal results include the market value of the item and options for selling or disposing of it.

[1595] 6. Selection of sale or disposal: The user selects sale or disposal via smart glasses or a head-mounted display. The selection information is sent to the server, which then initiates the necessary procedures based on the selection.

[1596] Specific examples

[1597] For example, here's the process for valuing and selling an old smartphone:

[1598] 1. A user wants to get rid of their old smartphone and wears a pair of smart glasses equipped with a camera.

[1599] 2. The device sends the video data captured by the camera to the server in real time.

[1600] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[1601] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed to provide reassurance.

[1602] 5. If the user chooses to sell, the selection is sent to the server.

[1603] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[1604] Example prompt for generative AI model:

[1605] "Develop an application that displays the real-time appraisal value of unwanted items such as used books, miscellaneous goods, and home appliances, and suggests assistance messages based on the customer's emotions. The application will use smart glasses or a head-mounted display. It will perform facial and emotion recognition, and will send images of the unwanted items captured by a camera to a server to assess their market value. Display the appraisal results and support suggestions based on the customer's emotions."

[1606] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1607] Step 1:

[1608] The user prepares an unwanted item and wears smart glasses or a head-mounted display equipped with a camera. The user then activates the device and takes a picture of the unwanted item with the camera. The input in this step is a video of the unwanted item, and the output is video data.

[1609] Step 2:

[1610] The video data acquired by the device is sent to the server in real time. The device continues to capture video from the camera and send it to the server. The input in this step is the video data acquired in the previous step, and the output is data sent to the server.

[1611] Step 3:

[1612] The server receives the transmitted video data and uses an item recognition algorithm to recognize unwanted items. This algorithm extracts specific features of the items in the video and identifies them by comparing them with a pre-built database. The input in this step is the transmitted video data, and the output is the recognized item information.

[1613] Step 4:

[1614] The server assesses the market value based on the recognized item information. It searches the database for past transaction data and market trend information for the item and calculates the assessed amount based on this. The input in this step is the recognized item information, and the output is the assessed amount of the item.

[1615] Step 5:

[1616] The device receives the appraisal amount and simultaneously analyzes the user's facial expressions and voice acquired by the emotion engine to recognize their emotions. The device then presents the appraisal result of the item along with a response plan based on the user's emotional state. The input in this step is the appraisal amount and the user's facial and voice data, and the output is the appraisal result and a display of the response plan.

[1617] Step 6:

[1618] The user checks the presented appraisal results and the corresponding measures, and selects whether to sell or dispose of the property. Once the user makes a selection, the selection is sent from the terminal to the server. The input in this step is the user's selection, and the output is the transmission of the selection to the server.

[1619] Step 7:

[1620] The server notifies the distributor based on the user's selection and starts the collection procedure. Specifically, it coordinates the date and time of collection of the item with the distributor and sends the schedule to the terminal. The input in this step is the user's selection, and the output is the start of collection procedure and the transmission of the schedule.

[1621] Step 8:

[1622] The terminal notifies the user of the collection schedule. The terminal notifies the user of detailed information such as the collection date and time so that the user can prepare. The input in this step is the collection schedule, and the output is a notification to the user.

[1623] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1624] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1625] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1626] [Fourth embodiment]

[1627] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1628] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1629] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1630] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1631] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1632] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1633] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1634] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1635] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1636] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1637] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1638] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1639] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1640] MODE FOR CARRYING OUT THE INVENTION

[1641] The present invention relates to a system for easily assessing unwanted items owned by users and efficiently selling or disposing of them. The system of the present invention includes a terminal equipped with a camera, a server that analyzes the video data, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[1642] System Overview

[1643] The system of the present invention includes a terminal equipped with a camera for capturing images of unwanted items, a server for analyzing the image data, recognizing the items, and assessing their market value, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[1644] The terminal is a mobile device such as a smartphone or tablet owned by the user, and captures images of unwanted items using a camera. The captured image data is then sent to a server in real time.

[1645] The server receives and analyzes the video data. Specifically, it uses a video analysis algorithm to recognize items in the video and searches a database for market value based on their characteristics. It then calculates the appraisal amount and sends it to the terminal.

[1646] The terminal presents the user with the received appraisal price and the option to sell or dispose of the item. When the user makes a selection, the selection information is sent to the server. The server then carries out the sale or disposal procedure based on the user's selection and notifies the terminal of the progress.

[1647] Natural language explanation of program processing

[1648] 1. Launching the smartphone app and accessing the camera

[1649] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The app requests permission to access the camera.

[1650] With the user's permission, the terminal prepares to acquire camera images in real time.

[1651] The user photographs the unwanted item on camera.

[1652] 2. Recognition and appraisal of items

[1653] The device transmits the video data captured by the camera to the server in real time.

[1654] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize unwanted items.

[1655] The server extracts the characteristic information of the recognized item, searches the market value in a database, and calculates the appraised amount.

[1656] 3. Display of assessment results

[1657] The server sends the calculated appraisal amount and detailed item information to the terminal.

[1658] The terminal displays the appraisal results to the user, showing a photo of the item, its name, the estimated value, and the option to sell or dispose of it.

[1659] 4. Sale or Disposal Procedures

[1660] The user chooses to sell or dispose of the property.

[1661] The terminal transmits the user's selection to the server.

[1662] The server will initiate the disposal procedure based on the selection, notify the logistics company of the information regarding the collection of the selected items, and arrange the date and time for collection.

[1663] The server sends the progress of the procedure to the terminal, and the terminal notifies the user.

[1664] Specific examples

[1665] Case: Selling your old smartphone

[1666] 1. A user wants to dispose of an old smartphone, so they launch the "Treasure Discovery! Appraisal & Disposal Agent AI" app. They allow camera access and point their old smartphone at the camera.

[1667] 2. The device sends the video data captured by the camera to the server in real time.

[1668] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[1669] 4. The server sends the appraisal results to the terminal, and the terminal displays the appraisal amount (2,000 yen) and selling options to the user.

[1670] 5. If the user chooses to sell, the selection is sent to the server.

[1671] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[1672] 7. The logistics company will pick up the old smartphone at the user's address.

[1673] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[1674] 9. The terminal displays a notification to the user that the transfer is complete.

[1675] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately.

[1676] The processing flow will be explained below.

[1677] Step 1:

[1678] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone, and the app requests permission to access the camera.

[1679] Step 2:

[1680] The user performs an operation to allow camera access.

[1681] Step 3:

[1682] The device prepares to acquire camera footage and makes it possible to acquire footage in real time.

[1683] Step 4:

[1684] The user takes a picture of unwanted items in their home with a camera.

[1685] Step 5:

[1686] The device transmits the video data captured by the camera to the server in real time, frame by frame.

[1687] Step 6:

[1688] The server analyzes the received video data and recognizes the objects in the video. Specifically, it uses a video analysis algorithm to identify the type and shape of the object.

[1689] Step 7:

[1690] The server extracts characteristic information (e.g., type, condition, size, etc.) of the recognized item.

[1691] Step 8:

[1692] The server searches the database for the relevant market value based on the characteristic information of the item.

[1693] Step 9:

[1694] The server calculates the market value based on the database search results and determines the assessed amount.

[1695] Step 10:

[1696] The server sends the appraisal results and detailed item information to the terminal.

[1697] Step 11:

[1698] The device displays the estimated value and the option to sell or dispose of the item to the user. Specifically, it presents a photo of the item, its name, the estimated value, etc.

[1699] Step 12:

[1700] The user checks the appraisal results and chooses whether to sell or dispose of the property.

[1701] Step 13:

[1702] The terminal transmits the user's selection (sale or disposal) to the server.

[1703] Step 14:

[1704] The server initiates the disposal procedure based on the user's selection. Specifically, it notifies the distribution company of the collection information for the selected items.

[1705] Step 15:

[1706] The server coordinates the pickup date and time with the logistics company and sends the confirmed pickup schedule to the terminal.

[1707] Step 16:

[1708] The terminal notifies the user of the pickup schedule, displaying the specific date and time and preparations.

[1709] Step 17:

[1710] The logistics company will pick up the item at the user's address.

[1711] Step 18:

[1712] The logistics company notifies the server that the pickup is complete.

[1713] Step 19:

[1714] The server confirms that the transaction has been completed and then transfers the sales amount.

[1715] Step 20:

[1716] The server transfers the sales amount to the account specified by the user and sends a notification of the completion of the transfer to the terminal.

[1717] Step 21:

[1718] The terminal displays a notification to the user that the transfer has been completed.

[1719] Example 1

[1720] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1721] In modern society, many users are seeking a means to easily appraise and efficiently sell or dispose of unwanted items. Conventional systems require users to manually appraise and sell or dispose of items themselves, which is time-consuming and labor-intensive. Furthermore, assessing the accurate market value of items requires specialized knowledge, making it difficult for users. The present invention aims to provide a system that allows users to easily appraise and efficiently sell or dispose of unwanted items.

[1722] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1723] In this invention, the server includes means for analyzing video data using an image analysis algorithm and a classification algorithm, extracting feature information of the item, and calculating the market value, means for transmitting the appraisal results to the user's terminal and presenting the option of selling or disposing of the item, and means for carrying out procedures based on the user's selection and notifying the user of the progress. This allows users to easily appraise unwanted items, accurately grasp their market value, and efficiently sell or dispose of them.

[1724] "Terminal" means a mobile device (such as a smartphone or tablet) equipped with a camera and used by a User.

[1725] A "server" is a computer system that receives video data and performs analysis and market value assessment.

[1726] "Unwanted items" refers to any items that the user no longer needs.

[1727] "Video data" is video information of an item captured through the camera of the terminal.

[1728] "Video analysis" is the process of analyzing video data to recognize objects and extract feature information.

[1729] "Characteristic information" is information about the specific attributes and characteristics of an item (e.g., manufacturer, model, condition).

[1730] "Market value" refers to the current market or trading price of an item.

[1731] A "database" is a data structure or system that stores information for retrieving the market value of an item.

[1732] The "valuation result" is the amount calculated based on the market value of the item and detailed information about the item.

[1733] "Options" are sale or disposal options offered to the User based on the results of the appraisal.

[1734] A "procedure" is a series of steps related to the sale or disposal that are carried out based on the user's selection.

[1735] "Notification" is information that informs the user about the progress and results of a procedure.

[1736] This invention relates to a system for easily assessing unwanted items owned by users and efficiently selling or disposing of them. The system of the present invention includes a terminal equipped with a camera, a server that analyzes the video data, and a means for presenting the assessment results and options for selling or disposing of the items to the user.

[1737] Hardware and Software Configuration

[1738] 1. Terminal

[1739] The terminal is a mobile device such as a smartphone or tablet, and is equipped with a camera.

[1740] A dedicated application installed on the device (e.g., the "Treasure Discovery! Appraisal & Disposal Agent AI" app) uses the camera to capture footage of unwanted items.

[1741] 2. Server

[1742] The server is a high-performance computer system that analyzes video data and assesses market value.

[1743] The server uses an image analysis library (e.g., OpenCV) and a machine learning model (e.g., TensorFlow) to analyze the video data and extract feature information about the item.

[1744] The server uses a database system (e.g., MySQL) to look up market value and calculate the appraisal amount.

[1745] 3. Means of communication

[1746] The terminal and the server communicate in real time via the Internet.

[1747] Usage and processing flow

[1748] 1. App launch and camera access

[1749] When the user launches the dedicated application and allows access to the camera, the app prepares to acquire camera footage in real time.

[1750] When a user captures an unwanted item on the camera, the device sends the video data to a server in real time.

[1751] 2. Recognition of the goods and assessment of their market value

[1752] The server receives the video data and uses image analysis algorithms and classification models to recognize the items.

[1753] The system extracts characteristic information about the item (e.g., manufacturer, model, condition), searches for market value in a database, and calculates the appraisal amount.

[1754] 3. Presenting the assessment results and offering options

[1755] The server transmits the calculated appraisal amount and detailed information about the item to the terminal.

[1756] The device displays the appraisal results to the user and offers the option of selling or disposing of the item.

[1757] 4. Execution of sale or disposal procedures

[1758] When the user selects to sell or dispose of the item, the selection information is sent from the terminal to the server.

[1759] The server starts the procedure based on the selection, notifies the logistics company of information regarding the collection of the selected items, and arranges the date and time of collection.

[1760] The server notifies the terminal of the progress of the procedure, and the terminal displays the progress to the user.

[1761] Specific examples

[1762] Case: Procedure for selling your old smartphone

[1763] 1. A user wants to dispose of their old smartphone, so they launch the dedicated app, allow camera access, and point their old smartphone at the camera.

[1764] 2. The device sends the video data captured by the camera to the server in real time.

[1765] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[1766] 4. The server sends the appraisal results to the terminal, which then displays the appraisal amount (2,000 yen) and selling options to the user.

[1767] 5. If the user chooses to sell, the selection is sent to the server.

[1768] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[1769] 7. The logistics company will pick up the old smartphone at the user's address.

[1770] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[1771] 9. The terminal will notify the user that the transfer is complete.

[1772] Example prompts for generative AI models

[1773] prompt:

[1774] I want to get rid of my old smartphone, and I want to use the camera in a dedicated app to request an appraisal. How can I go about this?

[1775] Example output:

[1776] 1. Launch the app and allow camera access.

[1777] 2. Point the old smartphone at the camera, and the device will send the video data to the server.

[1778] 3. The server analyzes the video data and assesses its market value.

[1779] 4. The server sends the assessment results to the terminal, which displays them to the user.

[1780] 5. Select Sell and your device will send your selection to the server.

[1781] 6. The server notifies the logistics company and arranges a pickup date and time.

[1782] 7. The logistics company will pick up your old smartphone at your address.

[1783] 8. The server will transfer the sales amount to the specified account.

[1784] 9. The terminal will notify the user that the transfer is complete.

[1785] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1786] Step 1:

[1787] The user launches the dedicated application and allows camera access.

[1788] Input: Camera access permission from user

[1789] Processing: The device initializes the camera.

[1790] Output: The camera is ready to capture video in real time.

[1791] Specific behavior: Launch the app and tap the "Launch Camera" button. The camera access permission dialog will be displayed and the user will select "Allow."

[1792] Step 2:

[1793] The user photographs the unwanted item on camera.

[1794] Input: Camera footage of unwanted items

[1795] Processing: The device captures the video in real time and converts it into video data.

[1796] Output: Video data

[1797] Specific operation: Operate the camera to display the unwanted item on the screen. The image will be displayed on the device screen in real time.

[1798] Step 3:

[1799] The device transmits the video data captured by the camera to the server in real time.

[1800] Input: Video data

[1801] Processing: Compresses the video data and divides it into data packets for transmission to the server

[1802] Output: Video data sent to the server

[1803] Specific operation: The device sends video data to the server using an HTTP request.

[1804] Step 4:

[1805] The server receives the video data and performs video analysis using an image analysis algorithm.

[1806] Input: Video data sent to the server

[1807] Processing: Recognize objects in the video using image analysis algorithms (e.g., OpenCV) and extract feature information of the objects.

[1808] Output: Item characteristics (e.g., make, model, condition)

[1809] How it works: The server analyzes the video data frame by frame and uses machine learning models (e.g., TensorFlow) to identify the objects.

[1810] Step 5:

[1811] The server searches the database for characteristic information about the item and assesses its market value.

[1812] Input: Item characteristics information

[1813] Processing: Issue an SQL query based on the feature information to obtain the market value from the database, then calculate the appraisal amount.

[1814] Output: Appraised amount and detailed item information

[1815] Specific operation: The server searches the database for data matching the item's characteristics and performs an appraisal based on information such as recent transaction prices.

[1816] Step 6:

[1817] The server sends the calculated appraisal amount and detailed item information to the terminal.

[1818] Input: Appraised amount and item details

[1819] Processing: Divide the data into packets and send them to the device

[1820] Output: The assessed value and detailed item information sent to the terminal

[1821] Specific operation: The server sends the assessment results to the terminal using an HTTP response.

[1822] Step 7:

[1823] The terminal displays the assessment results to the user.

[1824] Input: Estimated amount and detailed item information sent from the server

[1825] Processing: Parse the data and display it in the user interface

[1826] Output: The assessment results and options displayed to the user

[1827] What it does: The device screen will display a photo of the item, its name, its estimated value, and the option to sell or dispose of it.

[1828] Step 8:

[1829] The user chooses to sell or dispose of the property.

[1830] Input: User's choice (sale or disposal)

[1831] Processing: Converting user selections into data to send to the server

[1832] Output: User selections sent to the server

[1833] What happens: The user taps the sell or dispose option and then taps the "Confirm" button.

[1834] Step 9:

[1835] The terminal transmits the user's selection to the server.

[1836] Input: User selection

[1837] Processing: Convert the selection into a data packet and send it to the server

[1838] Output: Selections sent to the server

[1839] Specific operation: The device sends the selection to the server using an HTTP request.

[1840] Step 10:

[1841] The server performs the procedure based on the user's selection.

[1842] Input: User selection

[1843] Processing: Generate information to initiate a sale or disposal procedure

[1844] Output: Specific instructions and data for carrying out the procedure

[1845] Specific operation: The server notifies the logistics company of the selection and arranges the pickup date and time.

[1846] Step 11:

[1847] The server notifies the terminal of the progress of the procedure.

[1848] Input: Progress of procedure

[1849] Processing: Packetize progress data and send it to the device

[1850] Output: Progress notifications sent to the terminal

[1851] Specific operation: The server sends the procedure progress status to the terminal using an HTTP response.

[1852] Step 12:

[1853] The terminal notifies the user of the progress of the procedure.

[1854] Input: Progress notification sent by the server

[1855] Processing: Parse the notification data and display it in the user interface

[1856] Output: Progress notification displayed to the user

[1857] Specific operation: Messages such as "Disposal procedures have begun" and "Pickup date and time has been decided" will be displayed on the terminal screen.

[1858] (Application example 1)

[1859] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1860] Conventional procedures for appraising and disposing of unwanted items have been cumbersome and time-consuming for users. For example, when bringing unwanted items to a recycle shop, the appraisal often takes time and the process is tedious. Furthermore, because information on the market value of unwanted items is unclear, users may be dissatisfied with the appraisal amount. For these reasons, there is a demand for a system that allows users to easily appraise and dispose of unwanted items.

[1861] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1862] In this invention, the server includes a means for analyzing video data transmitted from the terminal in real time, a means for searching for characteristic information of the item from a sample collection to calculate the market value, and a means for initiating a purchase procedure at the store, thereby enabling users to easily carry out appraisals and purchase procedures for unwanted items in the store.

[1863] "Unwanted items" are items that a user no longer uses or has determined to be unnecessary.

[1864] "Appraisal" is the process of assessing and calculating the market value of a particular item.

[1865] "Consideration procedures" refers to the system's ability to act on behalf of all activities and procedures related to the acquisition, valuation, sale or disposal of an item.

[1866] "Device with a camera" refers to a smartphone, tablet, or other electronic device with a camera function that is used to capture video data of unwanted items.

[1867] "Video data" refers to visual information captured by a camera, and is data in the form of images or videos of items.

[1868] "Server" refers to a computer system that analyzes video data, identifies items, and calculates their market value.

[1869] "Market value" refers to the monetary value of an item when it is traded in the market, and means the price evaluation at that time.

[1870] "Selling" refers to the act of a user selling unwanted items to another person, meaning that the items are physically traded.

[1871] "Disposal" refers to the act of discarding unwanted items, including recycling, waste disposal, or otherwise relinquishing ownership of the items.

[1872] "Means for presenting options" refers to an interface for visually or audibly presenting the appraisal results and sale or disposal options to the user.

[1873] A "sample set" refers to a database that accumulates characteristic information about an item and calculates its market value based on that information.

[1874] "Purchase procedure" refers to all procedures carried out to sell an item, and is the process of acquiring the item based on the appraisal results and converting it into money.

[1875] "Real-time analysis" refers to the process of analyzing video data immediately upon transmission and providing results promptly.

[1876] "Characteristic information of an item" refers to information for specifically identifying the item, such as the shape, size, color, brand, and model of the item.

[1877] A specific embodiment of the present invention will now be described. In order to easily appraise unwanted items owned by a user and to handle procedures for selling or disposing of such items, the following system configuration is required.

[1878] System Configuration

[1879] 1. Hardware Configuration

[1880] Device: A mobile device equipped with a camera, such as a smartphone or tablet, used by the user. The device captures video of unwanted items and sends the video data to a server.

[1881] Server: A computer system for analyzing video data and assessing the recognition and market value of items. Specifically, it has a processor and database that runs video analysis algorithms.

[1882] 2. Software Configuration

[1883] Camera application: An application installed on a device that captures images of unwanted items and sends the image data to a server. It has a user interface that is easy for users to operate.

[1884] Video analysis algorithm: Software that runs on a server and recognizes objects from video data and extracts their characteristic information. This algorithm uses machine learning models and generative AI models.

[1885] Database: A database that stores information about the market value of items within the server. The database associates information such as the type, model, and condition of an item with its market value.

[1886] Operation explanation

[1887] 1. Video acquisition by device

[1888] The user launches the camera application on their smartphone and points the unwanted item at the camera, which captures the image of the unwanted item and sends the image data to the server in real time.

[1889] 2. Server Analysis and Assessment

[1890] The server receives the video data sent from the device and uses a video analysis algorithm to recognize the item, extracting characteristic information such as the shape, size, color, brand, and model of the item.

[1891] Based on the extracted feature information, the market value is searched for in the database and the appraisal amount is calculated. The appraisal results are sent back to the terminal from the server.

[1892] 3. Presentation and selection of assessment results

[1893] The terminal displays the estimated value and detailed information about the item to the user. The user confirms the estimated value and selects whether to sell or dispose of the item. The selection result is sent from the terminal to the server.

[1894] 4. Start the purchase procedure

[1895] If the user selects to sell, the server will begin the purchase procedure. Based on the user's selection, the server will notify the logistics company of the item's collection information and arrange a collection date and time. After confirming that the collection is complete, the sales amount will be paid to the user.

[1896] Specific examples

[1897] Case: Buying old cameras

[1898] 1. A user wants to sell an old camera, so they launch the camera application on their smartphone and point the camera at the camera.

[1899] 2. The device sends video data to the server in real time.

[1900] 3. The server analyzes the video data and assesses the market value at 10,000 yen.

[1901] 4. The appraisal result will be displayed on the device screen as "Appraisal result: 10,000 yen" and the user can confirm it.

[1902] 5. The user agrees to the estimated price and submits the information on their device regarding their choice to sell.

[1903] 6. The server starts the purchase procedure and notifies the logistics company of the pickup.

[1904] Example prompt sentence:

[1905] "I'd like you to appraise my old camera. I'll send you the footage so you can recognize it and tell me its market value."

[1906] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1907] Step 1:

[1908] Video acquisition by device

[1909] The user launches the camera application on the smartphone.

[1910] When a user captures an unwanted item on the camera, the device captures the video data in real time.

[1911] The acquired video data is transmitted from the terminal to the server.

[1912] Input: The unwanted item from which the user obtains footage.

[1913] Output: Video data sent to the server.

[1914] Data processing / calculation: The device's camera captures video data and sends it to a server via the network.

[1915] Step 2:

[1916] Video data reception and analysis by the server

[1917] The server receives the video data sent from the terminal.

[1918] The server uses a video analysis algorithm to recognize objects in the video and extract characteristic information about the objects.

[1919] Input: Video data sent from the device.

[1920] Output: Item characteristics information (shape, size, color, brand, model, etc.).

[1921] Data processing / calculation: The server analyzes the video data and uses machine learning models and generative AI models to identify the objects and extract their characteristic information.

[1922] Step 3:

[1923] Market value assessment by server

[1924] The server searches the database for characteristic information of the item and calculates the market value.

[1925] The calculated market value is recorded as an appraisal result and transmitted to the terminal.

[1926] Input: Extracted feature information of the item.

[1927] Output: Market value (appraisal result).

[1928] Data processing / calculation: The server searches the database, obtains relevant market value information, and calculates the assessed value.

[1929] Step 4:

[1930] Display of assessment results on the device

[1931] The terminal receives the assessment results sent from the server.

[1932] The appraisal results (appraisal amount, detailed item information, and options for selling or disposing of the item) are displayed to the user.

[1933] Input: Market value (valuation result) sent from the server.

[1934] Output: Display of assessment results (smartphone screen).

[1935] Data processing / calculation: The appraisal results received by the terminal are visually displayed on the screen.

[1936] Step 5:

[1937] User Selection and Submission

[1938] The user checks the displayed appraisal results and selects whether to sell or dispose of the property.

[1939] The terminal transmits the user's selection to the server.

[1940] Input: User's choice (Sell or Dispose).

[1941] Output: Sends the user's selection to the server.

[1942] Data processing / calculation: Takes user selection information as input and sends it to the server.

[1943] Step 6:

[1944] The server starts the purchase procedure.

[1945] The server receives the user's selection and begins the redemption process.

[1946] The server notifies the logistics company of information regarding the collection of the goods and arranges the date and time of collection.

[1947] The adjusted collection schedule is transmitted to the terminal and notified to the user.

[1948] Input: User selection information (sale).

[1949] Output: Notification of collection schedule (terminal and logistics provider).

[1950] Data processing / calculation: The server coordinates pickup dates and times with the logistics company and generates schedule information.

[1951] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1952] MODE FOR CARRYING OUT THE INVENTION

[1953] The present invention relates to a system for easily assessing unwanted items owned by a user, efficiently selling or disposing of them, and providing services by recognizing the user's emotions. The system of the present invention includes a terminal equipped with a camera, a server that analyzes video data to recognize the items and assess their market value, an emotion engine that recognizes the user's emotions, and a means for presenting the assessment results and options for selling or disposing of them to the user.

[1954] System Overview

[1955] The system according to the present invention includes a terminal equipped with a camera for capturing images of unwanted items, a server for analyzing the image data to recognize the items and assess their market value, an emotion engine for recognizing emotions from the user's facial expressions and voice, and means for presenting the assessment results and adjusting the method of presenting options to the user and the support proposals according to the emotions.

[1956] The device is a mobile device such as a smartphone or tablet owned by the user, and captures video of the unwanted items using a camera. The captured video data is sent to a server in real time. The device is also equipped with an emotion engine that analyzes the user's facial expressions and voice in real time to recognize their emotions.

[1957] The server receives and analyzes the video data. Specifically, it uses a video analysis algorithm to recognize items in the video, searches a database for their characteristic information, and assesses their market value. It then calculates the amount as the assessment result and sends it to the terminal.

[1958] The device then presents the user with the received appraisal amount and the options of selling or disposing of the item. Based on the user's emotions recognized by the emotion engine, the device adjusts the way the appraisal results are presented and the content of the disposal options. For example, if the user shows an anxious expression, it displays an assistant message or offers support.

[1959] Natural language explanation of program processing

[1960] 1. Launching the smartphone app and accessing the camera and emotion engine

[1961] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone. The app requests permission to access the camera and emotion engine.

[1962] With the user's permission, the terminal acquires camera images and prepares for emotion recognition.

[1963] The user takes a picture of the unwanted item with a camera.

[1964] 2. Recognition and appraisal of items

[1965] The device transmits the video data captured by the camera to the server in real time.

[1966] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize unwanted items.

[1967] The server extracts the characteristic information of the recognized item, searches the market value in a database, and calculates the appraised amount.

[1968] 3. Emotion recognition and assessment results display

[1969] The device analyzes the user's facial expressions and voice using an emotion engine, along with the assessment results received from the server, to recognize emotions.

[1970] The terminal displays the appraisal result, detailed information about the item, and the option to sell or dispose of the item based on the user's feelings. The terminal also displays a photo of the item, its name, and the estimated price.

[1971] 4. Sale or Disposal Procedures

[1972] The user checks the appraisal results and chooses whether to sell or dispose of the property while receiving emotion-based assistant messages.

[1973] The terminal transmits the user's selection (sale or disposal) to the server.

[1974] The server initiates the disposal procedure based on the user's selection. Specifically, it notifies the distribution company of the collection information for the selected items.

[1975] The server coordinates the pickup date and time with the logistics company and sends the confirmed pickup schedule to the terminal.

[1976] The terminal notifies the user of the pickup schedule, displaying the specific date and time and preparations.

[1977] Specific examples

[1978] Case: Selling your old smartphone

[1979] 1. A user wants to dispose of an old smartphone and launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The user allows access to the camera and emotion engine, and points the old smartphone at the camera.

[1980] 2. The device sends the video data captured by the camera to the server in real time.

[1981] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[1982] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed, providing a sense of security.

[1983] 5. If the user chooses to sell, the selection is sent to the server.

[1984] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[1985] 7. The logistics company will pick up the old smartphone at the user's address.

[1986] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[1987] 9. The terminal displays a notification to the user that the transfer is complete.

[1988] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately while receiving emotional support.

[1989] The processing flow will be explained below.

[1990] Step 1:

[1991] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone, and the app requests permission to access the camera and emotion engine.

[1992] Step 2:

[1993] The user approves camera access and emotion engine permissions.

[1994] Step 3:

[1995] The device prepares to acquire camera footage and recognize emotions, enabling real-time video acquisition and emotion analysis.

[1996] Step 4:

[1997] The user takes a picture of an unwanted item in their home with a camera, and an image of the unwanted item is captured.

[1998] Step 5:

[1999] The device transmits the video data captured by the camera to the server in real time, frame by frame.

[2000] Step 6:

[2001] The server receives the video data and performs video analysis. Specifically, it uses a video analysis algorithm to recognize objects in the video and extract their characteristic information.

[2002] Step 7:

[2003] The server searches the database for the market value of the item based on the extracted characteristic information.

[2004] Step 8:

[2005] The server calculates the market value based on the search results from the database and determines the assessed amount.

[2006] Step 9:

[2007] The server sends the assessment results and detailed item information (e.g., photo and name) to the terminal.

[2008] Step 10:

[2009] The device displays the estimated value and the option to sell or dispose of the item to the user, while the emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[2010] Step 11:

[2011] The device will tailor the presentation of assessment results and additional assistant messages based on the emotions it recognizes, for example, displaying reassuring messages if it recognizes anxiety.

[2012] Step 12:

[2013] The user checks the appraisal results and support messages and chooses whether to sell or dispose of the item.

[2014] Step 13:

[2015] The terminal transmits the user's selection (sale or disposal) to the server.

[2016] Step 14:

[2017] The server will start the disposal procedure based on the user's selection, notify the logistics company of the collection information for the selected items, and arrange the collection date and time.

[2018] Step 15:

[2019] The server transmits the collection schedule to the terminal.

[2020] Step 16:

[2021] The terminal notifies the user of the confirmed pickup schedule, displaying the specific date and time and preparations.

[2022] Step 17:

[2023] The logistics company will pick up the item at the user's address.

[2024] Step 18:

[2025] The logistics company notifies the server that the pickup is complete.

[2026] Step 19:

[2027] The server confirms the completion of the transaction and transfers the sales amount to the account specified by the user.

[2028] Step 20:

[2029] The server sends a notification of the completion of the transfer to the terminal.

[2030] Step 21:

[2031] The terminal displays a notification to the user that the transfer has been completed.

[2032] Example 2

[2033] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2034] The present invention aims to provide appropriate support that takes into account the user's emotions during the process of easily appraising unwanted items owned by the user and efficiently selling or disposing of them. Conventional systems make the appraisal and disposal procedures for items cumbersome, making it difficult to respond appropriately to the user's anxieties and questions. Furthermore, when the user makes an appraisal or disposal choice, support is not provided in accordance with the user's emotions, resulting in low user satisfaction.

[2035] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing acquired video data to recognize an item and assess its market value, means for analyzing video data transmitted from the terminal in real time and searching a database for characteristic information on the item to calculate its market value, emotion engine means for recognizing emotions from the user's facial expressions and voice, and means for presenting the user with the appraisal results and options for selling or disposing of the item. This enables the user to efficiently appraise unwanted items and appropriately sell or dispose of them while receiving support according to their emotions.

[2036] A "terminal" is a mobile device owned by a user, equipped with a camera and an emotion engine, that acquires and transmits video data of unwanted items and the user's emotion information.

[2037] A "camera" is an optical device installed on a terminal to capture video data of unwanted items.

[2038] "Video data" is digital information of images and videos of unwanted items captured by a camera.

[2039] "User" means any person who uses the System to appraise, sell, or dispose of unwanted items.

[2040] An "emotion engine" is software or hardware that is installed in a device and recognizes and analyzes emotions from the user's facial expressions and voice in real time.

[2041] The "server" is a computer system that receives the image data sent from the terminal, recognizes the item, and assesses its market value.

[2042] "Video analysis algorithm" refers to the computational methods and software used by the server to recognize objects in video data.

[2043] "Feature information of an article" is detailed attribute information such as the shape, color, and size of the recognized article.

[2044] A "database" is an information management system that stores information on product characteristics and corresponding market value information.

[2045] "Market value" is the current monetary value of the identified item, as assessed based on a database.

[2046] "Evaluation result" is information for notifying the user of the market value of the item calculated by the server.

[2047] "Options" refers to sale or disposition options presented to a user.

[2048] A "logistics provider" is a business or service provider that handles the collection of items that a user chooses to sell or dispose of.

[2049] "Pickup information" refers to detailed information about the items to be sold or disposed of and information about the pickup schedule.

[2050] The present invention is a system that allows users to easily appraise unwanted items they own and efficiently sell or dispose of them. This system includes a terminal equipped with a camera, a server that analyzes video data to identify the items and assess their market value, an emotion engine that recognizes the user's emotions, and a means for presenting the appraisal results and options for selling or disposing of the items to the user.

[2051] The device is a mobile device such as a smartphone or tablet owned by the user, and captures images of unwanted items using a camera. This camera captures the video data in real time and operates in conjunction with the emotion engine using a processing unit inside the device.

[2052] The emotion engine is software or hardware built into the device that analyzes the user's facial expressions and voice in real time to recognize their emotions. Specifically, emotion analysis is performed using video analysis algorithms such as OpenCV and TensorFlow, or the Google Speech-to-Text API.

[2053] The captured video data is sent to a server in real time via the Internet. The server analyzes the received video data, recognizes the items, and assesses their market value. Specifically, to recognize the items in the video, the server uses video analysis algorithms such as OpenCV and TensorFlow, and compares their feature information with existing data in a database. This allows the server to calculate the market value of the items and return the assessment results to the terminal.

[2054] The terminal receives the appraisal result and presents the appraisal result and the option of selling or disposing of the item to the user based on the user's emotions analyzed by the emotion engine. If the user's emotions are unstable, assistant messages and support suggestions can be displayed to provide reassurance.

[2055] As a concrete example, consider selling an old smartphone.

[2056] 1. A user wants to dispose of an old smartphone and launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app. The user allows access to the camera and emotion engine, and points the old smartphone at the camera.

[2057] 2. The device sends the video data captured by the camera to the server in real time.

[2058] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[2059] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed, providing a sense of security.

[2060] 5. If the user chooses to sell, the selection is sent to the server.

[2061] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[2062] 7. The logistics company will pick up the old smartphone at the user's address.

[2063] 8. The server confirms the completion of the transaction and transfers the sales amount to the user's designated account.

[2064] 9. The terminal displays a notification to the user that the transfer is complete.

[2065] In this way, the system of the present invention allows users to easily assess unwanted items and sell or dispose of them appropriately while receiving emotional support.

[2066] Example prompt sentence:

[2067] The user installs the "Treasure Discovery! Appraisal & Disposal Agent AI" app.

[2068] How do I launch the app, point the camera at my old smartphone, and have it automatically recognized and assessed?

[2069] Additionally, please explain how to use an emotion recognition engine to display support messages according to the user's emotions.

[2070] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2071] Step 1: Launch the smartphone app and grant access to the camera and emotion engine

[2072] The user launches the "Treasure Discovery! Appraisal & Disposal Agent AI" app on their smartphone.

[2073] When the app is launched, the device requests permission to access the camera and emotion engine. Specifically, it calls the device's operating system API to display a pop-up requesting permission.

[2074] The user approves the access permission in the popup that appears. The input here is the user's approval, and the output is permission to use the camera and emotion engine.

[2075] Step 2: Capture footage of unwanted items and send it in real time

[2076] The user photographs the unwanted item they want to have appraised using their smartphone camera.

[2077] The device captures video data with a camera and activates an emotion engine to analyze the user's facial expressions and voice in real time. The input is a video of the unwanted item and the user's facial expressions and voice, and the output is the captured video data and emotional data.

[2078] The video data acquired by the device is sent to the server in real time using WebSocket or HTTP POST requests.

[2079] Step 3: Analyzing video data and recognizing and assessing objects

[2080] The server analyzes the video data received from the device. Specifically, it uses a video analysis algorithm (using libraries such as OpenCV or TensorFlow) to recognize objects in the video. The input is the video data, and the output is feature information of the recognized objects.

[2081] The server extracts the feature information of the recognized item, including the shape, color, size, etc.

[2082] The server searches the database for this feature information and calculates the corresponding market value. The market value assessment utilizes machine learning models and existing price databases. The input is the feature information, and the output is the assessed amount.

[2083] The server sends the assessment result (specific assessment amount) to the terminal.

[2084] Step 4: Recognize emotions and display the assessment results

[2085] The device receives the assessment results from the server and then uses the emotion engine to analyze the user's facial expressions and voice in real time to recognize emotions. The input is the assessment results and the user's emotional data, and the output is an assistant message or support suggestion based on the emotion.

[2086] The terminal displays the appraisal results and detailed information about the item to the user, including a photo of the item, its name, and the appraised amount.

[2087] The device will adjust the way it presents appraisal results and the options for selling or disposing of the item based on the user's emotions. For example, if the user shows signs of anxiety, it will display an assistant message such as, "Don't worry, we're here to help."

[2088] Step 5: Execute the sale or disposal process

[2089] The user checks the appraisal result and selects either sale or disposal. The input is the choice of sale or disposal, and the output is the selection.

[2090] The terminal transmits the user's selection (sale or disposal) to the server.

[2091] The server initiates the disposal procedure based on the selection. Specifically, it notifies the logistics company of the item's collection information. The input is the selection, and the output is the collection information.

[2092] The server uses the logistics company's API to arrange the pickup date and time. The input is the pickup information, and the output is the confirmed pickup schedule.

[2093] The server transmits the confirmed pick-up schedule to the terminal.

[2094] The terminal notifies the user of the pickup schedule, including the specific date and time and preparations.

[2095] The logistics company will pick up the item at the user's address.

[2096] The server confirms the completion of the transaction and transfers the sales amount to the account specified by the user.

[2097] The terminal displays a notification to the user that the transfer is complete.

[2098] In this way, by clearly indicating the specific operations, inputs, and outputs for each step, the details of the assessment of unwanted items and the provision of emotionally based support by the system of the present invention become clear.

[2099] (Application example 2)

[2100] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2101] When selling or disposing of unwanted items, users have difficulty accurately understanding the market value of the items. Furthermore, when assessing items or choosing whether to sell or dispose of them, users' feelings are often not taken into consideration, which can lead to lower user satisfaction. Furthermore, if appraisal results and solutions are not provided in real time, users have to work harder and are unable to carry out efficient procedures. These issues need to be resolved.

[2102] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2103] In this invention, the server includes an emotion engine that recognizes emotions from the user's facial expressions and voice, a means for displaying the appraisal result and a response method based on the emotion via smart glasses or a head-mounted display, and a means for analyzing the acquired video data to recognize the item and assess its market value. This makes it possible to easily appraise the market value of unwanted items and provide appropriate responses that take the user's emotions into consideration in real time.

[2104] "Unwanted items" are items that a user no longer uses or determines are unnecessary.

[2105] A "device equipped with a camera" is a device that has a camera function and can capture images of unwanted items.

[2106] A "server" is a computer system with the computational resources to analyze captured video data and assess item recognition and market value.

[2107] An "emotion engine" is software that analyzes a user's facial expressions and voice data to recognize the user's emotional state.

[2108] "Smart glasses" are devices that can be worn by a user to visually display information.

[2109] A "head-mounted display" is a device that is worn on the user's head and has the function of visually displaying images and information.

[2110] The "assessment result" is information indicating the market value of the item calculated based on the acquired video data.

[2111] "Selling" is the act of selling unwanted items to someone else.

[2112] "Disposal" is the act of discarding or reusing unwanted items.

[2113] "Real-time" refers to a time frame in which data acquisition, analysis, and presentation of results occur almost immediately.

[2114] "Response methods" are appropriate response measures or suggestions that correspond to the user's emotions and situation.

[2115] To implement this invention, it is necessary to build a system that includes the following steps. This system assesses the user's unwanted items and provides options for selling or disposing of them. The terminal and server also cooperate to respond based on the user's emotional state.

[2116] Hardware and Software Configuration

[2117] Device: Use a smartphone, tablet, smart glasses, or head-mounted display with a camera.

[2118] Server: Uses a high performance computer system and acts as a computational resource for assessing the recognition and market value of items.

[2119] Emotion engine: Software for analyzing user facial expressions and voice data. It uses machine learning libraries such as TensorFlow and Keras.

[2120] Camera: Use the device's built-in camera to capture footage of unwanted items.

[2121] System Features

[2122] 1. Video capture: The device captures video of the unwanted item using a camera. Users can easily capture the video using smart glasses or a head-mounted display.

[2123] 2. Transmission of video data: The acquired video data is transmitted to the server in real time. The transmitted data must be high resolution.

[2124] 3. Item Recognition and Valuation: The server analyzes the video data, recognizes the item, searches the database for its characteristics, and calculates its market value.

[2125] 4. Emotion recognition: The emotion engine installed in the device analyzes the user's facial expressions and voice to recognize their emotional state.

[2126] 5. Display of response methods: The user is presented with the appraisal results and response methods based on their emotions through smart glasses or a head-mounted display. The appraisal results include the market value of the item and options for selling or disposing of it.

[2127] 6. Selection of sale or disposal: The user selects sale or disposal via smart glasses or a head-mounted display. The selection information is sent to the server, which then initiates the necessary procedures based on the selection.

[2128] Specific examples

[2129] For example, here's the process for valuing and selling an old smartphone:

[2130] 1. A user wants to get rid of their old smartphone and wears a pair of smart glasses equipped with a camera.

[2131] 2. The device sends the video data captured by the camera to the server in real time.

[2132] 3. The server analyzes the video data and identifies the old smartphone. After identifying it, it searches the database for its market value and calculates an estimated value of 2,000 yen.

[2133] 4. The server sends the appraisal results to the device, which then displays the estimated price (2,000 yen) and options for selling. At the same time, the device analyzes the user's facial expressions and voice to recognize their emotions. If the user shows signs of anxiety, an assistant message is displayed to provide reassurance.

[2134] 5. If the user chooses to sell, the selection is sent to the server.

[2135] 6. The server notifies the logistics company and arranges the pickup date and time. The pickup schedule is sent to the terminal and notified to the user.

[2136] Example prompt for generative AI model:

[2137] "Develop an application that displays the real-time appraisal value of unwanted items such as used books, miscellaneous goods, and home appliances, and suggests assistance messages based on the customer's emotions. The application will use smart glasses or a head-mounted display. It will perform facial and emotion recognition, and will send images of the unwanted items captured by a camera to a server to assess their market value. Display the appraisal results and support suggestions based on the customer's emotions."

[2138] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2139] Step 1:

[2140] The user prepares an unwanted item and wears smart glasses or a head-mounted display equipped with a camera. The user then activates the device and takes a picture of the unwanted item with the camera. The input in this step is a video of the unwanted item, and the output is video data.

[2141] Step 2:

[2142] The video data acquired by the device is sent to the server in real time. The device continues to capture video from the camera and send it to the server. The input in this step is the video data acquired in the previous step, and the output is data sent to the server.

[2143] Step 3:

[2144] The server receives the transmitted video data and uses an item recognition algorithm to recognize unwanted items. This algorithm extracts specific features of the items in the video and identifies them by comparing them with a pre-built database. The input in this step is the transmitted video data, and the output is the recognized item information.

[2145] Step 4:

[2146] The server assesses the market value based on the recognized item information. It searches the database for past transaction data and market trend information for the item and calculates the assessed amount based on this. The input in this step is the recognized item information, and the output is the assessed amount of the item.

[2147] Step 5:

[2148] The device receives the appraisal amount and simultaneously analyzes the user's facial expressions and voice acquired by the emotion engine to recognize their emotions. The device then presents the appraisal result of the item along with a response plan based on the user's emotional state. The input in this step is the appraisal amount and the user's facial and voice data, and the output is the appraisal result and a display of the response plan.

[2149] Step 6:

[2150] The user checks the presented appraisal results and the corresponding measures, and selects whether to sell or dispose of the property. Once the user makes a selection, the selection is sent from the terminal to the server. The input in this step is the user's selection, and the output is the transmission of the selection to the server.

[2151] Step 7:

[2152] The server notifies the distributor based on the user's selection and starts the collection procedure. Specifically, it coordinates the date and time of collection of the item with the distributor and sends the schedule to the terminal. The input in this step is the user's selection, and the output is the start of collection procedure and the transmission of the schedule.

[2153] Step 8:

[2154] The terminal notifies the user of the collection schedule. The terminal notifies the user of detailed information such as the collection date and time so that the user can prepare. The input in this step is the collection schedule, and the output is a notification to the user.

[2155] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2156] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2157] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2158] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2159] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2160] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2161] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2162] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2163] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2164] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2165] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2166] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific ...

Claims

1. A system that allows users to easily assess unwanted items they own and handle the procedures for selling and disposing of them, A device equipped with a camera that captures images of unwanted items; a server for analyzing the acquired video data and assessing the recognition and market value of the item; A system including a means for presenting appraisal results and sale / disposal options to users.

2. 2. The system according to claim 1, further comprising means for analyzing the image data transmitted from the terminal in real time, searching the database for characteristic information of the item, and calculating the market value.

3. 2. The system according to claim 1, further comprising means for allowing the user to select either sale or disposal based on the appraisal results presented by the terminal, and transmitting the selection information to the server.

Images