system
A system using a smartphone and cloud-based AI for item evaluation and collection addresses inefficiencies in Japan's recycling system, ensuring fair pricing and streamlined disposal of unwanted goods.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-04
- Publication Date
- 2026-03-16
AI Technical Summary
In Japan, there is a high waste disposal rate with low recycling efficiency, leading to resource wastage, cumbersome recycling processes, and issues like illegal collection and time constraints during inheritance, along with unfair pricing and inefficient item evaluation.
A system comprising a smartphone camera for photographing items, a cloud server for data upload, an AI engine for market value calculation, a buyer matching system, and a collection company for seamless item collection and payment, ensuring fair transactions.
Enables efficient and fair disposal of unwanted items by automating the evaluation, buyer selection, and collection process, reducing user burden and promoting environmental protection.
Smart Images

Figure 2026047858000001_ABST
Abstract
Description
Technical Field
[0005] ,
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance that responds to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In Japan, there is a situation where there is a lot of waste and incineration of goods, and the recycling rate is low, so many precious resources are wasted. In addition, it takes time and effort to bring goods to recycling shops or auctions, and often, an unacceptable price offer is received when bringing them in. Furthermore, there are also problems such as illegal collection by unscrupulous dealers and time constraints regarding the sorting of goods during inheritance. The purpose is to solve these problems and provide an effective utilization of unnecessary goods and a fair selling process.
Means for Solving the Problems
[0005] To solve the above problems, the present invention provides the following means: a system including a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; a means for arranging a buyer to collect the items if the user agrees to the proposed selling price; and a means for confirming that the items have been collected by the buyer and making payment to the user. Furthermore, the system includes means for the buyer to visit the user's address to collect the items and report the collection status, and means for the AI engine means to obtain transaction information of similar products from a database and calculate its market value based on that information, thereby guaranteeing a fair transaction for the user.
[0006] A "user" is someone who wishes to sell items using the app.
[0007] "Photography means" refers to a device or function used by a user to photograph items they wish to sell.
[0008] "Data transfer means" refers to a device or function for uploading captured image data to a cloud server.
[0009] A "cloud server" is a remote server used to store and process data over the internet.
[0010] An "AI engine" is an artificial intelligence program that analyzes image data and calculates its market value.
[0011] "Market value" refers to the price at which an item is currently traded in the market.
[0012] A "buyer matching method" is a device or function that lists suitable buyers based on the market value calculated by an AI engine and proposes them to the user.
[0013] A "collection company" is a company that visits the user's address to collect items for which the sale has been agreed upon.
[0014] "Means of payment" refers to a device or function that pays the user the sale price after the goods have been collected.
[0015] A "database" is a collection of digital data that stores past transaction information and information on similar products.
[0016] A "collection status reporting means" is a device or function that allows a collection company to report the status of an item to a server after it has been collected. [Brief explanation of the drawing]
[0017] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of the data processing device and smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] Shows an emotion map to which a plurality of emotions are mapped. [Figure 10] Shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.
Mode for Carrying Out the Invention
[0018] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described according to the accompanying drawings.
[0019] First, the terms used in the following description will be described.
[0020] In the following embodiments, a processor with a reference numeral (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.
[0021] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.
[0022] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.
[0023] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).
[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0025] [First Embodiment]
[0026] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0027] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0028] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0029] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0030] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0034] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0035] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0036] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0037] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0038] This invention is a system in which a user can easily and quickly photograph unwanted items, upload the image data to a cloud server, and an AI engine calculates the market value, matches the user with a suitable buyer, and automatically arranges for a collection company.
[0039] First, the user launches the app and takes a picture of the item they want to sell using their smartphone's camera. After taking the picture, the user clicks the "Upload" button to send the image data to the cloud server. In this process, the device uses a data transfer method to transfer the image data to the cloud server.
[0040] When image data arrives on the cloud server, an AI engine analyzes the image data and extracts the characteristics of the item. The AI engine retrieves transaction information for similar products from a database and calculates its market value based on this information. For example, if an image of an old record player is uploaded, the AI engine extracts its shape and brand name, searches the database for how much similar products have been traded for in the past, and values it at 10,000 yen.
[0041] Next, the cloud server lists suitable potential buyers, such as recycling shops, auction sites, and collection companies, based on this market value, and proposes them to the user using a buyer matching system. The user reviews the proposed selling price and list of buyers, and if they are satisfied, they click the "Accept" button to indicate their agreement.
[0042] With the user's consent, the device sends the user's address information to a cloud server, which then selects the most suitable collection company and schedules a visit. The collection company visits the user's address at the designated time and collects the items. After collection, the company reports the collection status to the cloud server.
[0043] After the cloud server confirms that the item has been picked up, it pays the user the predetermined sale price. For example, a vendor visits the user's home, picks up a record player, and reports the result to the cloud server. Upon confirming the report, the server transfers 10,000 yen to the user's bank account. This entire process allows users to efficiently monetize unwanted items without cumbersome procedures or unclear pricing.
[0044] As described above, the present invention is a system that links a smartphone and a cloud server and utilizes AI technology to perform a seamless process from photographing unwanted items, uploading them, evaluating them, matching them with buyers, collecting them, and making payments. This system allows many users to easily organize their belongings and achieve fair pricing and environmental protection.
[0045] The following describes the processing flow.
[0046] Step 1:
[0047] The user launches the app and takes a picture of the item they want to sell with their smartphone. The user uses the app's camera function to take a picture of the item, and once the photo is taken, they click the "Upload" button to send the image data to the cloud server.
[0048] Step 2:
[0049] The device uploads the captured image data to the cloud server. The device's data transfer method sends the image data to the cloud server via the internet.
[0050] Step 3:
[0051] The server receives the image data that has arrived on the cloud server and instructs the AI engine to perform the analysis. The AI engine first extracts the characteristics of the objects from the image (e.g., shape, brand, condition, etc.).
[0052] Step 4:
[0053] The server uses the AI engine's analysis data to retrieve transaction information for similar products from the database and calculates their market value. For example, it might refer to past transaction prices for similar record players and estimate the market value of an item at 10,000 yen.
[0054] Step 5:
[0055] The server lists suitable potential buyers (recycling shops, auction sites, collection companies, etc.) based on the calculated market value. It then creates a list of potential buyers to propose to the user using a buyer matching system.
[0056] Step 6:
[0057] The server notifies the user of the selling price and a list of potential buyers. The user reviews this notification, and if they are satisfied with the proposed selling price, they click the "Accept" button to indicate their agreement.
[0058] Step 7:
[0059] The device notifies the server that it has received the user's consent and simultaneously transmits the user's address information. The server then selects the most suitable pickup company based on the user's address information.
[0060] Step 8:
[0061] The server coordinates a visit date and time with the selected collection company and instructs them to pick up the items from the user's address. The company visits the user's address at the specified date and time and prepares to collect the items.
[0062] Step 9:
[0063] A collection company visits the user's address at the designated date and time to collect the items. After collection is complete, the company reports the collection status to the server.
[0064] Step 10:
[0065] The server checks the report from the collection company and confirms that the items have been safely recovered. Once confirmation is complete, it proceeds with the process of paying the user the sale price.
[0066] Step 11:
[0067] The server transfers the predetermined sale price to the user's bank account. This completes the sale process, allowing the user to receive payment for their items.
[0068] (Example 1)
[0069] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0070] In modern society, many users want to dispose of unwanted items quickly and easily. However, finding a suitable buyer for many of these items is difficult and time-consuming. Therefore, there is a need for a system that automates the entire process of item valuation, buyer selection, and pickup arrangements, thereby reducing the burden on users.
[0071] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0072] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; a means for arranging a buyer to take the items if the user agrees to the proposed selling price; a means for confirming that the items have been picked up by the buyer and making payment to the user; a means for transmitting the user's address information to the cloud server; and a means for the cloud server to select the most suitable buyer based on the address information. This makes it possible for the user to easily perform a series of steps, from evaluating items and selecting buyers to arranging pickup and making payments, automatically.
[0073] "Photography means" refers to the functions or devices used by users to photograph items they wish to sell.
[0074] "Data transfer means" refers to a function or device for transmitting image data of an object captured by a photographic means to a cloud server.
[0075] A "cloud server" is a server that is accessible via the internet for storing and processing data.
[0076] An "AI engine means" refers to a function or device that uses artificial intelligence technology to analyze image data uploaded to a cloud server and calculate its market value.
[0077] A "buyer matching method" refers to a function or device that lists suitable buyer candidates based on market value calculated by an AI engine and proposes them to the user.
[0078] "Means for arranging a company to pick up the goods" refers to a function or device for arranging a company to pick up the goods once the user agrees to the proposed selling price.
[0079] "Means for confirming the completion of collection and making payment to the user" refers to a function or device that confirms that the goods have been collected by the collection company and pays the user the sale price.
[0080] "Means for sending address information to a cloud server" refers to functions or devices for sending a user's address information to a cloud server.
[0081] "Means for selecting the most suitable collection company" refers to functions or devices that select the most suitable collection company based on address information received by the cloud server.
[0082] This invention is a system in which a user can easily and quickly photograph unwanted items, upload the image data to a cloud server, and an AI engine calculates the market value, matches the user with a suitable buyer, and automatically arranges for a collection company.
[0083] First, the user launches the app on their smartphone. The user then takes a photograph of the item they wish to sell using their smartphone's camera function. Once the photograph is complete, the user clicks the "Upload" button to send the image data to the cloud server. The HTTPS protocol is used for data transfer based on an internet connection.
[0084] The cloud server receives the transmitted image data. Next, the AI engine analyzes the image data and extracts the characteristics of the item (shape, brand name, color, condition, etc.). For example, when analyzing an image of an old record player, the AI engine detects its shape and brand name "Pioneer". Based on the analysis results, the AI engine retrieves transaction data of similar products from a database (e.g., MongoDB) and calculates the market value of the item. Based on past transaction data, the market value of the record player is estimated at 10,000 yen.
[0085] Next, the cloud server lists suitable potential buyers (e.g., recycling shops, auction sites, collection companies) based on the market value calculated by the AI engine. This list is generated using a buyer matching system and presented to the user. The user reviews the proposed buyer list and market value, and if satisfied, indicates their intention to sell by clicking the "Accept" button.
[0086] Upon receiving a "Accept" button click from the user, the device sends the user's address information to the cloud server. Based on the received address information, the cloud server selects the most suitable pickup company and coordinates the pickup date and time. Once the coordination is complete, a confirmation notification is sent to the user.
[0087] At the designated date and time, a collection company visits the user's address and collects the items. After collection, the company reports the status to a cloud server. After the server confirms the collection completion report, it pays the user the predetermined sale price. For example, the moment the server confirms the collection completion on the cloud server, 10,000 yen is transferred to the user's bank account.
[0088] This system includes means for capturing images, means for transferring data, means for an AI engine, means for matching buyers, means for arranging pickup companies, means for confirming pickup and making payments, means for transmitting address information, and means for selecting pickup companies. This allows users to easily perform the entire process from evaluating items and selecting buyers to arranging pickup and making payments in a single, seamless process.
[0089] As a concrete example, here is an example of a prompt message:
[0090] "Users take photos of unwanted items with their smartphones and upload the image data to a cloud server. An AI engine calculates the market value and suggests suitable buyers. Your role is to explain the program's processes in natural language to enable this system."
[0091] This invention enables users to quickly and efficiently dispose of unwanted items and trade them at fair prices, thus realizing a system that allows for this.
[0092] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0093] Step 1:
[0094] The user launches the smartphone app. The user uses the smartphone's camera function to photograph the item they want to sell. The user operates the camera and adjusts it so that the item fits entirely in the frame. Specifically, the user presses the shutter button to capture the image. The input is the actual image of the item, and the output is digital image data.
[0095] Step 2:
[0096] The device acquires images taken by the user, and when the "Upload" button is clicked, it sends the image data to the cloud server. Specifically, the device transfers the image data to the cloud server using the HTTPS protocol. The input is the image data taken by the user, and the output is the completion of the transmission of the image data to the cloud server.
[0097] Step 3:
[0098] The server receives image data sent to the cloud. Next, the AI engine analyzes the image data and extracts the characteristics of the item (e.g., shape, brand name, color, condition, etc.). Specifically, the AI engine uses a machine learning model to analyze the image and extract the characteristics as digital data. The input is image data sent to the cloud server, and the output is digital data representing the characteristics of the item.
[0099] Step 4:
[0100] The server retrieves historical transaction data for similar products from a database (e.g., MongoDB) based on the feature data extracted by the AI engine. Specifically, the server executes database queries to search for and retrieve the relevant transaction data. The input is the analyzed feature data, and the output is transaction data for similar products.
[0101] Step 5:
[0102] The server calculates market value based on the acquired transaction data. Specifically, the AI engine calculates market value using statistical methods and algorithms. For example, it determines market value by averaging past transaction price data or by calculating a weighted average. The input is past transaction data, and the output is numerical data of the market value.
[0103] Step 6:
[0104] The server lists suitable potential buyers (e.g., recycling shops, auction sites, recycling companies) based on market value. It then uses a buyer matching system to propose these options to the user. Specifically, the server generates buyer candidate data and creates an interface to display the list to the user. The input is numerical market value data, and the output is a list of potential buyers.
[0105] Step 7:
[0106] The user reviews the proposed buyer and sale price, and if satisfied, clicks the "Accept" button. This sends the user's consent information from the device to the cloud server. Specifically, the user clicks a button on the interface to generate consent data. The input is the proposed buyer information, and the output is the user's consent data.
[0107] Step 8:
[0108] The device sends address information to the cloud server with the user's consent. Specifically, the device displays an address input screen, encodes the information entered by the user, and sends it. The input is the address information entered by the user, and the output is the completion of the transmission to the cloud server.
[0109] Step 9:
[0110] The server selects the most suitable pickup company based on the received address information and coordinates the pickup date and time. Specifically, the server searches a database of pickup companies and executes an algorithm to select the most suitable company. The input is the user's address information, and the output is information determining the pickup company and the date and time of visit.
[0111] Step 10:
[0112] The collection company visits the user's address at the designated date and time to collect the items. After collection, the company reports the status to a cloud server. Specifically, the company uses an item collection application to send status report data to the cloud server. The input is information about the item's collection status, and the output is the report data sent to the server.
[0113] Step 11:
[0114] After receiving the pickup completion report, the server pays the user the sale price. Specifically, the server accesses the user's bank account information and executes a process with the banking system to transfer the sale price. The inputs are the pickup completion report data and bank account information, and the output is the transfer of funds to the user's bank account.
[0115] (Application Example 1)
[0116] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0117] Traditionally, selling unwanted items required users to go through cumbersome procedures such as item assessment, selecting a suitable buyer, and arranging for collection services. Furthermore, there was no efficient system in place to streamline the selling process within stores. These issues made the process cumbersome for both users and store staff, making efficient item sales difficult.
[0118] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0119] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates based on the market value calculated by the AI engine and proposing them to the user; a means for arranging a buyer for the items if the user agrees to the proposed selling price; a means for confirming that the items have been picked up by the buyer and making payment to the user; a smart device application means for performing a process within the store that calculates the market value from images of items photographed by the user and proposes suitable buyers; and a means for the user to scan items using the smart device application means and transmit the image data to the cloud server. This enables users and store staff to efficiently assess items, select buyers, and arrange for pickup.
[0120] A "user" is an individual or legal entity that intends to sell goods.
[0121] "Items" refers to any unwanted items that a user wishes to sell.
[0122] "Means of photography" refers to the camera function of a smart device or other photographic and acoustic devices, and is a means of acquiring image data of an object.
[0123] "Data transfer means" refers to the means of sending image data obtained by the shooting means to a cloud server, and typically utilizes an internet connection.
[0124] A "cloud server" is a server accessible via the internet that provides computing resources for storing and analyzing image data.
[0125] "AI engine means" refers to a program and hardware that uses artificial intelligence to analyze image data and calculate market value, and is implemented on a cloud server.
[0126] "Market value" is the estimated price at which the item would be traded in the current market, as calculated by the AI engine.
[0127] "Potential buyers" refers to potential destinations such as recycling shops, auction sites, and recycling companies that are suitable for selling items.
[0128] A "buyer matching method" is a means of proposing suitable buyer candidates to users based on the market value calculated by the AI engine.
[0129] A "collection company" is a company that collects items that users sell from a designated location.
[0130] "Application means for smart devices" refers to applications installed on mobile information terminals such as smartphones and tablets, which are used for tasks such as taking pictures of items, sending data to a cloud server, suggesting potential buyers, and arranging for collection companies.
[0131] A "generative AI model" is a machine learning or deep learning model used by an AI engine that runs on a cloud server.
[0132] A "prompt" refers to a text-based instruction or question input to a generative AI model, used to obtain specific processing instructions or answers.
[0133] This invention provides a system for users to efficiently sell unwanted items. Specific embodiments of this system are described below.
[0134] The user first launches a smart device application and takes a picture of the item they want to sell using their smartphone's camera. The smartphone's camera function is used as the means of taking the picture. This image data is then uploaded to a cloud server using a data transfer method.
[0135] The cloud server receives uploaded image data and performs analysis using an AI engine. This AI engine uses machine learning and deep learning generative AI models to extract features of items from the image data and retrieve transaction information for similar products from a database. Based on this, it calculates the market value.
[0136] Next, the cloud server lists suitable potential buyers based on market value and proposes them to the user using a buyer matching system. The user reviews the proposed selling price and the list of buyers, and clicks the "Accept" button if they are satisfied. Upon receiving this consent, the device sends the user's address information to the cloud server.
[0137] The cloud server selects the most suitable collection company based on the user's address and item information, and schedules a visit date and time. The collection company visits the user's address or store at the specified date and time to collect the items. After collection, the company reports the collection status to the cloud server.
[0138] After the cloud server confirms that the items have been collected, it pays the user the predetermined sale price. For example, a vendor visits the user's home or store, collects the items, and reports the results to the cloud server. Once the server confirms the report, it transfers the sale price to the user's bank account. This entire process allows users and store staff to avoid cumbersome procedures and opaque pricing, and efficiently convert unwanted items into cash.
[0139] For example, a store staff member might use an application to scan a used smartphone in the store, and an AI engine might estimate its market value at "20,000 yen." Based on this data, the system matches the user with multiple auction sites and other recycling businesses, suggesting the best place to sell the item.
[0140] Examples of prompt statements to input into a generative AI model include the following:
[0141] Please upload images of your used smartphone. Our AI engine will calculate its market value and suggest suitable buyers.
[0142] This system allows many users to easily organize their belongings, enabling fair pricing and environmental protection.
[0143] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0144] Step 1:
[0145] The user launches a smart device application and takes a picture of the item they want to sell using their smartphone's camera. The input is the image of the item captured by the smartphone's camera, and this image is sent to the next step.
[0146] Step 2:
[0147] The device uploads the captured image data to a cloud server. This transfers the captured image data to the cloud server, where it is used in the next analysis step. HTTP requests via an internet connection are used as the data transfer method.
[0148] Step 3:
[0149] The cloud server receives uploaded image data and analyzes this data using an AI engine. The input is image data stored on the cloud server, and the output is data in which the features and attributes of the items have been extracted. The AI engine uses a generative AI model to extract the features of the items from the images and recognize specific parameters (e.g., brand name, shape).
[0150] Step 4:
[0151] The cloud server calculates market value using data extracted by the AI engine. The input is the characteristic data of the extracted items, and the output is an estimate of the market value. The AI engine retrieves transaction information for similar products from the database and calculates the market value based on this.
[0152] Step 5:
[0153] The cloud server lists suitable potential buyers based on market value and proposes them to the user through a buyer matching system. The input is the calculated market value and buyer information from the database, and the output is a list of potential buyers. This list is sent to the user's terminal and displayed within the application.
[0154] Step 6:
[0155] The user reviews the proposed selling price and the list of potential buyers, then clicks the "Accept" button. This action sends the user's address information from the device to the cloud server. The input is the user's authentication and address information, and the output is the transmission of data to the cloud server.
[0156] Step 7:
[0157] The cloud server selects the most suitable pickup company based on the user's address and item information, and schedules the visit date and time. Inputs are the user's address and item information, while outputs are the selected pickup company and confirmed visit date and time. The cloud server then transmits this information to the pickup company.
[0158] Step 8:
[0159] The collection company visits the user's address or store at the designated date and time to collect the items. After collection, they report the collection status to the cloud server. The input is the collection status of the items, and the output is the data reported to the cloud server.
[0160] Step 9:
[0161] After the cloud server confirms that the pickup is complete, it pays the user the predetermined sale price. The inputs are the pickup completion report and the sale price, and the output is a notification that the payment has been transferred to the user's bank account.
[0162] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0163] This invention is a system that improves the user experience by allowing users to easily and quickly photograph unwanted items, upload the image data to a cloud server, and then having an AI engine calculate the market value, match the user with a suitable buyer, and further combine this with an emotion engine that analyzes the user's emotions.
[0164] First, the user launches the app and takes a picture of the item they want to sell using their smartphone's camera. After taking the picture, the user clicks the "Upload" button to send the image data to the cloud server. In this process, the device uses a data transfer method to transfer the image data to the cloud server.
[0165] When image data arrives on the cloud server, an AI engine analyzes the image data and extracts the characteristics of the item. The AI engine retrieves transaction information for similar products from a database and calculates its market value based on this information. For example, if an image of an old record player is uploaded, the AI engine extracts its shape and brand name, searches the database for how much similar products have been traded for in the past, and values it at 10,000 yen.
[0166] Next, the cloud server lists suitable potential buyers, such as recycling shops, auction sites, and collection companies, based on this market value, and proposes them to the user using a buyer matching system. Furthermore, an emotion engine analyzes the user's facial expressions and voice data to recognize the user's emotional state.
[0167] The emotion engine analyzes the user's emotional state, and if the user is feeling anxious or dissatisfied, the server adjusts the proposed content and price offer. For example, if the user has a dissatisfied expression, the emotion engine recognizes this, and the server has the capability to offer more detailed explanations or alternatives.
[0168] The user reviews the proposed selling price and list of potential buyers, and if satisfied, clicks the "Accept" button to indicate their agreement. Upon receiving the user's consent, the device sends the user's address information to the cloud server, which selects the most suitable collection company and schedules a visit. The collection company visits the user's address at the specified date and time and collects the items. After collection, the company reports the collection status to the cloud server.
[0169] After the cloud server confirms that the item has been picked up, it pays the user the predetermined sale price. For example, a vendor visits the user's home, picks up a record player, and reports the result to the cloud server. Upon confirming the report, the server transfers 10,000 yen to the user's bank account. This entire process allows users to efficiently monetize unwanted items without cumbersome procedures or unclear pricing.
[0170] As described above, the present invention is a system that links a smartphone with a cloud server and utilizes AI technology and emotion analysis technology to perform a seamless process from photographing unwanted items, uploading them, evaluating them, matching them with buyers, collecting them, and making payments. This system allows many users to easily organize their belongings and achieve fair pricing and environmental protection.
[0171] The following describes the processing flow.
[0172] Step 1:
[0173] The user launches the app and takes a picture of the item they want to sell using their smartphone's camera function. After the user takes the picture of the item with the camera function and finishes taking the picture, they click the "Upload" button to send the image data to the cloud server. For example, the user might take a picture of an old record player.
[0174] Step 2:
[0175] The device uploads the captured image data to the cloud server. The device's data transfer method transfers the image data to the cloud server via the internet. As a result, the image data from the record player reaches the cloud server.
[0176] Step 3:
[0177] The server receives the image data arriving at the cloud server and instructs the AI engine to perform the analysis. The AI engine first extracts the characteristics of the object from the image (e.g., shape, brand name, condition, etc.). The AI engine recognizes the shape and brand name of the record player.
[0178] Step 4:
[0179] The server uses the AI engine's analysis data to retrieve transaction information for similar products from a database and calculates their market value. For example, it might refer to data on how much similar record players have been traded for in the past and estimate the market value of an item at 10,000 yen.
[0180] Step 5:
[0181] Based on the calculated market value, the server lists suitable potential buyers (recycling shops, auction sites, recycling companies, etc.). The server then uses a buyer matching system to suggest a list of potential buyers to the user. For example, the server might present the user with recycling shop A and auction site B.
[0182] Step 6:
[0183] The server uses an emotion engine to analyze the user's facial expressions and voice data in real time to recognize how the user feels about the displayed selling price and offer. For example, if the user shows a dissatisfied expression after seeing the offer price, the emotion engine will detect this.
[0184] Step 7:
[0185] The server adjusts its offers and pricing based on the user's emotional state, as recognized by the emotion engine. If the user expresses dissatisfaction, the server provides more detailed explanations or additional selling options. For example, the server might notify the user that "If you are not satisfied with the current price, you can consider other recycling shops."
[0186] Step 8:
[0187] The user agrees to the proposed selling price and the list of potential buyers and clicks the "Accept" button. The user's address information is sent from their device to the cloud server. The server then uses this address information to select the most suitable pickup company.
[0188] Step 9:
[0189] The server coordinates a visit date and time with the selected pickup company and instructs them to pick up the items from the user's address. The pickup company visits the user's address at the specified date and time and prepares to collect the items.
[0190] Step 10:
[0191] A collection company visits the user's address at the designated date and time to collect the items. After collection is complete, the company reports the collection status to a cloud server. For example, the company might report to the server that "the record player has been successfully collected."
[0192] Step 11:
[0193] The server checks the report from the collection company and confirms that the items have been safely recovered. Once confirmation is complete, the server proceeds with the process of paying the user the predetermined sale price.
[0194] Step 12:
[0195] The server transfers the sale price to the user's bank account, and the user receives the cash. This completes the sale process, and the user receives 10,000 yen as payment for the items.
[0196] (Example 2)
[0197] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0198] Traditionally, when users sold unwanted items, finding a suitable buyer and calculating a fair market value was a time-consuming and laborious process. Furthermore, offers often failed to reflect the user's feelings and intentions, resulting in unsatisfactory transactions. To address these issues, there is a need for a system that accurately and quickly calculates the market value of items and provides more suitable selling proposals based on user sentiment analysis.
[0199] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0200] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an artificial intelligence engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the artificial intelligence engine; an emotion analysis means for analyzing the user's facial expressions and voice data and recognizing their emotional state; a means for adjusting the proposed content and price based on the user's emotional state recognized by the emotion analysis means; a means for arranging a buyer for the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user. This enables the user to efficiently and accurately calculate the market value and receive selling proposals that take into account the user's emotions.
[0201] "Photography means" refers to the functions or devices used by users to photograph items they wish to sell.
[0202] "Data transfer means" refers to the functions and protocols used to upload image data captured by a camera to a cloud server.
[0203] "Artificial intelligence engine means" refers to algorithms and software used to analyze uploaded image data and calculate the market value of goods.
[0204] "Sales matching method" refers to a function or algorithm that lists suitable potential buyers based on market value calculated by an artificial intelligence engine and proposes them to the user.
[0205] "Emotional analysis tools" refer to functions and software that analyze a user's facial expressions and voice data to recognize the user's emotional state.
[0206] "Proposal content adjustment means" refers to functions or algorithms used to adjust the content and price of a sales proposal based on the user's emotional state recognized by emotion analysis means.
[0207] "Arrangement of pickup service provider" refers to a function or system that arranges for a pickup service provider to collect items once the user agrees to the proposed selling price.
[0208] "Payment method" refers to the function or process for confirming that the item has been picked up by the collection company and for paying the user the sale price.
[0209] This invention is a system that eliminates the hassle of users easily selling unwanted items, enabling efficient, highly accurate, and fair transactions. Specific embodiments of the system are described below.
[0210] Hardware and software configuration
[0211] User terminal
[0212] Mobile devices such as smartphones and tablets are used.
[0213] It has a camera function and is used as a means of taking pictures.
[0214] It has internet connectivity and is used as a means of data transfer.
[0215] Cloud Server
[0216] It is a server built on a cloud computing environment.
[0217] It is equipped with an artificial intelligence engine for image analysis (e.g., TensorFlow, PyTorch).
[0218] It is connected to a database for calculating market value.
[0219] It is equipped with an algorithm for matching buyers.
[0220] It includes an emotion engine (e.g., OpenFace, EmoPy) for performing emotion analysis.
[0221] Program processing
[0222] 1. The user launches the app.
[0223] Users launch the app by tapping it on their smartphone's home screen.
[0224] 2. The user takes a picture of the item.
[0225] Users take photos of the items they want to sell using the app's camera function. After taking the photo, an image preview is displayed on the screen.
[0226] 3. Uploading image data
[0227] When a user clicks the "Upload" button, the captured image data is uploaded. The device uses its internet connection to send the image data to the cloud server. A data transfer protocol (e.g., HTTPS) is used for this process.
[0228] 4. Image analysis and calculation of market value
[0229] After the server receives image data, an artificial intelligence engine analyzes the image data and extracts the characteristics of the items. Based on the extracted characteristics, it retrieves transaction information for similar products from a database and calculates the market value. For example, an old record player might be valued at 10,000 yen.
[0230] 5. Proposals for potential buyers
[0231] The server lists potential buyers, such as recycling shops, auction sites, and recycling companies, based on the calculated market value. The listed buyers and their market values are then sent to the user's device.
[0232] 6. Emotional analysis and adjustment of proposed content
[0233] When a user reviews potential buyers, the device's camera and microphone activate to collect facial expressions and audio data. The collected data is sent to a server and analyzed by an emotion engine. If the user expresses anxiety or dissatisfaction, the offer and price are adjusted.
[0234] 7. Confirmation of the sale price and buyer.
[0235] The user reviews the proposed selling price and the list of potential buyers, and clicks the "Accept" button if they are satisfied. This action initiates the selling process.
[0236] 8. Submitting address information
[0237] When the user clicks the "Accept" button, the device sends the user's address information to the cloud server. This allows the pickup company to be arranged.
[0238] 9. Arrange for a pickup company and collect the items.
[0239] The server selects the most suitable collection company based on the user's address information and schedules a visit. The collection company visits the user's address at the specified time and collects the items. Once collection is complete, the company reports to the cloud server.
[0240] 10. Payment of the sale price
[0241] Once the server confirms that the item has been picked up, the sale price will be transferred to the user's bank account. For example, in the case of a record player, 10,000 yen will be transferred to the user's account.
[0242] Specific example
[0243] For example, if a user wants to sell an old record player, they can use the system by following these steps.
[0244] 1. Launch the app and take a picture of the record player using the camera function.
[0245] 2. Click the "Upload" button to send the image data to the cloud server.
[0246] 3. The server analyzes the image and values its market value at 10,000 yen.
[0247] 4. List potential buyers such as recycling shops and auction sites, and propose them to the user.
[0248] 5. The emotion engine analyzes the user's facial expressions, and if it detects anxiety, it refines the suggested actions.
[0249] 6. Once the user agrees and clicks the "Accept" button, the address information is sent to the server.
[0250] 7. A collection company will be arranged to pick up the record player on the designated date.
[0251] 8. Once the collection is complete, the server will transfer 10,000 yen to the user's bank account.
[0252] Example of a prompt
[0253] "Please calculate the market value of this old record player and suggest a suitable buyer."
[0254] "Perform sentiment analysis based on images uploaded by users and provide appropriate suggestions."
[0255] The above is a detailed explanation of how to carry out this invention.
[0256] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0257] Step 1:
[0258] The user launches the app.
[0259] The user launches the app by tapping it on their smartphone's home screen. This action displays the application interface on the user's device. The input is the user's tap action, and the output is the display of the app's home screen.
[0260] Step 2:
[0261] The user takes a picture of an item.
[0262] The user takes a picture of the item they want to sell using the app's camera function. After taking the picture, an image preview is displayed on the device screen. The input is the device's camera operation and the image of the item, and the output is the previewed image data.
[0263] Step 3:
[0264] Uploading image data
[0265] When a user clicks the "Upload" button, the device sends the captured image data to a cloud server. A data transfer protocol (e.g., HTTPS) is used. The input to this process is the user's click action and the image data, while the output is the data transfer status to the cloud server. Specifically, image data compression and encryption are performed during this process.
[0266] Step 4:
[0267] The server receives the image data.
[0268] The server receives image data and logs it. A request / response mechanism is used to verify whether the received image data was received correctly. The input is the image data sent from the terminal, and the output is a status log indicating successful reception.
[0269] Step 5:
[0270] The artificial intelligence engine analyzes the image.
[0271] The server starts an artificial intelligence engine (e.g., TensorFlow, PyTorch) and analyzes the received image data. During the analysis, it extracts the characteristics of objects (e.g., shape, brand name). The input is the received image data, and the output is the extracted feature data. Specifically, the process involves image preprocessing (resizing and normalization) and feature extraction (object detection and image classification).
[0272] Step 6:
[0273] Calculation of market value
[0274] The server uses extracted feature data to retrieve transaction information for similar products from the database and calculates the market value. The input is the feature data and transaction information from the database, and the output is the market value of the item. Specifically, it performs database searches using SQL queries and calculates price estimates. For example, an old record player might be valued at 10,000 yen.
[0275] Step 7:
[0276] Proposal of potential buyers
[0277] Based on the market value, the server lists potential buyers such as recycling shops, auction sites, and collectors. The server then sends the list of potential buyers and the market value information to the user's terminal. The input is the market value and the potential buyer database, and the output is the list of potential buyers. The specific operations include candidate selection using an algorithm and data transmission.
[0278] Step 8:
[0279] The user checks the potential buyers
[0280] The user checks the selling price and the list of potential buyers displayed on the terminal screen. At this time, the camera and microphone of the terminal are activated to collect facial expression and voice data. The input is the user's visual confirmation action, and the output is the confirmation status and the collected emotion data. [[ID=2 (1)]] [[ID=2 (2)]]
[0281] [[ID=2 (3)]] Step 9:
[0282] Implementation of emotion analysis
[0283] The terminal sends the facial expression and voice data collected to the server, and the emotion engine on the server performs analysis. The emotion engine recognizes the user's emotional state and determines whether the user feels anxious or dissatisfied. The input is the collected data, and the output is the analysis result of the emotional state. The specific operations include preprocessing of images and voices and application of the emotion recognition model.
[0284] Step 10:
[0285] Adjustment of the proposal content
[0286] Note: There seems to be a bit of an unclear or incorrect formatting in the original text with the repeated use of ID=2 in the translation part which might need to be double-checked in the source context. I've translated it as best as possible following the rules.Based on the sentiment analysis results, the server adjusts the content and price of the sales proposal. For example, if the user shows dissatisfaction, more detailed explanations or new alternatives are generated and sent to the user's terminal. The input is the sentiment analysis results and the sales proposal content, and the output is the adjusted proposal content.
[0287] Step 11:
[0288] Confirmation of selling price and buyer
[0289] If the user checks and agrees with the adjusted proposal content, the user clicks the "Commit" button. The input is the user's confirmation operation, and the output is the commitment status.
[0290] Step 12:
[0291] Transmit the user's address information
[0292] When the user clicks the "Commit" button, the terminal transmits the user's address information to the cloud server. The input is the address information, and the output is the transmission status to the server.
[0293] Step 13:
[0294] Arrangement of collector
[0295] Based on the user's address information, the server selects the optimal collector and adjusts the visit date and time. The input is the address information and the vendor database, and the output is the visit schedule. Specifically, vendor selection and schedule adjustment using an algorithm are performed.
[0296] Step 14:
[0297] Collection of items
[0298] The collector visits the user's address at the designated date and time to collect the items. When the collection is completed, the collector reports the status to the cloud server. The input is the collection status, and the output is the report data to the server.
[0299] Step 15:
[0300] Payment of sale price
[0301] After the server confirms that the item has been picked up, it transfers the sale price to the user's bank account. The input is the confirmation data of the item's pickup and the sale price information, and the output is the status of the completed transfer. For example, in the case of a record player, 10,000 yen will be transferred to the user's account.
[0302] (Application Example 2)
[0303] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".
[0304] Traditional systems for selling unwanted items have problems such as users having difficulty understanding the market value of their items and spending a lot of time and effort finding a suitable buyer. Furthermore, they often fail to consider the user's emotional state, offering only uniform offers, which can lead to decreased user satisfaction. To solve these problems, a system is needed that allows users to easily calculate the market value of their items and find a suitable buyer, while also incorporating emotional analysis.
[0305] The specific processing by the specific processing unit 290 of the data processing apparatus 12 in Application Example 2 is realized by the following means. In this invention, the server includes: imaging means for imaging an item that the user wishes to sell; data transfer means for uploading the image data of the item imaged by the imaging means to a cloud server; AI engine means for analyzing the image data uploaded to the cloud server and calculating the market value; selling destination matching means for listing appropriate selling destination candidates based on the market value calculated by the AI engine means and proposing them to the user; sentiment analysis means for analyzing the user's sentiment state; means for adjusting the proposal content and price presentation based on the sentiment state analyzed by the sentiment analysis means; means for arranging a collector for the item when the user agrees to the proposed selling price; and means for confirming that the item has been collected by the collector and making a payment to the user. Thereby, the user can sell unnecessary items efficiently and at an appropriate price, and furthermore, it becomes possible to respond according to the user's sentiment state.
[0306] A "user" is an individual or corporation that wishes to sell unnecessary items using the system.
[0307] The "imaging means" is a device (e.g., the camera of a smartphone) used to image an item that the user wishes to sell.
[0308] The "data transfer means" is a function for transmitting the image data of the item imaged by the imaging means to a cloud server.
[0309] A “cloud server” is a remote server that stores and processes data through a network.
[0310] The "AI engine means" is an artificial intelligence technology for analyzing the image data uploaded to the cloud server and calculating the market value of the item.
[0311] The "sales target matching method" is a function that lists suitable potential buyers based on market value calculated by an AI engine and proposes them to the user.
[0312] "Emotional analysis methods" refer to technologies for analyzing a user's emotional state. These methods recognize a user's emotional state by analyzing facial expressions and voice data.
[0313] A "collection company" is a company that collects items from a user's address with the user's consent.
[0314] The "collection completion confirmation method" is a function that confirms that the collection company has retrieved the items and then makes the payment to the user from the cloud server.
[0315] This invention is a system that allows users to easily and quickly sell unwanted items. Specific embodiments of this system are described below.
[0316] System Configuration
[0317] The server includes: a means for photographing items that a user wants to sell; a means for uploading image data of the items photographed by the means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; an emotion analysis means for analyzing the user's emotional state; a means for adjusting the proposal and price offer based on the emotional state analyzed by the emotion analysis means; a means for arranging a buyer to take the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user.
[0318] Program processing
[0319] The server uploads image data captured by the user using their smartphone camera to the cloud server. The uploaded image data is analyzed by an AI engine (e.g., TensorFlow or Keras model) on the cloud server. As a result of the analysis, the characteristics of the item are extracted, transaction information for similar products is retrieved from a database, and the market value is calculated. For example, if an image of an old telephone is uploaded, the AI engine analyzes its shape and brand name and calculates its market value based on transaction information.
[0320] Next, a buyer matching system lists several potential buyers based on the calculated market value, and proposals are made to the user. Simultaneously, the user's emotional state is analyzed by an emotion analysis system (e.g., an EmotionRecognition model). For example, if the user is feeling anxious or dissatisfied, more detailed proposals or alternatives are presented.
[0321] Once the user agrees to the proposed selling price, the server arranges for a pickup company to visit the user's address and collect the items. After the pickup company reports that the collection is complete, the server pays the user the agreed-upon selling price.
[0322] Specific example
[0323] If a user wants to sell an unwanted smartphone, they take a picture of the smartphone through the app and upload the image. An AI engine calculates its market value, for example, 5,000 yen, and suggests several places to sell it (e.g., a recycling shop or online auction). Sentiment analysis checks if the user is satisfied and provides additional explanations or alternatives as needed. Once the user agrees to the price, a pickup company is arranged, and after the item is collected, the user is paid 5,000 yen.
[0324] Example of a prompt
[0325] Example: "Analyze image data of unwanted items photographed by users, use AI to calculate their market value, and suggest suitable buyers. Also, analyze the user's emotions and provide detailed explanations and alternatives until the user is satisfied."
[0326] This ensures that users can sell unwanted items efficiently and at a fair price.
[0327] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0328] Step 1:
[0329] The user takes a picture of the item they want to sell using their smartphone camera. Specifically, the user launches the camera app on their smartphone and takes a picture of the item. The input is image data of the item, and the output is the captured image data.
[0330] Step 2:
[0331] The device uploads the captured image data to the cloud server. Specifically, the device's application sends the captured image to the cloud server using a data transfer method. The input is the captured image data, and the output is the image data stored on the cloud server.
[0332] Step 3:
[0333] The server uses an AI engine to analyze image data uploaded to the cloud server. Specifically, it uses AI models such as TensorFlow and Keras to extract features of items from images and calculate their market value based on those features. The input is image data stored on the cloud server, and the output is the calculated market value.
[0334] Step 4:
[0335] The server uses a buyer matching system to list suitable buyer candidates based on the market value calculated by the AI engine. Specifically, it retrieves information on potential buyers from a database and evaluates them based on their market value. The inputs are the calculated market value and buyer information from the database, and the output is a list of potential buyers.
[0336] Step 5:
[0337] The server analyzes the user's emotional state using emotion analysis tools. Specifically, it uses an EmotionRecognition model to analyze the user's facial expressions and voice data to recognize the user's emotional state. The input is the user's facial image or voice data, and the output is the analyzed emotional state.
[0338] Step 6:
[0339] The server adjusts its proposals and pricing based on the emotional state analyzed by the emotion analysis tool. Specifically, if the user is feeling anxious or dissatisfied, it will provide detailed explanations and alternatives. The input is the analyzed emotional state and a list of potential buyers, and the output is the adjusted proposal.
[0340] Step 7:
[0341] If the user agrees to the proposed selling price, the server arranges for a pickup service for the items. Specifically, it uses a pickup service arrangement system to send the user's address information and coordinate the pickup date. The inputs are the user's consent and address information, and the output is information about the arranged pickup service.
[0342] Step 8:
[0343] The collection company will visit the user's address at the designated date and time to collect the items. The input is the information of the arranged collection company, and the output is the collected items.
[0344] Step 9:
[0345] The collection company reports to the server that it has completed the collection of the items. Specifically, the collection company uses a dedicated reporting system to notify the server of the collection status. The input is the information reported by the collection company, and the output is the collection completion status confirmed by the server.
[0346] Step 10:
[0347] After confirming the completion of the pickup, the server pays the user the predetermined sale price. Specifically, it transfers the sale price to the user's bank account through the banking system. The input is the confirmed pickup completion status and the sale price, and the output is the sale price that has been transferred.
[0348] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0349] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0350] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0351] [Second Embodiment]
[0352] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0353] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0354] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0355] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0356] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0357] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0358] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0359] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0360] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0361] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0362] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0363] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0364] This invention is a system in which a user can easily and quickly photograph unwanted items, upload the image data to a cloud server, and an AI engine calculates the market value, matches the user with a suitable buyer, and automatically arranges for a collection company.
[0365] First, the user launches the app and takes a picture of the item they want to sell using their smartphone's camera. After taking the picture, the user clicks the "Upload" button to send the image data to the cloud server. In this process, the device uses a data transfer method to transfer the image data to the cloud server.
[0366] When image data arrives on the cloud server, an AI engine analyzes the image data and extracts the characteristics of the item. The AI engine retrieves transaction information for similar products from a database and calculates its market value based on this information. For example, if an image of an old record player is uploaded, the AI engine extracts its shape and brand name, searches the database for how much similar products have been traded for in the past, and values it at 10,000 yen.
[0367] Next, the cloud server lists suitable potential buyers, such as recycling shops, auction sites, and collection companies, based on this market value, and proposes them to the user using a buyer matching system. The user reviews the proposed selling price and list of buyers, and if they are satisfied, they click the "Accept" button to indicate their agreement.
[0368] With the user's consent, the device sends the user's address information to a cloud server, which then selects the most suitable collection company and schedules a visit. The collection company visits the user's address at the designated time and collects the items. After collection, the company reports the collection status to the cloud server.
[0369] After the cloud server confirms that the item has been picked up, it pays the user the predetermined sale price. For example, a vendor visits the user's home, picks up a record player, and reports the result to the cloud server. Upon confirming the report, the server transfers 10,000 yen to the user's bank account. This entire process allows users to efficiently monetize unwanted items without cumbersome procedures or unclear pricing.
[0370] As described above, the present invention is a system that links a smartphone and a cloud server and utilizes AI technology to perform a seamless process from photographing unwanted items, uploading them, evaluating them, matching them with buyers, collecting them, and making payments. This system allows many users to easily organize their belongings and achieve fair pricing and environmental protection.
[0371] The following describes the processing flow.
[0372] Step 1:
[0373] The user launches the app and takes a picture of the item they want to sell with their smartphone. The user uses the app's camera function to take a picture of the item, and once the photo is taken, they click the "Upload" button to send the image data to the cloud server.
[0374] Step 2:
[0375] The device uploads the captured image data to the cloud server. The device's data transfer method sends the image data to the cloud server via the internet.
[0376] Step 3:
[0377] The server receives the image data that has arrived on the cloud server and instructs the AI engine to perform the analysis. The AI engine first extracts the characteristics of the objects from the image (e.g., shape, brand, condition, etc.).
[0378] Step 4:
[0379] The server uses the AI engine's analysis data to retrieve transaction information for similar products from the database and calculates their market value. For example, it might refer to past transaction prices for similar record players and estimate the market value of an item at 10,000 yen.
[0380] Step 5:
[0381] The server lists suitable potential buyers (recycling shops, auction sites, collection companies, etc.) based on the calculated market value. It then creates a list of potential buyers to propose to the user using a buyer matching system.
[0382] Step 6:
[0383] The server notifies the user of the selling price and a list of potential buyers. The user reviews this notification, and if they are satisfied with the proposed selling price, they click the "Accept" button to indicate their agreement.
[0384] Step 7:
[0385] The device notifies the server that it has received the user's consent and simultaneously transmits the user's address information. The server then selects the most suitable pickup company based on the user's address information.
[0386] Step 8:
[0387] The server coordinates a visit date and time with the selected collection company and instructs them to pick up the items from the user's address. The company visits the user's address at the specified date and time and prepares to collect the items.
[0388] Step 9:
[0389] A collection company visits the user's address at the designated date and time to collect the items. After collection is complete, the company reports the collection status to the server.
[0390] Step 10:
[0391] The server checks the report from the collection company and confirms that the items have been safely recovered. Once confirmation is complete, it proceeds with the process of paying the user the sale price.
[0392] Step 11:
[0393] The server transfers the predetermined sale price to the user's bank account. This completes the sale process, allowing the user to receive payment for their items.
[0394] (Example 1)
[0395] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0396] In modern society, many users want to dispose of unwanted items quickly and easily. However, finding a suitable buyer for many of these items is difficult and time-consuming. Therefore, there is a need for a system that automates the entire process of item valuation, buyer selection, and pickup arrangements, thereby reducing the burden on users.
[0397] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0398] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; a means for arranging a buyer to take the items if the user agrees to the proposed selling price; a means for confirming that the items have been picked up by the buyer and making payment to the user; a means for transmitting the user's address information to the cloud server; and a means for the cloud server to select the most suitable buyer based on the address information. This makes it possible for the user to easily perform a series of steps, from evaluating items and selecting buyers to arranging pickup and making payments, automatically.
[0399] "Photography means" refers to the functions or devices used by users to photograph items they wish to sell.
[0400] "Data transfer means" refers to a function or device for transmitting image data of an object captured by a photographic means to a cloud server.
[0401] A "cloud server" is a server that is accessible via the internet for storing and processing data.
[0402] An "AI engine means" refers to a function or device that uses artificial intelligence technology to analyze image data uploaded to a cloud server and calculate its market value.
[0403] A "buyer matching method" refers to a function or device that lists suitable buyer candidates based on market value calculated by an AI engine and proposes them to the user.
[0404] "Means for arranging a company to pick up the goods" refers to a function or device for arranging a company to pick up the goods once the user agrees to the proposed selling price.
[0405] "Means for confirming the completion of collection and making payment to the user" refers to a function or device that confirms that the goods have been collected by the collection company and pays the user the sale price.
[0406] "Means for sending address information to a cloud server" refers to functions or devices for sending a user's address information to a cloud server.
[0407] "Means for selecting the most suitable collection company" refers to functions or devices that select the most suitable collection company based on address information received by the cloud server.
[0408] This invention is a system in which a user can easily and quickly photograph unwanted items, upload the image data to a cloud server, and an AI engine calculates the market value, matches the user with a suitable buyer, and automatically arranges for a collection company.
[0409] First, the user launches the app on their smartphone. The user then takes a photograph of the item they wish to sell using their smartphone's camera function. Once the photograph is complete, the user clicks the "Upload" button to send the image data to the cloud server. The HTTPS protocol is used for data transfer based on an internet connection.
[0410] The cloud server receives the transmitted image data. Next, the AI engine analyzes the image data and extracts the characteristics of the item (shape, brand name, color, condition, etc.). For example, when analyzing an image of an old record player, the AI engine detects its shape and brand name "Pioneer". Based on the analysis results, the AI engine retrieves transaction data of similar products from a database (e.g., MongoDB) and calculates the market value of the item. Based on past transaction data, the market value of the record player is estimated at 10,000 yen.
[0411] Next, the cloud server lists suitable potential buyers (e.g., recycling shops, auction sites, collection companies) based on the market value calculated by the AI engine. This list is generated using a buyer matching system and presented to the user. The user reviews the proposed buyer list and market value, and if satisfied, indicates their intention to sell by clicking the "Accept" button.
[0412] Upon receiving a "Accept" button click from the user, the device sends the user's address information to the cloud server. Based on the received address information, the cloud server selects the most suitable pickup company and coordinates the pickup date and time. Once the coordination is complete, a confirmation notification is sent to the user.
[0413] At the designated date and time, a collection company visits the user's address and collects the items. After collection, the company reports the status to a cloud server. After the server confirms the collection completion report, it pays the user the predetermined sale price. For example, the moment the server confirms the collection completion on the cloud server, 10,000 yen is transferred to the user's bank account.
[0414] This system includes means for capturing images, means for transferring data, means for an AI engine, means for matching buyers, means for arranging pickup companies, means for confirming pickup and making payments, means for transmitting address information, and means for selecting pickup companies. This allows users to easily perform the entire process from evaluating items and selecting buyers to arranging pickup and making payments in a single, seamless process.
[0415] As a concrete example, here is an example of a prompt message:
[0416] "Users take photos of unwanted items with their smartphones and upload the image data to a cloud server. An AI engine calculates the market value and suggests suitable buyers. Your role is to explain the program's processes in natural language to enable this system."
[0417] This invention enables users to quickly and efficiently dispose of unwanted items and trade them at fair prices, thus realizing a system that allows for this.
[0418] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0419] Step 1:
[0420] The user launches the smartphone app. The user uses the smartphone's camera function to photograph the item they want to sell. The user operates the camera and adjusts it so that the item fits entirely in the frame. Specifically, the user presses the shutter button to capture the image. The input is the actual image of the item, and the output is digital image data.
[0421] Step 2:
[0422] The device acquires images taken by the user, and when the "Upload" button is clicked, it sends the image data to the cloud server. Specifically, the device transfers the image data to the cloud server using the HTTPS protocol. The input is the image data taken by the user, and the output is the completion of the transmission of the image data to the cloud server.
[0423] Step 3:
[0424] The server receives image data sent to the cloud. Next, the AI engine analyzes the image data and extracts the characteristics of the item (e.g., shape, brand name, color, condition, etc.). Specifically, the AI engine uses a machine learning model to analyze the image and extract the characteristics as digital data. The input is image data sent to the cloud server, and the output is digital data representing the characteristics of the item.
[0425] Step 4:
[0426] The server retrieves historical transaction data for similar products from a database (e.g., MongoDB) based on the feature data extracted by the AI engine. Specifically, the server executes database queries to search for and retrieve the relevant transaction data. The input is the analyzed feature data, and the output is transaction data for similar products.
[0427] Step 5:
[0428] The server calculates market value based on the acquired transaction data. Specifically, the AI engine calculates market value using statistical methods and algorithms. For example, it determines market value by averaging past transaction price data or by calculating a weighted average. The input is past transaction data, and the output is numerical data of the market value.
[0429] Step 6:
[0430] The server lists suitable potential buyers (e.g., recycling shops, auction sites, recycling companies) based on market value. It then uses a buyer matching system to propose these options to the user. Specifically, the server generates buyer candidate data and creates an interface to display the list to the user. The input is numerical market value data, and the output is a list of potential buyers.
[0431] Step 7:
[0432] The user reviews the proposed buyer and sale price, and if satisfied, clicks the "Accept" button. This sends the user's consent information from the device to the cloud server. Specifically, the user clicks a button on the interface to generate consent data. The input is the proposed buyer information, and the output is the user's consent data.
[0433] Step 8:
[0434] The device sends address information to the cloud server with the user's consent. Specifically, the device displays an address input screen, encodes the information entered by the user, and sends it. The input is the address information entered by the user, and the output is the completion of the transmission to the cloud server.
[0435] Step 9:
[0436] The server selects the most suitable pickup company based on the received address information and coordinates the pickup date and time. Specifically, the server searches a database of pickup companies and executes an algorithm to select the most suitable company. The input is the user's address information, and the output is information determining the pickup company and the date and time of visit.
[0437] Step 10:
[0438] The collection company visits the user's address at the designated date and time to collect the items. After collection, the company reports the status to a cloud server. Specifically, the company uses an item collection application to send status report data to the cloud server. The input is information about the item's collection status, and the output is the report data sent to the server.
[0439] Step 11:
[0440] After receiving the pickup completion report, the server pays the user the sale price. Specifically, the server accesses the user's bank account information and executes a process with the banking system to transfer the sale price. The inputs are the pickup completion report data and bank account information, and the output is the transfer of funds to the user's bank account.
[0441] (Application Example 1)
[0442] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0443] Traditionally, selling unwanted items required users to go through cumbersome procedures such as item assessment, selecting a suitable buyer, and arranging for collection services. Furthermore, there was no efficient system in place to streamline the selling process within stores. These issues made the process cumbersome for both users and store staff, making efficient item sales difficult.
[0444] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0445] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates based on the market value calculated by the AI engine and proposing them to the user; a means for arranging a buyer for the items if the user agrees to the proposed selling price; a means for confirming that the items have been picked up by the buyer and making payment to the user; a smart device application means for performing a process within the store that calculates the market value from images of items photographed by the user and proposes suitable buyers; and a means for the user to scan items using the smart device application means and transmit the image data to the cloud server. This enables users and store staff to efficiently assess items, select buyers, and arrange for pickup.
[0446] A "user" is an individual or legal entity that intends to sell goods.
[0447] "Items" refers to any unwanted items that a user wishes to sell.
[0448] "Means of photography" refers to the camera function of a smart device or other photographic and acoustic devices, and is a means of acquiring image data of an object.
[0449] "Data transfer means" refers to the means of sending image data obtained by the shooting means to a cloud server, and typically utilizes an internet connection.
[0450] A "cloud server" is a server accessible via the internet that provides computing resources for storing and analyzing image data.
[0451] "AI engine means" refers to a program and hardware that uses artificial intelligence to analyze image data and calculate market value, and is implemented on a cloud server.
[0452] "Market value" is the estimated price at which the item would be traded in the current market, as calculated by the AI engine.
[0453] "Potential buyers" refers to potential destinations such as recycling shops, auction sites, and recycling companies that are suitable for selling items.
[0454] A "buyer matching method" is a means of proposing suitable buyer candidates to users based on the market value calculated by the AI engine.
[0455] A "collection company" is a company that collects items that users sell from a designated location.
[0456] "Application means for smart devices" refers to applications installed on mobile information terminals such as smartphones and tablets, which are used for tasks such as taking pictures of items, sending data to a cloud server, suggesting potential buyers, and arranging for collection companies.
[0457] A "generative AI model" is a machine learning or deep learning model used by an AI engine that runs on a cloud server.
[0458] A "prompt" refers to a text-based instruction or question input to a generative AI model, used to obtain specific processing instructions or answers.
[0459] This invention provides a system for users to efficiently sell unwanted items. Specific embodiments of this system are described below.
[0460] The user first launches a smart device application and takes a picture of the item they want to sell using their smartphone's camera. The smartphone's camera function is used as the means of taking the picture. This image data is then uploaded to a cloud server using a data transfer method.
[0461] The cloud server receives uploaded image data and performs analysis using an AI engine. This AI engine uses machine learning and deep learning generative AI models to extract features of items from the image data and retrieve transaction information for similar products from a database. Based on this, it calculates the market value.
[0462] Next, the cloud server lists suitable potential buyers based on market value and proposes them to the user using a buyer matching system. The user reviews the proposed selling price and the list of buyers, and clicks the "Accept" button if they are satisfied. Upon receiving this consent, the device sends the user's address information to the cloud server.
[0463] The cloud server selects the most suitable collection company based on the user's address and item information, and schedules a visit date and time. The collection company visits the user's address or store at the specified date and time to collect the items. After collection, the company reports the collection status to the cloud server.
[0464] After the cloud server confirms that the items have been collected, it pays the user the predetermined sale price. For example, a vendor visits the user's home or store, collects the items, and reports the results to the cloud server. Once the server confirms the report, it transfers the sale price to the user's bank account. This entire process allows users and store staff to avoid cumbersome procedures and opaque pricing, and efficiently convert unwanted items into cash.
[0465] For example, a store staff member might use an application to scan a used smartphone in the store, and an AI engine might estimate its market value at "20,000 yen." Based on this data, the system matches the user with multiple auction sites and other recycling businesses, suggesting the best place to sell the item.
[0466] Examples of prompt statements to input into a generative AI model include the following:
[0467] Please upload images of your used smartphone. Our AI engine will calculate its market value and suggest suitable buyers.
[0468] This system allows many users to easily organize their belongings, enabling fair pricing and environmental protection.
[0469] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0470] Step 1:
[0471] The user launches a smart device application and takes a picture of the item they want to sell using their smartphone's camera. The input is the image of the item captured by the smartphone's camera, and this image is sent to the next step.
[0472] Step 2:
[0473] The device uploads the captured image data to a cloud server. This transfers the captured image data to the cloud server, where it is used in the next analysis step. HTTP requests via an internet connection are used as the data transfer method.
[0474] Step 3:
[0475] The cloud server receives uploaded image data and analyzes this data using an AI engine. The input is image data stored on the cloud server, and the output is data in which the features and attributes of the items have been extracted. The AI engine uses a generative AI model to extract the features of the items from the images and recognize specific parameters (e.g., brand name, shape).
[0476] Step 4:
[0477] The cloud server calculates market value using data extracted by the AI engine. The input is the characteristic data of the extracted items, and the output is an estimate of the market value. The AI engine retrieves transaction information for similar products from the database and calculates the market value based on this.
[0478] Step 5:
[0479] The cloud server lists suitable potential buyers based on market value and proposes them to the user through a buyer matching system. The input is the calculated market value and buyer information from the database, and the output is a list of potential buyers. This list is sent to the user's terminal and displayed within the application.
[0480] Step 6:
[0481] The user reviews the proposed selling price and the list of potential buyers, then clicks the "Accept" button. This action sends the user's address information from the device to the cloud server. The input is the user's authentication and address information, and the output is the transmission of data to the cloud server.
[0482] Step 7:
[0483] The cloud server selects the most suitable pickup company based on the user's address and item information, and schedules the visit date and time. Inputs are the user's address and item information, while outputs are the selected pickup company and confirmed visit date and time. The cloud server then transmits this information to the pickup company.
[0484] Step 8:
[0485] The collection company visits the user's address or store at the designated date and time to collect the items. After collection, they report the collection status to the cloud server. The input is the collection status of the items, and the output is the data reported to the cloud server.
[0486] Step 9:
[0487] After the cloud server confirms that the pickup is complete, it pays the user the predetermined sale price. The inputs are the pickup completion report and the sale price, and the output is a notification that the payment has been transferred to the user's bank account.
[0488] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0489] This invention is a system that improves the user experience by allowing users to easily and quickly photograph unwanted items, upload the image data to a cloud server, and then having an AI engine calculate the market value, match the user with a suitable buyer, and further combine this with an emotion engine that analyzes the user's emotions.
[0490] First, the user launches the app and takes a picture of the item they want to sell using their smartphone's camera. After taking the picture, the user clicks the "Upload" button to send the image data to the cloud server. In this process, the device uses a data transfer method to transfer the image data to the cloud server.
[0491] When image data arrives on the cloud server, an AI engine analyzes the image data and extracts the characteristics of the item. The AI engine retrieves transaction information for similar products from a database and calculates its market value based on this information. For example, if an image of an old record player is uploaded, the AI engine extracts its shape and brand name, searches the database for how much similar products have been traded for in the past, and values it at 10,000 yen.
[0492] Next, the cloud server lists suitable potential buyers, such as recycling shops, auction sites, and collection companies, based on this market value, and proposes them to the user using a buyer matching system. Furthermore, an emotion engine analyzes the user's facial expressions and voice data to recognize the user's emotional state.
[0493] The emotion engine analyzes the user's emotional state, and if the user is feeling anxious or dissatisfied, the server adjusts the proposed content and price offer. For example, if the user has a dissatisfied expression, the emotion engine recognizes this, and the server has the capability to offer more detailed explanations or alternatives.
[0494] The user reviews the proposed selling price and list of potential buyers, and if satisfied, clicks the "Accept" button to indicate their agreement. Upon receiving the user's consent, the device sends the user's address information to the cloud server, which selects the most suitable collection company and schedules a visit. The collection company visits the user's address at the specified date and time and collects the items. After collection, the company reports the collection status to the cloud server.
[0495] After the cloud server confirms that the item has been picked up, it pays the user the predetermined sale price. For example, a vendor visits the user's home, picks up a record player, and reports the result to the cloud server. Upon confirming the report, the server transfers 10,000 yen to the user's bank account. This entire process allows users to efficiently monetize unwanted items without cumbersome procedures or unclear pricing.
[0496] As described above, the present invention is a system that links a smartphone with a cloud server and utilizes AI technology and emotion analysis technology to perform a seamless process from photographing unwanted items, uploading them, evaluating them, matching them with buyers, collecting them, and making payments. This system allows many users to easily organize their belongings and achieve fair pricing and environmental protection.
[0497] The following describes the processing flow.
[0498] Step 1:
[0499] The user launches the app and takes a picture of the item they want to sell using their smartphone's camera function. After the user takes the picture of the item with the camera function and finishes taking the picture, they click the "Upload" button to send the image data to the cloud server. For example, the user might take a picture of an old record player.
[0500] Step 2:
[0501] The device uploads the captured image data to the cloud server. The device's data transfer method transfers the image data to the cloud server via the internet. As a result, the image data from the record player reaches the cloud server.
[0502] Step 3:
[0503] The server receives the image data arriving at the cloud server and instructs the AI engine to perform the analysis. The AI engine first extracts the characteristics of the object from the image (e.g., shape, brand name, condition, etc.). The AI engine recognizes the shape and brand name of the record player.
[0504] Step 4:
[0505] The server uses the AI engine's analysis data to retrieve transaction information for similar products from a database and calculates their market value. For example, it might refer to data on how much similar record players have been traded for in the past and estimate the market value of an item at 10,000 yen.
[0506] Step 5:
[0507] Based on the calculated market value, the server lists suitable potential buyers (recycling shops, auction sites, recycling companies, etc.). The server then uses a buyer matching system to suggest a list of potential buyers to the user. For example, the server might present the user with recycling shop A and auction site B.
[0508] Step 6:
[0509] The server uses an emotion engine to analyze the user's facial expressions and voice data in real time to recognize how the user feels about the displayed selling price and offer. For example, if the user shows a dissatisfied expression after seeing the offer price, the emotion engine will detect this.
[0510] Step 7:
[0511] The server adjusts its offers and pricing based on the user's emotional state, as recognized by the emotion engine. If the user expresses dissatisfaction, the server provides more detailed explanations or additional selling options. For example, the server might notify the user that "If you are not satisfied with the current price, you can consider other recycling shops."
[0512] Step 8:
[0513] The user agrees to the proposed selling price and the list of potential buyers and clicks the "Accept" button. The user's address information is sent from their device to the cloud server. The server then uses this address information to select the most suitable pickup company.
[0514] Step 9:
[0515] The server coordinates a visit date and time with the selected pickup company and instructs them to pick up the items from the user's address. The pickup company visits the user's address at the specified date and time and prepares to collect the items.
[0516] Step 10:
[0517] A collection company visits the user's address at the designated date and time to collect the items. After collection is complete, the company reports the collection status to a cloud server. For example, the company might report to the server that "the record player has been successfully collected."
[0518] Step 11:
[0519] The server checks the report from the collection company and confirms that the items have been safely recovered. Once confirmation is complete, the server proceeds with the process of paying the user the predetermined sale price.
[0520] Step 12:
[0521] The server transfers the sale price to the user's bank account, and the user receives the cash. This completes the sale process, and the user receives 10,000 yen as payment for the items.
[0522] (Example 2)
[0523] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0524] Traditionally, when users sold unwanted items, finding a suitable buyer and calculating a fair market value was a time-consuming and laborious process. Furthermore, offers often failed to reflect the user's feelings and intentions, resulting in unsatisfactory transactions. To address these issues, there is a need for a system that accurately and quickly calculates the market value of items and provides more suitable selling proposals based on user sentiment analysis.
[0525] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0526] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an artificial intelligence engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the artificial intelligence engine; an emotion analysis means for analyzing the user's facial expressions and voice data and recognizing their emotional state; a means for adjusting the proposed content and price based on the user's emotional state recognized by the emotion analysis means; a means for arranging a buyer for the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user. This enables the user to efficiently and accurately calculate the market value and receive selling proposals that take into account the user's emotions.
[0527] "Photography means" refers to the functions or devices used by users to photograph items they wish to sell.
[0528] "Data transfer means" refers to the functions and protocols used to upload image data captured by a camera to a cloud server.
[0529] "Artificial intelligence engine means" refers to algorithms and software used to analyze uploaded image data and calculate the market value of goods.
[0530] "Sales matching method" refers to a function or algorithm that lists suitable potential buyers based on market value calculated by an artificial intelligence engine and proposes them to the user.
[0531] "Emotional analysis tools" refer to functions and software that analyze a user's facial expressions and voice data to recognize the user's emotional state.
[0532] "Proposal content adjustment means" refers to functions or algorithms used to adjust the content and price of a sales proposal based on the user's emotional state recognized by emotion analysis means.
[0533] "Arrangement of pickup service provider" refers to a function or system that arranges for a pickup service provider to collect items once the user agrees to the proposed selling price.
[0534] "Payment method" refers to the function or process for confirming that the item has been picked up by the collection company and for paying the user the sale price.
[0535] This invention is a system that eliminates the hassle of users easily selling unwanted items, enabling efficient, highly accurate, and fair transactions. Specific embodiments of the system are described below.
[0536] Hardware and software configuration
[0537] User terminal
[0538] Mobile devices such as smartphones and tablets are used.
[0539] It has a camera function and is used as a means of taking pictures.
[0540] It has internet connectivity and is used as a means of data transfer.
[0541] Cloud Server
[0542] It is a server built on a cloud computing environment.
[0543] It is equipped with an artificial intelligence engine for image analysis (e.g., TensorFlow, PyTorch).
[0544] It is connected to a database for calculating market value.
[0545] It is equipped with an algorithm for matching buyers.
[0546] It includes an emotion engine (e.g., OpenFace, EmoPy) for performing emotion analysis.
[0547] Program processing
[0548] 1. The user launches the app.
[0549] Users launch the app by tapping it on their smartphone's home screen.
[0550] 2. The user takes a picture of the item.
[0551] Users take photos of the items they want to sell using the app's camera function. After taking the photo, an image preview is displayed on the screen.
[0552] 3. Uploading image data
[0553] When a user clicks the "Upload" button, the captured image data is uploaded. The device uses its internet connection to send the image data to the cloud server. A data transfer protocol (e.g., HTTPS) is used for this process.
[0554] 4. Image analysis and calculation of market value
[0555] After the server receives image data, an artificial intelligence engine analyzes the image data and extracts the characteristics of the items. Based on the extracted characteristics, it retrieves transaction information for similar products from a database and calculates the market value. For example, an old record player might be valued at 10,000 yen.
[0556] 5. Proposals for potential buyers
[0557] The server lists potential buyers, such as recycling shops, auction sites, and recycling companies, based on the calculated market value. The listed buyers and their market values are then sent to the user's device.
[0558] 6. Emotional analysis and adjustment of proposed content
[0559] When a user reviews potential buyers, the device's camera and microphone activate to collect facial expressions and audio data. The collected data is sent to a server and analyzed by an emotion engine. If the user expresses anxiety or dissatisfaction, the offer and price are adjusted.
[0560] 7. Confirmation of the sale price and buyer.
[0561] The user reviews the proposed selling price and the list of potential buyers, and clicks the "Accept" button if they are satisfied. This action initiates the selling process.
[0562] 8. Submitting address information
[0563] When the user clicks the "Accept" button, the device sends the user's address information to the cloud server. This allows the pickup company to be arranged.
[0564] 9. Arrange for a pickup company and collect the items.
[0565] The server selects the most suitable collection company based on the user's address information and schedules a visit. The collection company visits the user's address at the specified time and collects the items. Once collection is complete, the company reports to the cloud server.
[0566] 10. Payment of the sale price
[0567] Once the server confirms that the item has been picked up, the sale price will be transferred to the user's bank account. For example, in the case of a record player, 10,000 yen will be transferred to the user's account.
[0568] Specific example
[0569] For example, if a user wants to sell an old record player, they can use the system by following these steps.
[0570] 1. Launch the app and take a picture of the record player using the camera function.
[0571] 2. Click the "Upload" button to send the image data to the cloud server.
[0572] 3. The server analyzes the image and values its market value at 10,000 yen.
[0573] 4. List potential buyers such as recycling shops and auction sites, and propose them to the user.
[0574] 5. The emotion engine analyzes the user's facial expressions, and if it detects anxiety, it refines the suggested actions.
[0575] 6. Once the user agrees and clicks the "Accept" button, the address information is sent to the server.
[0576] 7. A collection company will be arranged to pick up the record player on the designated date.
[0577] 8. Once the collection is complete, the server will transfer 10,000 yen to the user's bank account.
[0578] Example of a prompt
[0579] "Please calculate the market value of this old record player and suggest a suitable buyer."
[0580] "Perform sentiment analysis based on images uploaded by users and provide appropriate suggestions."
[0581] The above is a detailed explanation of how to carry out this invention.
[0582] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0583] Step 1:
[0584] The user launches the app.
[0585] The user launches the app by tapping it on their smartphone's home screen. This action displays the application interface on the user's device. The input is the user's tap action, and the output is the display of the app's home screen.
[0586] Step 2:
[0587] The user takes a picture of an item.
[0588] The user takes a picture of the item they want to sell using the app's camera function. After taking the picture, an image preview is displayed on the device screen. The input is the device's camera operation and the image of the item, and the output is the previewed image data.
[0589] Step 3:
[0590] Uploading image data
[0591] When a user clicks the "Upload" button, the device sends the captured image data to a cloud server. A data transfer protocol (e.g., HTTPS) is used. The input to this process is the user's click action and the image data, while the output is the data transfer status to the cloud server. Specifically, image data compression and encryption are performed during this process.
[0592] Step 4:
[0593] The server receives the image data.
[0594] The server receives image data and logs it. A request / response mechanism is used to verify whether the received image data was received correctly. The input is the image data sent from the terminal, and the output is a status log indicating successful reception.
[0595] Step 5:
[0596] The artificial intelligence engine analyzes the image.
[0597] The server starts an artificial intelligence engine (e.g., TensorFlow, PyTorch) and analyzes the received image data. During the analysis, it extracts the characteristics of objects (e.g., shape, brand name). The input is the received image data, and the output is the extracted feature data. Specifically, the process involves image preprocessing (resizing and normalization) and feature extraction (object detection and image classification).
[0598] Step 6:
[0599] Calculation of market value
[0600] The server uses extracted feature data to retrieve transaction information for similar products from the database and calculates the market value. The input is the feature data and transaction information from the database, and the output is the market value of the item. Specifically, it performs database searches using SQL queries and calculates price estimates. For example, an old record player might be valued at 10,000 yen.
[0601] Step 7:
[0602] Proposals from potential buyers
[0603] The server lists potential buyers such as recycling shops, auction sites, and recycling companies based on market value. It then sends the listed buyers and market value information to the user's terminal. The input is market value and a buyer database, and the output is a list of potential buyers. Specifically, it performs algorithmic candidate selection and data transmission.
[0604] Step 8:
[0605] Users can view potential buyers.
[0606] The user checks the selling price and list of buyers displayed on the device screen. At this time, the device's camera and microphone are activated to collect facial expression and audio data. The input is the user's visual confirmation action, and the output is the confirmation status and collected emotion data.
[0607] Step 9:
[0608] Conducting emotion analysis
[0609] The device collects facial and audio data, which is then sent to a server for analysis by an emotion engine on the server. The emotion engine recognizes the user's emotional state and determines whether they are feeling anxious or dissatisfied. The input is the collected data, and the output is the result of the emotional state analysis. Specifically, the process involves image and audio preprocessing and the application of an emotion recognition model.
[0610] Step 10:
[0611] Adjustment of the proposal
[0612] The server adjusts the sales offer and price based on the sentiment analysis results. For example, if a user expresses dissatisfaction, it generates a more detailed explanation and new alternatives and sends them to the user's terminal. The input is the sentiment analysis results and the sales offer, and the output is the adjusted offer.
[0613] Step 11:
[0614] Confirmation of sale price and buyer
[0615] The user reviews the revised proposal and, if satisfied, clicks the "Accept" button. The input is the user's confirmation action, and the output is the acceptance status.
[0616] Step 12:
[0617] Send user address information
[0618] When the user clicks the "Accept" button, the device sends the user's address information to the cloud server. The input is the address information, and the output is the status of the transmission to the server.
[0619] Step 13:
[0620] Arrangement of a pickup company
[0621] The server selects the most suitable pickup company based on the user's address information and schedules the visit date and time. Inputs are address information and a database of pickup companies; output is the visit schedule. Specifically, the system uses an algorithm to select a pickup company and adjust the schedule.
[0622] Step 14:
[0623] Collection of goods
[0624] A collection company visits the user's address at the designated date and time to collect the items. Once collection is complete, the company reports the status to a cloud server. The input is the collection status, and the output is the data reported to the server.
[0625] Step 15:
[0626] Payment of sale price
[0627] After the server confirms that the item has been picked up, it transfers the sale price to the user's bank account. The input is the confirmation data of the item's pickup and the sale price information, and the output is the status of the completed transfer. For example, in the case of a record player, 10,000 yen will be transferred to the user's account.
[0628] (Application Example 2)
[0629] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0630] Traditional systems for selling unwanted items have problems such as users having difficulty understanding the market value of their items and spending a lot of time and effort finding a suitable buyer. Furthermore, they often fail to consider the user's emotional state, offering only uniform offers, which can lead to decreased user satisfaction. To solve these problems, a system is needed that allows users to easily calculate the market value of their items and find a suitable buyer, while also incorporating emotional analysis.
[0631] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes: a shooting means for photographing items that the user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; an emotion analysis means for analyzing the user's emotional state; a means for adjusting the proposed content and price offer based on the emotional state analyzed by the emotion analysis means; a means for arranging a buyer for the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user. This allows the user to sell unwanted items efficiently and at a fair price, and also enables responses tailored to the user's emotional state.
[0632] A "user" is an individual or legal entity that wishes to sell unwanted items using the system.
[0633] "Means of photography" refers to the device (e.g., smartphone camera) used by the user to photograph the items they wish to sell.
[0634] "Data transfer means" refers to a function for sending image data of an object captured by a photographic means to a cloud server.
[0635] A "cloud server" is a remote server that stores and processes data over a network.
[0636] "AI engine means" refers to artificial intelligence technology that analyzes image data uploaded to a cloud server and calculates the market value of goods.
[0637] The "sales target matching method" is a function that lists suitable potential buyers based on market value calculated by an AI engine and proposes them to the user.
[0638] "Emotional analysis methods" refer to technologies for analyzing a user's emotional state. These methods recognize a user's emotional state by analyzing facial expressions and voice data.
[0639] A "collection company" is a company that collects items from a user's address with the user's consent.
[0640] The "collection completion confirmation method" is a function that confirms that the collection company has retrieved the items and then makes the payment to the user from the cloud server.
[0641] This invention is a system that allows users to easily and quickly sell unwanted items. Specific embodiments of this system are described below.
[0642] System Configuration
[0643] The server includes: a means for photographing items that a user wants to sell; a means for uploading image data of the items photographed by the means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; an emotion analysis means for analyzing the user's emotional state; a means for adjusting the proposal and price offer based on the emotional state analyzed by the emotion analysis means; a means for arranging a buyer to take the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user.
[0644] Program processing
[0645] The server uploads image data captured by the user using their smartphone camera to the cloud server. The uploaded image data is analyzed by an AI engine (e.g., TensorFlow or Keras model) on the cloud server. As a result of the analysis, the characteristics of the item are extracted, transaction information for similar products is retrieved from a database, and the market value is calculated. For example, if an image of an old telephone is uploaded, the AI engine analyzes its shape and brand name and calculates its market value based on transaction information.
[0646] Next, a buyer matching system lists several potential buyers based on the calculated market value, and proposals are made to the user. Simultaneously, the user's emotional state is analyzed by an emotion analysis system (e.g., an EmotionRecognition model). For example, if the user is feeling anxious or dissatisfied, more detailed proposals or alternatives are presented.
[0647] Once the user agrees to the proposed selling price, the server arranges for a pickup company to visit the user's address and collect the items. After the pickup company reports that the collection is complete, the server pays the user the agreed-upon selling price.
[0648] Specific example
[0649] If a user wants to sell an unwanted smartphone, they take a picture of the smartphone through the app and upload the image. An AI engine calculates its market value, for example, 5,000 yen, and suggests several places to sell it (e.g., a recycling shop or online auction). Sentiment analysis checks if the user is satisfied and provides additional explanations or alternatives as needed. Once the user agrees to the price, a pickup company is arranged, and after the item is collected, the user is paid 5,000 yen.
[0650] Example of a prompt
[0651] Example: "Analyze image data of unwanted items photographed by users, use AI to calculate their market value, and suggest suitable buyers. Also, analyze the user's emotions and provide detailed explanations and alternatives until the user is satisfied."
[0652] This ensures that users can sell unwanted items efficiently and at a fair price.
[0653] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0654] Step 1:
[0655] The user takes a picture of the item they want to sell using their smartphone camera. Specifically, the user launches the camera app on their smartphone and takes a picture of the item. The input is image data of the item, and the output is the captured image data.
[0656] Step 2:
[0657] The device uploads the captured image data to the cloud server. Specifically, the device's application sends the captured image to the cloud server using a data transfer method. The input is the captured image data, and the output is the image data stored on the cloud server.
[0658] Step 3:
[0659] The server uses an AI engine to analyze image data uploaded to the cloud server. Specifically, it uses AI models such as TensorFlow and Keras to extract features of items from images and calculate their market value based on those features. The input is image data stored on the cloud server, and the output is the calculated market value.
[0660] Step 4:
[0661] The server uses a buyer matching system to list suitable buyer candidates based on the market value calculated by the AI engine. Specifically, it retrieves information on potential buyers from a database and evaluates them based on their market value. The inputs are the calculated market value and buyer information from the database, and the output is a list of potential buyers.
[0662] Step 5:
[0663] The server analyzes the user's emotional state using emotion analysis tools. Specifically, it uses an EmotionRecognition model to analyze the user's facial expressions and voice data to recognize the user's emotional state. The input is the user's facial image or voice data, and the output is the analyzed emotional state.
[0664] Step 6:
[0665] The server adjusts its proposals and pricing based on the emotional state analyzed by the emotion analysis tool. Specifically, if the user is feeling anxious or dissatisfied, it will provide detailed explanations and alternatives. The input is the analyzed emotional state and a list of potential buyers, and the output is the adjusted proposal.
[0666] Step 7:
[0667] If the user agrees to the proposed selling price, the server arranges for a pickup service for the items. Specifically, it uses a pickup service arrangement system to send the user's address information and coordinate the pickup date. The inputs are the user's consent and address information, and the output is information about the arranged pickup service.
[0668] Step 8:
[0669] The collection company will visit the user's address at the designated date and time to collect the items. The input is the information of the arranged collection company, and the output is the collected items.
[0670] Step 9:
[0671] The collection company reports to the server that it has completed the collection of the items. Specifically, the collection company uses a dedicated reporting system to notify the server of the collection status. The input is the information reported by the collection company, and the output is the collection completion status confirmed by the server.
[0672] Step 10:
[0673] After confirming the completion of the pickup, the server pays the user the predetermined sale price. Specifically, it transfers the sale price to the user's bank account through the banking system. The input is the confirmed pickup completion status and the sale price, and the output is the sale price that has been transferred.
[0674] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0675] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0676] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0677] [Third Embodiment]
[0678] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0679] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0680] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0681] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0682] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0683] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0684] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0685] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0686] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0687] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0688] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0689] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[0690] This invention is a system in which a user can easily and quickly photograph unwanted items, upload the image data to a cloud server, and an AI engine calculates the market value, matches the user with a suitable buyer, and automatically arranges for a collection company.
[0691] First, the user launches the app and takes a picture of the item they want to sell using their smartphone's camera. After taking the picture, the user clicks the "Upload" button to send the image data to the cloud server. In this process, the device uses a data transfer method to transfer the image data to the cloud server.
[0692] When image data arrives on the cloud server, an AI engine analyzes the image data and extracts the characteristics of the item. The AI engine retrieves transaction information for similar products from a database and calculates its market value based on this information. For example, if an image of an old record player is uploaded, the AI engine extracts its shape and brand name, searches the database for how much similar products have been traded for in the past, and values it at 10,000 yen.
[0693] Next, the cloud server lists suitable potential buyers, such as recycling shops, auction sites, and collection companies, based on this market value, and proposes them to the user using a buyer matching system. The user reviews the proposed selling price and list of buyers, and if they are satisfied, they click the "Accept" button to indicate their agreement.
[0694] With the user's consent, the device sends the user's address information to a cloud server, which then selects the most suitable collection company and schedules a visit. The collection company visits the user's address at the designated time and collects the items. After collection, the company reports the collection status to the cloud server.
[0695] After the cloud server confirms that the item has been picked up, it pays the user the predetermined sale price. For example, a vendor visits the user's home, picks up a record player, and reports the result to the cloud server. Upon confirming the report, the server transfers 10,000 yen to the user's bank account. This entire process allows users to efficiently monetize unwanted items without cumbersome procedures or unclear pricing.
[0696] As described above, the present invention is a system that links a smartphone and a cloud server and utilizes AI technology to perform a seamless process from photographing unwanted items, uploading them, evaluating them, matching them with buyers, collecting them, and making payments. This system allows many users to easily organize their belongings and achieve fair pricing and environmental protection.
[0697] The following describes the processing flow.
[0698] Step 1:
[0699] The user launches the app and takes a picture of the item they want to sell with their smartphone. The user uses the app's camera function to take a picture of the item, and once the photo is taken, they click the "Upload" button to send the image data to the cloud server.
[0700] Step 2:
[0701] The device uploads the captured image data to the cloud server. The device's data transfer method sends the image data to the cloud server via the internet.
[0702] Step 3:
[0703] The server receives the image data that has arrived on the cloud server and instructs the AI engine to perform the analysis. The AI engine first extracts the characteristics of the objects from the image (e.g., shape, brand, condition, etc.).
[0704] Step 4:
[0705] The server uses the AI engine's analysis data to retrieve transaction information for similar products from the database and calculates their market value. For example, it might refer to past transaction prices for similar record players and estimate the market value of an item at 10,000 yen.
[0706] Step 5:
[0707] The server lists suitable potential buyers (recycling shops, auction sites, collection companies, etc.) based on the calculated market value. It then creates a list of potential buyers to propose to the user using a buyer matching system.
[0708] Step 6:
[0709] The server notifies the user of the selling price and a list of potential buyers. The user reviews this notification, and if they are satisfied with the proposed selling price, they click the "Accept" button to indicate their agreement.
[0710] Step 7:
[0711] The device notifies the server that it has received the user's consent and simultaneously transmits the user's address information. The server then selects the most suitable pickup company based on the user's address information.
[0712] Step 8:
[0713] The server coordinates a visit date and time with the selected collection company and instructs them to pick up the items from the user's address. The company visits the user's address at the specified date and time and prepares to collect the items.
[0714] Step 9:
[0715] A collection company visits the user's address at the designated date and time to collect the items. After collection is complete, the company reports the collection status to the server.
[0716] Step 10:
[0717] The server checks the report from the collection company and confirms that the items have been safely recovered. Once confirmation is complete, it proceeds with the process of paying the user the sale price.
[0718] Step 11:
[0719] The server transfers the predetermined sale price to the user's bank account. This completes the sale process, allowing the user to receive payment for their items.
[0720] (Example 1)
[0721] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0722] In modern society, many users want to dispose of unwanted items quickly and easily. However, finding a suitable buyer for many of these items is difficult and time-consuming. Therefore, there is a need for a system that automates the entire process of item valuation, buyer selection, and pickup arrangements, thereby reducing the burden on users.
[0723] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0724] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; a means for arranging a buyer to take the items if the user agrees to the proposed selling price; a means for confirming that the items have been picked up by the buyer and making payment to the user; a means for transmitting the user's address information to the cloud server; and a means for the cloud server to select the most suitable buyer based on the address information. This makes it possible for the user to easily perform a series of steps, from evaluating items and selecting buyers to arranging pickup and making payments, automatically.
[0725] "Photography means" refers to the functions or devices used by users to photograph items they wish to sell.
[0726] "Data transfer means" refers to a function or device for transmitting image data of an object captured by a photographic means to a cloud server.
[0727] A "cloud server" is a server that is accessible via the internet for storing and processing data.
[0728] An "AI engine means" refers to a function or device that uses artificial intelligence technology to analyze image data uploaded to a cloud server and calculate its market value.
[0729] A "buyer matching method" refers to a function or device that lists suitable buyer candidates based on market value calculated by an AI engine and proposes them to the user.
[0730] "Means for arranging a company to pick up the goods" refers to a function or device for arranging a company to pick up the goods once the user agrees to the proposed selling price.
[0731] "Means for confirming the completion of collection and making payment to the user" refers to a function or device that confirms that the goods have been collected by the collection company and pays the user the sale price.
[0732] "Means for sending address information to a cloud server" refers to functions or devices for sending a user's address information to a cloud server.
[0733] "Means for selecting the most suitable collection company" refers to functions or devices that select the most suitable collection company based on address information received by the cloud server.
[0734] This invention is a system in which a user can easily and quickly photograph unwanted items, upload the image data to a cloud server, and an AI engine calculates the market value, matches the user with a suitable buyer, and automatically arranges for a collection company.
[0735] First, the user launches the app on their smartphone. The user then takes a photograph of the item they wish to sell using their smartphone's camera function. Once the photograph is complete, the user clicks the "Upload" button to send the image data to the cloud server. The HTTPS protocol is used for data transfer based on an internet connection.
[0736] The cloud server receives the transmitted image data. Next, the AI engine analyzes the image data and extracts the characteristics of the item (shape, brand name, color, condition, etc.). For example, when analyzing an image of an old record player, the AI engine detects its shape and brand name "Pioneer". Based on the analysis results, the AI engine retrieves transaction data of similar products from a database (e.g., MongoDB) and calculates the market value of the item. Based on past transaction data, the market value of the record player is estimated at 10,000 yen.
[0737] Next, the cloud server lists suitable potential buyers (e.g., recycling shops, auction sites, collection companies) based on the market value calculated by the AI engine. This list is generated using a buyer matching system and presented to the user. The user reviews the proposed buyer list and market value, and if satisfied, indicates their intention to sell by clicking the "Accept" button.
[0738] Upon receiving a "Accept" button click from the user, the device sends the user's address information to the cloud server. Based on the received address information, the cloud server selects the most suitable pickup company and coordinates the pickup date and time. Once the coordination is complete, a confirmation notification is sent to the user.
[0739] At the designated date and time, a collection company visits the user's address and collects the items. After collection, the company reports the status to a cloud server. After the server confirms the collection completion report, it pays the user the predetermined sale price. For example, the moment the server confirms the collection completion on the cloud server, 10,000 yen is transferred to the user's bank account.
[0740] This system includes means for capturing images, means for transferring data, means for an AI engine, means for matching buyers, means for arranging pickup companies, means for confirming pickup and making payments, means for transmitting address information, and means for selecting pickup companies. This allows users to easily perform the entire process from evaluating items and selecting buyers to arranging pickup and making payments in a single, seamless process.
[0741] As a concrete example, here is an example of a prompt message:
[0742] "Users take photos of unwanted items with their smartphones and upload the image data to a cloud server. An AI engine calculates the market value and suggests suitable buyers. Your role is to explain the program's processes in natural language to enable this system."
[0743] This invention enables users to quickly and efficiently dispose of unwanted items and trade them at fair prices, thus realizing a system that allows for this.
[0744] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0745] Step 1:
[0746] The user launches the smartphone app. The user uses the smartphone's camera function to photograph the item they want to sell. The user operates the camera and adjusts it so that the item fits entirely in the frame. Specifically, the user presses the shutter button to capture the image. The input is the actual image of the item, and the output is digital image data.
[0747] Step 2:
[0748] The device acquires images taken by the user, and when the "Upload" button is clicked, it sends the image data to the cloud server. Specifically, the device transfers the image data to the cloud server using the HTTPS protocol. The input is the image data taken by the user, and the output is the completion of the transmission of the image data to the cloud server.
[0749] Step 3:
[0750] The server receives image data sent to the cloud. Next, the AI engine analyzes the image data and extracts the characteristics of the item (e.g., shape, brand name, color, condition, etc.). Specifically, the AI engine uses a machine learning model to analyze the image and extract the characteristics as digital data. The input is image data sent to the cloud server, and the output is digital data representing the characteristics of the item.
[0751] Step 4:
[0752] The server retrieves historical transaction data for similar products from a database (e.g., MongoDB) based on the feature data extracted by the AI engine. Specifically, the server executes database queries to search for and retrieve the relevant transaction data. The input is the analyzed feature data, and the output is transaction data for similar products.
[0753] Step 5:
[0754] The server calculates market value based on the acquired transaction data. Specifically, the AI engine calculates market value using statistical methods and algorithms. For example, it determines market value by averaging past transaction price data or by calculating a weighted average. The input is past transaction data, and the output is numerical data of the market value.
[0755] Step 6:
[0756] The server lists suitable potential buyers (e.g., recycling shops, auction sites, recycling companies) based on market value. It then uses a buyer matching system to propose these options to the user. Specifically, the server generates buyer candidate data and creates an interface to display the list to the user. The input is numerical market value data, and the output is a list of potential buyers.
[0757] Step 7:
[0758] The user reviews the proposed buyer and sale price, and if satisfied, clicks the "Accept" button. This sends the user's consent information from the device to the cloud server. Specifically, the user clicks a button on the interface to generate consent data. The input is the proposed buyer information, and the output is the user's consent data.
[0759] Step 8:
[0760] The device sends address information to the cloud server with the user's consent. Specifically, the device displays an address input screen, encodes the information entered by the user, and sends it. The input is the address information entered by the user, and the output is the completion of the transmission to the cloud server.
[0761] Step 9:
[0762] The server selects the most suitable pickup company based on the received address information and coordinates the pickup date and time. Specifically, the server searches a database of pickup companies and executes an algorithm to select the most suitable company. The input is the user's address information, and the output is information determining the pickup company and the date and time of visit.
[0763] Step 10:
[0764] The collection company visits the user's address at the designated date and time to collect the items. After collection, the company reports the status to a cloud server. Specifically, the company uses an item collection application to send status report data to the cloud server. The input is information about the item's collection status, and the output is the report data sent to the server.
[0765] Step 11:
[0766] After receiving the pickup completion report, the server pays the user the sale price. Specifically, the server accesses the user's bank account information and executes a process with the banking system to transfer the sale price. The inputs are the pickup completion report data and bank account information, and the output is the transfer of funds to the user's bank account.
[0767] (Application Example 1)
[0768] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0769] Traditionally, selling unwanted items required users to go through cumbersome procedures such as item assessment, selecting a suitable buyer, and arranging for collection services. Furthermore, there was no efficient system in place to streamline the selling process within stores. These issues made the process cumbersome for both users and store staff, making efficient item sales difficult.
[0770] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0771] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates based on the market value calculated by the AI engine and proposing them to the user; a means for arranging a buyer for the items if the user agrees to the proposed selling price; a means for confirming that the items have been picked up by the buyer and making payment to the user; a smart device application means for performing a process within the store that calculates the market value from images of items photographed by the user and proposes suitable buyers; and a means for the user to scan items using the smart device application means and transmit the image data to the cloud server. This enables users and store staff to efficiently assess items, select buyers, and arrange for pickup.
[0772] A "user" is an individual or legal entity that intends to sell goods.
[0773] "Items" refers to any unwanted items that a user wishes to sell.
[0774] "Means of photography" refers to the camera function of a smart device or other photographic and acoustic devices, and is a means of acquiring image data of an object.
[0775] "Data transfer means" refers to the means of sending image data obtained by the shooting means to a cloud server, and typically utilizes an internet connection.
[0776] A "cloud server" is a server accessible via the internet that provides computing resources for storing and analyzing image data.
[0777] "AI engine means" refers to a program and hardware that uses artificial intelligence to analyze image data and calculate market value, and is implemented on a cloud server.
[0778] "Market value" is the estimated price at which the item would be traded in the current market, as calculated by the AI engine.
[0779] "Potential buyers" refers to potential destinations such as recycling shops, auction sites, and recycling companies that are suitable for selling items.
[0780] A "buyer matching method" is a means of proposing suitable buyer candidates to users based on the market value calculated by the AI engine.
[0781] A "collection company" is a company that collects items that users sell from a designated location.
[0782] "Application means for smart devices" refers to applications installed on mobile information terminals such as smartphones and tablets, which are used for tasks such as taking pictures of items, sending data to a cloud server, suggesting potential buyers, and arranging for collection companies.
[0783] A "generative AI model" is a machine learning or deep learning model used by an AI engine that runs on a cloud server.
[0784] A "prompt" refers to a text-based instruction or question input to a generative AI model, used to obtain specific processing instructions or answers.
[0785] This invention provides a system for users to efficiently sell unwanted items. Specific embodiments of this system are described below.
[0786] The user first launches a smart device application and takes a picture of the item they want to sell using their smartphone's camera. The smartphone's camera function is used as the means of taking the picture. This image data is then uploaded to a cloud server using a data transfer method.
[0787] The cloud server receives uploaded image data and performs analysis using an AI engine. This AI engine uses machine learning and deep learning generative AI models to extract features of items from the image data and retrieve transaction information for similar products from a database. Based on this, it calculates the market value.
[0788] Next, the cloud server lists suitable potential buyers based on market value and proposes them to the user using a buyer matching system. The user reviews the proposed selling price and the list of buyers, and clicks the "Accept" button if they are satisfied. Upon receiving this consent, the device sends the user's address information to the cloud server.
[0789] The cloud server selects the most suitable collection company based on the user's address and item information, and schedules a visit date and time. The collection company visits the user's address or store at the specified date and time to collect the items. After collection, the company reports the collection status to the cloud server.
[0790] After the cloud server confirms that the items have been collected, it pays the user the predetermined sale price. For example, a vendor visits the user's home or store, collects the items, and reports the results to the cloud server. Once the server confirms the report, it transfers the sale price to the user's bank account. This entire process allows users and store staff to avoid cumbersome procedures and opaque pricing, and efficiently convert unwanted items into cash.
[0791] For example, a store staff member might use an application to scan a used smartphone in the store, and an AI engine might estimate its market value at "20,000 yen." Based on this data, the system matches the user with multiple auction sites and other recycling businesses, suggesting the best place to sell the item.
[0792] Examples of prompt statements to input into a generative AI model include the following:
[0793] Please upload images of your used smartphone. Our AI engine will calculate its market value and suggest suitable buyers.
[0794] This system allows many users to easily organize their belongings, enabling fair pricing and environmental protection.
[0795] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0796] Step 1:
[0797] The user launches a smart device application and takes a picture of the item they want to sell using their smartphone's camera. The input is the image of the item captured by the smartphone's camera, and this image is sent to the next step.
[0798] Step 2:
[0799] The device uploads the captured image data to a cloud server. This transfers the captured image data to the cloud server, where it is used in the next analysis step. HTTP requests via an internet connection are used as the data transfer method.
[0800] Step 3:
[0801] The cloud server receives uploaded image data and analyzes this data using an AI engine. The input is image data stored on the cloud server, and the output is data in which the features and attributes of the items have been extracted. The AI engine uses a generative AI model to extract the features of the items from the images and recognize specific parameters (e.g., brand name, shape).
[0802] Step 4:
[0803] The cloud server calculates market value using data extracted by the AI engine. The input is the characteristic data of the extracted items, and the output is an estimate of the market value. The AI engine retrieves transaction information for similar products from the database and calculates the market value based on this.
[0804] Step 5:
[0805] The cloud server lists suitable potential buyers based on market value and proposes them to the user through a buyer matching system. The input is the calculated market value and buyer information from the database, and the output is a list of potential buyers. This list is sent to the user's terminal and displayed within the application.
[0806] Step 6:
[0807] The user reviews the proposed selling price and the list of potential buyers, then clicks the "Accept" button. This action sends the user's address information from the device to the cloud server. The input is the user's authentication and address information, and the output is the transmission of data to the cloud server.
[0808] Step 7:
[0809] The cloud server selects the most suitable pickup company based on the user's address and item information, and schedules the visit date and time. Inputs are the user's address and item information, while outputs are the selected pickup company and confirmed visit date and time. The cloud server then transmits this information to the pickup company.
[0810] Step 8:
[0811] The collection company visits the user's address or store at the designated date and time to collect the items. After collection, they report the collection status to the cloud server. The input is the collection status of the items, and the output is the data reported to the cloud server.
[0812] Step 9:
[0813] After the cloud server confirms that the pickup is complete, it pays the user the predetermined sale price. The inputs are the pickup completion report and the sale price, and the output is a notification that the payment has been transferred to the user's bank account.
[0814] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0815] This invention is a system that improves the user experience by allowing users to easily and quickly photograph unwanted items, upload the image data to a cloud server, and then having an AI engine calculate the market value, match the user with a suitable buyer, and further combine this with an emotion engine that analyzes the user's emotions.
[0816] First, the user launches the app and takes a picture of the item they want to sell using their smartphone's camera. After taking the picture, the user clicks the "Upload" button to send the image data to the cloud server. In this process, the device uses a data transfer method to transfer the image data to the cloud server.
[0817] When image data arrives on the cloud server, an AI engine analyzes the image data and extracts the characteristics of the item. The AI engine retrieves transaction information for similar products from a database and calculates its market value based on this information. For example, if an image of an old record player is uploaded, the AI engine extracts its shape and brand name, searches the database for how much similar products have been traded for in the past, and values it at 10,000 yen.
[0818] Next, the cloud server lists suitable potential buyers, such as recycling shops, auction sites, and collection companies, based on this market value, and proposes them to the user using a buyer matching system. Furthermore, an emotion engine analyzes the user's facial expressions and voice data to recognize the user's emotional state.
[0819] The emotion engine analyzes the user's emotional state, and if the user is feeling anxious or dissatisfied, the server adjusts the proposed content and price offer. For example, if the user has a dissatisfied expression, the emotion engine recognizes this, and the server has the capability to offer more detailed explanations or alternatives.
[0820] The user reviews the proposed selling price and list of potential buyers, and if satisfied, clicks the "Accept" button to indicate their agreement. Upon receiving the user's consent, the device sends the user's address information to the cloud server, which selects the most suitable collection company and schedules a visit. The collection company visits the user's address at the specified date and time and collects the items. After collection, the company reports the collection status to the cloud server.
[0821] After the cloud server confirms that the item has been picked up, it pays the user the predetermined sale price. For example, a vendor visits the user's home, picks up a record player, and reports the result to the cloud server. Upon confirming the report, the server transfers 10,000 yen to the user's bank account. This entire process allows users to efficiently monetize unwanted items without cumbersome procedures or unclear pricing.
[0822] As described above, the present invention is a system that links a smartphone with a cloud server and utilizes AI technology and emotion analysis technology to perform a seamless process from photographing unwanted items, uploading them, evaluating them, matching them with buyers, collecting them, and making payments. This system allows many users to easily organize their belongings and achieve fair pricing and environmental protection.
[0823] The following describes the processing flow.
[0824] Step 1:
[0825] The user launches the app and takes a picture of the item they want to sell using their smartphone's camera function. After the user takes the picture of the item with the camera function and finishes taking the picture, they click the "Upload" button to send the image data to the cloud server. For example, the user might take a picture of an old record player.
[0826] Step 2:
[0827] The device uploads the captured image data to the cloud server. The device's data transfer method transfers the image data to the cloud server via the internet. As a result, the image data from the record player reaches the cloud server.
[0828] Step 3:
[0829] The server receives the image data arriving at the cloud server and instructs the AI engine to perform the analysis. The AI engine first extracts the characteristics of the object from the image (e.g., shape, brand name, condition, etc.). The AI engine recognizes the shape and brand name of the record player.
[0830] Step 4:
[0831] The server uses the AI engine's analysis data to retrieve transaction information for similar products from a database and calculates their market value. For example, it might refer to data on how much similar record players have been traded for in the past and estimate the market value of an item at 10,000 yen.
[0832] Step 5:
[0833] Based on the calculated market value, the server lists suitable potential buyers (recycling shops, auction sites, recycling companies, etc.). The server then uses a buyer matching system to suggest a list of potential buyers to the user. For example, the server might present the user with recycling shop A and auction site B.
[0834] Step 6:
[0835] The server uses an emotion engine to analyze the user's facial expressions and voice data in real time to recognize how the user feels about the displayed selling price and offer. For example, if the user shows a dissatisfied expression after seeing the offer price, the emotion engine will detect this.
[0836] Step 7:
[0837] The server adjusts its offers and pricing based on the user's emotional state, as recognized by the emotion engine. If the user expresses dissatisfaction, the server provides more detailed explanations or additional selling options. For example, the server might notify the user that "If you are not satisfied with the current price, you can consider other recycling shops."
[0838] Step 8:
[0839] The user agrees to the proposed selling price and the list of potential buyers and clicks the "Accept" button. The user's address information is sent from their device to the cloud server. The server then uses this address information to select the most suitable pickup company.
[0840] Step 9:
[0841] The server coordinates a visit date and time with the selected pickup company and instructs them to pick up the items from the user's address. The pickup company visits the user's address at the specified date and time and prepares to collect the items.
[0842] Step 10:
[0843] A collection company visits the user's address at the designated date and time to collect the items. After collection is complete, the company reports the collection status to a cloud server. For example, the company might report to the server that "the record player has been successfully collected."
[0844] Step 11:
[0845] The server checks the report from the collection company and confirms that the items have been safely recovered. Once confirmation is complete, the server proceeds with the process of paying the user the predetermined sale price.
[0846] Step 12:
[0847] The server transfers the sale price to the user's bank account, and the user receives the cash. This completes the sale process, and the user receives 10,000 yen as payment for the items.
[0848] (Example 2)
[0849] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0850] Traditionally, when users sold unwanted items, finding a suitable buyer and calculating a fair market value was a time-consuming and laborious process. Furthermore, offers often failed to reflect the user's feelings and intentions, resulting in unsatisfactory transactions. To address these issues, there is a need for a system that accurately and quickly calculates the market value of items and provides more suitable selling proposals based on user sentiment analysis.
[0851] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0852] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an artificial intelligence engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the artificial intelligence engine; an emotion analysis means for analyzing the user's facial expressions and voice data and recognizing their emotional state; a means for adjusting the proposed content and price based on the user's emotional state recognized by the emotion analysis means; a means for arranging a buyer for the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user. This enables the user to efficiently and accurately calculate the market value and receive selling proposals that take into account the user's emotions.
[0853] "Photography means" refers to the functions or devices used by users to photograph items they wish to sell.
[0854] "Data transfer means" refers to the functions and protocols used to upload image data captured by a camera to a cloud server.
[0855] "Artificial intelligence engine means" refers to algorithms and software used to analyze uploaded image data and calculate the market value of goods.
[0856] "Sales matching method" refers to a function or algorithm that lists suitable potential buyers based on market value calculated by an artificial intelligence engine and proposes them to the user.
[0857] "Emotional analysis tools" refer to functions and software that analyze a user's facial expressions and voice data to recognize the user's emotional state.
[0858] "Proposal content adjustment means" refers to functions or algorithms used to adjust the content and price of a sales proposal based on the user's emotional state recognized by emotion analysis means.
[0859] "Arrangement of pickup service provider" refers to a function or system that arranges for a pickup service provider to collect items once the user agrees to the proposed selling price.
[0860] "Payment method" refers to the function or process for confirming that the item has been picked up by the collection company and for paying the user the sale price.
[0861] This invention is a system that eliminates the hassle of users easily selling unwanted items, enabling efficient, highly accurate, and fair transactions. Specific embodiments of the system are described below.
[0862] Hardware and software configuration
[0863] User terminal
[0864] Mobile devices such as smartphones and tablets are used.
[0865] It has a camera function and is used as a means of taking pictures.
[0866] It has internet connectivity and is used as a means of data transfer.
[0867] Cloud Server
[0868] It is a server built on a cloud computing environment.
[0869] It is equipped with an artificial intelligence engine for image analysis (e.g., TensorFlow, PyTorch).
[0870] It is connected to a database for calculating market value.
[0871] It is equipped with an algorithm for matching buyers.
[0872] It includes an emotion engine (e.g., OpenFace, EmoPy) for performing emotion analysis.
[0873] Program processing
[0874] 1. The user launches the app.
[0875] Users launch the app by tapping it on their smartphone's home screen.
[0876] 2. The user takes a picture of the item.
[0877] Users take photos of the items they want to sell using the app's camera function. After taking the photo, an image preview is displayed on the screen.
[0878] 3. Uploading image data
[0879] When a user clicks the "Upload" button, the captured image data is uploaded. The device uses its internet connection to send the image data to the cloud server. A data transfer protocol (e.g., HTTPS) is used for this process.
[0880] 4. Image analysis and calculation of market value
[0881] After the server receives image data, an artificial intelligence engine analyzes the image data and extracts the characteristics of the items. Based on the extracted characteristics, it retrieves transaction information for similar products from a database and calculates the market value. For example, an old record player might be valued at 10,000 yen.
[0882] 5. Proposals for potential buyers
[0883] The server lists potential buyers, such as recycling shops, auction sites, and recycling companies, based on the calculated market value. The listed buyers and their market values are then sent to the user's device.
[0884] 6. Emotional analysis and adjustment of proposed content
[0885] When a user reviews potential buyers, the device's camera and microphone activate to collect facial expressions and audio data. The collected data is sent to a server and analyzed by an emotion engine. If the user expresses anxiety or dissatisfaction, the offer and price are adjusted.
[0886] 7. Confirmation of the sale price and buyer.
[0887] The user reviews the proposed selling price and the list of potential buyers, and clicks the "Accept" button if they are satisfied. This action initiates the selling process.
[0888] 8. Submitting address information
[0889] When the user clicks the "Accept" button, the device sends the user's address information to the cloud server. This allows the pickup company to be arranged.
[0890] 9. Arrange for a pickup company and collect the items.
[0891] The server selects the most suitable collection company based on the user's address information and schedules a visit. The collection company visits the user's address at the specified time and collects the items. Once collection is complete, the company reports to the cloud server.
[0892] 10. Payment of the sale price
[0893] Once the server confirms that the item has been picked up, the sale price will be transferred to the user's bank account. For example, in the case of a record player, 10,000 yen will be transferred to the user's account.
[0894] Specific example
[0895] For example, if a user wants to sell an old record player, they can use the system by following these steps.
[0896] 1. Launch the app and take a picture of the record player using the camera function.
[0897] 2. Click the "Upload" button to send the image data to the cloud server.
[0898] 3. The server analyzes the image and values its market value at 10,000 yen.
[0899] 4. List potential buyers such as recycling shops and auction sites, and propose them to the user.
[0900] 5. The emotion engine analyzes the user's facial expressions, and if it detects anxiety, it refines the suggested actions.
[0901] 6. Once the user agrees and clicks the "Accept" button, the address information is sent to the server.
[0902] 7. A collection company will be arranged to pick up the record player on the designated date.
[0903] 8. Once the collection is complete, the server will transfer 10,000 yen to the user's bank account.
[0904] Example of a prompt
[0905] "Please calculate the market value of this old record player and suggest a suitable buyer."
[0906] "Perform sentiment analysis based on images uploaded by users and provide appropriate suggestions."
[0907] The above is a detailed explanation of how to carry out this invention.
[0908] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0909] Step 1:
[0910] The user launches the app.
[0911] The user launches the app by tapping it on their smartphone's home screen. This action displays the application interface on the user's device. The input is the user's tap action, and the output is the display of the app's home screen.
[0912] Step 2:
[0913] The user takes a picture of an item.
[0914] The user takes a picture of the item they want to sell using the app's camera function. After taking the picture, an image preview is displayed on the device screen. The input is the device's camera operation and the image of the item, and the output is the previewed image data.
[0915] Step 3:
[0916] Uploading image data
[0917] When a user clicks the "Upload" button, the device sends the captured image data to a cloud server. A data transfer protocol (e.g., HTTPS) is used. The input to this process is the user's click action and the image data, while the output is the data transfer status to the cloud server. Specifically, image data compression and encryption are performed during this process.
[0918] Step 4:
[0919] The server receives the image data.
[0920] The server receives image data and logs it. A request / response mechanism is used to verify whether the received image data was received correctly. The input is the image data sent from the terminal, and the output is a status log indicating successful reception.
[0921] Step 5:
[0922] The artificial intelligence engine analyzes the image.
[0923] The server starts an artificial intelligence engine (e.g., TensorFlow, PyTorch) and analyzes the received image data. During the analysis, it extracts the characteristics of objects (e.g., shape, brand name). The input is the received image data, and the output is the extracted feature data. Specifically, the process involves image preprocessing (resizing and normalization) and feature extraction (object detection and image classification).
[0924] Step 6:
[0925] Calculation of market value
[0926] The server uses extracted feature data to retrieve transaction information for similar products from the database and calculates the market value. The input is the feature data and transaction information from the database, and the output is the market value of the item. Specifically, it performs database searches using SQL queries and calculates price estimates. For example, an old record player might be valued at 10,000 yen.
[0927] Step 7:
[0928] Proposals from potential buyers
[0929] The server lists potential buyers such as recycling shops, auction sites, and recycling companies based on market value. It then sends the listed buyers and market value information to the user's terminal. The input is market value and a buyer database, and the output is a list of potential buyers. Specifically, it performs algorithmic candidate selection and data transmission.
[0930] Step 8:
[0931] Users can view potential buyers.
[0932] The user checks the selling price and list of buyers displayed on the device screen. At this time, the device's camera and microphone are activated to collect facial expression and audio data. The input is the user's visual confirmation action, and the output is the confirmation status and collected emotion data.
[0933] Step 9:
[0934] Conducting emotion analysis
[0935] The device collects facial and audio data, which is then sent to a server for analysis by an emotion engine on the server. The emotion engine recognizes the user's emotional state and determines whether they are feeling anxious or dissatisfied. The input is the collected data, and the output is the result of the emotional state analysis. Specifically, the process involves image and audio preprocessing and the application of an emotion recognition model.
[0936] Step 10:
[0937] Adjustment of the proposal
[0938] The server adjusts the sales offer and price based on the sentiment analysis results. For example, if a user expresses dissatisfaction, it generates a more detailed explanation and new alternatives and sends them to the user's terminal. The input is the sentiment analysis results and the sales offer, and the output is the adjusted offer.
[0939] Step 11:
[0940] Confirmation of sale price and buyer
[0941] The user reviews the revised proposal and, if satisfied, clicks the "Accept" button. The input is the user's confirmation action, and the output is the acceptance status.
[0942] Step 12:
[0943] Send user address information
[0944] When the user clicks the "Accept" button, the device sends the user's address information to the cloud server. The input is the address information, and the output is the status of the transmission to the server.
[0945] Step 13:
[0946] Arrangement of a pickup company
[0947] The server selects the most suitable pickup company based on the user's address information and schedules the visit date and time. Inputs are address information and a database of pickup companies; output is the visit schedule. Specifically, the system uses an algorithm to select a pickup company and adjust the schedule.
[0948] Step 14:
[0949] Collection of goods
[0950] A collection company visits the user's address at the designated date and time to collect the items. Once collection is complete, the company reports the status to a cloud server. The input is the collection status, and the output is the data reported to the server.
[0951] Step 15:
[0952] Payment of sale price
[0953] After the server confirms that the item has been picked up, it transfers the sale price to the user's bank account. The input is the confirmation data of the item's pickup and the sale price information, and the output is the status of the completed transfer. For example, in the case of a record player, 10,000 yen will be transferred to the user's account.
[0954] (Application Example 2)
[0955] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0956] Traditional systems for selling unwanted items have problems such as users having difficulty understanding the market value of their items and spending a lot of time and effort finding a suitable buyer. Furthermore, they often fail to consider the user's emotional state, offering only uniform offers, which can lead to decreased user satisfaction. To solve these problems, a system is needed that allows users to easily calculate the market value of their items and find a suitable buyer, while also incorporating emotional analysis.
[0957] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes: a shooting means for photographing items that the user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; an emotion analysis means for analyzing the user's emotional state; a means for adjusting the proposed content and price offer based on the emotional state analyzed by the emotion analysis means; a means for arranging a buyer for the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user. This allows the user to sell unwanted items efficiently and at a fair price, and also enables responses tailored to the user's emotional state.
[0958] A "user" is an individual or legal entity that wishes to sell unwanted items using the system.
[0959] "Means of photography" refers to the device (e.g., smartphone camera) used by the user to photograph the items they wish to sell.
[0960] "Data transfer means" refers to a function for sending image data of an object captured by a photographic means to a cloud server.
[0961] A "cloud server" is a remote server that stores and processes data over a network.
[0962] "AI engine means" refers to artificial intelligence technology that analyzes image data uploaded to a cloud server and calculates the market value of goods.
[0963] The "sales target matching method" is a function that lists suitable potential buyers based on market value calculated by an AI engine and proposes them to the user.
[0964] "Emotional analysis methods" refer to technologies for analyzing a user's emotional state. These methods recognize a user's emotional state by analyzing facial expressions and voice data.
[0965] A "collection company" is a company that collects items from a user's address with the user's consent.
[0966] The "collection completion confirmation method" is a function that confirms that the collection company has retrieved the items and then makes the payment to the user from the cloud server.
[0967] This invention is a system that allows users to easily and quickly sell unwanted items. Specific embodiments of this system are described below.
[0968] System Configuration
[0969] The server includes: a means for photographing items that a user wants to sell; a means for uploading image data of the items photographed by the means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; an emotion analysis means for analyzing the user's emotional state; a means for adjusting the proposal and price offer based on the emotional state analyzed by the emotion analysis means; a means for arranging a buyer to take the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user.
[0970] Program processing
[0971] The server uploads image data captured by the user using their smartphone camera to the cloud server. The uploaded image data is analyzed by an AI engine (e.g., TensorFlow or Keras model) on the cloud server. As a result of the analysis, the characteristics of the item are extracted, transaction information for similar products is retrieved from a database, and the market value is calculated. For example, if an image of an old telephone is uploaded, the AI engine analyzes its shape and brand name and calculates its market value based on transaction information.
[0972] Next, a buyer matching system lists several potential buyers based on the calculated market value, and proposals are made to the user. Simultaneously, the user's emotional state is analyzed by an emotion analysis system (e.g., an EmotionRecognition model). For example, if the user is feeling anxious or dissatisfied, more detailed proposals or alternatives are presented.
[0973] Once the user agrees to the proposed selling price, the server arranges for a pickup company to visit the user's address and collect the items. After the pickup company reports that the collection is complete, the server pays the user the agreed-upon selling price.
[0974] Specific example
[0975] If a user wants to sell an unwanted smartphone, they take a picture of the smartphone through the app and upload the image. An AI engine calculates its market value, for example, 5,000 yen, and suggests several places to sell it (e.g., a recycling shop or online auction). Sentiment analysis checks if the user is satisfied and provides additional explanations or alternatives as needed. Once the user agrees to the price, a pickup company is arranged, and after the item is collected, the user is paid 5,000 yen.
[0976] Example of a prompt
[0977] Example: "Analyze image data of unwanted items photographed by users, use AI to calculate their market value, and suggest suitable buyers. Also, analyze the user's emotions and provide detailed explanations and alternatives until the user is satisfied."
[0978] This ensures that users can sell unwanted items efficiently and at a fair price.
[0979] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0980] Step 1:
[0981] The user takes a picture of the item they want to sell using their smartphone camera. Specifically, the user launches the camera app on their smartphone and takes a picture of the item. The input is image data of the item, and the output is the captured image data.
[0982] Step 2:
[0983] The device uploads the captured image data to the cloud server. Specifically, the device's application sends the captured image to the cloud server using a data transfer method. The input is the captured image data, and the output is the image data stored on the cloud server.
[0984] Step 3:
[0985] The server uses an AI engine to analyze image data uploaded to the cloud server. Specifically, it uses AI models such as TensorFlow and Keras to extract features of items from images and calculate their market value based on those features. The input is image data stored on the cloud server, and the output is the calculated market value.
[0986] Step 4:
[0987] The server uses a buyer matching system to list suitable buyer candidates based on the market value calculated by the AI engine. Specifically, it retrieves information on potential buyers from a database and evaluates them based on their market value. The inputs are the calculated market value and buyer information from the database, and the output is a list of potential buyers.
[0988] Step 5:
[0989] The server analyzes the user's emotional state using emotion analysis tools. Specifically, it uses an EmotionRecognition model to analyze the user's facial expressions and voice data to recognize the user's emotional state. The input is the user's facial image or voice data, and the output is the analyzed emotional state.
[0990] Step 6:
[0991] The server adjusts its proposals and pricing based on the emotional state analyzed by the emotion analysis tool. Specifically, if the user is feeling anxious or dissatisfied, it will provide detailed explanations and alternatives. The input is the analyzed emotional state and a list of potential buyers, and the output is the adjusted proposal.
[0992] Step 7:
[0993] If the user agrees to the proposed selling price, the server arranges for a pickup service for the items. Specifically, it uses a pickup service arrangement system to send the user's address information and coordinate the pickup date. The inputs are the user's consent and address information, and the output is information about the arranged pickup service.
[0994] Step 8:
[0995] The collection company will visit the user's address at the designated date and time to collect the items. The input is the information of the arranged collection company, and the output is the collected items.
[0996] Step 9:
[0997] The collection company reports to the server that it has completed the collection of the items. Specifically, the collection company uses a dedicated reporting system to notify the server of the collection status. The input is the information reported by the collection company, and the output is the collection completion status confirmed by the server.
[0998] Step 10:
[0999] After confirming the completion of the pickup, the server pays the user the predetermined sale price. Specifically, it transfers the sale price to the user's bank account through the banking system. The input is the confirmed pickup completion status and the sale price, and the output is the sale price that has been transferred.
[1000] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[1001] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1002] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[1003] [Fourth Embodiment]
[1004] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[1005] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1006] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1007] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[1008] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[1009] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[1010] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[1011] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[1012] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[1013] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1014] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1015] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[1016] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1017] This invention is a system in which a user can easily and quickly photograph unwanted items, upload the image data to a cloud server, and an AI engine calculates the market value, matches the user with a suitable buyer, and automatically arranges for a collection company.
[1018] First, the user launches the app and takes a picture of the item they want to sell using their smartphone's camera. After taking the picture, the user clicks the "Upload" button to send the image data to the cloud server. In this process, the device uses a data transfer method to transfer the image data to the cloud server.
[1019] When image data arrives on the cloud server, an AI engine analyzes the image data and extracts the characteristics of the item. The AI engine retrieves transaction information for similar products from a database and calculates its market value based on this information. For example, if an image of an old record player is uploaded, the AI engine extracts its shape and brand name, searches the database for how much similar products have been traded for in the past, and values it at 10,000 yen.
[1020] Next, the cloud server lists suitable potential buyers, such as recycling shops, auction sites, and collection companies, based on this market value, and proposes them to the user using a buyer matching system. The user reviews the proposed selling price and list of buyers, and if they are satisfied, they click the "Accept" button to indicate their agreement.
[1021] With the user's consent, the device sends the user's address information to a cloud server, which then selects the most suitable collection company and schedules a visit. The collection company visits the user's address at the designated time and collects the items. After collection, the company reports the collection status to the cloud server.
[1022] After the cloud server confirms that the item has been picked up, it pays the user the predetermined sale price. For example, a vendor visits the user's home, picks up a record player, and reports the result to the cloud server. Upon confirming the report, the server transfers 10,000 yen to the user's bank account. This entire process allows users to efficiently monetize unwanted items without cumbersome procedures or unclear pricing.
[1023] As described above, the present invention is a system that links a smartphone and a cloud server and utilizes AI technology to perform a seamless process from photographing unwanted items, uploading them, evaluating them, matching them with buyers, collecting them, and making payments. This system allows many users to easily organize their belongings and achieve fair pricing and environmental protection.
[1024] The following describes the processing flow.
[1025] Step 1:
[1026] The user launches the app and takes a picture of the item they want to sell with their smartphone. The user uses the app's camera function to take a picture of the item, and once the photo is taken, they click the "Upload" button to send the image data to the cloud server.
[1027] Step 2:
[1028] The device uploads the captured image data to the cloud server. The device's data transfer method sends the image data to the cloud server via the internet.
[1029] Step 3:
[1030] The server receives the image data that has arrived on the cloud server and instructs the AI engine to perform the analysis. The AI engine first extracts the characteristics of the objects from the image (e.g., shape, brand, condition, etc.).
[1031] Step 4:
[1032] The server uses the AI engine's analysis data to retrieve transaction information for similar products from the database and calculates their market value. For example, it might refer to past transaction prices for similar record players and estimate the market value of an item at 10,000 yen.
[1033] Step 5:
[1034] The server lists suitable potential buyers (recycling shops, auction sites, collection companies, etc.) based on the calculated market value. It then creates a list of potential buyers to propose to the user using a buyer matching system.
[1035] Step 6:
[1036] The server notifies the user of the selling price and a list of potential buyers. The user reviews this notification, and if they are satisfied with the proposed selling price, they click the "Accept" button to indicate their agreement.
[1037] Step 7:
[1038] The device notifies the server that it has received the user's consent and simultaneously transmits the user's address information. The server then selects the most suitable pickup company based on the user's address information.
[1039] Step 8:
[1040] The server coordinates a visit date and time with the selected collection company and instructs them to pick up the items from the user's address. The company visits the user's address at the specified date and time and prepares to collect the items.
[1041] Step 9:
[1042] A collection company visits the user's address at the designated date and time to collect the items. After collection is complete, the company reports the collection status to the server.
[1043] Step 10:
[1044] The server checks the report from the collection company and confirms that the items have been safely recovered. Once confirmation is complete, it proceeds with the process of paying the user the sale price.
[1045] Step 11:
[1046] The server transfers the predetermined sale price to the user's bank account. This completes the sale process, allowing the user to receive payment for their items.
[1047] (Example 1)
[1048] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1049] In modern society, many users want to dispose of unwanted items quickly and easily. However, finding a suitable buyer for many of these items is difficult and time-consuming. Therefore, there is a need for a system that automates the entire process of item valuation, buyer selection, and pickup arrangements, thereby reducing the burden on users.
[1050] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[1051] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; a means for arranging a buyer to take the items if the user agrees to the proposed selling price; a means for confirming that the items have been picked up by the buyer and making payment to the user; a means for transmitting the user's address information to the cloud server; and a means for the cloud server to select the most suitable buyer based on the address information. This makes it possible for the user to easily perform a series of steps, from evaluating items and selecting buyers to arranging pickup and making payments, automatically.
[1052] "Photography means" refers to the functions or devices used by users to photograph items they wish to sell.
[1053] "Data transfer means" refers to a function or device for transmitting image data of an object captured by a photographic means to a cloud server.
[1054] A "cloud server" is a server that is accessible via the internet for storing and processing data.
[1055] An "AI engine means" refers to a function or device that uses artificial intelligence technology to analyze image data uploaded to a cloud server and calculate its market value.
[1056] A "buyer matching method" refers to a function or device that lists suitable buyer candidates based on market value calculated by an AI engine and proposes them to the user.
[1057] "Means for arranging a company to pick up the goods" refers to a function or device for arranging a company to pick up the goods once the user agrees to the proposed selling price.
[1058] "Means for confirming the completion of collection and making payment to the user" refers to a function or device that confirms that the goods have been collected by the collection company and pays the user the sale price.
[1059] "Means for sending address information to a cloud server" refers to functions or devices for sending a user's address information to a cloud server.
[1060] "Means for selecting the most suitable collection company" refers to functions or devices that select the most suitable collection company based on address information received by the cloud server.
[1061] This invention is a system in which a user can easily and quickly photograph unwanted items, upload the image data to a cloud server, and an AI engine calculates the market value, matches the user with a suitable buyer, and automatically arranges for a collection company.
[1062] First, the user launches the app on their smartphone. The user then takes a photograph of the item they wish to sell using their smartphone's camera function. Once the photograph is complete, the user clicks the "Upload" button to send the image data to the cloud server. The HTTPS protocol is used for data transfer based on an internet connection.
[1063] The cloud server receives the transmitted image data. Next, the AI engine analyzes the image data and extracts the characteristics of the item (shape, brand name, color, condition, etc.). For example, when analyzing an image of an old record player, the AI engine detects its shape and brand name "Pioneer". Based on the analysis results, the AI engine retrieves transaction data of similar products from a database (e.g., MongoDB) and calculates the market value of the item. Based on past transaction data, the market value of the record player is estimated at 10,000 yen.
[1064] Next, the cloud server lists suitable potential buyers (e.g., recycling shops, auction sites, collection companies) based on the market value calculated by the AI engine. This list is generated using a buyer matching system and presented to the user. The user reviews the proposed buyer list and market value, and if satisfied, indicates their intention to sell by clicking the "Accept" button.
[1065] Upon receiving a "Accept" button click from the user, the device sends the user's address information to the cloud server. Based on the received address information, the cloud server selects the most suitable pickup company and coordinates the pickup date and time. Once the coordination is complete, a confirmation notification is sent to the user.
[1066] At the designated date and time, a collection company visits the user's address and collects the items. After collection, the company reports the status to a cloud server. After the server confirms the collection completion report, it pays the user the predetermined sale price. For example, the moment the server confirms the collection completion on the cloud server, 10,000 yen is transferred to the user's bank account.
[1067] This system includes means for capturing images, means for transferring data, means for an AI engine, means for matching buyers, means for arranging pickup companies, means for confirming pickup and making payments, means for transmitting address information, and means for selecting pickup companies. This allows users to easily perform the entire process from evaluating items and selecting buyers to arranging pickup and making payments in a single, seamless process.
[1068] As a concrete example, here is an example of a prompt message:
[1069] "Users take photos of unwanted items with their smartphones and upload the image data to a cloud server. An AI engine calculates the market value and suggests suitable buyers. Your role is to explain the program's processes in natural language to enable this system."
[1070] This invention enables users to quickly and efficiently dispose of unwanted items and trade them at fair prices, thus realizing a system that allows for this.
[1071] The flow of the specific processing in Example 1 will be explained using Figure 11.
[1072] Step 1:
[1073] The user launches the smartphone app. The user uses the smartphone's camera function to photograph the item they want to sell. The user operates the camera and adjusts it so that the item fits entirely in the frame. Specifically, the user presses the shutter button to capture the image. The input is the actual image of the item, and the output is digital image data.
[1074] Step 2:
[1075] The device acquires images taken by the user, and when the "Upload" button is clicked, it sends the image data to the cloud server. Specifically, the device transfers the image data to the cloud server using the HTTPS protocol. The input is the image data taken by the user, and the output is the completion of the transmission of the image data to the cloud server.
[1076] Step 3:
[1077] The server receives image data sent to the cloud. Next, the AI engine analyzes the image data and extracts the characteristics of the item (e.g., shape, brand name, color, condition, etc.). Specifically, the AI engine uses a machine learning model to analyze the image and extract the characteristics as digital data. The input is image data sent to the cloud server, and the output is digital data representing the characteristics of the item.
[1078] Step 4:
[1079] The server retrieves historical transaction data for similar products from a database (e.g., MongoDB) based on the feature data extracted by the AI engine. Specifically, the server executes database queries to search for and retrieve the relevant transaction data. The input is the analyzed feature data, and the output is transaction data for similar products.
[1080] Step 5:
[1081] The server calculates market value based on the acquired transaction data. Specifically, the AI engine calculates market value using statistical methods and algorithms. For example, it determines market value by averaging past transaction price data or by calculating a weighted average. The input is past transaction data, and the output is numerical data of the market value.
[1082] Step 6:
[1083] The server lists suitable potential buyers (e.g., recycling shops, auction sites, recycling companies) based on market value. It then uses a buyer matching system to propose these options to the user. Specifically, the server generates buyer candidate data and creates an interface to display the list to the user. The input is numerical market value data, and the output is a list of potential buyers.
[1084] Step 7:
[1085] The user reviews the proposed buyer and sale price, and if satisfied, clicks the "Accept" button. This sends the user's consent information from the device to the cloud server. Specifically, the user clicks a button on the interface to generate consent data. The input is the proposed buyer information, and the output is the user's consent data.
[1086] Step 8:
[1087] The device sends address information to the cloud server with the user's consent. Specifically, the device displays an address input screen, encodes the information entered by the user, and sends it. The input is the address information entered by the user, and the output is the completion of the transmission to the cloud server.
[1088] Step 9:
[1089] The server selects the most suitable pickup company based on the received address information and coordinates the pickup date and time. Specifically, the server searches a database of pickup companies and executes an algorithm to select the most suitable company. The input is the user's address information, and the output is information determining the pickup company and the date and time of visit.
[1090] Step 10:
[1091] The collection company visits the user's address at the designated date and time to collect the items. After collection, the company reports the status to a cloud server. Specifically, the company uses an item collection application to send status report data to the cloud server. The input is information about the item's collection status, and the output is the report data sent to the server.
[1092] Step 11:
[1093] After receiving the pickup completion report, the server pays the user the sale price. Specifically, the server accesses the user's bank account information and executes a process with the banking system to transfer the sale price. The inputs are the pickup completion report data and bank account information, and the output is the transfer of funds to the user's bank account.
[1094] (Application Example 1)
[1095] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1096] Traditionally, selling unwanted items required users to go through cumbersome procedures such as item assessment, selecting a suitable buyer, and arranging for collection services. Furthermore, there was no efficient system in place to streamline the selling process within stores. These issues made the process cumbersome for both users and store staff, making efficient item sales difficult.
[1097] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[1098] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates based on the market value calculated by the AI engine and proposing them to the user; a means for arranging a buyer for the items if the user agrees to the proposed selling price; a means for confirming that the items have been picked up by the buyer and making payment to the user; a smart device application means for performing a process within the store that calculates the market value from images of items photographed by the user and proposes suitable buyers; and a means for the user to scan items using the smart device application means and transmit the image data to the cloud server. This enables users and store staff to efficiently assess items, select buyers, and arrange for pickup.
[1099] A "user" is an individual or legal entity that intends to sell goods.
[1100] "Items" refers to any unwanted items that a user wishes to sell.
[1101] "Means of photography" refers to the camera function of a smart device or other photographic and acoustic devices, and is a means of acquiring image data of an object.
[1102] "Data transfer means" refers to the means of sending image data obtained by the shooting means to a cloud server, and typically utilizes an internet connection.
[1103] A "cloud server" is a server accessible via the internet that provides computing resources for storing and analyzing image data.
[1104] "AI engine means" refers to a program and hardware that uses artificial intelligence to analyze image data and calculate market value, and is implemented on a cloud server.
[1105] "Market value" is the estimated price at which the item would be traded in the current market, as calculated by the AI engine.
[1106] "Potential buyers" refers to potential destinations such as recycling shops, auction sites, and recycling companies that are suitable for selling items.
[1107] A "buyer matching method" is a means of proposing suitable buyer candidates to users based on the market value calculated by the AI engine.
[1108] A "collection company" is a company that collects items that users sell from a designated location.
[1109] "Application means for smart devices" refers to applications installed on mobile information terminals such as smartphones and tablets, which are used for tasks such as taking pictures of items, sending data to a cloud server, suggesting potential buyers, and arranging for collection companies.
[1110] A "generative AI model" is a machine learning or deep learning model used by an AI engine that runs on a cloud server.
[1111] A "prompt" refers to a text-based instruction or question input to a generative AI model, used to obtain specific processing instructions or answers.
[1112] This invention provides a system for users to efficiently sell unwanted items. Specific embodiments of this system are described below.
[1113] The user first launches a smart device application and takes a picture of the item they want to sell using their smartphone's camera. The smartphone's camera function is used as the means of taking the picture. This image data is then uploaded to a cloud server using a data transfer method.
[1114] The cloud server receives uploaded image data and performs analysis using an AI engine. This AI engine uses machine learning and deep learning generative AI models to extract features of items from the image data and retrieve transaction information for similar products from a database. Based on this, it calculates the market value.
[1115] Next, the cloud server lists suitable potential buyers based on market value and proposes them to the user using a buyer matching system. The user reviews the proposed selling price and the list of buyers, and clicks the "Accept" button if they are satisfied. Upon receiving this consent, the device sends the user's address information to the cloud server.
[1116] The cloud server selects the most suitable collection company based on the user's address and item information, and schedules a visit date and time. The collection company visits the user's address or store at the specified date and time to collect the items. After collection, the company reports the collection status to the cloud server.
[1117] After the cloud server confirms that the items have been collected, it pays the user the predetermined sale price. For example, a vendor visits the user's home or store, collects the items, and reports the results to the cloud server. Once the server confirms the report, it transfers the sale price to the user's bank account. This entire process allows users and store staff to avoid cumbersome procedures and opaque pricing, and efficiently convert unwanted items into cash.
[1118] For example, a store staff member might use an application to scan a used smartphone in the store, and an AI engine might estimate its market value at "20,000 yen." Based on this data, the system matches the user with multiple auction sites and other recycling businesses, suggesting the best place to sell the item.
[1119] Examples of prompt statements to input into a generative AI model include the following:
[1120] Please upload images of your used smartphone. Our AI engine will calculate its market value and suggest suitable buyers.
[1121] This system allows many users to easily organize their belongings, enabling fair pricing and environmental protection.
[1122] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[1123] Step 1:
[1124] The user launches a smart device application and takes a picture of the item they want to sell using their smartphone's camera. The input is the image of the item captured by the smartphone's camera, and this image is sent to the next step.
[1125] Step 2:
[1126] The device uploads the captured image data to a cloud server. This transfers the captured image data to the cloud server, where it is used in the next analysis step. HTTP requests via an internet connection are used as the data transfer method.
[1127] Step 3:
[1128] The cloud server receives uploaded image data and analyzes this data using an AI engine. The input is image data stored on the cloud server, and the output is data in which the features and attributes of the items have been extracted. The AI engine uses a generative AI model to extract the features of the items from the images and recognize specific parameters (e.g., brand name, shape).
[1129] Step 4:
[1130] The cloud server calculates market value using data extracted by the AI engine. The input is the characteristic data of the extracted items, and the output is an estimate of the market value. The AI engine retrieves transaction information for similar products from the database and calculates the market value based on this.
[1131] Step 5:
[1132] The cloud server lists suitable potential buyers based on market value and proposes them to the user through a buyer matching system. The input is the calculated market value and buyer information from the database, and the output is a list of potential buyers. This list is sent to the user's terminal and displayed within the application.
[1133] Step 6:
[1134] The user reviews the proposed selling price and the list of potential buyers, then clicks the "Accept" button. This action sends the user's address information from the device to the cloud server. The input is the user's authentication and address information, and the output is the transmission of data to the cloud server.
[1135] Step 7:
[1136] The cloud server selects the most suitable pickup company based on the user's address and item information, and schedules the visit date and time. Inputs are the user's address and item information, while outputs are the selected pickup company and confirmed visit date and time. The cloud server then transmits this information to the pickup company.
[1137] Step 8:
[1138] The collection company visits the user's address or store at the designated date and time to collect the items. After collection, they report the collection status to the cloud server. The input is the collection status of the items, and the output is the data reported to the cloud server.
[1139] Step 9:
[1140] After the cloud server confirms that the pickup is complete, it pays the user the predetermined sale price. The inputs are the pickup completion report and the sale price, and the output is a notification that the payment has been transferred to the user's bank account.
[1141] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[1142] This invention is a system that improves the user experience by allowing users to easily and quickly photograph unwanted items, upload the image data to a cloud server, and then having an AI engine calculate the market value, match the user with a suitable buyer, and further combine this with an emotion engine that analyzes the user's emotions.
[1143] First, the user launches the app and takes a picture of the item they want to sell using their smartphone's camera. After taking the picture, the user clicks the "Upload" button to send the image data to the cloud server. In this process, the device uses a data transfer method to transfer the image data to the cloud server.
[1144] When image data arrives on the cloud server, an AI engine analyzes the image data and extracts the characteristics of the item. The AI engine retrieves transaction information for similar products from a database and calculates its market value based on this information. For example, if an image of an old record player is uploaded, the AI engine extracts its shape and brand name, searches the database for how much similar products have been traded for in the past, and values it at 10,000 yen.
[1145] Next, the cloud server lists suitable potential buyers, such as recycling shops, auction sites, and collection companies, based on this market value, and proposes them to the user using a buyer matching system. Furthermore, an emotion engine analyzes the user's facial expressions and voice data to recognize the user's emotional state.
[1146] The emotion engine analyzes the user's emotional state, and if the user is feeling anxious or dissatisfied, the server adjusts the proposed content and price offer. For example, if the user has a dissatisfied expression, the emotion engine recognizes this, and the server has the capability to offer more detailed explanations or alternatives.
[1147] The user reviews the proposed selling price and list of potential buyers, and if satisfied, clicks the "Accept" button to indicate their agreement. Upon receiving the user's consent, the device sends the user's address information to the cloud server, which selects the most suitable collection company and schedules a visit. The collection company visits the user's address at the specified date and time and collects the items. After collection, the company reports the collection status to the cloud server.
[1148] After the cloud server confirms that the item has been picked up, it pays the user the predetermined sale price. For example, a vendor visits the user's home, picks up a record player, and reports the result to the cloud server. Upon confirming the report, the server transfers 10,000 yen to the user's bank account. This entire process allows users to efficiently monetize unwanted items without cumbersome procedures or unclear pricing.
[1149] As described above, the present invention is a system that links a smartphone with a cloud server and utilizes AI technology and emotion analysis technology to perform a seamless process from photographing unwanted items, uploading them, evaluating them, matching them with buyers, collecting them, and making payments. This system allows many users to easily organize their belongings and achieve fair pricing and environmental protection.
[1150] The following describes the processing flow.
[1151] Step 1:
[1152] The user launches the app and takes a picture of the item they want to sell using their smartphone's camera function. After the user takes the picture of the item with the camera function and finishes taking the picture, they click the "Upload" button to send the image data to the cloud server. For example, the user might take a picture of an old record player.
[1153] Step 2:
[1154] The device uploads the captured image data to the cloud server. The device's data transfer method transfers the image data to the cloud server via the internet. As a result, the image data from the record player reaches the cloud server.
[1155] Step 3:
[1156] The server receives the image data arriving at the cloud server and instructs the AI engine to perform the analysis. The AI engine first extracts the characteristics of the object from the image (e.g., shape, brand name, condition, etc.). The AI engine recognizes the shape and brand name of the record player.
[1157] Step 4:
[1158] The server uses the AI engine's analysis data to retrieve transaction information for similar products from a database and calculates their market value. For example, it might refer to data on how much similar record players have been traded for in the past and estimate the market value of an item at 10,000 yen.
[1159] Step 5:
[1160] Based on the calculated market value, the server lists suitable potential buyers (recycling shops, auction sites, recycling companies, etc.). The server then uses a buyer matching system to suggest a list of potential buyers to the user. For example, the server might present the user with recycling shop A and auction site B.
[1161] Step 6:
[1162] The server uses an emotion engine to analyze the user's facial expressions and voice data in real time to recognize how the user feels about the displayed selling price and offer. For example, if the user shows a dissatisfied expression after seeing the offer price, the emotion engine will detect this.
[1163] Step 7:
[1164] The server adjusts its offers and pricing based on the user's emotional state, as recognized by the emotion engine. If the user expresses dissatisfaction, the server provides more detailed explanations or additional selling options. For example, the server might notify the user that "If you are not satisfied with the current price, you can consider other recycling shops."
[1165] Step 8:
[1166] The user agrees to the proposed selling price and the list of potential buyers and clicks the "Accept" button. The user's address information is sent from their device to the cloud server. The server then uses this address information to select the most suitable pickup company.
[1167] Step 9:
[1168] The server coordinates a visit date and time with the selected pickup company and instructs them to pick up the items from the user's address. The pickup company visits the user's address at the specified date and time and prepares to collect the items.
[1169] Step 10:
[1170] A collection company visits the user's address at the designated date and time to collect the items. After collection is complete, the company reports the collection status to a cloud server. For example, the company might report to the server that "the record player has been successfully collected."
[1171] Step 11:
[1172] The server checks the report from the collection company and confirms that the items have been safely recovered. Once confirmation is complete, the server proceeds with the process of paying the user the predetermined sale price.
[1173] Step 12:
[1174] The server transfers the sale price to the user's bank account, and the user receives the cash. This completes the sale process, and the user receives 10,000 yen as payment for the items.
[1175] (Example 2)
[1176] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1177] Traditionally, when users sold unwanted items, finding a suitable buyer and calculating a fair market value was a time-consuming and laborious process. Furthermore, offers often failed to reflect the user's feelings and intentions, resulting in unsatisfactory transactions. To address these issues, there is a need for a system that accurately and quickly calculates the market value of items and provides more suitable selling proposals based on user sentiment analysis.
[1178] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[1179] In this invention, the server includes: a shooting means for photographing items that a user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an artificial intelligence engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the artificial intelligence engine; an emotion analysis means for analyzing the user's facial expressions and voice data and recognizing their emotional state; a means for adjusting the proposed content and price based on the user's emotional state recognized by the emotion analysis means; a means for arranging a buyer for the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user. This enables the user to efficiently and accurately calculate the market value and receive selling proposals that take into account the user's emotions.
[1180] "Photography means" refers to the functions or devices used by users to photograph items they wish to sell.
[1181] "Data transfer means" refers to the functions and protocols used to upload image data captured by a camera to a cloud server.
[1182] "Artificial intelligence engine means" refers to algorithms and software used to analyze uploaded image data and calculate the market value of goods.
[1183] "Sales matching method" refers to a function or algorithm that lists suitable potential buyers based on market value calculated by an artificial intelligence engine and proposes them to the user.
[1184] "Emotional analysis tools" refer to functions and software that analyze a user's facial expressions and voice data to recognize the user's emotional state.
[1185] "Proposal content adjustment means" refers to functions or algorithms used to adjust the content and price of a sales proposal based on the user's emotional state recognized by emotion analysis means.
[1186] "Arrangement of pickup service provider" refers to a function or system that arranges for a pickup service provider to collect items once the user agrees to the proposed selling price.
[1187] "Payment method" refers to the function or process for confirming that the item has been picked up by the collection company and for paying the user the sale price.
[1188] This invention is a system that eliminates the hassle of users easily selling unwanted items, enabling efficient, highly accurate, and fair transactions. Specific embodiments of the system are described below.
[1189] Hardware and software configuration
[1190] User terminal
[1191] Mobile devices such as smartphones and tablets are used.
[1192] It has a camera function and is used as a means of taking pictures.
[1193] It has internet connectivity and is used as a means of data transfer.
[1194] Cloud Server
[1195] It is a server built on a cloud computing environment.
[1196] It is equipped with an artificial intelligence engine for image analysis (e.g., TensorFlow, PyTorch).
[1197] It is connected to a database for calculating market value.
[1198] It is equipped with an algorithm for matching buyers.
[1199] It includes an emotion engine (e.g., OpenFace, EmoPy) for performing emotion analysis.
[1200] Program processing
[1201] 1. The user launches the app.
[1202] Users launch the app by tapping it on their smartphone's home screen.
[1203] 2. The user takes a picture of the item.
[1204] Users take photos of the items they want to sell using the app's camera function. After taking the photo, an image preview is displayed on the screen.
[1205] 3. Uploading image data
[1206] When a user clicks the "Upload" button, the captured image data is uploaded. The device uses its internet connection to send the image data to the cloud server. A data transfer protocol (e.g., HTTPS) is used for this process.
[1207] 4. Image analysis and calculation of market value
[1208] After the server receives image data, an artificial intelligence engine analyzes the image data and extracts the characteristics of the items. Based on the extracted characteristics, it retrieves transaction information for similar products from a database and calculates the market value. For example, an old record player might be valued at 10,000 yen.
[1209] 5. Proposals for potential buyers
[1210] The server lists potential buyers, such as recycling shops, auction sites, and recycling companies, based on the calculated market value. The listed buyers and their market values are then sent to the user's device.
[1211] 6. Emotional analysis and adjustment of proposed content
[1212] When a user reviews potential buyers, the device's camera and microphone activate to collect facial expressions and audio data. The collected data is sent to a server and analyzed by an emotion engine. If the user expresses anxiety or dissatisfaction, the offer and price are adjusted.
[1213] 7. Confirmation of the sale price and buyer.
[1214] The user reviews the proposed selling price and the list of potential buyers, and clicks the "Accept" button if they are satisfied. This action initiates the selling process.
[1215] 8. Submitting address information
[1216] When the user clicks the "Accept" button, the device sends the user's address information to the cloud server. This allows the pickup company to be arranged.
[1217] 9. Arrange for a pickup company and collect the items.
[1218] The server selects the most suitable collection company based on the user's address information and schedules a visit. The collection company visits the user's address at the specified time and collects the items. Once collection is complete, the company reports to the cloud server.
[1219] 10. Payment of the sale price
[1220] Once the server confirms that the item has been picked up, the sale price will be transferred to the user's bank account. For example, in the case of a record player, 10,000 yen will be transferred to the user's account.
[1221] Specific example
[1222] For example, if a user wants to sell an old record player, they can use the system by following these steps.
[1223] 1. Launch the app and take a picture of the record player using the camera function.
[1224] 2. Click the "Upload" button to send the image data to the cloud server.
[1225] 3. The server analyzes the image and values its market value at 10,000 yen.
[1226] 4. List potential buyers such as recycling shops and auction sites, and propose them to the user.
[1227] 5. The emotion engine analyzes the user's facial expressions, and if it detects anxiety, it refines the suggested actions.
[1228] 6. Once the user agrees and clicks the "Accept" button, the address information is sent to the server.
[1229] 7. A collection company will be arranged to pick up the record player on the designated date.
[1230] 8. Once the collection is complete, the server will transfer 10,000 yen to the user's bank account.
[1231] Example of a prompt
[1232] "Please calculate the market value of this old record player and suggest a suitable buyer."
[1233] "Perform sentiment analysis based on images uploaded by users and provide appropriate suggestions."
[1234] The above is a detailed explanation of how to carry out this invention.
[1235] The flow of the specific processing in Example 2 will be explained using Figure 13.
[1236] Step 1:
[1237] The user launches the app.
[1238] The user launches the app by tapping it on their smartphone's home screen. This action displays the application interface on the user's device. The input is the user's tap action, and the output is the display of the app's home screen.
[1239] Step 2:
[1240] The user takes a picture of an item.
[1241] The user takes a picture of the item they want to sell using the app's camera function. After taking the picture, an image preview is displayed on the device screen. The input is the device's camera operation and the image of the item, and the output is the previewed image data.
[1242] Step 3:
[1243] Uploading image data
[1244] When a user clicks the "Upload" button, the device sends the captured image data to a cloud server. A data transfer protocol (e.g., HTTPS) is used. The input to this process is the user's click action and the image data, while the output is the data transfer status to the cloud server. Specifically, image data compression and encryption are performed during this process.
[1245] Step 4:
[1246] The server receives the image data.
[1247] The server receives image data and logs it. A request / response mechanism is used to verify whether the received image data was received correctly. The input is the image data sent from the terminal, and the output is a status log indicating successful reception.
[1248] Step 5:
[1249] The artificial intelligence engine analyzes the image.
[1250] The server starts an artificial intelligence engine (e.g., TensorFlow, PyTorch) and analyzes the received image data. During the analysis, it extracts the characteristics of objects (e.g., shape, brand name). The input is the received image data, and the output is the extracted feature data. Specifically, the process involves image preprocessing (resizing and normalization) and feature extraction (object detection and image classification).
[1251] Step 6:
[1252] Calculation of market value
[1253] The server uses extracted feature data to retrieve transaction information for similar products from the database and calculates the market value. The input is the feature data and transaction information from the database, and the output is the market value of the item. Specifically, it performs database searches using SQL queries and calculates price estimates. For example, an old record player might be valued at 10,000 yen.
[1254] Step 7:
[1255] Proposals from potential buyers
[1256] The server lists potential buyers such as recycling shops, auction sites, and recycling companies based on market value. It then sends the listed buyers and market value information to the user's terminal. The input is market value and a buyer database, and the output is a list of potential buyers. Specifically, it performs algorithmic candidate selection and data transmission.
[1257] Step 8:
[1258] Users can view potential buyers.
[1259] The user checks the selling price and list of buyers displayed on the device screen. At this time, the device's camera and microphone are activated to collect facial expression and audio data. The input is the user's visual confirmation action, and the output is the confirmation status and collected emotion data.
[1260] Step 9:
[1261] Conducting emotion analysis
[1262] The device collects facial and audio data, which is then sent to a server for analysis by an emotion engine on the server. The emotion engine recognizes the user's emotional state and determines whether they are feeling anxious or dissatisfied. The input is the collected data, and the output is the result of the emotional state analysis. Specifically, the process involves image and audio preprocessing and the application of an emotion recognition model.
[1263] Step 10:
[1264] Adjustment of the proposal
[1265] The server adjusts the sales offer and price based on the sentiment analysis results. For example, if a user expresses dissatisfaction, it generates a more detailed explanation and new alternatives and sends them to the user's terminal. The input is the sentiment analysis results and the sales offer, and the output is the adjusted offer.
[1266] Step 11:
[1267] Confirmation of sale price and buyer
[1268] The user reviews the revised proposal and, if satisfied, clicks the "Accept" button. The input is the user's confirmation action, and the output is the acceptance status.
[1269] Step 12:
[1270] Send user address information
[1271] When the user clicks the "Accept" button, the device sends the user's address information to the cloud server. The input is the address information, and the output is the status of the transmission to the server.
[1272] Step 13:
[1273] Arrangement of a pickup company
[1274] The server selects the most suitable pickup company based on the user's address information and schedules the visit date and time. Inputs are address information and a database of pickup companies; output is the visit schedule. Specifically, the system uses an algorithm to select a pickup company and adjust the schedule.
[1275] Step 14:
[1276] Collection of goods
[1277] A collection company visits the user's address at the designated date and time to collect the items. Once collection is complete, the company reports the status to a cloud server. The input is the collection status, and the output is the data reported to the server.
[1278] Step 15:
[1279] Payment of sale price
[1280] After the server confirms that the item has been picked up, it transfers the sale price to the user's bank account. The input is the confirmation data of the item's pickup and the sale price information, and the output is the status of the completed transfer. For example, in the case of a record player, 10,000 yen will be transferred to the user's account.
[1281] (Application Example 2)
[1282] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1283] Traditional systems for selling unwanted items have problems such as users having difficulty understanding the market value of their items and spending a lot of time and effort finding a suitable buyer. Furthermore, they often fail to consider the user's emotional state, offering only uniform offers, which can lead to decreased user satisfaction. To solve these problems, a system is needed that allows users to easily calculate the market value of their items and find a suitable buyer, while also incorporating emotional analysis.
[1284] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes: a shooting means for photographing items that the user wants to sell; a data transfer means for uploading image data of the items photographed by the shooting means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; an emotion analysis means for analyzing the user's emotional state; a means for adjusting the proposed content and price offer based on the emotional state analyzed by the emotion analysis means; a means for arranging a buyer for the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user. This allows the user to sell unwanted items efficiently and at a fair price, and also enables responses tailored to the user's emotional state.
[1285] A "user" is an individual or legal entity that wishes to sell unwanted items using the system.
[1286] "Means of photography" refers to the device (e.g., smartphone camera) used by the user to photograph the items they wish to sell.
[1287] "Data transfer means" refers to a function for sending image data of an object captured by a photographic means to a cloud server.
[1288] A "cloud server" is a remote server that stores and processes data over a network.
[1289] "AI engine means" refers to artificial intelligence technology that analyzes image data uploaded to a cloud server and calculates the market value of goods.
[1290] The "sales target matching method" is a function that lists suitable potential buyers based on market value calculated by an AI engine and proposes them to the user.
[1291] "Emotional analysis methods" refer to technologies for analyzing a user's emotional state. These methods recognize a user's emotional state by analyzing facial expressions and voice data.
[1292] A "collection company" is a company that collects items from a user's address with the user's consent.
[1293] The "collection completion confirmation method" is a function that confirms that the collection company has retrieved the items and then makes the payment to the user from the cloud server.
[1294] This invention is a system that allows users to easily and quickly sell unwanted items. Specific embodiments of this system are described below.
[1295] System Configuration
[1296] The server includes: a means for photographing items that a user wants to sell; a means for uploading image data of the items photographed by the means to a cloud server; an AI engine means for analyzing the image data uploaded to the cloud server and calculating its market value; a buyer matching means for listing suitable buyer candidates and proposing them to the user based on the market value calculated by the AI engine means; an emotion analysis means for analyzing the user's emotional state; a means for adjusting the proposal and price offer based on the emotional state analyzed by the emotion analysis means; a means for arranging a buyer to take the items if the user agrees to the proposed selling price; and a means for confirming that the items have been picked up by the buyer and making payment to the user.
[1297] Program processing
[1298] The server uploads image data captured by the user using their smartphone camera to the cloud server. The uploaded image data is analyzed by an AI engine (e.g., TensorFlow or Keras model) on the cloud server. As a result of the analysis, the characteristics of the item are extracted, transaction information for similar products is retrieved from a database, and the market value is calculated. For example, if an image of an old telephone is uploaded, the AI engine analyzes its shape and brand name and calculates its market value based on transaction information.
[1299] Next, a buyer matching system lists several potential buyers based on the calculated market value, and proposals are made to the user. Simultaneously, the user's emotional state is analyzed by an emotion analysis system (e.g., an EmotionRecognition model). For example, if the user is feeling anxious or dissatisfied, more detailed proposals or alternatives are presented.
[1300] Once the user agrees to the proposed selling price, the server arranges for a pickup company to visit the user's address and collect the items. After the pickup company reports that the collection is complete, the server pays the user the agreed-upon selling price.
[1301] Specific example
[1302] If a user wants to sell an unwanted smartphone, they take a picture of the smartphone through the app and upload the image. An AI engine calculates its market value, for example, 5,000 yen, and suggests several places to sell it (e.g., a recycling shop or online auction). Sentiment analysis checks if the user is satisfied and provides additional explanations or alternatives as needed. Once the user agrees to the price, a pickup company is arranged, and after the item is collected, the user is paid 5,000 yen.
[1303] Example of a prompt
[1304] Example: "Analyze image data of unwanted items photographed by users, use AI to calculate their market value, and suggest suitable buyers. Also, analyze the user's emotions and provide detailed explanations and alternatives until the user is satisfied."
[1305] This ensures that users can sell unwanted items efficiently and at a fair price.
[1306] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[1307] Step 1:
[1308] The user takes a picture of the item they want to sell using their smartphone camera. Specifically, the user launches the camera app on their smartphone and takes a picture of the item. The input is image data of the item, and the output is the captured image data.
[1309] Step 2:
[1310] The device uploads the captured image data to the cloud server. Specifically, the device's application sends the captured image to the cloud server using a data transfer method. The input is the captured image data, and the output is the image data stored on the cloud server.
[1311] Step 3:
[1312] The server uses an AI engine to analyze image data uploaded to the cloud server. Specifically, it uses AI models such as TensorFlow and Keras to extract features of items from images and calculate their market value based on those features. The input is image data stored on the cloud server, and the output is the calculated market value.
[1313] Step 4:
[1314] The server uses a buyer matching system to list suitable buyer candidates based on the market value calculated by the AI engine. Specifically, it retrieves information on potential buyers from a database and evaluates them based on their market value. The inputs are the calculated market value and buyer information from the database, and the output is a list of potential buyers.
[1315] Step 5:
[1316] The server analyzes the user's emotional state using emotion analysis tools. Specifically, it uses an EmotionRecognition model to analyze the user's facial expressions and voice data to recognize the user's emotional state. The input is the user's facial image or voice data, and the output is the analyzed emotional state.
[1317] Step 6:
[1318] The server adjusts its proposals and pricing based on the emotional state analyzed by the emotion analysis tool. Specifically, if the user is feeling anxious or dissatisfied, it will provide detailed explanations and alternatives. The input is the analyzed emotional state and a list of potential buyers, and the output is the adjusted proposal.
[1319] Step 7:
[1320] If the user agrees to the proposed selling price, the server arranges for a pickup service for the items. Specifically, it uses a pickup service arrangement system to send the user's address information and coordinate the pickup date. The inputs are the user's consent and address information, and the output is information about the arranged pickup service.
[1321] Step 8:
[1322] The collection company will visit the user's address at the designated date and time to collect the items. The input is the information of the arranged collection company, and the output is the collected items.
[1323] Step 9:
[1324] The collection company reports to the server that it has completed the collection of the items. Specifically, the collection company uses a dedicated reporting system to notify the server of the collection status. The input is the information reported by the collection company, and the output is the collection completion status confirmed by the server.
[1325] Step 10:
[1326] After confirming the completion of the pickup, the server pays the user the predetermined sale price. Specifically, it transfers the sale price to the user's bank account through the banking system. The input is the confirmed pickup completion status and the sale price, and the output is the sale price that has been transferred.
[1327] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[1328] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1329] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.
[1330] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1331] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.
[1332] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.
[1333] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.
[1334] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.
[1335] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."
[1336] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.
[1337] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.
[1338] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.
[1339] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.
[1340] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1341] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.
[1342] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.
[1343] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.
[1344] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.
[1345] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.
[1346] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.
[1347] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.
[1348] The following is further disclosed regarding the embodiments described above.
[1349] (Claim 1)
[1350] A means of photography for users to photograph items they want to sell,
[1351] A data transfer means for uploading image data of an item captured by the aforementioned photographing means to a cloud server,
[1352] An AI engine means for analyzing image data uploaded to the aforementioned cloud server and calculating its market value,
[1353] Based on the market value calculated by the aforementioned AI engine, a buyer matching means is provided to list suitable buyer candidates and propose them to the user.
[1354] If the user agrees to the proposed selling price, a means for arranging for a company to pick up the goods,
[1355] A means for confirming that the goods have been collected by the aforementioned collection company and for making payment to the user,
[1356] A system that includes this.
[1357] (Claim 2)
[1358] The system according to claim 1, further comprising means for the collection company to visit the user's address to collect the goods and report the status of the collection.
[1359] (Claim 3)
[1360] The system according to claim 1, wherein the AI engine means includes means for obtaining transaction information of similar products from a database and calculating market value based thereon.
[1361]
[1362] "Example 1"
[1363] (Claim 1)
[1364] A means of photography for users to photograph items they want to sell,
[1365] A data transfer means for uploading image data of an item captured by the aforementioned photographing means to a cloud server,
[1366] An AI engine means for analyzing image data uploaded to the aforementioned cloud server and calculating its market value,
[1367] Based on the market value calculated by the aforementioned AI engine, a buyer matching means is provided to list suitable buyer candidates and propose them to the user.
[1368] If the user agrees to the proposed selling price, a means for arranging for a company to pick up the goods,
[1369] A means for confirming that the goods have been collected by the aforementioned collection company and for making payment to the user,
[1370] A means for sending user address information to a cloud server,
[1371] A means for the cloud server to select the most suitable pickup company based on the aforementioned address information,
[1372] A system that includes this.
[1373] (Claim 2)
[1374] The system according to claim 1, further comprising means for the collection company to visit the user's address to collect the goods and report the status of the collection.
[1375] (Claim 3)
[1376] The system according to claim 1, wherein the AI engine means includes means for obtaining transaction information of similar products from a database and calculating market value based thereon.
[1377] "Application Example 1"
[1378] (Claim 1)
[1379] A means of photography for users to photograph items they want to sell,
[1380] A data transfer means for uploading image data of an item captured by the aforementioned photographing means to a cloud server,
[1381] An AI engine means for analyzing image data uploaded to the aforementioned cloud server and calculating its market value,
[1382] Based on the market value calculated by the aforementioned AI engine, a buyer matching means is provided to list suitable buyer candidates and propose them to the user.
[1383] If the user agrees to the proposed selling price, a means for arranging for a company to pick up the goods,
[1384] A means for confirming that the goods have been collected by the aforementioned collection company and for making payment to the user,
[1385] Furthermore, a smart device application means for conducting a process within the store that calculates the market value from images of items taken by the user and suggests appropriate buyers,
[1386] A means for a user to scan an item using the aforementioned smart device application means and transmit the image data to a cloud server,
[1387] A system that includes this.
[1388] (Claim 2)
[1389] The system according to claim 1, further comprising means for the collection company to visit the user's address or store to collect the goods and report the status of the collection.
[1390] (Claim 3)
[1391] The system according to claim 1, wherein the AI engine means includes means for obtaining transaction information of similar products from a database and calculating market value based thereon, and means for generating prompt sentences to be input to a generating AI model.
[1392] "Example 2 of combining an emotion engine"
[1393] (Claim 1)
[1394] A means of photography for users to photograph items they want to sell,
[1395] A data transfer means for uploading image data of an item captured by the aforementioned photographing means to a cloud server,
[1396] An artificial intelligence engine means for analyzing image data uploaded to the aforementioned cloud server and calculating its market value,
[1397] Based on the market value calculated by the aforementioned artificial intelligence engine, a buyer matching means is provided to list suitable buyer candidates and propose them to the user.
[1398] An emotion analysis method for analyzing the user's facial expressions and voice data to recognize their emotional state,
[1399] A means for adjusting the proposed content and price based on the user's emotional state recognized by the aforementioned emotion analysis means,
[1400] If the user agrees to the proposed selling price, a means for arranging for a company to pick up the goods,
[1401] A means for confirming that the goods have been collected by the aforementioned collection company and for making payment to the user,
[1402] A system that includes this.
[1403] (Claim 2)
[1404] The system according to claim 1, further comprising means for the collection company to visit the user's address to collect the goods and report the status of the collection.
[1405] (Claim 3)
[1406] The system according to claim 1, wherein the artificial intelligence engine means includes means for obtaining transaction information of similar products from a database and calculating market value based thereon.
[1407] "Application example 2 when combining with an emotional engine"
[1408] (Claim 1)
[1409] A means of photography for users to photograph items they want to sell,
[1410] A data transfer means for uploading image data of an item captured by the aforementioned photographing means to a cloud server,
[1411] An AI engine means for analyzing image data uploaded to the aforementioned cloud server and calculating its market value,
[1412] Based on the market value calculated by the aforementioned AI engine, a buyer matching means is provided to list suitable buyer candidates and propose them to the user.
[1413] A means of analyzing the emotional state of a user,
[1414] A means for adjusting the proposed content and price offer based on the emotional state analyzed by the aforementioned emotion analysis means,
[1415] If the user agrees to the proposed selling price, a means for arranging for a company to pick up the goods,
[1416] A means for confirming that the goods have been collected by the aforementioned collection company and for making payment to the user,
[1417] A system that includes this.
[1418] (Claim 2)
[1419] The system according to claim 1, further comprising means for the collection company to visit the user's address to collect the goods and report the status of the collection.
[1420] (Claim 3)
[1421] The system according to claim 1, wherein the AI engine means includes means for obtaining transaction information of similar products from a database and calculating market value based thereon. [Explanation of Symbols]
[1422] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>
Claims
1. A means of photography for users to photograph items they want to sell, A data transfer means for uploading image data of an item captured by the aforementioned photographing means to a cloud server, An AI engine means for analyzing image data uploaded to the aforementioned cloud server and calculating its market value, Based on the market value calculated by the aforementioned AI engine, a buyer matching means is provided to list suitable buyer candidates and propose them to the user. If the user agrees to the proposed selling price, a means for arranging for a company to pick up the goods, A means for confirming that the goods have been collected by the aforementioned collection company and for making payment to the user, A system that includes this.
2. The system according to claim 1, further comprising means for the collection company to visit the user's address to collect the goods and report the status of the collection.
3. The system according to claim 1, wherein the AI engine means includes means for obtaining transaction information of similar products from a database and calculating market value based thereon.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A