System

Abstract

A system is provided.SOLUTION: The system includes a means for receiving property determination information, a means for receiving moving-in date information, a means for generating a schedule based on the property determination information and the moving-in date information, a means for converting the generated schedule into a calendar format, and a means for transmitting the converted schedule to a terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, with the increasing frequency of moves and disposals of belongings, users are faced with a wide range of tasks, including creating schedules, disposing of unwanted items, obtaining quotes from moving companies, and managing room space. These tasks require a lot of time and effort, and require efficient procedures. Furthermore, handling items, ensuring the accuracy of quotes, and determining whether furniture will fit in the room are difficult tasks for users. The present invention aims to provide a system that unifies these tasks and handles them efficiently and accurately. [Means for solving the problem]

[0005] The present invention provides a system that solves the above problems by the following means.

[0006] 1. Provided is a system including a means for receiving property decision information, a means for receiving move-in date information, a means for generating a schedule based on the property decision information and the move-in date information, a means for converting the generated schedule into a calendar format, and a means for transmitting the converted schedule to a terminal.

[0007] 2. Provide a system including a means for receiving photos of unwanted items from a user, a means for analyzing the received photos of the unwanted items and determining the category, condition, and estimated price of the items, a means for listing an automatically generated product description on a flea market site, and a means for notifying a terminal of the listing information.

[0008] 3. Provide a system including a means for receiving room layout information and furniture information from a user, a means for estimating the amount of cargo based on the received information, a means for transmitting the estimated amount of cargo information to a moving company and receiving an estimate, and a means for displaying a list of the received estimates on a terminal.

[0009] 4. Provide a system including a means for receiving a room floor plan and photos of furniture from a user, a means for analyzing the received floor plan and obtaining the dimensions of each room, a means for comparing the dimensions of the furniture with the dimensions of the room and determining whether the furniture can be installed, and a means for notifying a terminal of the determination result.

[0010] This allows users to efficiently manage the schedule from deciding on a property to moving in, and to centrally handle the disposal of unnecessary items, obtaining quotes from moving companies, and space compatibility of furniture.

[0011] "Property decision information" is information that includes selection information and specific details regarding the property in which the user will reside.

[0012] "Move-in date information" is information relating to the date on which the user actually moves into the newly selected property.

[0013] A "schedule" is a chronological plan of a series of events and tasks related to moving.

[0014] A "calendar format" is a format for visually displaying information based on dates and times.

[0015] "Unwanted items" are items that a user no longer uses or wants to dispose of for a particular reason.

[0016] A "flea market site" is an online marketplace where users can buy and sell goods between individuals.

[0017] "Item category" refers to a category division for classifying items based on their characteristics or uses.

[0018] "Item condition" is information indicating the usage status and storage state of the item.

[0019] "Estimated Price" is the automatically calculated selling price based on the market value of the item.

[0020] "Product description" is text that explains the characteristics, condition, and usage of an item.

[0021] "Cargo volume" refers to the total amount of items to be transported when moving, expressed based on volume and weight.

[0022] "Floor plan information" is information that indicates the number of rooms in a residence and the structure and layout of each room.

[0023] A "quote" is a statement of costs and resources required provided by a service provider.

[0024] "Furniture information" is detailed information such as the type, dimensions, and weight of the furniture to be moved.

[0025] A floor plan is a drawing that shows the interior layout and room dimensions of a residence.

[0026] "Installation possibility" is the result of determining whether a particular piece of furniture can be installed in a particular room. [Brief explanation of the drawings]

[0027] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0028] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0029] First, the terms used in the following description will be explained.

[0030] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0031] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0032] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0033] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0034] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0035] [First embodiment]

[0036] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0037] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0038] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0039] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0040] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0041] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0042] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0043] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0044] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0045] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0046] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0047] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0048] The present invention is a system for efficiently creating a schedule from when a user decides on a property until they move in, automatically listing unwanted items, obtaining estimates from moving companies, and determining whether the floor plan and furniture match. A detailed description of an embodiment of the present invention is provided below.

[0049] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. The server generates events from a standard template based on the received property selection information and move-in date information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal to be displayed to the user.

[0050] As a specific example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving a moving company, the start date for packing, and the moving date, and display this on the user's device.

[0051] Next, when an unwanted item needs to be disposed of, the user uploads a photo of the unwanted item to the device. The device then sends the photo to the server, which uses image recognition technology to determine the item's category, condition, and estimated price. Based on this information, the server generates an appropriate product description and automatically lists the item on the flea market site. The listing information is then notified to the device and displayed to the user.

[0052] As a specific example, when a user uploads a photo of an old smartphone, the server categorizes it as a "used smartphone in good working order," sets an appropriate price range, automatically lists it on a flea market site, and notifies the user that the listing is complete.

[0053] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The terminal sends this information to the server, which then estimates the amount of luggage based on the input information. Based on the estimated amount of luggage, the server then sends requests for quotes to multiple cooperating moving companies. The quotes received from each company are consolidated and displayed to the user via the terminal.

[0054] As a concrete example, when a user enters information about a sofa, bed, and dining table for a one-room apartment, the server estimates the amount of luggage, sends requests for quotes to multiple moving companies, and displays the results to the user.

[0055] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device sends this information to the server, which uses image recognition technology to analyze the floor plan and obtain the room dimensions. The dimensions of the furniture are compared with those of the room to determine whether it can be installed. The results are then sent to the device and displayed to the user.

[0056] For example, if a user uploads a floor plan of a living room with a large sofa, the server analyzes the floor plan and compares it with the sofa's dimensions. If it is difficult to install, the server notifies the device of the reason (e.g., the sofa will not fit through the door).

[0057] The above is a concrete embodiment for carrying out the present invention. This system allows users to perform moving-related tasks efficiently and accurately.

[0058] The processing flow will be explained below.

[0059] ■ Create a schedule from the time you choose a room until you move in! (Create a table)

[0060] Step 1:

[0061] The user selects the property and move-in date through the terminal.

[0062] Step 2:

[0063] The terminal sends the property information and move-in date to the server.

[0064] Step 3:

[0065] The server stores the property information and move-in date information it receives.

[0066] Step 4:

[0067] The server generates events (contract signing, moving company booking, packing, moving date, etc.) from standard templates.

[0068] Step 5:

[0069] A schedule leading up to occupancy is created based on events generated by the server.

[0070] Step 6:

[0071] The server converts the schedule into a calendar format.

[0072] Step 7:

[0073] The server transmits the generated schedule to the terminal.

[0074] Step 8:

[0075] The terminal displays the received schedule to the user.

[0076] ■ Sell your trash here! (Automatic Flea Market Listing)

[0077] Step 1:

[0078] The user takes a photo of the unwanted item and uploads it to the device.

[0079] Step 2:

[0080] The device sends the photo to the server.

[0081] Step 3:

[0082] The server uses image recognition technology to analyze the photos it receives and determine the item's category, condition, and estimated price.

[0083] Step 4:

[0084] The server automatically generates a product description based on the item's category, condition, and estimated price.

[0085] Step 5:

[0086] The server automatically lists the product using the flea market site API.

[0087] Step 6:

[0088] The server notifies the terminal of the listing information.

[0089] Step 7:

[0090] The terminal displays the listing information to the user.

[0091] ■ Get a quote from a moving company (approximate amount of luggage)

[0092] Step 1:

[0093] The user inputs the room layout information and furniture information into the terminal.

[0094] Step 2:

[0095] The terminal sends the input information to the server.

[0096] Step 3:

[0097] Based on the floor plan and furniture information received by the server, the volume and weight of the furniture are calculated and the cargo volume is estimated.

[0098] Step 4:

[0099] The server sends out quote requests to all the moving companies it works with.

[0100] Step 5:

[0101] The server receives estimates from multiple moving companies.

[0102] Step 6:

[0103] The server consolidates the received estimate results and sends them to the terminal.

[0104] Step 7:

[0105] The terminal displays the list of quotes to the user.

[0106] ■ This furniture does not fit into the layout (image recognition)

[0107] Step 1:

[0108] Users upload photos of room floor plans and furniture.

[0109] Step 2:

[0110] The device sends floor plans and photos of furniture to the server.

[0111] Step 3:

[0112] The server analyzes the floor plan using image recognition technology.

[0113] Step 4:

[0114] The server retrieves the dimensions of each room.

[0115] Step 5:

[0116] The server compares the furniture dimensions with the dimensions of the acquired floor plan.

[0117] Step 6:

[0118] The server determines whether or not furniture can be placed.

[0119] Step 7:

[0120] The server transmits the determination result to the terminal and notifies the user.

[0121] Step 8:

[0122] The terminal displays the judgment result and the reason (such as oversized) to the user.

[0123] Example 1

[0124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0125] Previously, preparing for a move and creating a schedule required many manual steps, which was time-consuming and labor-intensive. Furthermore, tasks such as disposing of unnecessary items, obtaining quotes from moving companies, and determining whether furniture and the floor plan are compatible had to be handled individually, making efficient move preparations difficult. A system was needed that would centralize and automate these processes, significantly reducing the burden on users.

[0126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0127] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the calendar format to the terminal, means for receiving photos of unwanted items from the user, means for analyzing the received photos of the unwanted items and determining the category, condition, and estimated price of the items, means for listing automatically generated product descriptions on an e-commerce site, means for notifying the terminal of the listing information, means for receiving room layout information and furniture information from the user, means for estimating the amount of cargo based on the received information, means for transmitting the estimated amount of cargo information to a carrier and receiving an estimate, means for displaying the received estimates in a list on the terminal, means for receiving room layout diagrams and photos of furniture from the user, means for analyzing the received floor plan and obtaining the dimensions of the room, means for comparing with furniture dimension data to determine whether the furniture can be installed, and means for notifying the terminal of the determination result. This makes it possible to centralize and automate a series of processes, such as creating a moving schedule, automatically listing unwanted items, obtaining quotes from moving companies, and determining whether furniture and floor plans are compatible.

[0128] "Property selection information" refers to detailed information about the property selected by the user.

[0129] "Move-in date information" refers to information about the date on which the user plans to move into their new home.

[0130] The "schedule" refers to a series of events and plans related to the user's preparations for moving.

[0131] A "calendar format" is a schedule converted into a format that can be viewed visually.

[0132] A "terminal" refers to an electronic device used by a user, such as a computer, smartphone, or tablet.

[0133] "Unnecessary items" are items that the user will not take with them when moving.

[0134] "Photographs" refer to image data that visually records unwanted items and floor plans.

[0135] "Analysis" refers to the process of analyzing information based on received data and determining its category, status, etc.

[0136] "Item category" refers to classification information regarding the type of unwanted item that has been analyzed.

[0137] "Estimated price" refers to the expected selling price of the item calculated based on the analysis results.

[0138] "Product description" refers to a detailed description of a product that is listed on an e-commerce site.

[0139] An "e-commerce site" is a platform for buying and selling goods online.

[0140] "Floor plan information" refers to information about the structure and layout of rooms.

[0141] "Furniture information" refers to detailed information about the furniture to be placed in the room.

[0142] "Cargo volume" refers to the total amount of items being transported when moving.

[0143] "Motoring Agent" means the transportation service provider handling your move.

[0144] An "estimate" is the price and services offered by a moving company for moving work.

[0145] "Receiving" refers to the server receiving a quote from a carrier.

[0146] "List display" refers to organizing multiple estimate results and displaying them on one screen.

[0147] A floor plan is a drawing that shows the layout and dimensions of a room.

[0148] "Room dimensions" refers to the size of a room, such as its length, width, and height.

[0149] "Installation feasibility" refers to determining whether the furniture can be properly installed in the specified room.

[0150] "Notification" refers to sending information from the server to the terminal to notify the user.

[0151] The present invention is a system that allows a user to efficiently create a schedule from when they decide on a property until they move in, automatically list unwanted items, obtain estimates from moving companies, and determine whether the floor plan and furniture match. To implement the present invention, the following steps are taken.

[0152] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. The server generates events from a standard template based on the received property selection information and move-in date information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal to be displayed to the user.

[0153] As a specific example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving a moving company, the start date for packing, and the moving date, and display this on the user's device.

[0154] Next, when an unwanted item needs to be disposed of, the user uploads a photo of the unwanted item to the device. The device then sends the photo to the server, which uses image recognition technology (e.g., TENSORFLOW (registered trademark)) to determine the item's category, condition, and estimated price. Based on this information, the server uses a generative AI model (e.g., GPT-3 (registered trademark)) to generate an appropriate product description and automatically lists the item on the e-commerce site. The listing information is then notified to the device and displayed to the user.

[0155] As a specific example, when a user uploads a photo of an old smartphone, the server categorizes it as a "used smartphone in good working condition," sets an appropriate price range, automatically lists it on an e-commerce site, and notifies the user that the listing is complete.

[0156] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The terminal sends this information to the server, which then estimates the amount of luggage based on the input information. Based on the estimated amount of luggage, the server then sends requests for quotes to multiple cooperating moving companies. The quotes received from each company are consolidated and displayed to the user via the terminal.

[0157] As a concrete example, when a user enters information about a sofa, bed, and dining table for a one-room apartment, the server estimates the amount of luggage, sends requests for quotes to multiple moving companies, and displays the results to the user.

[0158] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device sends this information to the server, which uses image recognition technology to analyze the floor plan and obtain the room dimensions. The dimensions of the furniture are compared with those of the room to determine whether it can be installed. The results are then sent to the device and displayed to the user.

[0159] For example, if a user uploads a floor plan of a living room with a large sofa, the server analyzes the floor plan and compares it with the sofa's dimensions. If it is difficult to install, the server notifies the device of the reason (e.g., the sofa will not fit through the door).

[0160] The above is a specific embodiment of the present invention. This system allows users to efficiently and accurately perform moving-related tasks. The use of generative AI models enables more advanced analysis and automation, reducing the burden on users.

[0161] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0162] Program processing steps

[0163] Creating a Schedule

[0164] Step 1:

[0165] The user enters property information (e.g., "Apartment A, Room 101") and the move-in date (e.g., two weeks later) into the terminal.

[0166] Input: Property information and move-in date

[0167] Output: User input data

[0168] Specific behavior: The user enters information into a form on the screen and clicks the submit button.

[0169] Step 2:

[0170] The terminal transmits the entered property decision information and move-in date information to the server.

[0171] Input: User-entered data

[0172] Output: Data sent from the device to the server

[0173] Specific operation: The device sends an HTTP POST request and sends the input data to the server.

[0174] Step 3:

[0175] The server analyzes the property decision information and move-in date information it receives.

[0176] Input: Property decision information and move-in date information sent to the server

[0177] Output: Analysis data

[0178] Specific operation: The server decodes the received data and analyzes it against the database.

[0179] Step 4:

[0180] The server searches for the corresponding event from the standard template and creates a schedule.

[0181] Input: Analysis data

[0182] Output: Initial schedule data

[0183] Specific operation: The server selects the appropriate event from a predefined template list and generates a schedule.

[0184] Step 5:

[0185] The schedule created by the server is converted into a calendar format.

[0186] Input: Initial schedule data

[0187] Output: Calendar format data

[0188] Specific operation: The server applies an algorithm to convert the schedule data into a standard format such as Google® Calendar format.

[0189] Step 6:

[0190] The server sends data in a calendar format to the terminal.

[0191] Input: Calendar format data

[0192] Output: Data sent to the terminal

[0193] Specific operation: The server sends calendar data to the device in an HTTP response.

[0194] Step 7:

[0195] The terminal formats the received schedule data for display and displays it to the user.

[0196] Input: Calendar format data sent to the terminal

[0197] Output: A viewable schedule

[0198] What happens: Your device formats the received data for display and displays it in the Calendar app.

[0199] Automatic listing of unwanted items

[0200] Step 1:

[0201] Users take a photo of an unwanted item (e.g., an old smartphone) using their device's camera, or select and upload an existing photo.

[0202] Input: Photo data of unwanted items

[0203] Output: User uploaded data

[0204] What happens: The user clicks the "Upload Photo" button in the app and selects or takes a photo.

[0205] Step 2:

[0206] The device sends the uploaded photo data to the server.

[0207] Input: User uploaded data

[0208] Output: Data sent from the device to the server

[0209] What happens: The device sends the photo data to the server using an HTTP POST request.

[0210] Step 3:

[0211] The server passes the received photo data to an image recognition algorithm for analysis.

[0212] Input: Photo data sent to the server

[0213] Output: Analysis results

[0214] What it does: The server uses Tensorflow to analyze the image and determine the category, condition, and estimated price.

[0215] Step 4:

[0216] The server generates a product description based on the analysis results.

[0217] Input: Analysis results

[0218] Output: Product description

[0219] What it does: The server generates product descriptions using a generative AI model (e.g., GPT-3).

[0220] Step 5:

[0221] The server automatically lists the generated product description on an electronic commerce site.

[0222] Input: Product description

[0223] Output: Notification of completion of listing on flea market site

[0224] Specific operation: The server uses the API of the e-commerce site to list the product and confirms that the listing is complete.

[0225] Step 6:

[0226] The server sends a notification of the completion of the listing to the terminal.

[0227] Input: Notification of listing completion from flea market site

[0228] Output: Data sent to the terminal

[0229] Specific operation: The server sends a listing completion notification to the terminal via HTTP response.

[0230] Step 7:

[0231] The terminal displays the received notification to the user.

[0232] Input: Listing completion notification sent to the terminal

[0233] Output: Display message

[0234] Specific behavior: The device displays the notification to the user as a pop-up message.

[0235] Get quotes from moving companies

[0236] Step 1:

[0237] The user selects the room layout information (e.g., 1K) on the input screen and enters furniture information (e.g., sofa, bed, dining table).

[0238] Input: Floor plan and furniture information

[0239] Output: User input data

[0240] Specific behavior: The user enters information into a form on the screen and clicks the submit button.

[0241] Step 2:

[0242] The terminal transmits the input floor plan information and furniture information to the server.

[0243] Input: User-entered data

[0244] Output: Data sent from the device to the server

[0245] Specific operation: The device sends an HTTP POST request and sends the input data to the server.

[0246] Step 3:

[0247] The server analyzes the floor plan and furniture information it receives and estimates the amount of cargo.

[0248] Input: Floor plan and furniture information sent to the server

[0249] Output: Load data

[0250] Specific operation: The server calculates the weight and volume based on the floor plan and furniture data.

[0251] Step 4:

[0252] The server sends a request for quote to multiple cooperating moving companies.

[0253] Input: Load data

[0254] Output: Request for quotation data from multiple vendors

[0255] Specific operation: The server sends an HTTP request to each supplier to request a quote.

[0256] Step 5:

[0257] The server consolidates the quotation results received from each supplier.

[0258] Input: Quote result data from vendor

[0259] Output: Integrated quote data

[0260] Specific operation: The server collects quote data from multiple vendors and consolidates it into a single list.

[0261] Step 6:

[0262] The server sends the integrated results to the terminal.

[0263] Input: Integrated quote data

[0264] Output: Data sent to the terminal

[0265] Specific operation: The server sends the integrated quotation data to the terminal in an HTTP response.

[0266] Step 7:

[0267] The terminal displays a list of the received estimate results and prompts the user to make a selection.

[0268] Input: Integrated quote data sent to the terminal

[0269] Output: Display options

[0270] Specific operation: The terminal organizes the quote results, displays them as a list, and offers the user options.

[0271] Determining compatibility between floor plan and furniture

[0272] Step 1:

[0273] The user uploads a floor plan and photos of furniture (e.g., a floor plan of a living room with a large sofa) to the device.

[0274] Input: Floor plan and furniture photos

[0275] Output: User uploaded data

[0276] What happens: The user clicks the "Upload Photo" button in the app and selects a photo.

[0277] Step 2:

[0278] The terminal sends the information to the server.

[0279] Input: User uploaded data

[0280] Output: Data sent from the device to the server

[0281] What happens: The device sends the floor plan and photo data to the server using an HTTP POST request.

[0282] Step 3:

[0283] The server analyzes the received floor plan data and obtains the dimensions of the rooms.

[0284] Input: Floor plan data sent to the server

[0285] Output: Room dimensions

[0286] What it does: The server uses image recognition technology to analyze the floor plan and obtain the length, width, and height.

[0287] Step 4:

[0288] The server compares the furniture's dimensions with the data and determines whether it can be installed.

[0289] Input: Room dimensions and furniture dimensions

[0290] Output: Installation success / failure result

[0291] What happens: The server runs an algorithm that compares the dimensions of the room with the dimensions of the furniture and determines whether it can be installed.

[0292] Step 5:

[0293] The server notifies the terminal of the determination result.

[0294] Input: Installation result

[0295] Output: Data sent to the terminal

[0296] Specific operation: The server sends the judgment result to the terminal in an HTTP response.

[0297] Step 6:

[0298] The terminal displays the received results to the user.

[0299] Input: Verification result sent to the terminal

[0300] Output: Display message

[0301] Specific operation: The device will display the judgment result to the user as a pop-up message, and if installation is difficult, will provide specific reasons.

[0302] These are the specific processing steps of this system. At each step, appropriate processing is performed based on the input data, and the results are passed on to the next step. Highly accurate analysis and automation are achieved by utilizing generative AI models and image recognition technology.

[0303] (Application example 1)

[0304] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0305] Moving involves a wide range of tasks, requiring many steps, from deciding on a property to arranging furniture in the new home, disposing of unnecessary items, and obtaining quotes from moving companies. While a system is needed to efficiently handle these steps, it is difficult to provide appropriate information in real time, especially when it comes to simulating furniture selection and placement in physical stores. This inconveniences users and makes the process leading up to a purchase decision inefficient. Additionally, disposing of unnecessary items and obtaining quotes from moving companies are both time-consuming and laborious, so a system capable of handling a series of moving-related tasks in an integrated manner is needed.

[0306] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0307] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the converted schedule to a terminal, means for receiving furniture placement information, means for determining whether furniture can be installed based on the furniture placement information, and means for notifying the user of the determination result. This enables the user to efficiently and comprehensively manage and execute a series of moving-related tasks, from selecting a property to moving in, selecting and placing furniture, disposing of unnecessary items, and obtaining quotes from moving companies.

[0308] "Property selection information" refers to detailed information about the property selected by the user, including the name, address, and room number of the property.

[0309] "Move-in date information" refers to the planned date on which the user moves into the property, and includes a specific date.

[0310] A "schedule" refers to a plan that outlines a series of tasks and events from deciding on a property to moving in.

[0311] "Calendar format" refers to a format in which the generated schedule is organized by date and displayed visually.

[0312] "Terminal" refers to an electronic device such as a computer or smartphone used by a user.

[0313] "Furniture placement information" refers to detailed information about the furniture that the user plans to install in their new home, including, for example, the dimensions and shape of the furniture.

[0314] "Installability" refers to the criteria and results used to determine whether furniture can be physically placed correctly in a specified space.

[0315] "Notification" refers to the act or means by which a system provides information to a user, including alerts and messages.

[0316] "Unwanted items" refers to unnecessary items that need to be disposed of when moving.

[0317] "Image recognition technology" refers to technology that analyzes image data such as photographs and videos and identifies specific objects or information.

[0318] "Flea market site" refers to an online marketplace where users can buy and sell goods.

[0319] "Quotation" A quotation is a document or information detailing the price and terms of the services to be provided by a moving company.

[0320] This invention is a system for efficiently managing and executing a series of tasks from when a user decides on a property until they move in. This system allows the user to smoothly move based on various data, from property decision information, move-in date information, furniture layout information, disposal of unwanted items, to obtaining quotes from moving companies. Each component of the system and its functions are explained in detail below.

[0321] System Program

[0322] 1. Receiving property decision information and move-in date information:

[0323] Users enter property selection information and move-in date information via their device (smartphone or computer) and send it to the server. The server receives this information and uses it as basic data for generating schedules.

[0324] 2. Generate the schedule:

[0325] Based on the property decision information and move-in date information, the server generates a schedule including events such as contract signing, moving-in and moving-out procedures, moving company reservations, the start date for packing, and the moving date. This schedule is converted into a calendar format and sent to the terminal.

[0326] 3. Dispose of unwanted items:

[0327] When a user uploads a photo of an unwanted item using their device, the photo is sent to a server. The server uses image recognition technology (e.g., Google Cloud Vision API) to determine the item's category, condition, and estimated price. It then uses a generative AI model to generate an appropriate product description and automatically lists the item on a flea market site (e.g., Mercari API). The listing information is then sent to the user's device.

[0328] 4. Get quotes from moving companies:

[0329] The user inputs the room layout and furniture information into the terminal and sends it to the server. The server uses this information to estimate the amount of luggage and sends requests for quotes to multiple moving companies. The received quotes are consolidated and displayed as a list on the user's terminal.

[0330] 5. Furniture placement simulation:

[0331] When a user uploads a floor plan and photos of furniture, the server analyzes this information and determines whether the furniture can be installed. The server uses image recognition technology to analyze the floor plan and obtain the room dimensions. The server compares the furniture dimensions with the room dimensions to determine whether the furniture can be installed and notifies the device of the result.

[0332] Hardware and Software Use

[0333] Hardware: Smartphones, computers

[0334] Cloud server: Amazon AWS (registered trademark)

[0335] Image recognition technology: Google Cloud Vision API

[0336] Calendar API: Google Calendar API

[0337] AI model: OpenAI (registered trademark) GPT-4 (registered trademark)

[0338] Flea market site API: Mercari API

[0339] Specific examples

[0340] A user selects a dining table in a physical store and sets the purchase date one week in the future. Then, they upload a photo of the old table they no longer need. They then upload a floor plan of their living room and a photo of the new dining table to run a simulation to see if it will fit in their room.

[0341] Prompt Sentence Examples

[0342] "A user has selected a dining table in a physical store and is planning to purchase it in a week. They uploaded a photo of the old table they no longer need. We'll analyze the floor plan of their living room and the photo of the new dining table to see if it will fit in their room."

[0343] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0344] Step 1:

[0345] The user inputs property selection information and move-in date information and sends it from the terminal to the server. The input data includes the property name, address, room number, expected move-in date, etc. The server receives this information and stores it in a database.

[0346] Step 2:

[0347] Based on the received property decision information and move-in date information, the server generates a schedule including events such as contract signing, moving-in and moving-out procedures, moving company reservations, the start date for packing, and the moving date. The generated schedule is converted into a calendar format.

[0348] Step 3:

[0349] The server sends the generated schedule in a calendar format to the terminal, which receives it and visually displays it to the user. The user can check the details of each event on the calendar and modify them as necessary.

[0350] Step 4:

[0351] To dispose of unwanted items, users upload photos of the items from their devices to the server. The input data includes images related to the item's category and condition. The server uses image recognition technology to determine the item's category, condition, and estimated price.

[0352] Step 5:

[0353] The server uses the results of image analysis to send prompts to the generative AI model, which then generates an appropriate product description. Based on the generated product description and price information, the product is automatically listed on a flea market site. The listing information is then sent to the user's device.

[0354] Step 6:

[0355] The user inputs the room layout and furniture information from their device and sends it to the server. The input data includes the floor plan and dimensions of each piece of furniture. The server then calculates the approximate load based on this information.

[0356] Step 7:

[0357] The server sends the estimated cargo volume information to multiple moving companies and requests quotes. The server consolidates the quotes received from the companies and sends them to the user's device in a list format. The user can compare these quotes and select the most suitable company.

[0358] Step 8:

[0359] The user uploads a floor plan of the room and photos of the new furniture they want to purchase from their device to the server. The input data includes images of the floor plan and photos of the furniture. The server then analyzes the floor plan using image recognition technology to obtain the dimensions of the room.

[0360] Step 9:

[0361] The server compares the acquired dimensional data with the furniture's dimensional data and determines whether the furniture can be installed. The server notifies the user of the result (whether it can be installed or not, and the reason why) and the user can check the result and select and arrange the appropriate furniture.

[0362] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0363] The present invention is a new moving support system that combines a function for recognizing a user's emotions and taking appropriate action based on the emotions. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following describes in detail the embodiments of the present invention.

[0364] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. At this point, the emotion engine runs and analyzes the emotion the user expressed when entering the information. This emotion information is also sent to the server.

[0365] The server generates events from a standard template based on the received property selection information, move-in date information, and emotion information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal for display. It is also possible to set reminders for specific events and optimize the content of the template based on the emotion information.

[0366] As a concrete example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving the moving company, the date to start packing, and the moving date, and if the user is feeling stressed, it will set frequent reminders and display these on the user's device.

[0367] Next, when it becomes necessary to dispose of unwanted items, the user uploads a photo of the unwanted item to the device. The device then sends the photo along with the user's emotional state to the server. The server uses image recognition technology to determine the item's category, condition, and estimated price. Based on this information and the user's emotional state, the server generates an appropriate product description and automatically lists the item on the flea market site. The listing information is then notified to the device and displayed to the user. It is also possible to adjust the price depending on the user's emotional state.

[0368] As a specific example, if a user uploads a photo of an old smartphone and the emotion engine determines that the user is in a hurry, the server will generate a product description at a low price aimed at an immediate sale, automatically list the item on a flea market site, and notify the user that the listing is complete.

[0369] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The device sends this information, along with the user's emotional state, to the server. The server estimates the amount of luggage based on the input information and simultaneously sends requests for quotes to multiple cooperating moving companies. Again, by taking emotional information into account, it is possible to select a company that will cause the least stress and determine the priority for displaying quotes. The quotes received from each company are consolidated and displayed to the user via the device.

[0370] As a concrete example, if a user inputs information about a sofa, bed, and dining table for a one-room apartment, and the emotion engine detects the user's anxiety, the server will prioritize displaying quotes from reliable contractors.

[0371] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device then sends this information along with the user's emotional state to the server. The server then uses image recognition technology to analyze the floor plan and obtain the room dimensions. It then compares the furniture dimensions with the room dimensions to determine whether the furniture can be installed. The results are then sent to the device and displayed to the user. It is also possible to adjust the timing and method of feedback based on the emotional information.

[0372] For example, if a user uploads a large sofa and a floor plan for their living room and the emotion engine detects their disappointment, the server will gently explain the impossibility notice and suggest alternatives.

[0373] The above is a specific embodiment for carrying out the present invention. This system allows users to perform moving-related tasks efficiently and accurately, while also receiving emotionally sensitive service.

[0374] The processing flow will be explained below.

[0375] ■ Create a schedule from the time you choose a room until you move in! (Create a table)

[0376] Step 1:

[0377] The user selects the property and move-in date through the terminal.

[0378] Step 2:

[0379] The emotion engine analyzes the emotion of the user's input.

[0380] Step 3:

[0381] The terminal transmits property decision information, move-in date information, and emotion information to the server.

[0382] Step 4:

[0383] The server stores the property decision information and move-in date information received.

[0384] Step 5:

[0385] The server generates events (contract signing, moving company booking, packing, moving day, etc.) from standard templates.

[0386] Step 6:

[0387] A schedule leading up to occupancy is created based on events generated by the server.

[0388] Step 7:

[0389] The server adjusts the reminder frequency and event details based on the emotion information.

[0390] Step 8:

[0391] The server converts the schedule into a calendar format.

[0392] Step 9:

[0393] The server transmits the generated schedule to the terminal.

[0394] Step 10:

[0395] The terminal displays the received schedule to the user.

[0396] ■ Sell your trash here! (Automatic Flea Market Listing)

[0397] Step 1:

[0398] The user takes a photo of the unwanted item and uploads it to the device.

[0399] Step 2:

[0400] The emotion engine analyzes the emotions of users when they upload photos.

[0401] Step 3:

[0402] The device sends the photo and emotional information to the server.

[0403] Step 4:

[0404] The server uses image recognition technology to analyze the photos it receives and determine the item's category, condition, and estimated price.

[0405] Step 5:

[0406] The server automatically generates a product description based on the item's category, condition, estimated price, and emotional information.

[0407] Step 6:

[0408] The server adjusts certain pricing based on emotional information (e.g., lower prices if you're in a hurry).

[0409] Step 7:

[0410] The server automatically lists the product using the flea market site API.

[0411] Step 8:

[0412] The server notifies the terminal of the listing information.

[0413] Step 9:

[0414] The terminal displays the listing information to the user.

[0415] ■ Get a quote from a moving company (approximate amount of luggage)

[0416] Step 1:

[0417] The user inputs the room layout information and furniture information into the terminal.

[0418] Step 2:

[0419] The emotion engine analyzes the emotion of the user's input.

[0420] Step 3:

[0421] The terminal transmits the floor plan information, furniture information, and emotion information to the server.

[0422] Step 4:

[0423] Based on the floor plan and furniture information received by the server, the volume and weight of the furniture are calculated and the cargo volume is estimated.

[0424] Step 5:

[0425] The server sends out quote requests to all the moving companies it works with.

[0426] Step 6:

[0427] The server takes emotional information into account when requesting a quote and prioritizes companies that cause the user less stress.

[0428] Step 7:

[0429] The server receives estimates from multiple moving companies.

[0430] Step 8:

[0431] The server consolidates the received estimate results and sends them to the terminal.

[0432] Step 9:

[0433] The terminal displays the list of quotes to the user.

[0434] ■ This furniture does not fit into the layout (image recognition)

[0435] Step 1:

[0436] Users upload photos of room floor plans and furniture.

[0437] Step 2:

[0438] The emotion engine analyzes the user's emotions when uploading.

[0439] Step 3:

[0440] The device sends the floor plan, photos of the furniture, and emotional information to the server.

[0441] Step 4:

[0442] The server analyzes the floor plan using image recognition technology.

[0443] Step 5:

[0444] The server retrieves the dimensions of each room.

[0445] Step 6:

[0446] The server compares the furniture dimensions with the dimensions of the acquired floor plan.

[0447] Step 7:

[0448] The server determines whether or not furniture can be placed.

[0449] Step 8:

[0450] The server adjusts the feedback method based on the emotional information (e.g., generating a gentle notification if the user is depressed).

[0451] Step 9:

[0452] The server transmits the determination result to the terminal and notifies the user.

[0453] Step 10:

[0454] The terminal displays the result of the judgment and the reason for it (e.g., oversized) to the user.

[0455] Example 2

[0456] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0457] Conventional moving support systems do not take into account the user's emotional state and are unable to reduce the user's stress and anxiety. Furthermore, they do not provide optimal suggestions based on the user's emotions when it comes to disposing of unwanted items or selecting a moving company, making it difficult to increase user satisfaction. Furthermore, while there is a demand for accurate schedules to be created based on information entered by the user and for notifications to be made at the appropriate time, conventional technologies have difficulty achieving this.

[0458] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0459] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for analyzing the user's emotional state based on the property selection information and the move-in date information, means for generating events and creating a schedule based on the analyzed emotional state, means for converting the generated schedule into a calendar format, and means for transmitting the converted schedule to the terminal. This enables moving support that takes the user's emotions into consideration, and realizes timely notifications while reducing the user's stress and anxiety.

[0460] In this invention, the server includes means for receiving images of unwanted items from a user, means for analyzing the received images and determining the category, condition, and estimated price of the items, means for automatically generating product descriptions based on the user's emotional state and listing the items on an e-commerce platform, and means for notifying the terminal of the listing information. This allows optimal suggestions based on the user's emotions when disposing of unwanted items, reducing the burden on the user.

[0461] In this invention, the server includes a means for receiving room layout information and furniture information from the user, a means for estimating the transportation amount based on the received information, a means for transmitting the estimated transportation amount information to the service provider and receiving the estimate, and a means for displaying the received estimates in a list on the terminal. This makes it possible to prioritize and display estimates from reliable companies taking into account the user's emotional information, thereby helping the user select an appropriate moving company while reducing their anxiety.

[0462] The "property selection information" is information about the residential property selected by the user, including detailed information such as the address and room number.

[0463] "Move-in date information" is information indicating the date on which the user plans to move into a new residential property.

[0464] "User's emotional state" is information that indicates the emotional state of the user when using the system, and includes emotions such as stress, anxiety, and hurry.

[0465] "Events" are specific tasks and activities related to moving, such as signing contracts, booking movers, and starting packing.

[0466] A "schedule" is a plan that arranges all events related to the user's move in appropriate timing.

[0467] A "calendar format" is a format that visually displays a schedule along a date or time axis.

[0468] A "terminal" is a device that a user uses to input information or receive and view information sent from the system. Examples include smartphones and personal computers.

[0469] "Unwanted items" are items that a user wants to dispose of when moving, such as an old smartphone or furniture.

[0470] "Images" refers to data that contains visual information, such as photos of unwanted items or floor plans of rooms.

[0471] "Category" is classification information that indicates the type of item, such as electronic equipment, furniture, and clothing.

[0472] "Condition" is information indicating the storage and usage status of the unwanted item, such as new, used, damaged, etc.

[0473] "Estimated price" is information indicating the market value of the analyzed item.

[0474] "Product description" refers to the description used when listing unwanted items on an e-commerce platform.

[0475] An "e-commerce platform" is a website or application through which goods are bought and sold online.

[0476] "Layout information" refers to information about the layout and arrangement of a room, including, for example, the size and shape of the room, and the arrangement of furniture.

[0477] "Furniture information" is information indicating the type, size, quantity, etc. of furniture owned by the user.

[0478] "Transportation volume" is information that roughly estimates the total amount of luggage to be transported when the user moves.

[0479] A "service provider" is a company that provides moving services to users.

[0480] MODE FOR CARRYING OUT THE INVENTION

[0481] The present invention is a moving support system that recognizes the user's emotions and takes appropriate action based on the emotions. Specific embodiments of this system will be described below.

[0482] Deciding on the property and setting the move-in date

[0483] User: Enter property selection information and move-in date information into the terminal. For example, enter "Apartment A, Room 101" and "Move-in date in two weeks."

[0484] Terminal: In addition to the entered property decision information and move-in date information, the terminal analyzes the user's emotional state using an emotion analysis engine (e.g., IBM Watson (registered trademark)) and sends the results to the server.

[0485] Server: Based on the received information, it generates events from standard templates, creates schedules, converts them into a calendar format, and sends them back to the device, so that reminders can be sent to the user at the appropriate time.

[0486] Example: If a user is moving into "A Apartment, Room 101" in two weeks, the server generates a schedule including the contract signing, moving company booking, and the start date for packing. If the server detects that the user is stressed, it sets frequent reminders.

[0487] Disposal of unnecessary items

[0488] User: Upload an image of the unwanted item to the device, for example, upload a photo from an old smartphone.

[0489] Device: Sends the user's emotional state along with the uploaded image to the server.

[0490] Server: Uses image recognition technology (e.g., TensorFlow) to determine the item's category, condition, and estimated price, and generates a product description based on the user's emotional state. The description is then automatically listed on an e-commerce platform (e.g., Mercari).

[0491] Terminal: Receives listing completion information and notifies the user.

[0492] Example: If a user uploads an old smartphone and the emotion engine determines that the user is in a hurry, the server generates a product description at a low price and automatically lists the item on a flea market site for immediate sale. The server notifies the user that the listing is complete.

[0493] Get quotes from moving companies

[0494] User: Enters room layout and furniture information into the terminal. For example, enters information about a sofa, bed, and dining table for a one-room apartment.

[0495] Terminal: Sends the user's emotional state along with the input information to the server.

[0496] Server: Based on the input information, the server estimates the amount of goods to be transported and sends requests for quotes to multiple moving companies simultaneously. The information is used to select the most appropriate company.

[0497] Terminal: The estimates received from each supplier are consolidated and sent to the terminal, where they are displayed as a list to the user.

[0498] Example: If a user inputs a sofa, bed, and dining table into a one-room apartment, and concerns are detected, quotes from reliable contractors will be displayed first.

[0499] Determine whether furniture can be installed

[0500] User: Upload a room floor plan and photos of furniture to the device. For example, upload a floor plan of a living room with a large sofa.

[0501] Terminal: Sends the uploaded information and the user's emotional state to the server.

[0502] Server: Analyzes the floor plan using image recognition technology to obtain the dimensions of the room. It compares the dimensions of the furniture with the dimensions of the room to determine whether it can be installed and sends the result to the device.

[0503] Device: The result of whether installation is possible or not is displayed to the user, and the timing and method of feedback are adjusted based on emotional information.

[0504] Example: If a user uploads a large sofa and a floor plan for their living room, and the emotion engine detects disappointment, the server can gently explain the impossibility notice and suggest alternatives.

[0505] Examples of prompts for generative AI models

[0506] 1. Setting reminders based on emotion information: "Generate a schedule reminder for a user who is moving to Apartment 101 in two weeks and is feeling stressed."

[0507] 2. Product Description Generation: "Generate a low-cost product description for an older smartphone for a user in a hurry."

[0508] 3. Display quotes from reliable movers: "For a user who is worried about moving to a one-room apartment with lots of furniture, please prioritize displaying quotes from reliable movers."

[0509] 4. Unavailable notifications and suggestions: “Generate a friendly notification suggesting alternatives for a disappointed user who uploads a large sofa and living room floor plan.”

[0510] The above is a specific embodiment for carrying out the invention.

[0511] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0512] Deciding on the property and setting the move-in date

[0513] Step 1: The user enters the property selection information and move-in date information into the terminal.

[0514] Input: Property information (e.g., "Apartment A, Room 101") and move-in date information (e.g., "Move-in date in two weeks")

[0515] Operation: Enter property selection information and move-in date information into the input form on the device.

[0516] Step 2: The device sends the input information to the server

[0517] Input: Property decision information, move-in date information, user's emotional state

[0518] Data calculation: Analyzes the user's emotional state from input information using an emotion analysis engine.

[0519] Output: Property decision information, move-in date information, and analyzed emotional state sent to the server

[0520] Step 3: Server generates and schedules events

[0521] Input: Property decision information, move-in date information, emotional state

[0522] Data calculation: Generate events from standard templates and create schedules based on them. The schedules are converted into a calendar format.

[0523] Output: The generated schedule

[0524] Step 4: The server sends the schedule to the device

[0525] Input: Generated schedule

[0526] What it does: Converts the schedule into a calendar format and sends it to the device.

[0527] Output: Schedule displayed on the terminal

[0528] Disposal of unnecessary items

[0529] Step 1: User uploads a photo of unwanted items to the device

[0530] Input: Image of unwanted item (e.g., photo of old smartphone)

[0531] What it does: Uploads an image using the device's image upload functionality.

[0532] Step 2: The device sends the image and emotional state to the server.

[0533] Input: uploaded image, user emotional state

[0534] Data calculation: Performs image analysis and sentiment analysis.

[0535] Output: Image, emotional state sent to server

[0536] Step 3: The server analyzes the image and generates a product description

[0537] Input: Image, emotional state

[0538] Data Computing: Using image recognition technology (e.g., TensorFlow) to determine an item's category, condition, and estimated price, and generate product descriptions based on the customer's emotional state.

[0539] Output: Product description, automatically generated listing information

[0540] Step 4: The server sends the product description and listing information to the e-commerce platform

[0541] Input: Product description, listing information

[0542] What it does: Sends product description and listing information to an e-commerce platform (e.g., Mercari).

[0543] Output: Information on items listed on flea market sites

[0544] Step 5: The server sends the listing completion information to the device.

[0545] Input: Listing completion information

[0546] Action: Sends a notification to the device that the listing is complete.

[0547] Output: Notification of successful listing displayed on your device

[0548] Get quotes from moving companies

[0549] Step 1: The user inputs the room layout and furniture information into the terminal.

[0550] Input: Room layout information, furniture information (e.g., 1K floor plan, sofa, bed, dining table)

[0551] Operation: Enter room layout and furniture information into the input form on the device.

[0552] Step 2: The device sends information and emotional state to the server

[0553] Input: Room layout information, furniture information, emotional state

[0554] Data calculation: Performs data processing for sentiment analysis and layout information.

[0555] Output: Layout information, furniture information, and emotional state sent to the server

[0556] Step 3: The server estimates the transport volume and sends a quote request

[0557] Input: Layout information, furniture information, emotional state

[0558] Data calculation: The amount of transportation is estimated based on layout information and furniture information, and quote requests are sent simultaneously to multiple service providers.

[0559] Output: Request for quote

[0560] Step 4: The server receives and consolidates the quote results

[0561] Input: Quotation results from each service provider

[0562] Data calculation: Integrates the estimates and selects the best result based on sentiment information.

[0563] Output: Consolidated quotation results

[0564] Step 5: The device will list the information

[0565] Input: Consolidated quote results

[0566] Operation: Displays the consolidated estimate results in a list on the terminal.

[0567] Output: Estimate results displayed on the terminal

[0568] Determine whether furniture can be installed

[0569] Step 1: The user uploads a floor plan and photos of the furniture to their device.

[0570] Input: Floor plan of the room, photos of furniture (e.g., a photo of a large sofa)

[0571] How it works: Upload photos of floor plans and furniture using the device's image upload feature.

[0572] Step 2: The device sends information and emotional state to the server

[0573] Input: Floor plan, furniture photos, emotional state

[0574] Data calculation: Performs image analysis and sentiment analysis.

[0575] Output: Floor plan, furniture photos, and emotional state sent to the server

[0576] Step 3: The server analyzes the dimensions and determines whether it can be installed.

[0577] Input: Floor plan, furniture photos, emotional state

[0578] Data calculation: Using image recognition technology, the floor plan is analyzed to obtain the dimensions of the room. The dimensions of the furniture are compared with those of the room to determine whether it can be installed.

[0579] Output: Installation success / failure result

[0580] Step 4: The server sends the results to the device

[0581] Input: Installation result

[0582] Operation: Sends the result of whether installation is possible or not to the terminal.

[0583] Output: The installation result displayed on the device

[0584] Step 5: The device displays feedback to the user

[0585] Input: Possible placement result, feedback based on emotional state

[0586] What it does: Shows the user the results of whether it's installed or not, and adjusts the timing and content of notifications based on their emotional state.

[0587] Output: Feedback that is displayed to the user

[0588] The above is the detailed flow and specific operations of each processing step.

[0589] (Application example 2)

[0590] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0591] Conventional moving support systems did not take users' emotions into consideration and lacked effective means to reduce user stress. As a result, moving operations were often psychologically stressful. Furthermore, there was no system that recognized the emotions of factory employees and provided appropriate work instructions or support, making it difficult to efficiently improve productivity. To address these issues, there is a need to provide optimal support based on the emotional information of users and employees.

[0592] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the converted schedule to a terminal, means for analyzing user emotion information, and means for optimizing the schedule and reminders based on the emotion information. This enables an optimal moving support service to be provided according to the user's emotional state.

[0593] The server also includes means for receiving photos of unwanted items from users, means for analyzing the received photos of unwanted items and determining the category, condition, and estimated price of the items, means for listing automatically generated product descriptions on the flea market site, means for notifying the terminal of the listing information, and means for analyzing user emotional information and optimizing the product descriptions and prices based on the emotional information, thereby enabling unwanted items to be listed efficiently and quickly.

[0594] The server further includes means for receiving room layout information and furniture information from the user, means for estimating the amount of cargo based on the received information, means for transmitting the estimated amount of cargo information to the moving company and receiving an estimate, means for displaying the received estimates in a list on the terminal, and means for analyzing the user's emotional information and optimizing company selection and estimate display based on the emotional information, thereby enabling the user to obtain and select estimates from moving companies while reducing stress.

[0595] Furthermore, the server includes a means for providing appropriate work instructions and support according to the user's emotional state, and a means for displaying the work instructions and support on the terminal, thereby enabling optimal work support to be provided according to the emotional state of the factory employees, thereby improving productivity.

[0596] "Property selection information" is information about the property selected by the user, and includes the property's address, room number, building name, and the like.

[0597] "Move-in date information" is information about the date on which the user plans to move into the newly selected property.

[0598] A "schedule" is a timetable or plan created based on property selection information and move-in date information, and includes tasks and events related to moving.

[0599] "Calendar format" organizes the generated schedule by date and makes it possible to display it in a general calendar format.

[0600] "Terminal" refers to electronic devices used by users, such as smartphones, personal computers, and tablets.

[0601] "Emotion information" is data that indicates the user's emotional state and is analyzed using emotion recognition technology.

[0602] "Reminder" is a function for notifying users of tasks or events, and notifications are sent based on specific times or conditions.

[0603] "Photos of unwanted items" are image data of items that the user wishes to dispose of or sell when moving.

[0604] A "flea market site" refers to an online marketplace that users use to sell unwanted items.

[0605] "Product description" refers to the description of a product that is displayed when selling an item on a flea market site.

[0606] "Floor plan information" is information relating to the structure and layout of a room, including floor plans and room dimensions.

[0607] "Furniture information" is information about the furniture to be carried to the new home, including the type, dimensions, quantity, etc. of the furniture.

[0608] "Cargo volume" refers to the total weight or volume of the items being transported during a move.

[0609] "Moving company" refers to a company that provides moving-related services.

[0610] "Quotation" means a written estimate of the cost of the moving work provided by the moving company.

[0611] A "work instruction" is an instruction given to an employee regarding a specific task or job.

[0612] "Assistance" refers to auxiliary support provided to help users or employees perform their tasks.

[0613] To implement this invention, the server first receives property selection information and move-in date information from the user. The server then generates a schedule based on this information and converts it into a calendar format. The converted schedule is then sent to the terminal and displayed to the user. The server also obtains the user's emotional state at the time of input and optimizes the schedule and reminders based on this information.

[0614] The server also receives photos of unwanted items from users and analyzes them to determine the item's category, condition, and estimated price. The server automatically generates a product description based on this information and lists the item on the flea market site. The listing information is then sent to the user's device. Here, the server also analyzes emotional information and optimizes the product description and selling price based on the user's emotions.

[0615] In addition, when the user provides information about the room layout and furniture, the server receives this information and estimates the amount of luggage. The server then sends the estimated amount of luggage information to the moving company and receives quotes from several companies. The received quotes are displayed as a list on the device. The server takes emotional information into consideration and recommends the most suitable moving company.

[0616] In a factory, a specific example would be a device or robot recognizing an employee's emotional state and providing appropriate work instructions or assistance. The employee's face is captured by a camera and their emotions are analyzed using an emotion recognition model. Based on the analysis results, the device or robot displays work instructions or assistance details.

[0617] The system's main software includes an emotion recognition model using Keras, an image processing system using OpenCV, and Python for data analysis. The user's device and server are standard PCs and smartphones. Using a generative AI model and prompts, the system generates optimal feedback and support sentences based on the user's emotional state.

[0618] For example, if the emotion recognition model determines that the user is feeling down, the server will display a kind notification and send an encouraging message to the user. If the emotion recognition model determines that a factory worker is feeling tired, the work robot will display a supportive message such as "Please take a short break."

[0619] Example prompts to input to a generative AI model:

[0620] "Create a prompt that generates appropriate work instructions when an employee is sad."

[0621] "Create a prompt that generates a message to reduce employee stress."

[0622] This allows optimal support according to the emotional state of the user and employees, reducing stress and enabling more efficient work.

[0623] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0624] Step 1:

[0625] The user inputs property selection information and move-in date information into the terminal and transmits it to the server.

[0626] Input: Property decision information (e.g., "Apartment A, Room 101"), move-in date information (e.g., May 1, 2023).

[0627] Data processing: This information is converted into an appropriate format and sent to the server along with the user's emotional information.

[0628] Output: Property decision information, move-in date information, and sentiment information sent to the server.

[0629] Step 2:

[0630] The server analyzes the received property decision information, move-in date information, and emotion information to generate a schedule.

[0631] Input: Property decision information, move-in date information, and sentiment information.

[0632] Data calculation: A schedule generation algorithm is used to calculate a series of tasks (e.g., signing a contract, booking a moving company, etc.) and adjust the frequency of reminders based on the user's emotions.

[0633] Output: The generated schedule.

[0634] Step 3:

[0635] The generated schedule is converted into a calendar format and sent to the terminal.

[0636] Input: The generated schedule.

[0637] Data processing: Convert schedules into standard calendar format.

[0638] Output: The converted schedule is displayed on the terminal.

[0639] Step 4:

[0640] The user uploads a photo of the unwanted item to the terminal and sends it to the server.

[0641] Input: A photo of your unwanted item (e.g., an image of your old smartphone).

[0642] Data processing: The user's emotional information is sent to the server along with the photo data.

[0643] Output: Photo data and emotion information sent to the server.

[0644] Step 5:

[0645] The server analyzes the photos of the unwanted items it receives to determine the item's category, condition, and estimated value.

[0646] Input: Photos of unwanted items, emotional information.

[0647] Data calculation: Analyzes product information using image recognition technology and optimizes prices and product descriptions based on emotional information.

[0648] Output: Item category, condition, estimated price, optimized product description.

[0649] Step 6:

[0650] The automatically generated product description is put up for sale on a flea market site, and the listing information is notified to the terminal.

[0651] Input: Optimized product description.

[0652] Data calculation: Automates the process of listing items on flea market sites and generates listing completion information.

[0653] Output: Listing completion information sent to the device.

[0654] Step 7:

[0655] The user inputs the room layout information and furniture information into the terminal and transmits it to the server.

[0656] Input: Room layout information, furniture information.

[0657] Data processing: The user's emotional information is sent to the server along with floor plan and furniture information.

[0658] Output: Floor plan information, furniture information, and emotion information sent to the server.

[0659] Step 8:

[0660] The server estimates the amount of cargo based on the received information and sends requests for quotes to multiple cooperating moving companies.

[0661] Input: Floor plan information, furniture information, and emotion information.

[0662] Data calculation: Calculate the total weight and volume of the package and send a quote request using a contractor selection algorithm.

[0663] Output: The estimate provided.

[0664] Step 9:

[0665] The server aggregates the received quotes and prioritizes the best quote based on the sentiment information.

[0666] Input: Quote received.

[0667] Data calculation: Analyze quotes and prioritize them based on reliability and price.

[0668] Output: Consolidated quotes listed on the terminal.

[0669] Step 10:

[0670] The terminal or robot recognizes the employee's emotional state and provides appropriate work instructions or assistance.

[0671] Input: Employee video data.

[0672] Data calculation: Analyze emotions using facial recognition technology and emotion recognition models to generate optimal work instructions.

[0673] Output: Work instructions and assistance messages displayed on the terminal or robot.

[0674] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0675] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0676] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0677] [Second embodiment]

[0678] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0679] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0680] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0681] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0682] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0683] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0684] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0685] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0686] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0687] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0688] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0689] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0690] The present invention is a system for efficiently creating a schedule from when a user decides on a property until they move in, automatically listing unwanted items, obtaining estimates from moving companies, and determining whether the floor plan and furniture match. A detailed description of an embodiment of the present invention is provided below.

[0691] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. The server generates events from a standard template based on the received property selection information and move-in date information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal to be displayed to the user.

[0692] As a specific example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving a moving company, the start date for packing, and the moving date, and display this on the user's device.

[0693] Next, when an unwanted item needs to be disposed of, the user uploads a photo of the unwanted item to the device. The device then sends the photo to the server, which uses image recognition technology to determine the item's category, condition, and estimated price. Based on this information, the server generates an appropriate product description and automatically lists the item on the flea market site. The listing information is then notified to the device and displayed to the user.

[0694] As a specific example, when a user uploads a photo of an old smartphone, the server categorizes it as a "used smartphone in good working order," sets an appropriate price range, automatically lists it on a flea market site, and notifies the user that the listing is complete.

[0695] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The terminal sends this information to the server, which then estimates the amount of luggage based on the input information. Based on the estimated amount of luggage, the server then sends requests for quotes to multiple cooperating moving companies. The quotes received from each company are consolidated and displayed to the user via the terminal.

[0696] As a concrete example, when a user enters information about a sofa, bed, and dining table for a one-room apartment, the server estimates the amount of luggage, sends requests for quotes to multiple moving companies, and displays the results to the user.

[0697] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device sends this information to the server, which uses image recognition technology to analyze the floor plan and obtain the room dimensions. The dimensions of the furniture are compared with those of the room to determine whether it can be installed. The results are then sent to the device and displayed to the user.

[0698] For example, if a user uploads a floor plan of a living room with a large sofa, the server analyzes the floor plan and compares it with the sofa's dimensions. If it is difficult to install, the server notifies the device of the reason (e.g., the sofa will not fit through the door).

[0699] The above is a concrete embodiment for carrying out the present invention. This system allows users to perform moving-related tasks efficiently and accurately.

[0700] The processing flow will be explained below.

[0701] ■ Create a schedule from the time you choose a room until you move in! (Create a table)

[0702] Step 1:

[0703] The user selects the property and move-in date through the terminal.

[0704] Step 2:

[0705] The terminal sends the property information and move-in date to the server.

[0706] Step 3:

[0707] The server stores the property information and move-in date information it receives.

[0708] Step 4:

[0709] The server generates events (contract signing, moving company booking, packing, moving date, etc.) from standard templates.

[0710] Step 5:

[0711] A schedule leading up to occupancy is created based on events generated by the server.

[0712] Step 6:

[0713] The server converts the schedule into a calendar format.

[0714] Step 7:

[0715] The server transmits the generated schedule to the terminal.

[0716] Step 8:

[0717] The terminal displays the received schedule to the user.

[0718] ■ Sell your trash here! (Automatic Flea Market Listing)

[0719] Step 1:

[0720] The user takes a photo of the unwanted item and uploads it to the device.

[0721] Step 2:

[0722] The device sends the photo to the server.

[0723] Step 3:

[0724] The server uses image recognition technology to analyze the photos it receives and determine the item's category, condition, and estimated price.

[0725] Step 4:

[0726] The server automatically generates a product description based on the item's category, condition, and estimated price.

[0727] Step 5:

[0728] The server automatically lists the product using the flea market site API.

[0729] Step 6:

[0730] The server notifies the terminal of the listing information.

[0731] Step 7:

[0732] The terminal displays the listing information to the user.

[0733] ■ Get a quote from a moving company (approximate amount of luggage)

[0734] Step 1:

[0735] The user inputs the room layout information and furniture information into the terminal.

[0736] Step 2:

[0737] The terminal sends the input information to the server.

[0738] Step 3:

[0739] Based on the floor plan and furniture information received by the server, the volume and weight of the furniture are calculated and the cargo volume is estimated.

[0740] Step 4:

[0741] The server sends out quote requests to all the moving companies it works with.

[0742] Step 5:

[0743] The server receives estimates from multiple moving companies.

[0744] Step 6:

[0745] The server consolidates the received estimate results and sends them to the terminal.

[0746] Step 7:

[0747] The terminal displays the list of quotes to the user.

[0748] ■ This furniture does not fit into the layout (image recognition)

[0749] Step 1:

[0750] Users upload photos of room floor plans and furniture.

[0751] Step 2:

[0752] The device sends floor plans and photos of furniture to the server.

[0753] Step 3:

[0754] The server analyzes the floor plan using image recognition technology.

[0755] Step 4:

[0756] The server retrieves the dimensions of each room.

[0757] Step 5:

[0758] The server compares the furniture dimensions with the dimensions of the acquired floor plan.

[0759] Step 6:

[0760] The server determines whether or not furniture can be placed.

[0761] Step 7:

[0762] The server transmits the determination result to the terminal and notifies the user.

[0763] Step 8:

[0764] The terminal displays the judgment result and the reason (such as oversized) to the user.

[0765] Example 1

[0766] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0767] Previously, preparing for a move and creating a schedule required many manual steps, which was time-consuming and labor-intensive. Furthermore, tasks such as disposing of unnecessary items, obtaining quotes from moving companies, and determining whether furniture and the floor plan are compatible had to be handled individually, making efficient move preparations difficult. A system was needed that would centralize and automate these processes, significantly reducing the burden on users.

[0768] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0769] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the calendar format to the terminal, means for receiving photos of unwanted items from the user, means for analyzing the received photos of the unwanted items and determining the category, condition, and estimated price of the items, means for listing automatically generated product descriptions on an e-commerce site, means for notifying the terminal of the listing information, means for receiving room layout information and furniture information from the user, means for estimating the amount of cargo based on the received information, means for transmitting the estimated amount of cargo information to a carrier and receiving an estimate, means for displaying the received estimates in a list on the terminal, means for receiving room layout diagrams and photos of furniture from the user, means for analyzing the received floor plan and obtaining the dimensions of the room, means for comparing with furniture dimension data to determine whether the furniture can be installed, and means for notifying the terminal of the determination result. This makes it possible to centralize and automate a series of processes, such as creating a moving schedule, automatically listing unwanted items, obtaining quotes from moving companies, and determining whether furniture and floor plans are compatible.

[0770] "Property selection information" refers to detailed information about the property selected by the user.

[0771] "Move-in date information" refers to information about the date on which the user plans to move into their new home.

[0772] The "schedule" refers to a series of events and plans related to the user's preparations for moving.

[0773] A "calendar format" is a schedule converted into a format that can be viewed visually.

[0774] A "terminal" refers to an electronic device used by a user, such as a computer, smartphone, or tablet.

[0775] "Unnecessary items" are items that the user will not take with them when moving.

[0776] "Photographs" refer to image data that visually records unwanted items and floor plans.

[0777] "Analysis" refers to the process of analyzing information based on received data and determining its category, status, etc.

[0778] "Item category" refers to classification information regarding the type of unwanted item that has been analyzed.

[0779] "Estimated price" refers to the expected selling price of the item calculated based on the analysis results.

[0780] "Product description" refers to a detailed description of a product that is listed on an e-commerce site.

[0781] An "e-commerce site" is a platform for buying and selling goods online.

[0782] "Floor plan information" refers to information about the structure and layout of rooms.

[0783] "Furniture information" refers to detailed information about the furniture to be placed in the room.

[0784] "Cargo volume" refers to the total amount of items being transported when moving.

[0785] "Motoring Agent" means the transportation service provider handling your move.

[0786] An "estimate" is the price and services offered by a moving company for moving work.

[0787] "Receiving" refers to the server receiving a quote from a carrier.

[0788] "List display" refers to organizing multiple estimate results and displaying them on one screen.

[0789] A floor plan is a drawing that shows the layout and dimensions of a room.

[0790] "Room dimensions" refers to the size of a room, such as its length, width, and height.

[0791] "Installation feasibility" refers to determining whether the furniture can be properly installed in the specified room.

[0792] "Notification" refers to sending information from the server to the terminal to notify the user.

[0793] The present invention is a system that allows a user to efficiently create a schedule from when they decide on a property until they move in, automatically list unwanted items, obtain estimates from moving companies, and determine whether the floor plan and furniture match. To implement the present invention, the following steps are taken.

[0794] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. The server generates events from a standard template based on the received property selection information and move-in date information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal to be displayed to the user.

[0795] As a specific example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving a moving company, the start date for packing, and the moving date, and display this on the user's device.

[0796] Next, when an unwanted item needs to be disposed of, the user uploads a photo of the unwanted item to the device. The device then sends the photo to a server, which uses image recognition technology (e.g., Tensorflow) to determine the item's category, condition, and estimated price. Based on this information, the server uses a generative AI model (e.g., GPT-3) to generate an appropriate product description and automatically lists the item on an e-commerce site. The listing information is then notified to the device and displayed to the user.

[0797] As a specific example, when a user uploads a photo of an old smartphone, the server categorizes it as a "used smartphone in good working condition," sets an appropriate price range, automatically lists it on an e-commerce site, and notifies the user that the listing is complete.

[0798] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The terminal sends this information to the server, which then estimates the amount of luggage based on the input information. Based on the estimated amount of luggage, the server then sends requests for quotes to multiple cooperating moving companies. The quotes received from each company are consolidated and displayed to the user via the terminal.

[0799] As a concrete example, when a user enters information about a sofa, bed, and dining table for a one-room apartment, the server estimates the amount of luggage, sends requests for quotes to multiple moving companies, and displays the results to the user.

[0800] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device sends this information to the server, which uses image recognition technology to analyze the floor plan and obtain the room dimensions. The dimensions of the furniture are compared with those of the room to determine whether it can be installed. The results are then sent to the device and displayed to the user.

[0801] For example, if a user uploads a floor plan of a living room with a large sofa, the server analyzes the floor plan and compares it with the sofa's dimensions. If it is difficult to install, the server notifies the device of the reason (e.g., the sofa will not fit through the door).

[0802] The above is a specific embodiment of the present invention. This system allows users to efficiently and accurately perform moving-related tasks. The use of generative AI models enables more advanced analysis and automation, reducing the burden on users.

[0803] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0804] Program processing steps

[0805] Creating a Schedule

[0806] Step 1:

[0807] The user enters property information (e.g., "Apartment A, Room 101") and the move-in date (e.g., two weeks later) into the terminal.

[0808] Input: Property information and move-in date

[0809] Output: User input data

[0810] Specific behavior: The user enters information into a form on the screen and clicks the submit button.

[0811] Step 2:

[0812] The terminal transmits the entered property decision information and move-in date information to the server.

[0813] Input: User-entered data

[0814] Output: Data sent from the device to the server

[0815] Specific operation: The device sends an HTTP POST request and sends the input data to the server.

[0816] Step 3:

[0817] The server analyzes the property decision information and move-in date information it receives.

[0818] Input: Property decision information and move-in date information sent to the server

[0819] Output: Analysis data

[0820] Specific operation: The server decodes the received data and analyzes it against the database.

[0821] Step 4:

[0822] The server searches for the corresponding event from the standard template and creates a schedule.

[0823] Input: Analysis data

[0824] Output: Initial schedule data

[0825] Specific operation: The server selects the appropriate event from a predefined template list and generates a schedule.

[0826] Step 5:

[0827] The schedule created by the server is converted into a calendar format.

[0828] Input: Initial schedule data

[0829] Output: Calendar format data

[0830] What happens: The server applies an algorithm to convert the schedule data into a standard format, such as Google Calendar format.

[0831] Step 6:

[0832] The server sends data in a calendar format to the terminal.

[0833] Input: Calendar format data

[0834] Output: Data sent to the terminal

[0835] Specific operation: The server sends calendar data to the device in an HTTP response.

[0836] Step 7:

[0837] The terminal formats the received schedule data for display and displays it to the user.

[0838] Input: Calendar format data sent to the terminal

[0839] Output: A viewable schedule

[0840] What happens: Your device formats the received data for display and displays it in the Calendar app.

[0841] Automatic listing of unwanted items

[0842] Step 1:

[0843] Users take a photo of an unwanted item (e.g., an old smartphone) using their device's camera, or select and upload an existing photo.

[0844] Input: Photo data of unwanted items

[0845] Output: User uploaded data

[0846] What happens: The user clicks the "Upload Photo" button in the app and selects or takes a photo.

[0847] Step 2:

[0848] The device sends the uploaded photo data to the server.

[0849] Input: User uploaded data

[0850] Output: Data sent from the device to the server

[0851] What happens: The device sends the photo data to the server using an HTTP POST request.

[0852] Step 3:

[0853] The server passes the received photo data to an image recognition algorithm for analysis.

[0854] Input: Photo data sent to the server

[0855] Output: Analysis results

[0856] What it does: The server uses Tensorflow to analyze the image and determine the category, condition, and estimated price.

[0857] Step 4:

[0858] The server generates a product description based on the analysis results.

[0859] Input: Analysis results

[0860] Output: Product description

[0861] What it does: The server generates product descriptions using a generative AI model (e.g., GPT-3).

[0862] Step 5:

[0863] The server automatically lists the generated product description on an electronic commerce site.

[0864] Input: Product description

[0865] Output: Notification of completion of listing on flea market site

[0866] Specific operation: The server uses the API of the e-commerce site to list the product and confirms that the listing is complete.

[0867] Step 6:

[0868] The server sends a notification of the completion of the listing to the terminal.

[0869] Input: Notification of listing completion from flea market site

[0870] Output: Data sent to the terminal

[0871] Specific operation: The server sends a listing completion notification to the terminal via HTTP response.

[0872] Step 7:

[0873] The terminal displays the received notification to the user.

[0874] Input: Listing completion notification sent to the terminal

[0875] Output: Display message

[0876] Specific behavior: The device displays the notification to the user as a pop-up message.

[0877] Get quotes from moving companies

[0878] Step 1:

[0879] The user selects the room layout information (e.g., 1K) on the input screen and enters furniture information (e.g., sofa, bed, dining table).

[0880] Input: Floor plan and furniture information

[0881] Output: User input data

[0882] Specific behavior: The user enters information into a form on the screen and clicks the submit button.

[0883] Step 2:

[0884] The terminal transmits the input floor plan information and furniture information to the server.

[0885] Input: User-entered data

[0886] Output: Data sent from the device to the server

[0887] Specific operation: The device sends an HTTP POST request and sends the input data to the server.

[0888] Step 3:

[0889] The server analyzes the floor plan and furniture information it receives and estimates the amount of cargo.

[0890] Input: Floor plan and furniture information sent to the server

[0891] Output: Load data

[0892] Specific operation: The server calculates the weight and volume based on the floor plan and furniture data.

[0893] Step 4:

[0894] The server sends a request for quote to multiple cooperating moving companies.

[0895] Input: Load data

[0896] Output: Request for quotation data from multiple vendors

[0897] Specific operation: The server sends an HTTP request to each supplier to request a quote.

[0898] Step 5:

[0899] The server consolidates the quotation results received from each supplier.

[0900] Input: Quote result data from vendor

[0901] Output: Integrated quote data

[0902] Specific operation: The server collects quote data from multiple vendors and consolidates it into a single list.

[0903] Step 6:

[0904] The server sends the integrated results to the terminal.

[0905] Input: Integrated quote data

[0906] Output: Data sent to the terminal

[0907] Specific operation: The server sends the integrated quotation data to the terminal in an HTTP response.

[0908] Step 7:

[0909] The terminal displays a list of the received estimate results and prompts the user to make a selection.

[0910] Input: Integrated quote data sent to the terminal

[0911] Output: Display options

[0912] Specific operation: The terminal organizes the quote results, displays them as a list, and offers the user options.

[0913] Determining compatibility between floor plan and furniture

[0914] Step 1:

[0915] The user uploads a floor plan and photos of furniture (e.g., a floor plan of a living room with a large sofa) to the device.

[0916] Input: Floor plan and furniture photos

[0917] Output: User uploaded data

[0918] What happens: The user clicks the "Upload Photo" button in the app and selects a photo.

[0919] Step 2:

[0920] The terminal sends the information to the server.

[0921] Input: User uploaded data

[0922] Output: Data sent from the device to the server

[0923] What happens: The device sends the floor plan and photo data to the server using an HTTP POST request.

[0924] Step 3:

[0925] The server analyzes the received floor plan data and obtains the dimensions of the rooms.

[0926] Input: Floor plan data sent to the server

[0927] Output: Room dimensions

[0928] What it does: The server uses image recognition technology to analyze the floor plan and obtain the length, width, and height.

[0929] Step 4:

[0930] The server compares the furniture's dimensions with the data and determines whether it can be installed.

[0931] Input: Room dimensions and furniture dimensions

[0932] Output: Installation success / failure result

[0933] What happens: The server runs an algorithm that compares the dimensions of the room with the dimensions of the furniture and determines whether it can be installed.

[0934] Step 5:

[0935] The server notifies the terminal of the determination result.

[0936] Input: Installation result

[0937] Output: Data sent to the terminal

[0938] Specific operation: The server sends the judgment result to the terminal in an HTTP response.

[0939] Step 6:

[0940] The terminal displays the received results to the user.

[0941] Input: Verification result sent to the terminal

[0942] Output: Display message

[0943] Specific operation: The device will display the judgment result to the user as a pop-up message, and if installation is difficult, will provide specific reasons.

[0944] These are the specific processing steps of this system. At each step, appropriate processing is performed based on the input data, and the results are passed on to the next step. Highly accurate analysis and automation are achieved by utilizing generative AI models and image recognition technology.

[0945] (Application example 1)

[0946] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0947] Moving involves a wide range of tasks, requiring many steps, from deciding on a property to arranging furniture in the new home, disposing of unnecessary items, and obtaining quotes from moving companies. While a system is needed to efficiently handle these steps, it is difficult to provide appropriate information in real time, especially when it comes to simulating furniture selection and placement in physical stores. This inconveniences users and makes the process leading up to a purchase decision inefficient. Additionally, disposing of unnecessary items and obtaining quotes from moving companies are both time-consuming and laborious, so a system capable of handling a series of moving-related tasks in an integrated manner is needed.

[0948] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0949] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the converted schedule to a terminal, means for receiving furniture placement information, means for determining whether furniture can be installed based on the furniture placement information, and means for notifying the user of the determination result. This enables the user to efficiently and comprehensively manage and execute a series of moving-related tasks, from selecting a property to moving in, selecting and placing furniture, disposing of unnecessary items, and obtaining quotes from moving companies.

[0950] "Property selection information" refers to detailed information about the property selected by the user, including the name, address, and room number of the property.

[0951] "Move-in date information" refers to the planned date on which the user moves into the property, and includes a specific date.

[0952] A "schedule" refers to a plan that outlines a series of tasks and events from deciding on a property to moving in.

[0953] "Calendar format" refers to a format in which the generated schedule is organized by date and displayed visually.

[0954] "Terminal" refers to an electronic device such as a computer or smartphone used by a user.

[0955] "Furniture placement information" refers to detailed information about the furniture that the user plans to install in their new home, including, for example, the dimensions and shape of the furniture.

[0956] "Installability" refers to the criteria and results used to determine whether furniture can be physically placed correctly in a specified space.

[0957] "Notification" refers to the act or means by which a system provides information to a user, including alerts and messages.

[0958] "Unwanted items" refers to unnecessary items that need to be disposed of when moving.

[0959] "Image recognition technology" refers to technology that analyzes image data such as photographs and videos and identifies specific objects or information.

[0960] "Flea market site" refers to an online marketplace where users can buy and sell goods.

[0961] "Quotation" A quotation is a document or information detailing the price and terms of the services to be provided by a moving company.

[0962] This invention is a system for efficiently managing and executing a series of tasks from when a user decides on a property until they move in. This system allows the user to smoothly move based on various data, from property decision information, move-in date information, furniture layout information, disposal of unwanted items, to obtaining quotes from moving companies. Each component of the system and its functions are explained in detail below.

[0963] System Program

[0964] 1. Receiving property decision information and move-in date information:

[0965] Users enter property selection information and move-in date information via their device (smartphone or computer) and send it to the server. The server receives this information and uses it as basic data for generating schedules.

[0966] 2. Generate the schedule:

[0967] Based on the property decision information and move-in date information, the server generates a schedule including events such as contract signing, moving-in and moving-out procedures, moving company reservations, the start date for packing, and the moving date. This schedule is converted into a calendar format and sent to the terminal.

[0968] 3. Dispose of unwanted items:

[0969] When a user uploads a photo of an unwanted item using their device, the photo is sent to a server. The server uses image recognition technology (e.g., Google Cloud Vision API) to determine the item's category, condition, and estimated price. It then uses a generative AI model to generate an appropriate product description and automatically lists the item on a flea market site (e.g., Mercari API). The listing information is then sent to the user's device.

[0970] 4. Get quotes from moving companies:

[0971] The user inputs the room layout and furniture information into the terminal and sends it to the server. The server uses this information to estimate the amount of luggage and sends requests for quotes to multiple moving companies. The received quotes are consolidated and displayed as a list on the user's terminal.

[0972] 5. Furniture placement simulation:

[0973] When a user uploads a floor plan and photos of furniture, the server analyzes this information and determines whether the furniture can be installed. The server uses image recognition technology to analyze the floor plan and obtain the room dimensions. The server compares the furniture dimensions with the room dimensions to determine whether the furniture can be installed and notifies the device of the result.

[0974] Hardware and Software Use

[0975] Hardware: Smartphones, computers

[0976] Cloud server: Amazon AWS

[0977] Image recognition technology: Google Cloud Vision API

[0978] Calendar API: Google Calendar API

[0979] AI model: OpenAI GPT-4

[0980] Flea market site API: Mercari API

[0981] Specific examples

[0982] A user selects a dining table in a physical store and sets the purchase date one week in the future. Then, they upload a photo of the old table they no longer need. They then upload a floor plan of their living room and a photo of the new dining table to run a simulation to see if it will fit in their room.

[0983] Prompt Sentence Examples

[0984] "A user has selected a dining table in a physical store and is planning to purchase it in a week. They uploaded a photo of the old table they no longer need. We'll analyze the floor plan of their living room and the photo of the new dining table to see if it will fit in their room."

[0985] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0986] Step 1:

[0987] The user inputs property selection information and move-in date information and sends it from the terminal to the server. The input data includes the property name, address, room number, expected move-in date, etc. The server receives this information and stores it in a database.

[0988] Step 2:

[0989] Based on the received property decision information and move-in date information, the server generates a schedule including events such as contract signing, moving-in and moving-out procedures, moving company reservations, the start date for packing, and the moving date. The generated schedule is converted into a calendar format.

[0990] Step 3:

[0991] The server sends the generated schedule in a calendar format to the terminal, which receives it and visually displays it to the user. The user can check the details of each event on the calendar and modify them as necessary.

[0992] Step 4:

[0993] To dispose of unwanted items, users upload photos of the items from their devices to the server. The input data includes images related to the item's category and condition. The server uses image recognition technology to determine the item's category, condition, and estimated price.

[0994] Step 5:

[0995] The server uses the results of image analysis to send prompts to the generative AI model, which then generates an appropriate product description. Based on the generated product description and price information, the product is automatically listed on a flea market site. The listing information is then sent to the user's device.

[0996] Step 6:

[0997] The user inputs the room layout and furniture information from their device and sends it to the server. The input data includes the floor plan and dimensions of each piece of furniture. The server then calculates the approximate load based on this information.

[0998] Step 7:

[0999] The server sends the estimated cargo volume information to multiple moving companies and requests quotes. The server consolidates the quotes received from the companies and sends them to the user's device in a list format. The user can compare these quotes and select the most suitable company.

[1000] Step 8:

[1001] The user uploads a floor plan of the room and photos of the new furniture they want to purchase from their device to the server. The input data includes images of the floor plan and photos of the furniture. The server then analyzes the floor plan using image recognition technology to obtain the dimensions of the room.

[1002] Step 9:

[1003] The server compares the acquired dimensional data with the furniture's dimensional data and determines whether the furniture can be installed. The server notifies the user of the result (whether it can be installed or not, and the reason why) and the user can check the result and select and arrange the appropriate furniture.

[1004] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1005] The present invention is a new moving support system that combines a function for recognizing a user's emotions and taking appropriate action based on the emotions. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following describes in detail the embodiments of the present invention.

[1006] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. At this point, the emotion engine runs and analyzes the emotion the user expressed when entering the information. This emotion information is also sent to the server.

[1007] The server generates events from a standard template based on the received property selection information, move-in date information, and emotion information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal for display. It is also possible to set reminders for specific events and optimize the content of the template based on the emotion information.

[1008] As a concrete example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving the moving company, the date to start packing, and the moving date, and if the user is feeling stressed, it will set frequent reminders and display these on the user's device.

[1009] Next, when it becomes necessary to dispose of unwanted items, the user uploads a photo of the unwanted item to the device. The device then sends the photo along with the user's emotional state to the server. The server uses image recognition technology to determine the item's category, condition, and estimated price. Based on this information and the user's emotional state, the server generates an appropriate product description and automatically lists the item on the flea market site. The listing information is then notified to the device and displayed to the user. It is also possible to adjust the price depending on the user's emotional state.

[1010] As a specific example, if a user uploads a photo of an old smartphone and the emotion engine determines that the user is in a hurry, the server will generate a product description at a low price aimed at an immediate sale, automatically list the item on a flea market site, and notify the user that the listing is complete.

[1011] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The device sends this information, along with the user's emotional state, to the server. The server estimates the amount of luggage based on the input information and simultaneously sends requests for quotes to multiple cooperating moving companies. Again, by taking emotional information into account, it is possible to select a company that will cause the least stress and determine the priority for displaying quotes. The quotes received from each company are consolidated and displayed to the user via the device.

[1012] As a concrete example, if a user inputs information about a sofa, bed, and dining table for a one-room apartment, and the emotion engine detects the user's anxiety, the server will prioritize displaying quotes from reliable contractors.

[1013] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device then sends this information along with the user's emotional state to the server. The server then uses image recognition technology to analyze the floor plan and obtain the room dimensions. It then compares the furniture dimensions with the room dimensions to determine whether the furniture can be installed. The results are then sent to the device and displayed to the user. It is also possible to adjust the timing and method of feedback based on the emotional information.

[1014] For example, if a user uploads a large sofa and a floor plan for their living room and the emotion engine detects their disappointment, the server will gently explain the impossibility notice and suggest alternatives.

[1015] The above is a specific embodiment for carrying out the present invention. This system allows users to perform moving-related tasks efficiently and accurately, while also receiving emotionally sensitive service.

[1016] The processing flow will be explained below.

[1017] ■ Create a schedule from the time you choose a room until you move in! (Create a table)

[1018] Step 1:

[1019] The user selects the property and move-in date through the terminal.

[1020] Step 2:

[1021] The emotion engine analyzes the emotion of the user's input.

[1022] Step 3:

[1023] The terminal transmits property decision information, move-in date information, and emotion information to the server.

[1024] Step 4:

[1025] The server stores the property decision information and move-in date information received.

[1026] Step 5:

[1027] The server generates events (contract signing, moving company booking, packing, moving day, etc.) from standard templates.

[1028] Step 6:

[1029] A schedule leading up to occupancy is created based on events generated by the server.

[1030] Step 7:

[1031] The server adjusts the reminder frequency and event details based on the emotion information.

[1032] Step 8:

[1033] The server converts the schedule into a calendar format.

[1034] Step 9:

[1035] The server transmits the generated schedule to the terminal.

[1036] Step 10:

[1037] The terminal displays the received schedule to the user.

[1038] ■ Sell your trash here! (Automatic Flea Market Listing)

[1039] Step 1:

[1040] The user takes a photo of the unwanted item and uploads it to the device.

[1041] Step 2:

[1042] The emotion engine analyzes the emotions of users when they upload photos.

[1043] Step 3:

[1044] The device sends the photo and emotional information to the server.

[1045] Step 4:

[1046] The server uses image recognition technology to analyze the photos it receives and determine the item's category, condition, and estimated price.

[1047] Step 5:

[1048] The server automatically generates a product description based on the item's category, condition, estimated price, and emotional information.

[1049] Step 6:

[1050] The server adjusts certain pricing based on emotional information (e.g., lower prices if you're in a hurry).

[1051] Step 7:

[1052] The server automatically lists the product using the flea market site API.

[1053] Step 8:

[1054] The server notifies the terminal of the listing information.

[1055] Step 9:

[1056] The terminal displays the listing information to the user.

[1057] ■ Get a quote from a moving company (approximate amount of luggage)

[1058] Step 1:

[1059] The user inputs the room layout information and furniture information into the terminal.

[1060] Step 2:

[1061] The emotion engine analyzes the emotion of the user's input.

[1062] Step 3:

[1063] The terminal transmits the floor plan information, furniture information, and emotion information to the server.

[1064] Step 4:

[1065] Based on the floor plan and furniture information received by the server, the volume and weight of the furniture are calculated and the cargo volume is estimated.

[1066] Step 5:

[1067] The server sends out quote requests to all the moving companies it works with.

[1068] Step 6:

[1069] The server takes emotional information into account when requesting a quote and prioritizes companies that cause the user less stress.

[1070] Step 7:

[1071] The server receives estimates from multiple moving companies.

[1072] Step 8:

[1073] The server consolidates the received estimate results and sends them to the terminal.

[1074] Step 9:

[1075] The terminal displays the list of quotes to the user.

[1076] ■ This furniture does not fit into the layout (image recognition)

[1077] Step 1:

[1078] Users upload photos of room floor plans and furniture.

[1079] Step 2:

[1080] The emotion engine analyzes the user's emotions when uploading.

[1081] Step 3:

[1082] The device sends the floor plan, photos of the furniture, and emotional information to the server.

[1083] Step 4:

[1084] The server analyzes the floor plan using image recognition technology.

[1085] Step 5:

[1086] The server retrieves the dimensions of each room.

[1087] Step 6:

[1088] The server compares the furniture dimensions with the dimensions of the acquired floor plan.

[1089] Step 7:

[1090] The server determines whether or not furniture can be placed.

[1091] Step 8:

[1092] The server adjusts the feedback method based on the emotional information (e.g., generating a gentle notification if the user is depressed).

[1093] Step 9:

[1094] The server transmits the determination result to the terminal and notifies the user.

[1095] Step 10:

[1096] The terminal displays the result of the judgment and the reason for it (e.g., oversized) to the user.

[1097] Example 2

[1098] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1099] Conventional moving support systems do not take into account the user's emotional state and are unable to reduce the user's stress and anxiety. Furthermore, they do not provide optimal suggestions based on the user's emotions when it comes to disposing of unwanted items or selecting a moving company, making it difficult to increase user satisfaction. Furthermore, while there is a demand for accurate schedules to be created based on information entered by the user and for notifications to be made at the appropriate time, conventional technologies have difficulty achieving this.

[1100] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1101] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for analyzing the user's emotional state based on the property selection information and the move-in date information, means for generating events and creating a schedule based on the analyzed emotional state, means for converting the generated schedule into a calendar format, and means for transmitting the converted schedule to the terminal. This enables moving support that takes the user's emotions into consideration, and realizes timely notifications while reducing the user's stress and anxiety.

[1102] In this invention, the server includes means for receiving images of unwanted items from a user, means for analyzing the received images and determining the category, condition, and estimated price of the items, means for automatically generating product descriptions based on the user's emotional state and listing the items on an e-commerce platform, and means for notifying the terminal of the listing information. This allows optimal suggestions based on the user's emotions when disposing of unwanted items, reducing the burden on the user.

[1103] In this invention, the server includes a means for receiving room layout information and furniture information from the user, a means for estimating the transportation amount based on the received information, a means for transmitting the estimated transportation amount information to the service provider and receiving the estimate, and a means for displaying the received estimates in a list on the terminal. This makes it possible to prioritize and display estimates from reliable companies taking into account the user's emotional information, thereby helping the user select an appropriate moving company while reducing their anxiety.

[1104] The "property selection information" is information about the residential property selected by the user, including detailed information such as the address and room number.

[1105] "Move-in date information" is information indicating the date on which the user plans to move into a new residential property.

[1106] "User's emotional state" is information that indicates the emotional state of the user when using the system, and includes emotions such as stress, anxiety, and hurry.

[1107] "Events" are specific tasks and activities related to moving, such as signing contracts, booking movers, and starting packing.

[1108] A "schedule" is a plan that arranges all events related to the user's move in appropriate timing.

[1109] A "calendar format" is a format that visually displays a schedule along a date or time axis.

[1110] A "terminal" is a device that a user uses to input information or receive and view information sent from the system. Examples include smartphones and personal computers.

[1111] "Unwanted items" are items that a user wants to dispose of when moving, such as an old smartphone or furniture.

[1112] "Images" refers to data that contains visual information, such as photos of unwanted items or floor plans of rooms.

[1113] "Category" is classification information that indicates the type of item, such as electronic equipment, furniture, and clothing.

[1114] "Condition" is information indicating the storage and usage status of the unwanted item, such as new, used, damaged, etc.

[1115] "Estimated price" is information indicating the market value of the analyzed item.

[1116] "Product description" refers to the description used when listing unwanted items on an e-commerce platform.

[1117] An "e-commerce platform" is a website or application through which goods are bought and sold online.

[1118] "Layout information" refers to information about the layout and arrangement of a room, including, for example, the size and shape of the room, and the arrangement of furniture.

[1119] "Furniture information" is information indicating the type, size, quantity, etc. of furniture owned by the user.

[1120] "Transportation volume" is information that roughly estimates the total amount of luggage to be transported when the user moves.

[1121] A "service provider" is a company that provides moving services to users.

[1122] MODE FOR CARRYING OUT THE INVENTION

[1123] The present invention is a moving support system that recognizes the user's emotions and takes appropriate action based on the emotions. Specific embodiments of this system will be described below.

[1124] Deciding on the property and setting the move-in date

[1125] User: Enter property selection information and move-in date information into the terminal. For example, enter "Apartment A, Room 101" and "Move-in date in two weeks."

[1126] Terminal: In addition to the entered property decision information and move-in date information, the user's emotional state is analyzed using an emotion analysis engine (e.g., IBM Watson), and the results are sent to the server.

[1127] Server: Based on the received information, it generates events from standard templates, creates schedules, converts them into a calendar format, and sends them back to the device, so that reminders can be sent to the user at the appropriate time.

[1128] Example: If a user is moving into "A Apartment, Room 101" in two weeks, the server generates a schedule including the contract signing, moving company booking, and the start date for packing. If the server detects that the user is stressed, it sets frequent reminders.

[1129] Disposal of unnecessary items

[1130] User: Upload an image of the unwanted item to the device, for example, upload a photo from an old smartphone.

[1131] Device: Sends the user's emotional state along with the uploaded image to the server.

[1132] Server: Uses image recognition technology (e.g., TensorFlow) to determine the item's category, condition, and estimated price, and generates a product description based on the user's emotional state. The description is then automatically listed on an e-commerce platform (e.g., Mercari).

[1133] Terminal: Receives listing completion information and notifies the user.

[1134] Example: If a user uploads an old smartphone and the emotion engine determines that the user is in a hurry, the server generates a product description at a low price and automatically lists the item on a flea market site for immediate sale. The server notifies the user that the listing is complete.

[1135] Get quotes from moving companies

[1136] User: Enters room layout and furniture information into the terminal. For example, enters information about a sofa, bed, and dining table for a one-room apartment.

[1137] Terminal: Sends the user's emotional state along with the input information to the server.

[1138] Server: Based on the input information, the server estimates the amount of goods to be transported and sends requests for quotes to multiple moving companies simultaneously. The information is used to select the most appropriate company.

[1139] Terminal: The estimates received from each supplier are consolidated and sent to the terminal, where they are displayed as a list to the user.

[1140] Example: If a user inputs a sofa, bed, and dining table into a one-room apartment, and concerns are detected, quotes from reliable contractors will be displayed first.

[1141] Determine whether furniture can be installed

[1142] User: Upload a room floor plan and photos of furniture to the device. For example, upload a floor plan of a living room with a large sofa.

[1143] Terminal: Sends the uploaded information and the user's emotional state to the server.

[1144] Server: Analyzes the floor plan using image recognition technology to obtain the dimensions of the room. It compares the dimensions of the furniture with the dimensions of the room to determine whether it can be installed and sends the result to the device.

[1145] Device: The result of whether installation is possible or not is displayed to the user, and the timing and method of feedback are adjusted based on emotional information.

[1146] Example: If a user uploads a large sofa and a floor plan for their living room, and the emotion engine detects disappointment, the server can gently explain the impossibility notice and suggest alternatives.

[1147] Examples of prompts for generative AI models

[1148] 1. Setting reminders based on emotion information: "Generate a schedule reminder for a user who is moving to Apartment 101 in two weeks and is feeling stressed."

[1149] 2. Product Description Generation: "Generate a low-cost product description for an older smartphone for a user in a hurry."

[1150] 3. Display quotes from reliable movers: "For a user who is worried about moving to a one-room apartment with lots of furniture, please prioritize displaying quotes from reliable movers."

[1151] 4. Unavailable notifications and suggestions: “Generate a friendly notification suggesting alternatives for a disappointed user who uploads a large sofa and living room floor plan.”

[1152] The above is a specific embodiment for carrying out the invention.

[1153] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1154] Deciding on the property and setting the move-in date

[1155] Step 1: The user enters the property selection information and move-in date information into the terminal.

[1156] Input: Property information (e.g., "Apartment A, Room 101") and move-in date information (e.g., "Move-in date in two weeks")

[1157] Operation: Enter property selection information and move-in date information into the input form on the device.

[1158] Step 2: The device sends the input information to the server

[1159] Input: Property decision information, move-in date information, user's emotional state

[1160] Data calculation: Analyzes the user's emotional state from input information using an emotion analysis engine.

[1161] Output: Property decision information, move-in date information, and analyzed emotional state sent to the server

[1162] Step 3: Server generates and schedules events

[1163] Input: Property decision information, move-in date information, emotional state

[1164] Data calculation: Generate events from standard templates and create schedules based on them. The schedules are converted into a calendar format.

[1165] Output: The generated schedule

[1166] Step 4: The server sends the schedule to the device

[1167] Input: Generated schedule

[1168] What it does: Converts the schedule into a calendar format and sends it to the device.

[1169] Output: Schedule displayed on the terminal

[1170] Disposal of unnecessary items

[1171] Step 1: User uploads a photo of unwanted items to the device

[1172] Input: Image of unwanted item (e.g., photo of old smartphone)

[1173] What it does: Uploads an image using the device's image upload functionality.

[1174] Step 2: The device sends the image and emotional state to the server.

[1175] Input: uploaded image, user emotional state

[1176] Data calculation: Performs image analysis and sentiment analysis.

[1177] Output: Image, emotional state sent to server

[1178] Step 3: The server analyzes the image and generates a product description

[1179] Input: Image, emotional state

[1180] Data Computing: Using image recognition technology (e.g., TensorFlow) to determine an item's category, condition, and estimated price, and generate product descriptions based on the customer's emotional state.

[1181] Output: Product description, automatically generated listing information

[1182] Step 4: The server sends the product description and listing information to the e-commerce platform

[1183] Input: Product description, listing information

[1184] What it does: Sends product description and listing information to an e-commerce platform (e.g., Mercari).

[1185] Output: Information on items listed on flea market sites

[1186] Step 5: The server sends the listing completion information to the device.

[1187] Input: Listing completion information

[1188] Action: Sends a notification to the device that the listing is complete.

[1189] Output: Notification of successful listing displayed on your device

[1190] Get quotes from moving companies

[1191] Step 1: The user inputs the room layout and furniture information into the terminal.

[1192] Input: Room layout information, furniture information (e.g., 1K floor plan, sofa, bed, dining table)

[1193] Operation: Enter room layout and furniture information into the input form on the device.

[1194] Step 2: The device sends information and emotional state to the server

[1195] Input: Room layout information, furniture information, emotional state

[1196] Data calculation: Performs data processing for sentiment analysis and layout information.

[1197] Output: Layout information, furniture information, and emotional state sent to the server

[1198] Step 3: The server estimates the transport volume and sends a quote request

[1199] Input: Layout information, furniture information, emotional state

[1200] Data calculation: The amount of transportation is estimated based on layout information and furniture information, and quote requests are sent simultaneously to multiple service providers.

[1201] Output: Request for quote

[1202] Step 4: The server receives and consolidates the quote results

[1203] Input: Quotation results from each service provider

[1204] Data calculation: Integrates the estimates and selects the best result based on sentiment information.

[1205] Output: Consolidated quotation results

[1206] Step 5: The device will list the information

[1207] Input: Consolidated quote results

[1208] Operation: Displays the consolidated estimate results in a list on the terminal.

[1209] Output: Estimate results displayed on the terminal

[1210] Determine whether furniture can be installed

[1211] Step 1: The user uploads a floor plan and photos of the furniture to their device.

[1212] Input: Floor plan of the room, photos of furniture (e.g., a photo of a large sofa)

[1213] How it works: Upload photos of floor plans and furniture using the device's image upload feature.

[1214] Step 2: The device sends information and emotional state to the server

[1215] Input: Floor plan, furniture photos, emotional state

[1216] Data calculation: Performs image analysis and sentiment analysis.

[1217] Output: Floor plan, furniture photos, and emotional state sent to the server

[1218] Step 3: The server analyzes the dimensions and determines whether it can be installed.

[1219] Input: Floor plan, furniture photos, emotional state

[1220] Data calculation: Using image recognition technology, the floor plan is analyzed to obtain the dimensions of the room. The dimensions of the furniture are compared with those of the room to determine whether it can be installed.

[1221] Output: Installation success / failure result

[1222] Step 4: The server sends the results to the device

[1223] Input: Installation result

[1224] Operation: Sends the result of whether installation is possible or not to the terminal.

[1225] Output: The installation result displayed on the device

[1226] Step 5: The device displays feedback to the user

[1227] Input: Possible placement result, feedback based on emotional state

[1228] What it does: Shows the user the results of whether it's installed or not, and adjusts the timing and content of notifications based on their emotional state.

[1229] Output: Feedback that is displayed to the user

[1230] The above is the detailed flow and specific operations of each processing step.

[1231] (Application example 2)

[1232] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1233] Conventional moving support systems did not take users' emotions into consideration and lacked effective means to reduce user stress. As a result, moving operations were often psychologically stressful. Furthermore, there was no system that recognized the emotions of factory employees and provided appropriate work instructions or support, making it difficult to efficiently improve productivity. To address these issues, there is a need to provide optimal support based on the emotional information of users and employees.

[1234] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the converted schedule to a terminal, means for analyzing user emotion information, and means for optimizing the schedule and reminders based on the emotion information. This enables an optimal moving support service to be provided according to the user's emotional state.

[1235] The server also includes means for receiving photos of unwanted items from users, means for analyzing the received photos of unwanted items and determining the category, condition, and estimated price of the items, means for listing automatically generated product descriptions on the flea market site, means for notifying the terminal of the listing information, and means for analyzing user emotional information and optimizing the product descriptions and prices based on the emotional information, thereby enabling unwanted items to be listed efficiently and quickly.

[1236] The server further includes means for receiving room layout information and furniture information from the user, means for estimating the amount of cargo based on the received information, means for transmitting the estimated amount of cargo information to the moving company and receiving an estimate, means for displaying the received estimates in a list on the terminal, and means for analyzing the user's emotional information and optimizing company selection and estimate display based on the emotional information, thereby enabling the user to obtain and select estimates from moving companies while reducing stress.

[1237] Furthermore, the server includes a means for providing appropriate work instructions and support according to the user's emotional state, and a means for displaying the work instructions and support on the terminal, thereby enabling optimal work support to be provided according to the emotional state of the factory employees, thereby improving productivity.

[1238] "Property selection information" is information about the property selected by the user, and includes the property's address, room number, building name, and the like.

[1239] "Move-in date information" is information about the date on which the user plans to move into the newly selected property.

[1240] A "schedule" is a timetable or plan created based on property selection information and move-in date information, and includes tasks and events related to moving.

[1241] "Calendar format" organizes the generated schedule by date and makes it possible to display it in a general calendar format.

[1242] "Terminal" refers to electronic devices used by users, such as smartphones, personal computers, and tablets.

[1243] "Emotion information" is data that indicates the user's emotional state and is analyzed using emotion recognition technology.

[1244] "Reminder" is a function for notifying users of tasks or events, and notifications are sent based on specific times or conditions.

[1245] "Photos of unwanted items" are image data of items that the user wishes to dispose of or sell when moving.

[1246] A "flea market site" refers to an online marketplace that users use to sell unwanted items.

[1247] "Product description" refers to the description of a product that is displayed when selling an item on a flea market site.

[1248] "Floor plan information" is information relating to the structure and layout of a room, including floor plans and room dimensions.

[1249] "Furniture information" is information about the furniture to be carried to the new home, including the type, dimensions, quantity, etc. of the furniture.

[1250] "Cargo volume" refers to the total weight or volume of the items being transported during a move.

[1251] "Moving company" refers to a company that provides moving-related services.

[1252] "Quotation" means a written estimate of the cost of the moving work provided by the moving company.

[1253] A "work instruction" is an instruction given to an employee regarding a specific task or job.

[1254] "Assistance" refers to auxiliary support provided to help users or employees perform their tasks.

[1255] To implement this invention, the server first receives property selection information and move-in date information from the user. The server then generates a schedule based on this information and converts it into a calendar format. The converted schedule is then sent to the terminal and displayed to the user. The server also obtains the user's emotional state at the time of input and optimizes the schedule and reminders based on this information.

[1256] The server also receives photos of unwanted items from users and analyzes them to determine the item's category, condition, and estimated price. The server automatically generates a product description based on this information and lists the item on the flea market site. The listing information is then sent to the user's device. Here, the server also analyzes emotional information and optimizes the product description and selling price based on the user's emotions.

[1257] In addition, when the user provides information about the room layout and furniture, the server receives this information and estimates the amount of luggage. The server then sends the estimated amount of luggage information to the moving company and receives quotes from several companies. The received quotes are displayed as a list on the device. The server takes emotional information into consideration and recommends the most suitable moving company.

[1258] In a factory, a specific example would be a device or robot recognizing an employee's emotional state and providing appropriate work instructions or assistance. The employee's face is captured by a camera and their emotions are analyzed using an emotion recognition model. Based on the analysis results, the device or robot displays work instructions or assistance details.

[1259] The system's main software includes an emotion recognition model using Keras, an image processing system using OpenCV, and Python for data analysis. The user's device and server are standard PCs and smartphones. Using a generative AI model and prompts, the system generates optimal feedback and support sentences based on the user's emotional state.

[1260] For example, if the emotion recognition model determines that the user is feeling down, the server will display a kind notification and send an encouraging message to the user. If the emotion recognition model determines that a factory worker is feeling tired, the work robot will display a supportive message such as "Please take a short break."

[1261] Example prompts to input to a generative AI model:

[1262] "Create a prompt that generates appropriate work instructions when an employee is sad."

[1263] "Create a prompt that generates a message to reduce employee stress."

[1264] This allows optimal support according to the emotional state of the user and employees, reducing stress and enabling more efficient work.

[1265] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1266] Step 1:

[1267] The user inputs property selection information and move-in date information into the terminal and transmits it to the server.

[1268] Input: Property decision information (e.g., "Apartment A, Room 101"), move-in date information (e.g., May 1, 2023).

[1269] Data processing: This information is converted into an appropriate format and sent to the server along with the user's emotional information.

[1270] Output: Property decision information, move-in date information, and sentiment information sent to the server.

[1271] Step 2:

[1272] The server analyzes the received property decision information, move-in date information, and emotion information to generate a schedule.

[1273] Input: Property decision information, move-in date information, and sentiment information.

[1274] Data calculation: A schedule generation algorithm is used to calculate a series of tasks (e.g., signing a contract, booking a moving company, etc.) and adjust the frequency of reminders based on the user's emotions.

[1275] Output: The generated schedule.

[1276] Step 3:

[1277] The generated schedule is converted into a calendar format and sent to the terminal.

[1278] Input: The generated schedule.

[1279] Data processing: Convert schedules into standard calendar format.

[1280] Output: The converted schedule is displayed on the terminal.

[1281] Step 4:

[1282] The user uploads a photo of the unwanted item to the terminal and sends it to the server.

[1283] Input: A photo of your unwanted item (e.g., an image of your old smartphone).

[1284] Data processing: The user's emotional information is sent to the server along with the photo data.

[1285] Output: Photo data and emotion information sent to the server.

[1286] Step 5:

[1287] The server analyzes the photos of the unwanted items it receives to determine the item's category, condition, and estimated value.

[1288] Input: Photos of unwanted items, emotional information.

[1289] Data calculation: Analyzes product information using image recognition technology and optimizes prices and product descriptions based on emotional information.

[1290] Output: Item category, condition, estimated price, optimized product description.

[1291] Step 6:

[1292] The automatically generated product description is put up for sale on a flea market site, and the listing information is notified to the terminal.

[1293] Input: Optimized product description.

[1294] Data calculation: Automates the process of listing items on flea market sites and generates listing completion information.

[1295] Output: Listing completion information sent to the device.

[1296] Step 7:

[1297] The user inputs the room layout information and furniture information into the terminal and transmits it to the server.

[1298] Input: Room layout information, furniture information.

[1299] Data processing: The user's emotional information is sent to the server along with floor plan and furniture information.

[1300] Output: Floor plan information, furniture information, and emotion information sent to the server.

[1301] Step 8:

[1302] The server estimates the amount of cargo based on the received information and sends requests for quotes to multiple cooperating moving companies.

[1303] Input: Floor plan information, furniture information, and emotion information.

[1304] Data calculation: Calculate the total weight and volume of the package and send a quote request using a contractor selection algorithm.

[1305] Output: The estimate provided.

[1306] Step 9:

[1307] The server aggregates the received quotes and prioritizes the best quote based on the sentiment information.

[1308] Input: Quote received.

[1309] Data calculation: Analyze quotes and prioritize them based on reliability and price.

[1310] Output: Consolidated quotes listed on the terminal.

[1311] Step 10:

[1312] The terminal or robot recognizes the employee's emotional state and provides appropriate work instructions or assistance.

[1313] Input: Employee video data.

[1314] Data calculation: Analyze emotions using facial recognition technology and emotion recognition models to generate optimal work instructions.

[1315] Output: Work instructions and assistance messages displayed on the terminal or robot.

[1316] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1317] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1318] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1319] [Third embodiment]

[1320] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1321] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1322] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1323] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1324] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1325] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1326] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1327] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1328] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1329] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1330] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1331] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1332] The present invention is a system for efficiently creating a schedule from when a user decides on a property until they move in, automatically listing unwanted items, obtaining estimates from moving companies, and determining whether the floor plan and furniture match. A detailed description of an embodiment of the present invention is provided below.

[1333] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. The server generates events from a standard template based on the received property selection information and move-in date information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal to be displayed to the user.

[1334] As a specific example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving a moving company, the start date for packing, and the moving date, and display this on the user's device.

[1335] Next, when an unwanted item needs to be disposed of, the user uploads a photo of the unwanted item to the device. The device then sends the photo to the server, which uses image recognition technology to determine the item's category, condition, and estimated price. Based on this information, the server generates an appropriate product description and automatically lists the item on the flea market site. The listing information is then notified to the device and displayed to the user.

[1336] As a specific example, when a user uploads a photo of an old smartphone, the server categorizes it as a "used smartphone in good working order," sets an appropriate price range, automatically lists it on a flea market site, and notifies the user that the listing is complete.

[1337] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The terminal sends this information to the server, which then estimates the amount of luggage based on the input information. Based on the estimated amount of luggage, the server then sends requests for quotes to multiple cooperating moving companies. The quotes received from each company are consolidated and displayed to the user via the terminal.

[1338] As a concrete example, when a user enters information about a sofa, bed, and dining table for a one-room apartment, the server estimates the amount of luggage, sends requests for quotes to multiple moving companies, and displays the results to the user.

[1339] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device sends this information to the server, which uses image recognition technology to analyze the floor plan and obtain the room dimensions. The dimensions of the furniture are compared with those of the room to determine whether it can be installed. The results are then sent to the device and displayed to the user.

[1340] For example, if a user uploads a floor plan of a living room with a large sofa, the server analyzes the floor plan and compares it with the sofa's dimensions. If it is difficult to install, the server notifies the device of the reason (e.g., the sofa will not fit through the door).

[1341] The above is a concrete embodiment for carrying out the present invention. This system allows users to perform moving-related tasks efficiently and accurately.

[1342] The processing flow will be explained below.

[1343] ■ Create a schedule from the time you choose a room until you move in! (Create a table)

[1344] Step 1:

[1345] The user selects the property and move-in date through the terminal.

[1346] Step 2:

[1347] The terminal sends the property information and move-in date to the server.

[1348] Step 3:

[1349] The server stores the property information and move-in date information it receives.

[1350] Step 4:

[1351] The server generates events (contract signing, moving company booking, packing, moving date, etc.) from standard templates.

[1352] Step 5:

[1353] A schedule leading up to occupancy is created based on events generated by the server.

[1354] Step 6:

[1355] The server converts the schedule into a calendar format.

[1356] Step 7:

[1357] The server transmits the generated schedule to the terminal.

[1358] Step 8:

[1359] The terminal displays the received schedule to the user.

[1360] ■ Sell your trash here! (Automatic Flea Market Listing)

[1361] Step 1:

[1362] The user takes a photo of the unwanted item and uploads it to the device.

[1363] Step 2:

[1364] The device sends the photo to the server.

[1365] Step 3:

[1366] The server uses image recognition technology to analyze the photos it receives and determine the item's category, condition, and estimated price.

[1367] Step 4:

[1368] The server automatically generates a product description based on the item's category, condition, and estimated price.

[1369] Step 5:

[1370] The server automatically lists the product using the flea market site API.

[1371] Step 6:

[1372] The server notifies the terminal of the listing information.

[1373] Step 7:

[1374] The terminal displays the listing information to the user.

[1375] ■ Get a quote from a moving company (approximate amount of luggage)

[1376] Step 1:

[1377] The user inputs the room layout information and furniture information into the terminal.

[1378] Step 2:

[1379] The terminal sends the input information to the server.

[1380] Step 3:

[1381] Based on the floor plan and furniture information received by the server, the volume and weight of the furniture are calculated and the cargo volume is estimated.

[1382] Step 4:

[1383] The server sends out quote requests to all the moving companies it works with.

[1384] Step 5:

[1385] The server receives estimates from multiple moving companies.

[1386] Step 6:

[1387] The server consolidates the received estimate results and sends them to the terminal.

[1388] Step 7:

[1389] The terminal displays the list of quotes to the user.

[1390] ■ This furniture does not fit into the layout (image recognition)

[1391] Step 1:

[1392] Users upload photos of room floor plans and furniture.

[1393] Step 2:

[1394] The device sends floor plans and photos of furniture to the server.

[1395] Step 3:

[1396] The server analyzes the floor plan using image recognition technology.

[1397] Step 4:

[1398] The server retrieves the dimensions of each room.

[1399] Step 5:

[1400] The server compares the furniture dimensions with the dimensions of the acquired floor plan.

[1401] Step 6:

[1402] The server determines whether or not furniture can be placed.

[1403] Step 7:

[1404] The server transmits the determination result to the terminal and notifies the user.

[1405] Step 8:

[1406] The terminal displays the judgment result and the reason (such as oversized) to the user.

[1407] Example 1

[1408] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1409] Previously, preparing for a move and creating a schedule required many manual steps, which was time-consuming and labor-intensive. Furthermore, tasks such as disposing of unnecessary items, obtaining quotes from moving companies, and determining whether furniture and the floor plan are compatible had to be handled individually, making efficient move preparations difficult. A system was needed that would centralize and automate these processes, significantly reducing the burden on users.

[1410] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1411] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the calendar format to the terminal, means for receiving photos of unwanted items from the user, means for analyzing the received photos of the unwanted items and determining the category, condition, and estimated price of the items, means for listing automatically generated product descriptions on an e-commerce site, means for notifying the terminal of the listing information, means for receiving room layout information and furniture information from the user, means for estimating the amount of cargo based on the received information, means for transmitting the estimated amount of cargo information to a carrier and receiving an estimate, means for displaying the received estimates in a list on the terminal, means for receiving room layout diagrams and photos of furniture from the user, means for analyzing the received floor plan and obtaining the dimensions of the room, means for comparing with furniture dimension data to determine whether the furniture can be installed, and means for notifying the terminal of the determination result. This makes it possible to centralize and automate a series of processes, such as creating a moving schedule, automatically listing unwanted items, obtaining quotes from moving companies, and determining whether furniture and floor plans are compatible.

[1412] "Property selection information" refers to detailed information about the property selected by the user.

[1413] "Move-in date information" refers to information about the date on which the user plans to move into their new home.

[1414] The "schedule" refers to a series of events and plans related to the user's preparations for moving.

[1415] A "calendar format" is a schedule converted into a format that can be viewed visually.

[1416] A "terminal" refers to an electronic device used by a user, such as a computer, smartphone, or tablet.

[1417] "Unnecessary items" are items that the user will not take with them when moving.

[1418] "Photographs" refer to image data that visually records unwanted items and floor plans.

[1419] "Analysis" refers to the process of analyzing information based on received data and determining its category, status, etc.

[1420] "Item category" refers to classification information regarding the type of unwanted item that has been analyzed.

[1421] "Estimated price" refers to the expected selling price of the item calculated based on the analysis results.

[1422] "Product description" refers to a detailed description of a product that is listed on an e-commerce site.

[1423] An "e-commerce site" is a platform for buying and selling goods online.

[1424] "Floor plan information" refers to information about the structure and layout of rooms.

[1425] "Furniture information" refers to detailed information about the furniture to be placed in the room.

[1426] "Cargo volume" refers to the total amount of items being transported when moving.

[1427] "Motoring Agent" means the transportation service provider handling your move.

[1428] An "estimate" is the price and services offered by a moving company for moving work.

[1429] "Receiving" refers to the server receiving a quote from a carrier.

[1430] "List display" refers to organizing multiple estimate results and displaying them on one screen.

[1431] A floor plan is a drawing that shows the layout and dimensions of a room.

[1432] "Room dimensions" refers to the size of a room, such as its length, width, and height.

[1433] "Installation feasibility" refers to determining whether the furniture can be properly installed in the specified room.

[1434] "Notification" refers to sending information from the server to the terminal to notify the user.

[1435] The present invention is a system that allows a user to efficiently create a schedule from when they decide on a property until they move in, automatically list unwanted items, obtain estimates from moving companies, and determine whether the floor plan and furniture match. To implement the present invention, the following steps are taken.

[1436] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. The server generates events from a standard template based on the received property selection information and move-in date information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal to be displayed to the user.

[1437] As a specific example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving a moving company, the start date for packing, and the moving date, and display this on the user's device.

[1438] Next, when an unwanted item needs to be disposed of, the user uploads a photo of the unwanted item to the device. The device then sends the photo to a server, which uses image recognition technology (e.g., Tensorflow) to determine the item's category, condition, and estimated price. Based on this information, the server uses a generative AI model (e.g., GPT-3) to generate an appropriate product description and automatically lists the item on an e-commerce site. The listing information is then notified to the device and displayed to the user.

[1439] As a specific example, when a user uploads a photo of an old smartphone, the server categorizes it as a "used smartphone in good working condition," sets an appropriate price range, automatically lists it on an e-commerce site, and notifies the user that the listing is complete.

[1440] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The terminal sends this information to the server, which then estimates the amount of luggage based on the input information. Based on the estimated amount of luggage, the server then sends requests for quotes to multiple cooperating moving companies. The quotes received from each company are consolidated and displayed to the user via the terminal.

[1441] As a concrete example, when a user enters information about a sofa, bed, and dining table for a one-room apartment, the server estimates the amount of luggage, sends requests for quotes to multiple moving companies, and displays the results to the user.

[1442] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device sends this information to the server, which uses image recognition technology to analyze the floor plan and obtain the room dimensions. The dimensions of the furniture are compared with those of the room to determine whether it can be installed. The results are then sent to the device and displayed to the user.

[1443] For example, if a user uploads a floor plan of a living room with a large sofa, the server analyzes the floor plan and compares it with the sofa's dimensions. If it is difficult to install, the server notifies the device of the reason (e.g., the sofa will not fit through the door).

[1444] The above is a specific embodiment of the present invention. This system allows users to efficiently and accurately perform moving-related tasks. The use of generative AI models enables more advanced analysis and automation, reducing the burden on users.

[1445] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1446] Program processing steps

[1447] Creating a Schedule

[1448] Step 1:

[1449] The user enters property information (e.g., "Apartment A, Room 101") and the move-in date (e.g., two weeks later) into the terminal.

[1450] Input: Property information and move-in date

[1451] Output: User input data

[1452] Specific behavior: The user enters information into a form on the screen and clicks the submit button.

[1453] Step 2:

[1454] The terminal transmits the entered property decision information and move-in date information to the server.

[1455] Input: User-entered data

[1456] Output: Data sent from the device to the server

[1457] Specific operation: The device sends an HTTP POST request and sends the input data to the server.

[1458] Step 3:

[1459] The server analyzes the property decision information and move-in date information it receives.

[1460] Input: Property decision information and move-in date information sent to the server

[1461] Output: Analysis data

[1462] Specific operation: The server decodes the received data and analyzes it against the database.

[1463] Step 4:

[1464] The server searches for the corresponding event from the standard template and creates a schedule.

[1465] Input: Analysis data

[1466] Output: Initial schedule data

[1467] Specific operation: The server selects the appropriate event from a predefined template list and generates a schedule.

[1468] Step 5:

[1469] The schedule created by the server is converted into a calendar format.

[1470] Input: Initial schedule data

[1471] Output: Calendar format data

[1472] What happens: The server applies an algorithm to convert the schedule data into a standard format, such as Google Calendar format.

[1473] Step 6:

[1474] The server sends data in a calendar format to the terminal.

[1475] Input: Calendar format data

[1476] Output: Data sent to the terminal

[1477] Specific operation: The server sends calendar data to the device in an HTTP response.

[1478] Step 7:

[1479] The terminal formats the received schedule data for display and displays it to the user.

[1480] Input: Calendar format data sent to the terminal

[1481] Output: A viewable schedule

[1482] What happens: Your device formats the received data for display and displays it in the Calendar app.

[1483] Automatic listing of unwanted items

[1484] Step 1:

[1485] Users take a photo of an unwanted item (e.g., an old smartphone) using their device's camera, or select and upload an existing photo.

[1486] Input: Photo data of unwanted items

[1487] Output: User uploaded data

[1488] What happens: The user clicks the "Upload Photo" button in the app and selects or takes a photo.

[1489] Step 2:

[1490] The device sends the uploaded photo data to the server.

[1491] Input: User uploaded data

[1492] Output: Data sent from the device to the server

[1493] What happens: The device sends the photo data to the server using an HTTP POST request.

[1494] Step 3:

[1495] The server passes the received photo data to an image recognition algorithm for analysis.

[1496] Input: Photo data sent to the server

[1497] Output: Analysis results

[1498] What it does: The server uses Tensorflow to analyze the image and determine the category, condition, and estimated price.

[1499] Step 4:

[1500] The server generates a product description based on the analysis results.

[1501] Input: Analysis results

[1502] Output: Product description

[1503] What it does: The server generates product descriptions using a generative AI model (e.g., GPT-3).

[1504] Step 5:

[1505] The server automatically lists the generated product description on an electronic commerce site.

[1506] Input: Product description

[1507] Output: Notification of completion of listing on flea market site

[1508] Specific operation: The server uses the API of the e-commerce site to list the product and confirms that the listing is complete.

[1509] Step 6:

[1510] The server sends a notification of the completion of the listing to the terminal.

[1511] Input: Notification of listing completion from flea market site

[1512] Output: Data sent to the terminal

[1513] Specific operation: The server sends a listing completion notification to the terminal via HTTP response.

[1514] Step 7:

[1515] The terminal displays the received notification to the user.

[1516] Input: Listing completion notification sent to the terminal

[1517] Output: Display message

[1518] Specific behavior: The device displays the notification to the user as a pop-up message.

[1519] Get quotes from moving companies

[1520] Step 1:

[1521] The user selects the room layout information (e.g., 1K) on the input screen and enters furniture information (e.g., sofa, bed, dining table).

[1522] Input: Floor plan and furniture information

[1523] Output: User input data

[1524] Specific behavior: The user enters information into a form on the screen and clicks the submit button.

[1525] Step 2:

[1526] The terminal transmits the input floor plan information and furniture information to the server.

[1527] Input: User-entered data

[1528] Output: Data sent from the device to the server

[1529] Specific operation: The device sends an HTTP POST request and sends the input data to the server.

[1530] Step 3:

[1531] The server analyzes the floor plan and furniture information it receives and estimates the amount of cargo.

[1532] Input: Floor plan and furniture information sent to the server

[1533] Output: Load data

[1534] Specific operation: The server calculates the weight and volume based on the floor plan and furniture data.

[1535] Step 4:

[1536] The server sends a request for quote to multiple cooperating moving companies.

[1537] Input: Load data

[1538] Output: Request for quotation data from multiple vendors

[1539] Specific operation: The server sends an HTTP request to each supplier to request a quote.

[1540] Step 5:

[1541] The server consolidates the quotation results received from each supplier.

[1542] Input: Quote result data from vendor

[1543] Output: Integrated quote data

[1544] Specific operation: The server collects quote data from multiple vendors and consolidates it into a single list.

[1545] Step 6:

[1546] The server sends the integrated results to the terminal.

[1547] Input: Integrated quote data

[1548] Output: Data sent to the terminal

[1549] Specific operation: The server sends the integrated quotation data to the terminal in an HTTP response.

[1550] Step 7:

[1551] The terminal displays a list of the received estimate results and prompts the user to make a selection.

[1552] Input: Integrated quote data sent to the terminal

[1553] Output: Display options

[1554] Specific operation: The terminal organizes the quote results, displays them as a list, and offers the user options.

[1555] Determining compatibility between floor plan and furniture

[1556] Step 1:

[1557] The user uploads a floor plan and photos of furniture (e.g., a floor plan of a living room with a large sofa) to the device.

[1558] Input: Floor plan and furniture photos

[1559] Output: User uploaded data

[1560] What happens: The user clicks the "Upload Photo" button in the app and selects a photo.

[1561] Step 2:

[1562] The terminal sends the information to the server.

[1563] Input: User uploaded data

[1564] Output: Data sent from the device to the server

[1565] What happens: The device sends the floor plan and photo data to the server using an HTTP POST request.

[1566] Step 3:

[1567] The server analyzes the received floor plan data and obtains the dimensions of the rooms.

[1568] Input: Floor plan data sent to the server

[1569] Output: Room dimensions

[1570] What it does: The server uses image recognition technology to analyze the floor plan and obtain the length, width, and height.

[1571] Step 4:

[1572] The server compares the furniture's dimensions with the data and determines whether it can be installed.

[1573] Input: Room dimensions and furniture dimensions

[1574] Output: Installation success / failure result

[1575] What happens: The server runs an algorithm that compares the dimensions of the room with the dimensions of the furniture and determines whether it can be installed.

[1576] Step 5:

[1577] The server notifies the terminal of the determination result.

[1578] Input: Installation result

[1579] Output: Data sent to the terminal

[1580] Specific operation: The server sends the judgment result to the terminal in an HTTP response.

[1581] Step 6:

[1582] The terminal displays the received results to the user.

[1583] Input: Verification result sent to the terminal

[1584] Output: Display message

[1585] Specific operation: The device will display the judgment result to the user as a pop-up message, and if installation is difficult, will provide specific reasons.

[1586] These are the specific processing steps of this system. At each step, appropriate processing is performed based on the input data, and the results are passed on to the next step. Highly accurate analysis and automation are achieved by utilizing generative AI models and image recognition technology.

[1587] (Application example 1)

[1588] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1589] Moving involves a wide range of tasks, requiring many steps, from deciding on a property to arranging furniture in the new home, disposing of unnecessary items, and obtaining quotes from moving companies. While a system is needed to efficiently handle these steps, it is difficult to provide appropriate information in real time, especially when it comes to simulating furniture selection and placement in physical stores. This inconveniences users and makes the process leading up to a purchase decision inefficient. Additionally, disposing of unnecessary items and obtaining quotes from moving companies are both time-consuming and laborious, so a system capable of handling a series of moving-related tasks in an integrated manner is needed.

[1590] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1591] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the converted schedule to a terminal, means for receiving furniture placement information, means for determining whether furniture can be installed based on the furniture placement information, and means for notifying the user of the determination result. This enables the user to efficiently and comprehensively manage and execute a series of moving-related tasks, from selecting a property to moving in, selecting and placing furniture, disposing of unnecessary items, and obtaining quotes from moving companies.

[1592] "Property selection information" refers to detailed information about the property selected by the user, including the name, address, and room number of the property.

[1593] "Move-in date information" refers to the planned date on which the user moves into the property, and includes a specific date.

[1594] A "schedule" refers to a plan that outlines a series of tasks and events from deciding on a property to moving in.

[1595] "Calendar format" refers to a format in which the generated schedule is organized by date and displayed visually.

[1596] "Terminal" refers to an electronic device such as a computer or smartphone used by a user.

[1597] "Furniture placement information" refers to detailed information about the furniture that the user plans to install in their new home, including, for example, the dimensions and shape of the furniture.

[1598] "Installability" refers to the criteria and results used to determine whether furniture can be physically placed correctly in a specified space.

[1599] "Notification" refers to the act or means by which a system provides information to a user, including alerts and messages.

[1600] "Unwanted items" refers to unnecessary items that need to be disposed of when moving.

[1601] "Image recognition technology" refers to technology that analyzes image data such as photographs and videos and identifies specific objects or information.

[1602] "Flea market site" refers to an online marketplace where users can buy and sell goods.

[1603] "Quotation" A quotation is a document or information detailing the price and terms of the services to be provided by a moving company.

[1604] This invention is a system for efficiently managing and executing a series of tasks from when a user decides on a property until they move in. This system allows the user to smoothly move based on various data, from property decision information, move-in date information, furniture layout information, disposal of unwanted items, to obtaining quotes from moving companies. Each component of the system and its functions are explained in detail below.

[1605] System Program

[1606] 1. Receiving property decision information and move-in date information:

[1607] Users enter property selection information and move-in date information via their device (smartphone or computer) and send it to the server. The server receives this information and uses it as basic data for generating schedules.

[1608] 2. Generate the schedule:

[1609] Based on the property decision information and move-in date information, the server generates a schedule including events such as contract signing, moving-in and moving-out procedures, moving company reservations, the start date for packing, and the moving date. This schedule is converted into a calendar format and sent to the terminal.

[1610] 3. Dispose of unwanted items:

[1611] When a user uploads a photo of an unwanted item using their device, the photo is sent to a server. The server uses image recognition technology (e.g., Google Cloud Vision API) to determine the item's category, condition, and estimated price. It then uses a generative AI model to generate an appropriate product description and automatically lists the item on a flea market site (e.g., Mercari API). The listing information is then sent to the user's device.

[1612] 4. Get quotes from moving companies:

[1613] The user inputs the room layout and furniture information into the terminal and sends it to the server. The server uses this information to estimate the amount of luggage and sends requests for quotes to multiple moving companies. The received quotes are consolidated and displayed as a list on the user's terminal.

[1614] 5. Furniture placement simulation:

[1615] When a user uploads a floor plan and photos of furniture, the server analyzes this information and determines whether the furniture can be installed. The server uses image recognition technology to analyze the floor plan and obtain the room dimensions. The server compares the furniture dimensions with the room dimensions to determine whether the furniture can be installed and notifies the device of the result.

[1616] Hardware and Software Use

[1617] Hardware: Smartphones, computers

[1618] Cloud server: Amazon AWS

[1619] Image recognition technology: Google Cloud Vision API

[1620] Calendar API: Google Calendar API

[1621] AI model: OpenAI GPT-4

[1622] Flea market site API: Mercari API

[1623] Specific examples

[1624] A user selects a dining table in a physical store and sets the purchase date one week in the future. Then, they upload a photo of the old table they no longer need. They then upload a floor plan of their living room and a photo of the new dining table to run a simulation to see if it will fit in their room.

[1625] Prompt Sentence Examples

[1626] "A user has selected a dining table in a physical store and is planning to purchase it in a week. They uploaded a photo of the old table they no longer need. We'll analyze the floor plan of their living room and the photo of the new dining table to see if it will fit in their room."

[1627] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1628] Step 1:

[1629] The user inputs property selection information and move-in date information and sends it from the terminal to the server. The input data includes the property name, address, room number, expected move-in date, etc. The server receives this information and stores it in a database.

[1630] Step 2:

[1631] Based on the received property decision information and move-in date information, the server generates a schedule including events such as contract signing, moving-in and moving-out procedures, moving company reservations, the start date for packing, and the moving date. The generated schedule is converted into a calendar format.

[1632] Step 3:

[1633] The server sends the generated schedule in a calendar format to the terminal, which receives it and visually displays it to the user. The user can check the details of each event on the calendar and modify them as necessary.

[1634] Step 4:

[1635] To dispose of unwanted items, users upload photos of the items from their devices to the server. The input data includes images related to the item's category and condition. The server uses image recognition technology to determine the item's category, condition, and estimated price.

[1636] Step 5:

[1637] The server uses the results of image analysis to send prompts to the generative AI model, which then generates an appropriate product description. Based on the generated product description and price information, the product is automatically listed on a flea market site. The listing information is then sent to the user's device.

[1638] Step 6:

[1639] The user inputs the room layout and furniture information from their device and sends it to the server. The input data includes the floor plan and dimensions of each piece of furniture. The server then calculates the approximate load based on this information.

[1640] Step 7:

[1641] The server sends the estimated cargo volume information to multiple moving companies and requests quotes. The server consolidates the quotes received from the companies and sends them to the user's device in a list format. The user can compare these quotes and select the most suitable company.

[1642] Step 8:

[1643] The user uploads a floor plan of the room and photos of the new furniture they want to purchase from their device to the server. The input data includes images of the floor plan and photos of the furniture. The server then analyzes the floor plan using image recognition technology to obtain the dimensions of the room.

[1644] Step 9:

[1645] The server compares the acquired dimensional data with the furniture's dimensional data and determines whether the furniture can be installed. The server notifies the user of the result (whether it can be installed or not, and the reason why) and the user can check the result and select and arrange the appropriate furniture.

[1646] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1647] The present invention is a new moving support system that combines a function for recognizing a user's emotions and taking appropriate action based on the emotions. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following describes in detail the embodiments of the present invention.

[1648] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. At this point, the emotion engine runs and analyzes the emotion the user expressed when entering the information. This emotion information is also sent to the server.

[1649] The server generates events from a standard template based on the received property selection information, move-in date information, and emotion information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal for display. It is also possible to set reminders for specific events and optimize the content of the template based on the emotion information.

[1650] As a concrete example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving the moving company, the date to start packing, and the moving date, and if the user is feeling stressed, it will set frequent reminders and display these on the user's device.

[1651] Next, when it becomes necessary to dispose of unwanted items, the user uploads a photo of the unwanted item to the device. The device then sends the photo along with the user's emotional state to the server. The server uses image recognition technology to determine the item's category, condition, and estimated price. Based on this information and the user's emotional state, the server generates an appropriate product description and automatically lists the item on the flea market site. The listing information is then notified to the device and displayed to the user. It is also possible to adjust the price depending on the user's emotional state.

[1652] As a specific example, if a user uploads a photo of an old smartphone and the emotion engine determines that the user is in a hurry, the server will generate a product description at a low price aimed at an immediate sale, automatically list the item on a flea market site, and notify the user that the listing is complete.

[1653] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The device sends this information, along with the user's emotional state, to the server. The server estimates the amount of luggage based on the input information and simultaneously sends requests for quotes to multiple cooperating moving companies. Again, by taking emotional information into account, it is possible to select a company that will cause the least stress and determine the priority for displaying quotes. The quotes received from each company are consolidated and displayed to the user via the device.

[1654] As a concrete example, if a user inputs information about a sofa, bed, and dining table for a one-room apartment, and the emotion engine detects the user's anxiety, the server will prioritize displaying quotes from reliable contractors.

[1655] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device then sends this information along with the user's emotional state to the server. The server then uses image recognition technology to analyze the floor plan and obtain the room dimensions. It then compares the furniture dimensions with the room dimensions to determine whether the furniture can be installed. The results are then sent to the device and displayed to the user. It is also possible to adjust the timing and method of feedback based on the emotional information.

[1656] For example, if a user uploads a large sofa and a floor plan for their living room and the emotion engine detects their disappointment, the server will gently explain the impossibility notice and suggest alternatives.

[1657] The above is a specific embodiment for carrying out the present invention. This system allows users to perform moving-related tasks efficiently and accurately, while also receiving emotionally sensitive service.

[1658] The processing flow will be explained below.

[1659] ■ Create a schedule from the time you choose a room until you move in! (Create a table)

[1660] Step 1:

[1661] The user selects the property and move-in date through the terminal.

[1662] Step 2:

[1663] The emotion engine analyzes the emotion of the user's input.

[1664] Step 3:

[1665] The terminal transmits property decision information, move-in date information, and emotion information to the server.

[1666] Step 4:

[1667] The server stores the property decision information and move-in date information received.

[1668] Step 5:

[1669] The server generates events (contract signing, moving company booking, packing, moving day, etc.) from standard templates.

[1670] Step 6:

[1671] A schedule leading up to occupancy is created based on events generated by the server.

[1672] Step 7:

[1673] The server adjusts the reminder frequency and event details based on the emotion information.

[1674] Step 8:

[1675] The server converts the schedule into a calendar format.

[1676] Step 9:

[1677] The server transmits the generated schedule to the terminal.

[1678] Step 10:

[1679] The terminal displays the received schedule to the user.

[1680] ■ Sell your trash here! (Automatic Flea Market Listing)

[1681] Step 1:

[1682] The user takes a photo of the unwanted item and uploads it to the device.

[1683] Step 2:

[1684] The emotion engine analyzes the emotions of users when they upload photos.

[1685] Step 3:

[1686] The device sends the photo and emotional information to the server.

[1687] Step 4:

[1688] The server uses image recognition technology to analyze the photos it receives and determine the item's category, condition, and estimated price.

[1689] Step 5:

[1690] The server automatically generates a product description based on the item's category, condition, estimated price, and emotional information.

[1691] Step 6:

[1692] The server adjusts certain pricing based on emotional information (e.g., lower prices if you're in a hurry).

[1693] Step 7:

[1694] The server automatically lists the product using the flea market site API.

[1695] Step 8:

[1696] The server notifies the terminal of the listing information.

[1697] Step 9:

[1698] The terminal displays the listing information to the user.

[1699] ■ Get a quote from a moving company (approximate amount of luggage)

[1700] Step 1:

[1701] The user inputs the room layout information and furniture information into the terminal.

[1702] Step 2:

[1703] The emotion engine analyzes the emotion of the user's input.

[1704] Step 3:

[1705] The terminal transmits the floor plan information, furniture information, and emotion information to the server.

[1706] Step 4:

[1707] Based on the floor plan and furniture information received by the server, the volume and weight of the furniture are calculated and the cargo volume is estimated.

[1708] Step 5:

[1709] The server sends out quote requests to all the moving companies it works with.

[1710] Step 6:

[1711] The server takes emotional information into account when requesting a quote and prioritizes companies that cause the user less stress.

[1712] Step 7:

[1713] The server receives estimates from multiple moving companies.

[1714] Step 8:

[1715] The server consolidates the received estimate results and sends them to the terminal.

[1716] Step 9:

[1717] The terminal displays the list of quotes to the user.

[1718] ■ This furniture does not fit into the layout (image recognition)

[1719] Step 1:

[1720] Users upload photos of room floor plans and furniture.

[1721] Step 2:

[1722] The emotion engine analyzes the user's emotions when uploading.

[1723] Step 3:

[1724] The device sends the floor plan, photos of the furniture, and emotional information to the server.

[1725] Step 4:

[1726] The server analyzes the floor plan using image recognition technology.

[1727] Step 5:

[1728] The server retrieves the dimensions of each room.

[1729] Step 6:

[1730] The server compares the furniture dimensions with the dimensions of the acquired floor plan.

[1731] Step 7:

[1732] The server determines whether or not furniture can be placed.

[1733] Step 8:

[1734] The server adjusts the feedback method based on the emotional information (e.g., generating a gentle notification if the user is depressed).

[1735] Step 9:

[1736] The server transmits the determination result to the terminal and notifies the user.

[1737] Step 10:

[1738] The terminal displays the result of the judgment and the reason for it (e.g., oversized) to the user.

[1739] Example 2

[1740] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1741] Conventional moving support systems do not take into account the user's emotional state and are unable to reduce the user's stress and anxiety. Furthermore, they do not provide optimal suggestions based on the user's emotions when it comes to disposing of unwanted items or selecting a moving company, making it difficult to increase user satisfaction. Furthermore, while there is a demand for accurate schedules to be created based on information entered by the user and for notifications to be made at the appropriate time, conventional technologies have difficulty achieving this.

[1742] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1743] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for analyzing the user's emotional state based on the property selection information and the move-in date information, means for generating events and creating a schedule based on the analyzed emotional state, means for converting the generated schedule into a calendar format, and means for transmitting the converted schedule to the terminal. This enables moving support that takes the user's emotions into consideration, and realizes timely notifications while reducing the user's stress and anxiety.

[1744] In this invention, the server includes means for receiving images of unwanted items from a user, means for analyzing the received images and determining the category, condition, and estimated price of the items, means for automatically generating product descriptions based on the user's emotional state and listing the items on an e-commerce platform, and means for notifying the terminal of the listing information. This allows optimal suggestions based on the user's emotions when disposing of unwanted items, reducing the burden on the user.

[1745] In this invention, the server includes a means for receiving room layout information and furniture information from the user, a means for estimating the transportation amount based on the received information, a means for transmitting the estimated transportation amount information to the service provider and receiving the estimate, and a means for displaying the received estimates in a list on the terminal. This makes it possible to prioritize and display estimates from reliable companies taking into account the user's emotional information, thereby helping the user select an appropriate moving company while reducing their anxiety.

[1746] The "property selection information" is information about the residential property selected by the user, including detailed information such as the address and room number.

[1747] "Move-in date information" is information indicating the date on which the user plans to move into a new residential property.

[1748] "User's emotional state" is information that indicates the emotional state of the user when using the system, and includes emotions such as stress, anxiety, and hurry.

[1749] "Events" are specific tasks and activities related to moving, such as signing contracts, booking movers, and starting packing.

[1750] A "schedule" is a plan that arranges all events related to the user's move in appropriate timing.

[1751] A "calendar format" is a format that visually displays a schedule along a date or time axis.

[1752] A "terminal" is a device that a user uses to input information or receive and view information sent from the system. Examples include smartphones and personal computers.

[1753] "Unwanted items" are items that a user wants to dispose of when moving, such as an old smartphone or furniture.

[1754] "Images" refers to data that contains visual information, such as photos of unwanted items or floor plans of rooms.

[1755] "Category" is classification information that indicates the type of item, such as electronic equipment, furniture, and clothing.

[1756] "Condition" is information indicating the storage and usage status of the unwanted item, such as new, used, damaged, etc.

[1757] "Estimated price" is information indicating the market value of the analyzed item.

[1758] "Product description" refers to the description used when listing unwanted items on an e-commerce platform.

[1759] An "e-commerce platform" is a website or application through which goods are bought and sold online.

[1760] "Layout information" refers to information about the layout and arrangement of a room, including, for example, the size and shape of the room, and the arrangement of furniture.

[1761] "Furniture information" is information indicating the type, size, quantity, etc. of furniture owned by the user.

[1762] "Transportation volume" is information that roughly estimates the total amount of luggage to be transported when the user moves.

[1763] A "service provider" is a company that provides moving services to users.

[1764] MODE FOR CARRYING OUT THE INVENTION

[1765] The present invention is a moving support system that recognizes the user's emotions and takes appropriate action based on the emotions. Specific embodiments of this system will be described below.

[1766] Deciding on the property and setting the move-in date

[1767] User: Enter property selection information and move-in date information into the terminal. For example, enter "Apartment A, Room 101" and "Move-in date in two weeks."

[1768] Terminal: In addition to the entered property decision information and move-in date information, the user's emotional state is analyzed using an emotion analysis engine (e.g., IBM Watson), and the results are sent to the server.

[1769] Server: Based on the received information, it generates events from standard templates, creates schedules, converts them into a calendar format, and sends them back to the device, so that reminders can be sent to the user at the appropriate time.

[1770] Example: If a user is moving into "A Apartment, Room 101" in two weeks, the server generates a schedule including the contract signing, moving company booking, and the start date for packing. If the server detects that the user is stressed, it sets frequent reminders.

[1771] Disposal of unnecessary items

[1772] User: Upload an image of the unwanted item to the device, for example, upload a photo from an old smartphone.

[1773] Device: Sends the user's emotional state along with the uploaded image to the server.

[1774] Server: Uses image recognition technology (e.g., TensorFlow) to determine the item's category, condition, and estimated price, and generates a product description based on the user's emotional state. The description is then automatically listed on an e-commerce platform (e.g., Mercari).

[1775] Terminal: Receives listing completion information and notifies the user.

[1776] Example: If a user uploads an old smartphone and the emotion engine determines that the user is in a hurry, the server generates a product description at a low price and automatically lists the item on a flea market site for immediate sale. The server notifies the user that the listing is complete.

[1777] Get quotes from moving companies

[1778] User: Enters room layout and furniture information into the terminal. For example, enters information about a sofa, bed, and dining table for a one-room apartment.

[1779] Terminal: Sends the user's emotional state along with the input information to the server.

[1780] Server: Based on the input information, the server estimates the amount of goods to be transported and sends requests for quotes to multiple moving companies simultaneously. The information is used to select the most appropriate company.

[1781] Terminal: The estimates received from each supplier are consolidated and sent to the terminal, where they are displayed as a list to the user.

[1782] Example: If a user inputs a sofa, bed, and dining table into a one-room apartment, and concerns are detected, quotes from reliable contractors will be displayed first.

[1783] Determine whether furniture can be installed

[1784] User: Upload a room floor plan and photos of furniture to the device. For example, upload a floor plan of a living room with a large sofa.

[1785] Terminal: Sends the uploaded information and the user's emotional state to the server.

[1786] Server: Analyzes the floor plan using image recognition technology to obtain the dimensions of the room. It compares the dimensions of the furniture with the dimensions of the room to determine whether it can be installed and sends the result to the device.

[1787] Device: The result of whether installation is possible or not is displayed to the user, and the timing and method of feedback are adjusted based on emotional information.

[1788] Example: If a user uploads a large sofa and a floor plan for their living room, and the emotion engine detects disappointment, the server can gently explain the impossibility notice and suggest alternatives.

[1789] Examples of prompts for generative AI models

[1790] 1. Setting reminders based on emotion information: "Generate a schedule reminder for a user who is moving to Apartment 101 in two weeks and is feeling stressed."

[1791] 2. Product Description Generation: "Generate a low-cost product description for an older smartphone for a user in a hurry."

[1792] 3. Display quotes from reliable movers: "For a user who is worried about moving to a one-room apartment with lots of furniture, please prioritize displaying quotes from reliable movers."

[1793] 4. Unavailable notifications and suggestions: “Generate a friendly notification suggesting alternatives for a disappointed user who uploads a large sofa and living room floor plan.”

[1794] The above is a specific embodiment for carrying out the invention.

[1795] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1796] Deciding on the property and setting the move-in date

[1797] Step 1: The user enters the property selection information and move-in date information into the terminal.

[1798] Input: Property information (e.g., "Apartment A, Room 101") and move-in date information (e.g., "Move-in date in two weeks")

[1799] Operation: Enter property selection information and move-in date information into the input form on the device.

[1800] Step 2: The device sends the input information to the server

[1801] Input: Property decision information, move-in date information, user's emotional state

[1802] Data calculation: Analyzes the user's emotional state from input information using an emotion analysis engine.

[1803] Output: Property decision information, move-in date information, and analyzed emotional state sent to the server

[1804] Step 3: Server generates and schedules events

[1805] Input: Property decision information, move-in date information, emotional state

[1806] Data calculation: Generate events from standard templates and create schedules based on them. The schedules are converted into a calendar format.

[1807] Output: The generated schedule

[1808] Step 4: The server sends the schedule to the device

[1809] Input: Generated schedule

[1810] What it does: Converts the schedule into a calendar format and sends it to the device.

[1811] Output: Schedule displayed on the terminal

[1812] Disposal of unnecessary items

[1813] Step 1: User uploads a photo of unwanted items to the device

[1814] Input: Image of unwanted item (e.g., photo of old smartphone)

[1815] What it does: Uploads an image using the device's image upload functionality.

[1816] Step 2: The device sends the image and emotional state to the server.

[1817] Input: uploaded image, user emotional state

[1818] Data calculation: Performs image analysis and sentiment analysis.

[1819] Output: Image, emotional state sent to server

[1820] Step 3: The server analyzes the image and generates a product description

[1821] Input: Image, emotional state

[1822] Data Computing: Using image recognition technology (e.g., TensorFlow) to determine an item's category, condition, and estimated price, and generate product descriptions based on the customer's emotional state.

[1823] Output: Product description, automatically generated listing information

[1824] Step 4: The server sends the product description and listing information to the e-commerce platform

[1825] Input: Product description, listing information

[1826] What it does: Sends product description and listing information to an e-commerce platform (e.g., Mercari).

[1827] Output: Information on items listed on flea market sites

[1828] Step 5: The server sends the listing completion information to the device.

[1829] Input: Listing completion information

[1830] Action: Sends a notification to the device that the listing is complete.

[1831] Output: Notification of successful listing displayed on your device

[1832] Get quotes from moving companies

[1833] Step 1: The user inputs the room layout and furniture information into the terminal.

[1834] Input: Room layout information, furniture information (e.g., 1K floor plan, sofa, bed, dining table)

[1835] Operation: Enter room layout and furniture information into the input form on the device.

[1836] Step 2: The device sends information and emotional state to the server

[1837] Input: Room layout information, furniture information, emotional state

[1838] Data calculation: Performs data processing for sentiment analysis and layout information.

[1839] Output: Layout information, furniture information, and emotional state sent to the server

[1840] Step 3: The server estimates the transport volume and sends a quote request

[1841] Input: Layout information, furniture information, emotional state

[1842] Data calculation: The amount of transportation is estimated based on layout information and furniture information, and quote requests are sent simultaneously to multiple service providers.

[1843] Output: Request for quote

[1844] Step 4: The server receives and consolidates the quote results

[1845] Input: Quotation results from each service provider

[1846] Data calculation: Integrates the estimates and selects the best result based on sentiment information.

[1847] Output: Consolidated quotation results

[1848] Step 5: The device will list the information

[1849] Input: Consolidated quote results

[1850] Operation: Displays the consolidated estimate results in a list on the terminal.

[1851] Output: Estimate results displayed on the terminal

[1852] Determine whether furniture can be installed

[1853] Step 1: The user uploads a floor plan and photos of the furniture to their device.

[1854] Input: Floor plan of the room, photos of furniture (e.g., a photo of a large sofa)

[1855] How it works: Upload photos of floor plans and furniture using the device's image upload feature.

[1856] Step 2: The device sends information and emotional state to the server

[1857] Input: Floor plan, furniture photos, emotional state

[1858] Data calculation: Performs image analysis and sentiment analysis.

[1859] Output: Floor plan, furniture photos, and emotional state sent to the server

[1860] Step 3: The server analyzes the dimensions and determines whether it can be installed.

[1861] Input: Floor plan, furniture photos, emotional state

[1862] Data calculation: Using image recognition technology, the floor plan is analyzed to obtain the dimensions of the room. The dimensions of the furniture are compared with those of the room to determine whether it can be installed.

[1863] Output: Installation success / failure result

[1864] Step 4: The server sends the results to the device

[1865] Input: Installation result

[1866] Operation: Sends the result of whether installation is possible or not to the terminal.

[1867] Output: The installation result displayed on the device

[1868] Step 5: The device displays feedback to the user

[1869] Input: Possible placement result, feedback based on emotional state

[1870] What it does: Shows the user the results of whether it's installed or not, and adjusts the timing and content of notifications based on their emotional state.

[1871] Output: Feedback that is displayed to the user

[1872] The above is the detailed flow and specific operations of each processing step.

[1873] (Application example 2)

[1874] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1875] Conventional moving support systems did not take users' emotions into consideration and lacked effective means to reduce user stress. As a result, moving operations were often psychologically stressful. Furthermore, there was no system that recognized the emotions of factory employees and provided appropriate work instructions or support, making it difficult to efficiently improve productivity. To address these issues, there is a need to provide optimal support based on the emotional information of users and employees.

[1876] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the converted schedule to a terminal, means for analyzing user emotion information, and means for optimizing the schedule and reminders based on the emotion information. This enables an optimal moving support service to be provided according to the user's emotional state.

[1877] The server also includes means for receiving photos of unwanted items from users, means for analyzing the received photos of unwanted items and determining the category, condition, and estimated price of the items, means for listing automatically generated product descriptions on the flea market site, means for notifying the terminal of the listing information, and means for analyzing user emotional information and optimizing the product descriptions and prices based on the emotional information, thereby enabling unwanted items to be listed efficiently and quickly.

[1878] The server further includes means for receiving room layout information and furniture information from the user, means for estimating the amount of cargo based on the received information, means for transmitting the estimated amount of cargo information to the moving company and receiving an estimate, means for displaying the received estimates in a list on the terminal, and means for analyzing the user's emotional information and optimizing company selection and estimate display based on the emotional information, thereby enabling the user to obtain and select estimates from moving companies while reducing stress.

[1879] Furthermore, the server includes a means for providing appropriate work instructions and support according to the user's emotional state, and a means for displaying the work instructions and support on the terminal, thereby enabling optimal work support to be provided according to the emotional state of the factory employees, thereby improving productivity.

[1880] "Property selection information" is information about the property selected by the user, and includes the property's address, room number, building name, and the like.

[1881] "Move-in date information" is information about the date on which the user plans to move into the newly selected property.

[1882] A "schedule" is a timetable or plan created based on property selection information and move-in date information, and includes tasks and events related to moving.

[1883] "Calendar format" organizes the generated schedule by date and makes it possible to display it in a general calendar format.

[1884] "Terminal" refers to electronic devices used by users, such as smartphones, personal computers, and tablets.

[1885] "Emotion information" is data that indicates the user's emotional state and is analyzed using emotion recognition technology.

[1886] "Reminder" is a function for notifying users of tasks or events, and notifications are sent based on specific times or conditions.

[1887] "Photos of unwanted items" are image data of items that the user wishes to dispose of or sell when moving.

[1888] A "flea market site" refers to an online marketplace that users use to sell unwanted items.

[1889] "Product description" refers to the description of a product that is displayed when selling an item on a flea market site.

[1890] "Floor plan information" is information relating to the structure and layout of a room, including floor plans and room dimensions.

[1891] "Furniture information" is information about the furniture to be carried to the new home, including the type, dimensions, quantity, etc. of the furniture.

[1892] "Cargo volume" refers to the total weight or volume of the items being transported during a move.

[1893] "Moving company" refers to a company that provides moving-related services.

[1894] "Quotation" means a written estimate of the cost of the moving work provided by the moving company.

[1895] A "work instruction" is an instruction given to an employee regarding a specific task or job.

[1896] "Assistance" refers to auxiliary support provided to help users or employees perform their tasks.

[1897] To implement this invention, the server first receives property selection information and move-in date information from the user. The server then generates a schedule based on this information and converts it into a calendar format. The converted schedule is then sent to the terminal and displayed to the user. The server also obtains the user's emotional state at the time of input and optimizes the schedule and reminders based on this information.

[1898] The server also receives photos of unwanted items from users and analyzes them to determine the item's category, condition, and estimated price. The server automatically generates a product description based on this information and lists the item on the flea market site. The listing information is then sent to the user's device. Here, the server also analyzes emotional information and optimizes the product description and selling price based on the user's emotions.

[1899] In addition, when the user provides information about the room layout and furniture, the server receives this information and estimates the amount of luggage. The server then sends the estimated amount of luggage information to the moving company and receives quotes from several companies. The received quotes are displayed as a list on the device. The server takes emotional information into consideration and recommends the most suitable moving company.

[1900] In a factory, a specific example would be a device or robot recognizing an employee's emotional state and providing appropriate work instructions or assistance. The employee's face is captured by a camera and their emotions are analyzed using an emotion recognition model. Based on the analysis results, the device or robot displays work instructions or assistance details.

[1901] The system's main software includes an emotion recognition model using Keras, an image processing system using OpenCV, and Python for data analysis. The user's device and server are standard PCs and smartphones. Using a generative AI model and prompts, the system generates optimal feedback and support sentences based on the user's emotional state.

[1902] For example, if the emotion recognition model determines that the user is feeling down, the server will display a kind notification and send an encouraging message to the user. If the emotion recognition model determines that a factory worker is feeling tired, the work robot will display a supportive message such as "Please take a short break."

[1903] Example prompts to input to a generative AI model:

[1904] "Create a prompt that generates appropriate work instructions when an employee is sad."

[1905] "Create a prompt that generates a message to reduce employee stress."

[1906] This allows optimal support according to the emotional state of the user and employees, reducing stress and enabling more efficient work.

[1907] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1908] Step 1:

[1909] The user inputs property selection information and move-in date information into the terminal and transmits it to the server.

[1910] Input: Property decision information (e.g., "Apartment A, Room 101"), move-in date information (e.g., May 1, 2023).

[1911] Data processing: This information is converted into an appropriate format and sent to the server along with the user's emotional information.

[1912] Output: Property decision information, move-in date information, and sentiment information sent to the server.

[1913] Step 2:

[1914] The server analyzes the received property decision information, move-in date information, and emotion information to generate a schedule.

[1915] Input: Property decision information, move-in date information, and sentiment information.

[1916] Data calculation: A schedule generation algorithm is used to calculate a series of tasks (e.g., signing a contract, booking a moving company, etc.) and adjust the frequency of reminders based on the user's emotions.

[1917] Output: The generated schedule.

[1918] Step 3:

[1919] The generated schedule is converted into a calendar format and sent to the terminal.

[1920] Input: The generated schedule.

[1921] Data processing: Convert schedules into standard calendar format.

[1922] Output: The converted schedule is displayed on the terminal.

[1923] Step 4:

[1924] The user uploads a photo of the unwanted item to the terminal and sends it to the server.

[1925] Input: A photo of your unwanted item (e.g., an image of your old smartphone).

[1926] Data processing: The user's emotional information is sent to the server along with the photo data.

[1927] Output: Photo data and emotion information sent to the server.

[1928] Step 5:

[1929] The server analyzes the photos of the unwanted items it receives to determine the item's category, condition, and estimated value.

[1930] Input: Photos of unwanted items, emotional information.

[1931] Data calculation: Analyzes product information using image recognition technology and optimizes prices and product descriptions based on emotional information.

[1932] Output: Item category, condition, estimated price, optimized product description.

[1933] Step 6:

[1934] The automatically generated product description is put up for sale on a flea market site, and the listing information is notified to the terminal.

[1935] Input: Optimized product description.

[1936] Data calculation: Automates the process of listing items on flea market sites and generates listing completion information.

[1937] Output: Listing completion information sent to the device.

[1938] Step 7:

[1939] The user inputs the room layout information and furniture information into the terminal and transmits it to the server.

[1940] Input: Room layout information, furniture information.

[1941] Data processing: The user's emotional information is sent to the server along with floor plan and furniture information.

[1942] Output: Floor plan information, furniture information, and emotion information sent to the server.

[1943] Step 8:

[1944] The server estimates the amount of cargo based on the received information and sends requests for quotes to multiple cooperating moving companies.

[1945] Input: Floor plan information, furniture information, and emotion information.

[1946] Data calculation: Calculate the total weight and volume of the package and send a quote request using a contractor selection algorithm.

[1947] Output: The estimate provided.

[1948] Step 9:

[1949] The server aggregates the received quotes and prioritizes the best quote based on the sentiment information.

[1950] Input: Quote received.

[1951] Data calculation: Analyze quotes and prioritize them based on reliability and price.

[1952] Output: Consolidated quotes listed on the terminal.

[1953] Step 10:

[1954] The terminal or robot recognizes the employee's emotional state and provides appropriate work instructions or assistance.

[1955] Input: Employee video data.

[1956] Data calculation: Analyze emotions using facial recognition technology and emotion recognition models to generate optimal work instructions.

[1957] Output: Work instructions and assistance messages displayed on the terminal or robot.

[1958] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1959] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1960] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1961] [Fourth embodiment]

[1962] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1963] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1964] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1965] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1966] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1967] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1968] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1969] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1970] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1971] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1972] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1973] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1974] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1975] The present invention is a system for efficiently creating a schedule from when a user decides on a property until they move in, automatically listing unwanted items, obtaining estimates from moving companies, and determining whether the floor plan and furniture match. A detailed description of an embodiment of the present invention is provided below.

[1976] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. The server generates events from a standard template based on the received property selection information and move-in date information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal to be displayed to the user.

[1977] As a specific example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving a moving company, the start date for packing, and the moving date, and display this on the user's device.

[1978] Next, when an unwanted item needs to be disposed of, the user uploads a photo of the unwanted item to the device. The device then sends the photo to the server, which uses image recognition technology to determine the item's category, condition, and estimated price. Based on this information, the server generates an appropriate product description and automatically lists the item on the flea market site. The listing information is then notified to the device and displayed to the user.

[1979] As a specific example, when a user uploads a photo of an old smartphone, the server categorizes it as a "used smartphone in good working order," sets an appropriate price range, automatically lists it on a flea market site, and notifies the user that the listing is complete.

[1980] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The terminal sends this information to the server, which then estimates the amount of luggage based on the input information. Based on the estimated amount of luggage, the server then sends requests for quotes to multiple cooperating moving companies. The quotes received from each company are consolidated and displayed to the user via the terminal.

[1981] As a concrete example, when a user enters information about a sofa, bed, and dining table for a one-room apartment, the server estimates the amount of luggage, sends requests for quotes to multiple moving companies, and displays the results to the user.

[1982] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device sends this information to the server, which uses image recognition technology to analyze the floor plan and obtain the room dimensions. The dimensions of the furniture are compared with those of the room to determine whether it can be installed. The results are then sent to the device and displayed to the user.

[1983] For example, if a user uploads a floor plan of a living room with a large sofa, the server analyzes the floor plan and compares it with the sofa's dimensions. If it is difficult to install, the server notifies the device of the reason (e.g., the sofa will not fit through the door).

[1984] The above is a concrete embodiment for carrying out the present invention. This system allows users to perform moving-related tasks efficiently and accurately.

[1985] The processing flow will be explained below.

[1986] ■ Create a schedule from the time you choose a room until you move in! (Create a table)

[1987] Step 1:

[1988] The user selects the property and move-in date through the terminal.

[1989] Step 2:

[1990] The terminal sends the property information and move-in date to the server.

[1991] Step 3:

[1992] The server stores the property information and move-in date information it receives.

[1993] Step 4:

[1994] The server generates events (contract signing, moving company booking, packing, moving date, etc.) from standard templates.

[1995] Step 5:

[1996] A schedule leading up to occupancy is created based on events generated by the server.

[1997] Step 6:

[1998] The server converts the schedule into a calendar format.

[1999] Step 7:

[2000] The server transmits the generated schedule to the terminal.

[2001] Step 8:

[2002] The terminal displays the received schedule to the user.

[2003] ■ Sell your trash here! (Automatic Flea Market Listing)

[2004] Step 1:

[2005] The user takes a photo of the unwanted item and uploads it to the device.

[2006] Step 2:

[2007] The device sends the photo to the server.

[2008] Step 3:

[2009] The server uses image recognition technology to analyze the photos it receives and determine the item's category, condition, and estimated price.

[2010] Step 4:

[2011] The server automatically generates a product description based on the item's category, condition, and estimated price.

[2012] Step 5:

[2013] The server automatically lists the product using the flea market site API.

[2014] Step 6:

[2015] The server notifies the terminal of the listing information.

[2016] Step 7:

[2017] The terminal displays the listing information to the user.

[2018] ■ Get a quote from a moving company (approximate amount of luggage)

[2019] Step 1:

[2020] The user inputs the room layout information and furniture information into the terminal.

[2021] Step 2:

[2022] The terminal sends the input information to the server.

[2023] Step 3:

[2024] Based on the floor plan and furniture information received by the server, the volume and weight of the furniture are calculated and the cargo volume is estimated.

[2025] Step 4:

[2026] The server sends out quote requests to all the moving companies it works with.

[2027] Step 5:

[2028] The server receives estimates from multiple moving companies.

[2029] Step 6:

[2030] The server consolidates the received estimate results and sends them to the terminal.

[2031] Step 7:

[2032] The terminal displays the list of quotes to the user.

[2033] ■ This furniture does not fit into the layout (image recognition)

[2034] Step 1:

[2035] Users upload photos of room floor plans and furniture.

[2036] Step 2:

[2037] The device sends floor plans and photos of furniture to the server.

[2038] Step 3:

[2039] The server analyzes the floor plan using image recognition technology.

[2040] Step 4:

[2041] The server retrieves the dimensions of each room.

[2042] Step 5:

[2043] The server compares the furniture dimensions with the dimensions of the acquired floor plan.

[2044] Step 6:

[2045] The server determines whether or not furniture can be placed.

[2046] Step 7:

[2047] The server transmits the determination result to the terminal and notifies the user.

[2048] Step 8:

[2049] The terminal displays the judgment result and the reason (such as oversized) to the user.

[2050] Example 1

[2051] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2052] Previously, preparing for a move and creating a schedule required many manual steps, which was time-consuming and labor-intensive. Furthermore, tasks such as disposing of unnecessary items, obtaining quotes from moving companies, and determining whether furniture and the floor plan are compatible had to be handled individually, making efficient move preparations difficult. A system was needed that would centralize and automate these processes, significantly reducing the burden on users.

[2053] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2054] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the calendar format to the terminal, means for receiving photos of unwanted items from the user, means for analyzing the received photos of the unwanted items and determining the category, condition, and estimated price of the items, means for listing automatically generated product descriptions on an e-commerce site, means for notifying the terminal of the listing information, means for receiving room layout information and furniture information from the user, means for estimating the amount of cargo based on the received information, means for transmitting the estimated amount of cargo information to a carrier and receiving an estimate, means for displaying the received estimates in a list on the terminal, means for receiving room layout diagrams and photos of furniture from the user, means for analyzing the received floor plan and obtaining the dimensions of the room, means for comparing with furniture dimension data to determine whether the furniture can be installed, and means for notifying the terminal of the determination result. This makes it possible to centralize and automate a series of processes, such as creating a moving schedule, automatically listing unwanted items, obtaining quotes from moving companies, and determining whether furniture and floor plans are compatible.

[2055] "Property selection information" refers to detailed information about the property selected by the user.

[2056] "Move-in date information" refers to information about the date on which the user plans to move into their new home.

[2057] The "schedule" refers to a series of events and plans related to the user's preparations for moving.

[2058] A "calendar format" is a schedule converted into a format that can be viewed visually.

[2059] A "terminal" refers to an electronic device used by a user, such as a computer, smartphone, or tablet.

[2060] "Unnecessary items" are items that the user will not take with them when moving.

[2061] "Photographs" refer to image data that visually records unwanted items and floor plans.

[2062] "Analysis" refers to the process of analyzing information based on received data and determining its category, status, etc.

[2063] "Item category" refers to classification information regarding the type of unwanted item that has been analyzed.

[2064] "Estimated price" refers to the expected selling price of the item calculated based on the analysis results.

[2065] "Product description" refers to a detailed description of a product that is listed on an e-commerce site.

[2066] An "e-commerce site" is a platform for buying and selling goods online.

[2067] "Floor plan information" refers to information about the structure and layout of rooms.

[2068] "Furniture information" refers to detailed information about the furniture to be placed in the room.

[2069] "Cargo volume" refers to the total amount of items being transported when moving.

[2070] "Motoring Agent" means the transportation service provider handling your move.

[2071] An "estimate" is the price and services offered by a moving company for moving work.

[2072] "Receiving" refers to the server receiving a quote from a carrier.

[2073] "List display" refers to organizing multiple estimate results and displaying them on one screen.

[2074] A floor plan is a drawing that shows the layout and dimensions of a room.

[2075] "Room dimensions" refers to the size of a room, such as its length, width, and height.

[2076] "Installation feasibility" refers to determining whether the furniture can be properly installed in the specified room.

[2077] "Notification" refers to sending information from the server to the terminal to notify the user.

[2078] The present invention is a system that allows a user to efficiently create a schedule from when they decide on a property until they move in, automatically list unwanted items, obtain estimates from moving companies, and determine whether the floor plan and furniture match. To implement the present invention, the following steps are taken.

[2079] First, the user decides on the property they will live in and sets the move-in date. When the user enters the property selection information and move-in date information into the terminal, the terminal sends this information to the server. The server generates events from a standard template based on the received property selection information and move-in date information, and creates a schedule. This schedule is converted into a calendar format and sent back to the terminal to be displayed to the user.

[2080] As a specific example, if a user decides on a property called "Room 101, Apartment A" and schedules their move-in date to be two weeks later, the server will schedule events such as signing the contract, moving-in and moving-out procedures, reserving a moving company, the start date for packing, and the moving date, and display this on the user's device.

[2081] Next, when an unwanted item needs to be disposed of, the user uploads a photo of the unwanted item to the device. The device then sends the photo to a server, which uses image recognition technology (e.g., Tensorflow) to determine the item's category, condition, and estimated price. Based on this information, the server uses a generative AI model (e.g., GPT-3) to generate an appropriate product description and automatically lists the item on an e-commerce site. The listing information is then notified to the device and displayed to the user.

[2082] As a specific example, when a user uploads a photo of an old smartphone, the server categorizes it as a "used smartphone in good working condition," sets an appropriate price range, automatically lists it on an e-commerce site, and notifies the user that the listing is complete.

[2083] Furthermore, to obtain quotes from moving companies, the user inputs information about the room layout and furniture. The terminal sends this information to the server, which then estimates the amount of luggage based on the input information. Based on the estimated amount of luggage, the server then sends requests for quotes to multiple cooperating moving companies. The quotes received from each company are consolidated and displayed to the user via the terminal.

[2084] As a concrete example, when a user enters information about a sofa, bed, and dining table for a one-room apartment, the server estimates the amount of luggage, sends requests for quotes to multiple moving companies, and displays the results to the user.

[2085] Finally, to determine whether the furniture will fit into the floor plan, the user uploads a floor plan and photos of the furniture. The device sends this information to the server, which uses image recognition technology to analyze the floor plan and obtain the room dimensions. The dimensions of the furniture are compared with those of the room to determine whether it can be installed. The results are then sent to the device and displayed to the user.

[2086] For example, if a user uploads a floor plan of a living room with a large sofa, the server analyzes the floor plan and compares it with the sofa's dimensions. If it is difficult to install, the server notifies the device of the reason (e.g., the sofa will not fit through the door).

[2087] The above is a specific embodiment of the present invention. This system allows users to efficiently and accurately perform moving-related tasks. The use of generative AI models enables more advanced analysis and automation, reducing the burden on users.

[2088] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2089] Program processing steps

[2090] Creating a Schedule

[2091] Step 1:

[2092] The user enters property information (e.g., "Apartment A, Room 101") and the move-in date (e.g., two weeks later) into the terminal.

[2093] Input: Property information and move-in date

[2094] Output: User input data

[2095] Specific behavior: The user enters information into a form on the screen and clicks the submit button.

[2096] Step 2:

[2097] The terminal transmits the entered property decision information and move-in date information to the server.

[2098] Input: User-entered data

[2099] Output: Data sent from the device to the server

[2100] Specific operation: The device sends an HTTP POST request and sends the input data to the server.

[2101] Step 3:

[2102] The server analyzes the property decision information and move-in date information it receives.

[2103] Input: Property decision information and move-in date information sent to the server

[2104] Output: Analysis data

[2105] Specific operation: The server decodes the received data and analyzes it against the database.

[2106] Step 4:

[2107] The server searches for the corresponding event from the standard template and creates a schedule.

[2108] Input: Analysis data

[2109] Output: Initial schedule data

[2110] Specific operation: The server selects the appropriate event from a predefined template list and generates a schedule.

[2111] Step 5:

[2112] The schedule created by the server is converted into a calendar format.

[2113] Input: Initial schedule data

[2114] Output: Calendar format data

[2115] What happens: The server applies an algorithm to convert the schedule data into a standard format, such as Google Calendar format.

[2116] Step 6:

[2117] The server sends data in a calendar format to the terminal.

[2118] Input: Calendar format data

[2119] Output: Data sent to the terminal

[2120] Specific operation: The server sends calendar data to the device in an HTTP response.

[2121] Step 7:

[2122] The terminal formats the received schedule data for display and displays it to the user.

[2123] Input: Calendar format data sent to the terminal

[2124] Output: A viewable schedule

[2125] What happens: Your device formats the received data for display and displays it in the Calendar app.

[2126] Automatic listing of unwanted items

[2127] Step 1:

[2128] Users take a photo of an unwanted item (e.g., an old smartphone) using their device's camera, or select and upload an existing photo.

[2129] Input: Photo data of unwanted items

[2130] Output: User uploaded data

[2131] What happens: The user clicks the "Upload Photo" button in the app and selects or takes a photo.

[2132] Step 2:

[2133] The device sends the uploaded photo data to the server.

[2134] Input: User uploaded data

[2135] Output: Data sent from the device to the server

[2136] What happens: The device sends the photo data to the server using an HTTP POST request.

[2137] Step 3:

[2138] The server passes the received photo data to an image recognition algorithm for analysis.

[2139] Input: Photo data sent to the server

[2140] Output: Analysis results

[2141] What it does: The server uses Tensorflow to analyze the image and determine the category, condition, and estimated price.

[2142] Step 4:

[2143] The server generates a product description based on the analysis results.

[2144] Input: Analysis results

[2145] Output: Product description

[2146] What it does: The server generates product descriptions using a generative AI model (e.g., GPT-3).

[2147] Step 5:

[2148] The server automatically lists the generated product description on an electronic commerce site.

[2149] Input: Product description

[2150] Output: Notification of completion of listing on flea market site

[2151] Specific operation: The server uses the API of the e-commerce site to list the product and confirms that the listing is complete.

[2152] Step 6:

[2153] The server sends a notification of the completion of the listing to the terminal.

[2154] Input: Notification of listing completion from flea market site

[2155] Output: Data sent to the terminal

[2156] Specific operation: The server sends a listing completion notification to the terminal via HTTP response.

[2157] Step 7:

[2158] The terminal displays the received notification to the user.

[2159] Input: Listing completion notification sent to the terminal

[2160] Output: Display message

[2161] Specific behavior: The device displays the notification to the user as a pop-up message.

[2162] Get quotes from moving companies

[2163] Step 1:

[2164] The user selects the room layout information (e.g., 1K) on the input screen and enters furniture information (e.g., sofa, bed, dining table).

[2165] Input: Floor plan and furniture information

[2166] Output: User input data

[2167] Specific behavior: The user enters information into a form on the screen and clicks the submit button.

[2168] Step 2:

[2169] The terminal transmits the input floor plan information and furniture information to the server.

[2170] Input: User-entered data

[2171] Output: Data sent from the device to the server

[2172] Specific operation: The device sends an HTTP POST request and sends the input data to the server.

[2173] Step 3:

[2174] The server analyzes the floor plan and furniture information it receives and estimates the amount of cargo.

[2175] Input: Floor plan and furniture information sent to the server

[2176] Output: Load data

[2177] Specific operation: The server calculates the weight and volume based on the floor plan and furniture data.

[2178] Step 4:

[2179] The server sends a request for quote to multiple cooperating moving companies.

[2180] Input: Load data

[2181] Output: Request for quotation data from multiple vendors

[2182] Specific operation: The server sends an HTTP request to each supplier to request a quote.

[2183] Step 5:

[2184] The server consolidates the quotation results received from each supplier.

[2185] Input: Quote result data from vendor

[2186] Output: Integrated quote data

[2187] Specific operation: The server collects quote data from multiple vendors and consolidates it into a single list.

[2188] Step 6:

[2189] The server sends the integrated results to the terminal.

[2190] Input: Integrated quote data

[2191] Output: Data sent to the terminal

[2192] Specific operation: The server sends the integrated quotation data to the terminal in an HTTP response.

[2193] Step 7:

[2194] The terminal displays a list of the received estimate results and prompts the user to make a selection.

[2195] Input: Integrated quote data sent to the terminal

[2196] Output: Display options

[2197] Specific operation: The terminal organizes the quote results, displays them as a list, and offers the user options.

[2198] Determining compatibility between floor plan and furniture

[2199] Step 1:

[2200] The user uploads a floor plan and photos of furniture (e.g., a floor plan of a living room with a large sofa) to the device.

[2201] Input: Floor plan and furniture photos

[2202] Output: User uploaded data

[2203] What happens: The user clicks the "Upload Photo" button in the app and selects a photo.

[2204] Step 2:

[2205] The terminal sends the information to the server.

[2206] Input: User uploaded data

[2207] Output: Data sent from the device to the server

[2208] What happens: The device sends the floor plan and photo data to the server using an HTTP POST request.

[2209] Step 3:

[2210] The server analyzes the received floor plan data and obtains the dimensions of the rooms.

[2211] Input: Floor plan data sent to the server

[2212] Output: Room dimensions

[2213] What it does: The server uses image recognition technology to analyze the floor plan and obtain the length, width, and height.

[2214] Step 4:

[2215] The server compares the furniture's dimensions with the data and determines whether it can be installed.

[2216] Input: Room dimensions and furniture dimensions

[2217] Output: Installation success / failure result

[2218] What happens: The server runs an algorithm that compares the dimensions of the room with the dimensions of the furniture and determines whether it can be installed.

[2219] Step 5:

[2220] The server notifies the terminal of the determination result.

[2221] Input: Installation result

[2222] Output: Data sent to the terminal

[2223] Specific operation: The server sends the judgment result to the terminal in an HTTP response.

[2224] Step 6:

[2225] The terminal displays the received results to the user.

[2226] Input: Verification result sent to the terminal

[2227] Output: Display message

[2228] Specific operation: The device will display the judgment result to the user as a pop-up message, and if installation is difficult, will provide specific reasons.

[2229] These are the specific processing steps of this system. At each step, appropriate processing is performed based on the input data, and the results are passed on to the next step. Highly accurate analysis and automation are achieved by utilizing generative AI models and image recognition technology.

[2230] (Application example 1)

[2231] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2232] Moving involves a wide range of tasks, requiring many steps, from deciding on a property to arranging furniture in the new home, disposing of unnecessary items, and obtaining quotes from moving companies. While a system is needed to efficiently handle these steps, it is difficult to provide appropriate information in real time, especially when it comes to simulating furniture selection and placement in physical stores. This inconveniences users and makes the process leading up to a purchase decision inefficient. Additionally, disposing of unnecessary items and obtaining quotes from moving companies are both time-consuming and laborious, so a system capable of handling a series of moving-related tasks in an integrated manner is needed.

[2233] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2234] In this invention, the server includes means for receiving property selection information, means for receiving move-in date information, means for generating a schedule based on the property selection information and the move-in date information, means for converting the generated schedule into a calendar format, means for transmitting the converted schedule to a terminal, means for receiving furniture placement information, means for determining whether furniture can be installed based on the furniture placement information, and means for notifying the user of the determination result. This enables the user to efficiently and comprehensively manage and execute a series of moving-related tasks, from selecting a property to moving in, selecting and placing furniture, disposing of unnecessary items, and obtaining quotes from moving companies.

[2235] "Property selection information" refers to detailed information about the property selected by the user, including the name, address, and room number of the property.

[2236] "Move-in date information" refers to the planned date on which the user moves into the property, and includes a specific date.

[2237] A "schedule" refers to a plan that outlines a series of tasks and events from deciding on a property to moving in.

[2238] "Calendar format" refers to a format in which the generated schedule is organized by date and displayed visually.

[2239] "Terminal" refers to an electronic device such as a computer or smartphone used by a user.

[2240] "Furniture placement information" refers to detailed information about the furniture that the user plans to install in their new home, including, for example, the dimensions and shape of the furniture.

[2241] "Installability" refers to the criteria and results used to determine whether furniture can be physically placed correctly in a specified space.

[2242] "Notification" refers to the act or means by which a system provides information to a user, including alerts and messages.

[2243] "Unwanted items" refers to unnecessary items that need to be disposed of when moving.

[2244] "Image recognition technology" refers to technology that analyzes image data such as photographs and videos and identifies specific objects or information.

[2245] "Flea market site" refers to an online marketplace where users can buy and sell goods.

[2246] "Quotation" A quotation is a document or information detailing the price and terms of the services to be provided by a moving company.

[2247] This invention is a system for efficiently managing and executing a series of tasks from when a user decides on a property until they move in. This system allows the user to smoothly move based on various data, from property decision information, move-in date information, furniture layout information, disposal of unwanted items, to obtaining quotes from moving companies. Each component of the system and its functions are explained in detail below.

[2248] System Program

[2249] 1. Receiving property decision information and move-in date information:

[2250] Users enter property selection information and move-in date information via their device (smartphone or computer) and send it to the server. The server receives this information and uses it as basic data for generating schedules.

[2251] 2. Generate the schedule:

[2252] Based on the property decision information and move-in date information, the server generates a schedule including events such as contract signing, moving-in and moving-out procedures, moving company reservations, the start date for packing, and the moving date. This schedule is converted into a calendar format and sent to the terminal.

[2253] 3. Dispose of unwanted items:

[2254] When a user uploads a photo of an unwanted item using their device, the photo is sent to a server. The server uses image recognition technology (e.g., Google Cloud Vision API) to determine the item's category, condition, and estimated price. It then uses a generative AI model to generate an appropriate product description and automatically lists the item on a flea market site (e.g., Mercari API). The listing information is then sent to the user's device.

[2255] 4. Get quotes from moving companies:

[2256] The user inputs the room layout and furniture information into the terminal and sends it to the server. The server uses this information to estimate the amount of luggage and sends requests for quotes to multiple moving companies. The received quotes are consolidated and displayed as a list on the user's terminal.

[2257] 5. Furniture placement simulation:

[2258] When a user uploads a floor plan and photos of furniture, the server analyzes this information and determines whether the furniture can be installed. The server uses image recognition technology to analyze the floor plan and obtain the room dimensions. The server compares the furniture dimensions with the room dimensions to determine whether the furniture can be installed and notifies the device of the result.

[2259] Hardware and Software Use

[2260] Hardware: Smartphones, computers

[2261] Cloud server: Amazon AWS

[2262] Image recognition technology: Google Cloud Vision API

[2263] Calendar API: Google Calendar API

[2264] AI model: OpenAI GPT-4

[2265] Flea market site API: Mercari API

[2266] Specific examples

[2267] A user selects a dining table in a physical store and sets the purchase date one week in the future. Then, they upload a photo of the old table they no longer need. They then upload a floor plan of their living room and a photo of the new dining table to run a simulation to see if it will fit in their room.

[2268] Prompt Sentence Examples

[2269] "A user has selected a dining table in a physical store and is planning to purchase it in a week. They uploaded a photo of the old table they no longer need. We'll analyze the floor plan of their living room and the photo of the new dining table to see if it will fit in their room."

[2270] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2271] Step 1:

[2272] The user inputs property selection information and move-in date information and sends it from the terminal to the server. The input data includes the property name, address, room number, expected move-in date, etc. The server receives this information and stores it in a database.

[2273] Step 2:

[2274] Based on the received property decision information and move-in date information, the server generates a schedule inc...

Claims

1. a means for receiving property decision information; means for receiving move-in date information; A means for generating a schedule based on property decision information and move-in date information; means for converting the generated schedule into a calendar format; means for transmitting the converted schedule to a terminal; A system including:

2. means for receiving a photograph of the unwanted item from a user; means for analyzing the received photographs of the unwanted items to determine the category, condition, and estimated value of the items; A means to list automatically generated product descriptions on flea market sites, A means for notifying the terminal of the listing information; A system including:

3. means for receiving room layout information and furniture information from a user; means for estimating the load based on the received information; A means for transmitting estimated cargo volume information to a moving company and receiving a quote; A means for displaying a list of received quotations on the terminal; A system including:

4. means for receiving a room floor plan and furniture photos from a user; means for analyzing the received floor plan and obtaining dimensions of each room; a means for comparing the dimensions of the furniture with the dimensions of the room and determining whether the furniture can be installed; means for notifying the terminal of the determination result; A system including:

5. 10. The system of claim 1, further comprising: means for generating events including contract signing, moving-in / out procedures, moving company booking, and packing from predefined templates.

6. 3. The system of claim 2, further comprising means for automatically determining the type, condition, and market value of the item.

7. 4. The system of claim 3, further comprising means for sending a request for quote to a plurality of moving companies based on the estimated load size.

8. 5. The system according to claim 4, further comprising means for notifying the user of the reason why the furniture cannot be installed.

Images