System

Abstract

A system is provided.SOLUTION: This system is provided with a means for allowing a user to input the basic information and additional information of a vacant house, a means for confirming the consistency of the basic information and additional information, a means for generating an renovation plan based on the information whose consistency is confirmed, a means for presenting the renovation plan to the user, and a means for generating a quotation and a contract document based on the renovation plan selected by the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Japan today faces multiple simultaneous challenges, including the rapidly increasing number of vacant homes, even in urban areas, rising new home prices, and the difficulty of securing high-quality housing. Solving these issues separately is difficult, and comprehensive solutions are needed. Furthermore, there is a lack of means to promote the rental or resale of vacant homes and to avoid abandonment, demolition, and increased tax burdens following legal reforms. Another challenge is the growing need to provide affordable, high-quality housing for the Y family generation. [Means for solving the problem]

[0005] The present invention is a system that includes a means for a user to input basic information and additional information about a vacant house, a means for confirming the consistency between the basic information and the additional information, a means for generating a renovation plan based on the information whose consistency has been confirmed, a means for presenting the renovation plan to the user, and a means for generating an estimate and a contract based on the renovation plan selected by the user.

[0006] The renovation plan generation means generates an optimal plan based on housing examples and rental market data from around the world. Furthermore, the estimate and contract generation means provides users with an electronic signature procedure. This invention promotes the effective use of vacant houses, making it possible to avoid abandonment, demolition, and increased tax burdens following legal reforms. It also makes it possible to provide high-quality housing at affordable prices to the Y family generation.

[0007] "User" refers to an individual or corporation that uses this system to input and check vacant house information and select the most suitable renovation plan from the proposed plans.

[0008] "Basic information about vacant houses" refers to data about the basic specifications of vacant houses, such as area, age, and number of rooms.

[0009] "Additional information" refers to detailed data other than basic information, such as videos, photos, and comments on the current state of the vacant house.

[0010] "Means for verifying consistency" refers to means for checking the validity and consistency of the basic information and additional information entered, and for detecting invalid or missing data.

[0011] "Means for generating a renovation plan" refers to a means for creating a specific plan for renovation based on input information.

[0012] "Rental price data" refers to data on the rental prices of homes in a specific area.

[0013] "Housing examples" refer to past renovation projects and existing housing plans.

[0014] "Means for presenting to the user" refers to means for displaying the generated renovation plan to the user.

[0015] The "quote generation means" refers to a means for automatically creating a quotation to be presented to the user based on the selected renovation plan.

[0016] The "contract generation means" refers to a means for automatically creating a contract to be presented to the user based on the estimate.

[0017] "Electronic Signature Process" means the process for signing a contract online. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9]1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] A specific embodiment of the "Vacant House Utilization AI Planner" of the present invention will be described.

[0040] Overall system overview

[0041] The system uses a web interface to allow users to input basic and additional information about a vacant house, and then uses AI to generate an optimal renovation plan and present it to the user.The system also automatically generates estimates and contracts based on the plan selected by the user, allowing the user to complete the contract process online with an electronic signature.

[0042] User Input

[0043] Users enter basic and additional information about the vacant house through a dedicated web interface. Specifically, in addition to basic information such as area, age, and number of rooms, they enter additional information such as videos and photos of the current state and comments. This information is sent to the server and checked for consistency before being passed on to the generation AI.

[0044] example:

[0045] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[0046] The user enters a comment about the current state, such as "Part of the wall is damaged."

[0047] Checking the integrity of information

[0048] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data, such as whether the area is less than or equal to 0 or the number of rooms is a negative number.

[0049] example:

[0050] Does the property meet certain conditions, such as an area of ​​less than 100 square meters and being more than 30 years old?

[0051] Generative AI Planning

[0052] Based on the information that has been confirmed to be consistent, the server inputs the data into the generation AI, which then begins generating renovation plans. The generation AI then creates multiple plans, taking into account renovation examples from around the world and market rental data. These plans include full renovations, partial renovations, and interior changes.

[0053] example:

[0054] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[0055] Plan B: Partial renovation (living room and kitchen renovation)

[0056] Plan C: Interior changes (wallpaper and flooring changes)

[0057] Plan presentation and proposal

[0058] The server then presents the generated renovation plans to the user via a web interface. The user can compare the plans and select the one that best suits them. Each plan includes images, detailed descriptions, 3D modeling, and audio guides.

[0059] example:

[0060] User clicks to view details of Plan A.

[0061] The server displays the details of Plan A (project duration, budget, expected rent).

[0062] Generate quotes and contracts

[0063] Once the user selects the most suitable plan, the server automatically generates a quote and sends it electronically to the user. The user can check the quote online and submit revision requests as necessary. Finally, if the user agrees to the quote, a contract is automatically generated. The entire contract process is completed online, allowing the user to sign electronically.

[0064] example:

[0065] The user selects Plan A and clicks Request a Quote.

[0066] The server automatically generates a quote and sends it to the user.

[0067] The user confirms the contract details and completes the contract by signing electronically.

[0068] As described above, this invention provides a system that promotes the effective use of vacant houses and avoids abandonment, demolition, and increased tax burdens following legal reform. It also makes it possible to provide high-quality housing at affordable prices to the Y family generation.

[0069] The processing flow will be explained below.

[0070] Step 1:

[0071] The user accesses a dedicated web interface and enters basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, the user clicks the "Submit" button to send the information to the server.

[0072] Step 2:

[0073] The server receives the information sent by the user. It checks the basic and additional information for data consistency by checking whether the area and age of the property are within invalid ranges (area is less than 0, age is over 100 years, etc.). If an inconsistency is found, it returns an error message to the user.

[0074] Step 3:

[0075] The server inputs the information that has been confirmed to be consistent into the generation AI, which analyzes the received data and begins generating renovation plans by referencing housing examples and rental price data from around the world.

[0076] Step 4:

[0077] The generation AI creates multiple renovation plans (e.g., Plan A, Plan B, Plan C), including variations such as full renovation, partial renovation, and interior changes. The generated plans are returned to the server.

[0078] Step 5:

[0079] The server displays the renovation plans received from the AI ​​on a web interface. The user can review the multiple plans presented and compare them through images, detailed descriptions, 3D modeling, and audio guides for each plan.

[0080] Step 6:

[0081] Once the user selects the most suitable plan, he / she clicks the "Request a Quote" button, and the server automatically generates a quote based on the selected plan and electronically sends it to the user.

[0082] Step 7:

[0083] The user checks the estimate online and sends a request for revisions to the server if necessary. The server receives the request, uses the generation AI again to generate a revised estimate, and resends it to the user.

[0084] Step 8:

[0085] When the user agrees with the final quote, he clicks the "Generate Contract" button, and the server automatically generates a contract and sends it electronically to the user.

[0086] Step 9:

[0087] The user completes the electronic signature procedure online and sends it to the server, which officially concludes the contract.

[0088] Through these steps, the "Vacant House Utilization AI Planner" can quickly and efficiently provide users with plans for effective utilization of vacant houses, completing the entire process from negotiations to signing a contract in one go.

[0089] Example 1

[0090] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0091] In recent years, the increase in vacant houses has become a social problem, raising concerns about the resulting abandonment and demolition of these houses, as well as increased tax burdens following legal reforms. In response, there is a need for a system that can provide specific proposals for the effective use of vacant houses, quickly and efficiently generate renovation plans, and expedite contract procedures. Conventional methods involve separate steps, placing a heavy burden on users and lengthening the overall process.

[0092] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0093] In this invention, the server includes: a means for a user to input basic information and additional information about a property; a means for confirming the consistency of the basic information and additional information; a means for generating a renovation plan based on the confirmed consistency of the information; a means for presenting the renovation plan to the user; a means for generating an estimate and contract based on the renovation plan selected by the user; a means for electronically transmitting the estimate and contract to the user for online confirmation and correction; and a means for electronically signing online and completing the contract procedure. This makes it possible to consistently perform the entire process from generating an effective renovation plan for a vacant house to the contract procedure.

[0094] "User" refers to the person or entity that inputs information about a particular property and generates, reviews, or selects a renovation plan.

[0095] "Property" refers to the building or room that will be renovated using this system.

[0096] "Basic information" refers to the main attributes of the property, such as the area, age, and number of rooms.

[0097] "Additional information" refers to detailed information provided in addition to basic information, such as videos, photos, and comments about the property's current state.

[0098] "Integrity" means that the input data is valid and internal consistency is ensured.

[0099] A "renovation plan" refers to a proposed plan for remodeling or repairing a property based on the information entered.

[0100] "Quotation" refers to a detailed statement of costs based on the selected renovation plan.

[0101] "Contract" refers to a document that sets out the terms and conditions of the construction work to be carried out based on the renovation plan.

[0102] "Electronic transmission" refers to the server sending documents or information to a user using electronic means.

[0103] "Online" refers to processes or procedures conducted over the Internet or a network.

[0104] "Electronic Signature" means a legally recognized form of digital signature.

[0105] "Server" refers to a computer system that receives and processes user input information.

[0106] A "generative AI model" refers to a program that generates renovation plans using artificial intelligence technology.

[0107] A "prompt" is a sentence containing specific instructions to be input into an AI model to obtain a result.

[0108] This invention relates to a system that efficiently plans renovations of vacant houses and allows users to complete contract procedures online. The system uses hardware and software such as a web interface, a server, a generative AI model, a database, and an electronic signature system.

[0109] A specific embodiment of this system will now be described.

[0110] Overall system overview

[0111] This system allows users to input basic and additional information about a property through a web interface, and then generates a renovation plan based on that information and presents it to the user.The system also automatically generates estimates and contracts based on the plan selected by the user, allowing contract procedures to be completed online through electronic signatures.

[0112] Hardware and Software

[0113] Server: Receives input from users, processes it, and passes it to the generative AI model. It also checks consistency, generates renovation plans, and generates estimates and contracts.

[0114] Web interface: Provides a screen for users to access and enter information. Uses web technologies such as HTML, CSS, and JavaScript (registered trademark).

[0115] Generative AI model: An artificial intelligence model that generates optimal renovation plans from input information. The plan is generated based on renovation examples and rental market data from around the world.

[0116] Database: Stores data such as information entered by users, generated renovation plans, estimates, and contracts.

[0117] Electronic Signature System: A system that allows users to electronically sign contracts online.

[0118] User operation example

[0119] Users access a dedicated web interface and enter basic information about their property (e.g., area, age, number of rooms, etc.) and then upload additional information such as videos and photos of the current state and comments.

[0120] Examples:

[0121] The user enters the following information: "40 years old, 150 square meters, 5 rooms."

[0122] A user uploads three photos of their living room with the comment "The living room wall is cracked."

[0123] Prompt Sentence Examples

[0124] We also provide specific examples of prompt sentences to be input into the generative AI model.

[0125] Example prompt sentence:

[0126] "A user owns a 40-year-old property. The property is 150 square meters and has a total of five rooms. The user has uploaded three photos along with a comment that the current living room wall is cracked. Please suggest the best renovation plan based on this information."

[0127] This system allows users to easily create renovation plans for vacant houses and complete contract procedures online, promoting the effective use of vacant houses and leading to the provision of high-quality housing.

[0128] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0129] Step 1:

[0130] The user accesses the web interface. The user accesses the specified URL from a web browser on their device. The input at this stage is the user's access request, and the output is the web interface displayed.

[0131] Step 2:

[0132] The user enters basic information. On the web interface, the user enters basic information about the property, such as the area, age, and number of rooms. This information is sent to the server, which receives the information and stores it in a database. The input data might be {area: 150 square meters, age: 40 years, number of rooms: 5}, and the output is the saved result of that data.

[0133] Specific working example:

[0134] The user enters the following information into the form: Area: 150 square meters, Age: 40 years, Number of rooms: 5.

[0135] Step 3:

[0136] The user inputs additional information. The user inputs additional information such as current video, photos, and comments through a web interface. This information is also sent to the server and stored in the database. The input data is photo files and text comments, and the output is the saved result of that data.

[0137] Specific working example:

[0138] A user uploaded three photos of the living room with the comment, "The living room wall is cracked."

[0139] Step 4:

[0140] The server verifies the integrity of the information. The server checks the integrity of the basic and additional information received from the user. It verifies that the data is valid and that all required information is present. The input is the information stored in the database and the output is the result of the integrity check.

[0141] Specific working example:

[0142] The server checks the information "150 square meters," "40 years," and "5 rooms" and verifies that there are no problems.

[0143] Step 5:

[0144] The server inputs data into the generative AI model. Based on the information whose consistency has been confirmed, the server generates a prompt statement to pass to the generative AI model. This prompt statement is the basis for generating a renovation plan. The input is the data whose consistency has been confirmed, and the output is the generated prompt statement.

[0145] Specific working example:

[0146] Prompt: "The user owns a 40-year-old property. It is 150 square meters and has five rooms. They have uploaded three photos, along with a comment about the cracks in the current living room wall. Based on this information, please suggest the best renovation plan."

[0147] Step 6:

[0148] The generative AI model generates renovation plans based on prompt statements sent from the server. The input is the prompt statement, and the output is multiple renovation plans.

[0149] Specific working example:

[0150] The AI ​​generated Plan A: Complete renovation (modern design, earthquake resistance reinforcement), Plan B: Renovation of the kitchen and living room, and Plan C: Interior changes (changing wallpaper and flooring).

[0151] Step 7:

[0152] The server presents the generated plan to the user. The server displays the generated renovation plan on a web interface and presents it to the user. The input is the generated renovation plan, and the output is the display result on the web interface.

[0153] Specific working example:

[0154] The server displays an overview and detailed information for Plan A, Plan B, and Plan C on a web page.

[0155] Step 8:

[0156] The user selects the optimal renovation plan. The user compares the presented plans and selects the optimal plan. This selection is sent to the server. The input is the user's selected plan, and the output is the selection information.

[0157] Specific working example:

[0158] The user selects Plan A and clicks the Select button.

[0159] Step 9:

[0160] The server automatically generates an estimate and sends it to the user. The server generates an estimate based on the selected plan and electronically sends it to the user. The input is the selected renovation plan, and the output is the estimate generation and transmission results.

[0161] Specific working example:

[0162] The server generates a quote and sends it to the user's email address.

[0163] Step 10:

[0164] The user checks the estimate and submits a request for revision. The user checks the estimate online and submits a request for revision to the server if necessary. The input is the estimate and the user's request for revision, and the output is the result received by the server.

[0165] Specific working example:

[0166] The user checks the quote and submits a correction request.

[0167] Step 11:

[0168] The server automatically generates the final contract and sends it to the user. If the user finally agrees to the quote, the server automatically generates and sends the contract. The input is the final adjusted quote, and the output is the generated contract and the transmission result.

[0169] Specific working example:

[0170] The server generates a contract and sends it to the user's email address.

[0171] Step 12:

[0172] The user electronically signs the contract and completes it. The user reviews the contract and completes it by signing electronically online. The input is the user's electronic signature, and the output is the contract completion status.

[0173] Specific working example:

[0174] The user electronically signs the contract to complete it.

[0175] These are the specific processing steps of the "Vacant House Utilization AI Planner." This system can efficiently carry out everything from generating renovation plans for vacant houses to contract procedures.

[0176] (Application example 1)

[0177] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0178] Currently, many factories face the problem of insufficient optimization of equipment and layout, making efficient operation difficult. In particular, excessive use of old equipment or inappropriate placement of new equipment can lead to reduced production efficiency and increased operating costs. Furthermore, the time and effort required for factory managers to input equipment and layout information makes it difficult to quickly create optimization plans. There is a need for a system that can solve these problems and support efficient factory operation.

[0179] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0180] In this invention, the server includes means for a user to input basic information and additional information about a vacant house, means for confirming consistency between the basic information and the additional information, means for generating a renovation plan based on the confirmed consistency of the information, means for presenting the renovation plan to the user, means for generating an estimate and contract based on the renovation plan selected by the user, means for a factory manager to input factory equipment information and layout information, means for confirming consistency of the factory equipment information and layout information, and means for generating an optimization plan for equipment placement and layout based on the generated plan. This allows the factory manager to quickly input equipment information and layout information and receive suggestions for efficient optimization plans.

[0181] "Basic information" refers to key data such as the area, age, number of rooms, and facility information of vacant houses and factories.

[0182] "Additional information" is supplementary data such as videos, photos, and comments about the current state of vacant houses and factories.

[0183] "Integrity" refers to checking the consistency and accuracy of the basic information and additional information entered.

[0184] A "renovation plan" is a proposed plan for renovating or changing the layout of vacant houses or factories, created using a generative AI model.

[0185] "User" refers to anyone who uses this system, such as an owner of a vacant house or a factory manager.

[0186] An "estimate" is a document that estimates costs based on the renovation plan selected by the user.

[0187] A "contract" is a formal agreement document regarding the implementation of the renovation plan selected by the user.

[0188] "Factory manager" refers to a person who manages factory equipment information and layout information and uses this system to obtain optimization plans.

[0189] "Facility information" is detailed information about the machines and equipment installed in the factory.

[0190] "Layout information" is information about the layout of facilities and equipment within a factory.

[0191] An "optimization plan" is a proposed plan for equipment placement and layout to maximize production efficiency within a factory.

[0192] A "generative AI model" is an artificial intelligence model that automatically generates renovation plans and optimization plans based on input information.

[0193] A "prompt sentence" is a question or instruction sentence that is displayed to the user to prompt them to make a specific input.

[0194] System Overview

[0195] This invention is a system that allows users to input basic and additional information about vacant houses and factories, and then uses a generative AI model to generate optimal renovation plans or facility layout optimization plans based on that information. The system operates through a web interface, and aims to complete the entire process online.

[0196] Hardware and software used

[0197] Hardware

[0198] Smart glasses (e.g., Microsoft® HoloLens®): A device that makes it easier for users to input information about factory equipment and layout.

[0199] Server (e.g., AWS (registered trademark) EC2 instance): Computing resources for running AI models based on input information and generating plans.

[0200] software

[0201] Generative AI model: An artificial intelligence model that generates renovation and optimization plans based on input information.

[0202] Document Generator: Software for automatically generating quotes and contracts.

[0203] Processing flow

[0204] Enter user information

[0205] Users can input basic and additional information about vacant houses and factories through a web interface or smart glasses. For example, in the case of a factory, a factory manager can use smart glasses to capture the current equipment and layout information and add any necessary comments or notes.

[0206] Specific examples

[0207] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[0208] The factory manager enters a comment such as "There is an excessive amount of old equipment deployed."

[0209] Information consistency check

[0210] The server verifies the integrity of the basic and additional information entered, checking for incorrect or missing data and ensuring that each is consistent.

[0211] Generative AI Planning

[0212] Based on the information that has been confirmed to be consistent, the server uses a generative AI model to generate renovation plans and facility layout optimization plans, which include full renovations, partial renovations, and interior changes.

[0213] Specific examples

[0214] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[0215] Plan B: Partial renovation (living room and kitchen renovation)

[0216] Plan C: Interior changes (wallpaper and flooring changes)

[0217] Plan presentation and selection

[0218] The generated plans are presented to the user via a web interface, where the user can compare the plans and select the most suitable one.

[0219] Prompt Sentence Examples

[0220] Enter the number of your selected plan:

[0221] 1: Plan A - Full renovation

[0222] 2: Plan B - Partial Renovation

[0223] 3: Plan C - Interior Changes

[0224] Generate quotes and contracts

[0225] Once the user selects the most suitable plan, the server automatically generates a quote and sends it to the user electronically. If the user agrees to the quote, a contract is automatically generated and the contract procedure is completed through an electronic signature.

[0226] Specific examples

[0227] The user selects Plan A and clicks Request a Quote.

[0228] The server automatically generates a quote and sends it to the user.

[0229] The user confirms the contract details and completes the contract by signing electronically.

[0230] The system will enable the rapid and efficient renovation and optimization of vacant houses and factories.

[0231] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0232] Step 1:

[0233] The server accepts input from users via a web interface or smart glasses. Here, users enter basic information about the vacant house or factory (area, age, number of rooms, equipment information, etc.) and additional information (videos and photos of the current state, comments, etc.). The entered data is temporarily stored.

[0234] Input: Area, age, number of rooms, facility information, video, photos, comments

[0235] Output: Temporarily saved user input information

[0236] Step 2:

[0237] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data and ensuring that each is consistent, for example, checking that the number of rooms is not negative, that the square footage is realistic, etc.

[0238] Input: User-entered information

[0239] Output: User-entered information with integrity checked

[0240] Step 3:

[0241] The server inputs the confirmed information into a generative AI model and begins generating renovation or optimization plans. The generative AI model creates multiple plans based on housing examples from around the world, factory equipment data, and market rental data.

[0242] Input: User-entered information whose integrity is checked

[0243] Output: Generated plans (e.g., full renovation, partial renovation, interior modification, etc.)

[0244] Step 4:

[0245] The server presents the generated plans to the user through a web interface, where the user can compare them and select the most suitable plan, which includes images, detailed descriptions, 3D modeling, and audio guides.

[0246] Input: Generated plans

[0247] Output: Plan selected by user

[0248] Step 5:

[0249] The server automatically generates an estimate based on the plan selected by the user and electronically transmits it to the user, including details such as the renovation cost and required time.

[0250] Input: User selects plan

[0251] Output: Auto-generated quote

[0252] Step 6:

[0253] If the user agrees with the quote, the server automatically generates a contract, which is completed through an electronic signature and includes details of the work, a schedule, and legally binding terms.

[0254] Input: User accepts quote

[0255] Output: Auto-generated contract and completion of contract with electronic signature

[0256] In this way, the system can process a series of steps, from inputting information from the user to presenting the optimal plan and automatically generating estimates and contracts.

[0257] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0258] Our invention, the "Vacant House Utilization AI Planner," is a system that recognizes user emotions and optimizes the way renovation plans are presented by combining an emotion engine. The system allows users to input basic and additional information about a vacant house, and then uses a generative AI to generate an optimal renovation plan and present it to the user. Furthermore, by adjusting the proposed plan based on the user's emotions, the system can provide more personalized proposals. The system also aims to automatically generate estimates and contracts based on the plan selected by the user, allowing the contract process to be completed online through electronic signatures.

[0259] System configuration

[0260] The system consists of the following main components:

[0261] 1. User input means: A web interface for entering basic and additional information about vacant properties.

[0262] 2. Consistency check measures: Check the validity of the information entered.

[0263] 3. Renovation plan generation method: Based on the information whose consistency has been confirmed, the generation AI creates the optimal renovation plan.

[0264] 4. Emotion engine: Analyzes the user's facial expressions and voice to recognize emotions.

[0265] 5. Plan presentation method: Using data from the emotion engine, renovation plans are presented to the user.

[0266] 6. Estimate and contract generation means: Automatically generate estimates and contracts based on the renovation plan selected by the user.

[0267] User Input

[0268] Through the web interface, users input basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, users click the "Submit" button, which sends the input information to the server.

[0269] example:

[0270] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[0271] The user enters a comment about the current state, such as "Part of the wall is damaged."

[0272] Checking the integrity of information

[0273] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data, such as whether the area is less than or equal to 0 or the number of rooms is a negative number.

[0274] example:

[0275] Does the property meet certain conditions, such as an area of ​​less than 100 square meters and being more than 30 years old?

[0276] Generate renovation plans

[0277] Based on the information that has been confirmed to be consistent, the server inputs the data into the generation AI, which then begins generating renovation plans. The generation AI then creates multiple plans based on renovation examples from around the world and market rental data. These plans include full renovations, partial renovations, and interior changes.

[0278] example:

[0279] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[0280] Plan B: Partial renovation (living room and kitchen renovation)

[0281] Plan C: Interior changes (wallpaper and flooring changes)

[0282] Emotional engine regulation

[0283] When presenting the generated renovation plans, the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. Based on the emotion data acquired by the emotion engine, the server adjusts how the renovation plans are presented. For example, it may prioritize the display of plans that the user is interested in.

[0284] example:

[0285] If the user smiles at Plan A, the server will display the details of Plan A preferentially.

[0286] If the user shows signs of dissatisfaction with Plan B, the server will change the way Plan B is presented.

[0287] Generate quotes and contracts

[0288] Once the user selects the most suitable plan, the server automatically generates a quote and sends it electronically to the user. The user can check the quote online and submit revision requests as necessary. Finally, if the user agrees to the quote, a contract is automatically generated. The entire contract process is completed online, allowing the user to sign electronically.

[0289] example:

[0290] The user selects Plan A and clicks Request a Quote.

[0291] The server automatically generates a quote and sends it to the user.

[0292] The user confirms the contract details and completes the contract by signing electronically.

[0293] In this way, by combining an emotion engine that recognizes the user's emotions, the present invention enables the presentation of personalized renovation plans and efficient contract procedures.

[0294] The processing flow will be explained below.

[0295] (Specific steps for carrying out the invention)

[0296] Step 1:

[0297] The user accesses a dedicated web interface and enters basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, the user clicks the "Submit" button, and the input information is sent to the server.

[0298] Step 2:

[0299] The server receives the information sent by the user and checks the consistency of the basic information and additional information. It checks whether invalid data (e.g., area less than 0, age of building more than 100 years, etc.) is included. If an inconsistency is found, the server returns an error message to the user and prompts them to re-enter the information.

[0300] Step 3:

[0301] The server inputs the information that has been confirmed to be consistent into the generation AI, which then begins generating renovation plans based on the received data. At this point, multiple plans are created, referring to renovation examples and rental market data from around the world.

[0302] Step 4:

[0303] The generation AI returns renovation plans (e.g., Plan A, Plan B, and Plan C) to the server. Plan A includes specific details such as a full renovation (modern design, earthquake-resistance reinforcement), Plan B includes partial renovations (renovation of the living room and kitchen), and Plan C includes interior changes (changing wallpaper and flooring).

[0304] Step 5:

[0305] The server displays multiple renovation plans received from the generation AI on a web interface, allowing users to review the plans and view details of each plan (images, 3D modeling, audio guides, etc.).

[0306] Step 6:

[0307] While the user is checking the plan, the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The server receives the data from the emotion engine in real time and determines whether the user is interested or dislikes the plan.

[0308] Step 7:

[0309] The server adjusts how the plans are presented based on the user's emotions. For example, if the user smiles at Plan A, the server will prioritize displaying the details of Plan A, making it easier for the user to see the details. On the other hand, if the user shows dissatisfaction with Plan B, the server will reevaluate Plan B along with the other plans and adjust their order and content.

[0310] Step 8:

[0311] After the user selects the most suitable plan, he / she clicks the "Request a Quote" button. The server automatically generates a quote based on the selected plan and sends it electronically to the user. The user can check the quote online and, if necessary, submit a request for revisions to the server.

[0312] Step 9:

[0313] The server receives the correction request, uses the generation AI again to create a revised quotation, and sends the revised quotation back to the user.

[0314] Step 10:

[0315] When the user agrees to the final estimate, he or she clicks the "Generate Contract" button. The server automatically generates a contract and sends it electronically to the user. The user then confirms the contract contents and completes the contract procedure by signing electronically.

[0316] Through these steps, the "Vacant House Utilization AI Planner" can quickly and efficiently provide users with plans for effective utilization of vacant houses, and by utilizing its emotion engine, it can make more personalized proposals and complete the process from negotiation to contract in one continuous process.

[0317] Example 2

[0318] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0319] Conventional systems that propose renovation plans do not take the user's emotions into consideration, and therefore may not be able to present the optimal plan for the user. Furthermore, to efficiently proceed with contract procedures, it is essential to generate estimates and contracts online and to digitally sign them, but no system with this functionality existed.

[0320] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for the user to input basic information and additional information about the vacant house, a means for checking consistency, a means for generating a renovation plan, a means for adjusting and presenting the generated renovation plan based on the user's feelings, and a means for generating an estimate and contract based on the plan selected by the user and providing electronic signature procedures. This makes it possible to present an optimal renovation plan that takes the user's feelings into consideration and to carry out efficient online contract procedures.

[0321] "User" refers to an individual or corporation that uses the system to input information about vacant houses and select a renovation plan.

[0322] "Vacant house" refers to a building or house that has no occupants.

[0323] "Basic information" refers to key data about vacant houses, such as area, age, and number of rooms.

[0324] "Additional information" refers to supplementary data other than basic information, such as photos, videos, and comments about the vacant house.

[0325] "Integrity" refers to the process of verifying that entered data is accurate and complete.

[0326] A "renovation plan" refers to a specific proposal for renovating or remodeling a vacant house.

[0327] "Emotion" refers to the psychological state of the user as analyzed from their facial expressions and voice.

[0328] "Quotation" refers to a document that details the costs calculated based on the renovation plan.

[0329] "Contract" refers to the official agreement between the User and the System Provider regarding the implementation of the Renovation Plan.

[0330] "Electronic signature" refers to a digital form of signature used to sign a contract online.

[0331] The present invention, the "Vacant House Utilization AI Planner," is a system that recognizes user emotions and optimizes the presentation of renovation plans by combining an emotion engine. The system allows users to input basic and additional information about a vacant house, and then uses a generative AI model to generate an optimal renovation plan and present it to the user. Furthermore, by adjusting the proposed plan based on the user's emotions, the system can provide more personalized proposals. The system also aims to automatically generate estimates and contracts based on the plan selected by the user, allowing the contract procedure to be completed online through electronic signatures.

[0332] System configuration

[0333] The system consists of the following main components:

[0334] 1. User input means: The user inputs basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments on the current state, etc.) into the web interface via their terminal. Specifically, the user enters information into the provided input form and clicks the send button, which causes the terminal to send the necessary information to the server.

[0335] Examples:

[0336] Users upload information about a 30-year-old, 120-square-meter, four-room property, along with photos of its current condition.

[0337] The user enters a comment such as "Part of the wall is damaged" and presses the send button.

[0338] 2. Consistency check: The server checks the consistency of the received basic information and additional information. Specifically, it checks whether the area is less than or equal to 0 or the number of rooms is a negative number, and checks for invalid or missing data.

[0339] Examples:

[0340] The server stores the newly received information in a database.

[0341] If the server finds that the area is less than or equal to 0 or the number of rooms is negative, it generates an error message and sends it to the user.

[0342] If the server determines that the input data is valid, it proceeds to the next step.

[0343] 3. Renovation plan generation method: The server inputs the information that has been confirmed to be consistent into the generative AI model to generate a renovation plan. The generative AI model creates multiple plans based on building examples and rental market data from around the world. This process includes three types: full renovation, partial renovation, and interior remodeling.

[0344] Examples:

[0345] The server sends the input information (area, age of building, number of rooms, comments, photos) to the generative AI model.

[0346] The generative AI model generates Plan A (full renovation), Plan B (partial renovation), and Plan C (interior changes).

[0347] The server temporarily saves the generated plan.

[0348] 4. Adjustment by emotion engine: The server uses the emotion engine to analyze the user's facial expressions and voice to recognize their emotions. Based on the recognized emotion data, the server adjusts the way the renovation plan is presented. This allows the server to effectively present information that matches the user's interests and preferences.

[0349] Examples:

[0350] The server sends the facial expressions and tone of voice of the user while viewing Plan A to the emotion engine.

[0351] If the emotion engine detects that the user is smiling, the server will display the details of Plan A first.

[0352] For Plan B, which is less interesting to the user, the server updates the proposal and presents it from a different perspective.

[0353] 5. Estimate and contract generation means: Once the user selects the optimal renovation plan, the server automatically creates an estimate and contract and sends them electronically to the user. The user can review these documents online and request revisions as necessary. Finally, if the user agrees, the contract is concluded online.

[0354] Examples:

[0355] The user selects Plan A and clicks the Request a Quote button.

[0356] The server automatically generates a quote and contract and emails it to the user.

[0357] The user reviews the quote and contract and electronically signs them.

[0358] The server verifies the signature and notifies the user that the contract is valid.

[0359] Prompt Sentence Examples

[0360] Below are some example prompts to input to a generative AI model:

[0361] "Generate three renovation plans for a 30-year-old, 120-square-meter, 4-room vacant house: a full renovation, a partial renovation, and an interior change."

[0362] "If the user smiles at Plan A, prioritize showing the details of Plan A."

[0363] "Based on user selections, automatically generate quotes and contracts and complete the process until e-signature is complete."

[0364] The above are the specific steps for implementing the invention. This system takes into account the user's emotions, presents personalized renovation plans, and enables efficient contract procedures.

[0365] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0366] Step 1:

[0367] Users input basic and additional information about the vacant house into a web interface via their device and submit it. The input information includes the area, age of the building, number of rooms, video, photos, and comments about the current state of the house.

[0368] Specific behavior:

[0369] The user enters basic information such as "30 years old, 120 square meters, 4 rooms" into an input form on a web interface.

[0370] The user selects a photo file and clicks the upload button.

[0371] The user enters a comment such as "Part of the wall is damaged" and presses the send button.

[0372] Input: Basic information and additional information entered by the user

[0373] Output: User information sent to the server

[0374] Step 2:

[0375] The server verifies the integrity of the received user basic information and additional information, checking for any incorrect or missing data and verifying that the information is valid.

[0376] Specific behavior:

[0377] The server stores the newly received information in a database.

[0378] If the server finds that the area is less than or equal to 0 or the number of rooms is negative, it generates an error message and sends it to the user.

[0379] If the server determines that the input data is valid, it proceeds to the next step.

[0380] Input: User information received by the server

[0381] Output: Information that has been verified as consistent, or an error message

[0382] Step 3:

[0383] The server inputs the confirmed consistency information into a generative AI model to generate an optimal renovation plan. The generative AI model then references building examples and rental price data from around the world to create multiple renovation plans.

[0384] Specific behavior:

[0385] The server sends the input information (area, age of building, number of rooms, comments, photos) to the generative AI model.

[0386] The generative AI model generates Plan A (full renovation), Plan B (partial renovation), and Plan C (interior changes).

[0387] The server temporarily saves the generated plan.

[0388] Input: Information whose integrity has been verified

[0389] Output: Generated renovation plan

[0390] Step 4:

[0391] The server uses an emotion engine to analyze the user's facial expressions and voice to recognize their emotions. Based on the recognized emotion data, the server adjusts the way it presents renovation plans.

[0392] Specific behavior:

[0393] The server sends the facial expressions and tone of voice of the user while viewing Plan A to the emotion engine.

[0394] If the emotion engine detects that the user is smiling, the server will display the details of Plan A first.

[0395] For Plan B, which is less interesting to the user, the server updates the proposal and presents it from a different perspective.

[0396] Input: User's facial expression and voice data

[0397] Output: Renovation plan tailored based on emotions

[0398] Step 5:

[0399] Once the user selects the optimal renovation plan, the server automatically creates an estimate and contract and sends them electronically to the user. The user can review these documents online and request revisions as necessary. Finally, if the user agrees, the contract is concluded online.

[0400] Specific behavior:

[0401] The user selects Plan A and clicks the Request a Quote button.

[0402] The server automatically generates a quote and contract and emails it to the user.

[0403] The user reviews the quote and contract and electronically signs them.

[0404] The server verifies the signature and notifies the user that the contract is valid.

[0405] Input: Renovation plan selected by the user

[0406] Output: Generated quote and contract, online contract completion notification

[0407] (Application example 2)

[0408] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0409] Conventional renovation plan proposal systems present a uniform plan without considering the user's emotions, making it difficult to improve the user experience. Furthermore, when proposing renovation plans in a brick-and-mortar store, plans that reflect the user's emotions in real time are required, but no such system exists. Furthermore, streamlining online contract procedures is also an issue.

[0410] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to input basic information and additional information about a building, means for confirming consistency between the basic information and additional information, means for generating a renovation plan based on the confirmed consistency, means for analyzing the user's emotions using an emotion recognition engine and adjusting the presentation method of the renovation plan, means for presenting the renovation plan to the user, means for generating an estimate and a contract based on the renovation plan selected by the user, and means for providing an electronic signature procedure. This enables the presentation of a personalized renovation plan that reflects the user's emotions and efficient contract procedures in a physical store.

[0411] A "building" is a structure constructed for human habitation or business purposes.

[0412] "Basic information" refers to important data about the building, such as the building's area, age, and number of rooms.

[0413] "Additional information" is supplementary data that accompanies basic information such as building footage, photos, and comments on the current state of the building.

[0414] "Renovation Plan" means a specific plan or proposal for improving the interior or exterior of a building.

[0415] An "emotion recognition engine" refers to a system or function that analyzes a user's facial expressions and voice and recognizes their emotions.

[0416] "Integrity check measures" refers to the functions and processes that verify that the basic and additional information entered is accurate and complete.

[0417] "Means for adjusting presentation method" refers to the function or process of presenting information to the user in the most optimal format based on the emotion recognition engine.

[0418] An "quote" is a document detailing the costs to be incurred based on the renovation plan.

[0419] A "contract" is a legal document that details the agreements between the parties regarding the renovation plans.

[0420] "Electronic signature" refers to the technology and process for electronically authenticating and agreeing to contracts and estimates.

[0421] "Means for generating a renovation plan based on information whose consistency has been confirmed" refers to the function or process of creating an optimal renovation plan based on information entered by the user after verifying its accuracy.

[0422] The present invention provides a system that allows users to input basic and additional information about a building, generates an optimal renovation plan based on the input, and presents the plan through an emotion recognition engine. This system allows users to use smart glasses in a brick-and-mortar store, performs emotion recognition in real time, proposes a personalized renovation plan based on the user's emotions in real time, and finally completes the online contract procedure.

[0423] Hardware and software used

[0424] The system uses the following hardware and software:

[0425] 1. Smart glasses: worn by users in physical stores and support input and emotion recognition.

[0426] 2. Camera and video capture device: Captures the user's facial expressions in real time and provides data to the emotion recognition engine.

[0427] 3. Server: Organizes input data, generates renovation plans, analyzes emotion data, and automatically generates estimates and contracts.

[0428] Data processing and calculation

[0429] 1. Enter basic and additional information and check consistency:

[0430] Users enter basic building information (area, age, number of rooms) and additional information (video, photos, comments, etc.) through smart glasses.

[0431] The server checks the consistency of the entered basic information and additional information and verifies that there is no invalid data.

[0432] 2. Generate renovation plans:

[0433] The server then generates a renovation plan by sending a prompt to the generative AI model based on the information that has been verified to be consistent. An example of a prompt is as follows:

[0434] Vacant house information: Area 120 sqm, Age 30 years, Number of rooms 4, Comments: Part of wall damaged. Generate the optimal renovation plan.

[0435] The server receives and stores the generated multiple renovation plans.

[0436] 3. Emotion recognition and plan presentation adjustment:

[0437] When the user wears the smart glasses, the camera captures the user's facial expressions, which are then analyzed by an emotion recognition engine.

[0438] Based on the results of the emotion recognition engine, the server adjusts the way renovation plans are presented according to the user's emotions, for example, by prioritizing and displaying details of plans that the user is interested in.

[0439] 4. Generate quotes and contracts:

[0440] Once the user selects the optimal renovation plan, the server automatically generates an estimate and contract, and completes the online contract through an electronic signature procedure.

[0441] Specific examples

[0442] For example, a user wants to renovate a 30-year-old house, so they put on smart glasses in a brick-and-mortar showroom. Using the glasses, they input the building's area, number of rooms, and comments on current damage, and the data is sent to a server. The server checks the consistency of the information and sends prompts to a generative AI model to generate multiple renovation plans.

[0443] Then, as the user reviews their options, a camera captures their facial expressions in real time, and an emotion recognition engine analyzes their reactions: for example, if the user smiles at a particular renovation plan, the plan is displayed in detail.

[0444] The server automatically generates a quote for the plan the user finally selects, and once the user agrees to the terms, an electronic signature is carried out to complete the contract, making the entire process efficient and improving the user experience.

[0445] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0446] Step 1:

[0447] The user inputs basic building information (area, age, number of rooms) and additional information (video, photos, comments, etc.) through the smart glasses. The input information is sent from the smart glasses to the server. The input in this step is information about the user's building, and the output is that information is sent to the server. Specifically, the user operates the interface of the smart glasses to input data for each item.

[0448] Step 2:

[0449] The server checks the consistency of the basic information and additional information entered. The input is the building information sent in the previous step, and the output is the information whose consistency has been confirmed. The server checks for invalid or missing data to ensure reliable information. Specifically, the server validates the format of the data, for example, checking that the area is not a negative number.

[0450] Step 3:

[0451] Based on the information whose consistency has been confirmed, the server sends a prompt to the generative AI model to generate a renovation plan. The input is the building information whose consistency has been confirmed, and the output is multiple generated renovation plans. Specifically, the data is passed to the AI ​​model as a prompt in the following format:

[0452] Vacant house information: Area 120 sqm, Age 30 years, Number of rooms 4, Comments: Part of wall damaged. Generate the optimal renovation plan.

[0453] A generative AI model analyzes this and generates multiple renovation plans.

[0454] Step 4:

[0455] When a user wears the smart glasses, the camera captures the user's facial expressions in real time, and the emotion recognition engine analyzes the emotions. The input is real-time video data captured by the camera, and the output is emotion data. Specifically, the emotion recognition engine analyzes the user's facial features and classifies emotions based on those features.

[0456] Step 5:

[0457] The server adjusts the presentation method of the renovation plan according to the user's emotions based on the results of the emotion recognition engine. The input is the emotion data and the generated renovation plan, and the output is the presentation method of the renovation plan adjusted based on the emotion. Specifically, the server displays the plan for which the user smiles in detail, and replaces the plan for which the user shows dissatisfaction with another plan.

[0458] Step 6:

[0459] When the user selects the optimal renovation plan, the server automatically generates an estimate and contract based on that plan. The input is the renovation plan selected by the user, and the output is the automatically generated estimate and contract. Specifically, the server creates an estimate that lists the necessary costs and conditions based on the contents of the selected plan, and also generates a contract that details the contract contents.

[0460] Step 7:

[0461] The user reviews the generated quotation and contract and completes the contract through the electronic signature procedure. The input is the generated quotation and contract, and the output is an electronically signed contract. Specifically, the user reviews the contents of the quotation and contract through the interface of the smart glasses and then electronically signs, officially establishing the contract.

[0462] The above are the specific processing steps in this system.

[0463] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0464] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0465] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0466] [Second embodiment]

[0467] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0468] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0469] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0470] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0471] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0472] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0473] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0474] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0475] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0476] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0477] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0478] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0479] A specific embodiment of the "Vacant House Utilization AI Planner" of the present invention will be described.

[0480] Overall system overview

[0481] The system uses a web interface to allow users to input basic and additional information about a vacant house, and then uses AI to generate an optimal renovation plan and present it to the user.The system also automatically generates estimates and contracts based on the plan selected by the user, allowing the user to complete the contract process online with an electronic signature.

[0482] User Input

[0483] Users enter basic and additional information about the vacant house through a dedicated web interface. Specifically, in addition to basic information such as area, age, and number of rooms, they enter additional information such as videos and photos of the current state and comments. This information is sent to the server and checked for consistency before being passed on to the generation AI.

[0484] example:

[0485] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[0486] The user enters a comment about the current state, such as "Part of the wall is damaged."

[0487] Checking the integrity of information

[0488] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data, such as whether the area is less than or equal to 0 or the number of rooms is a negative number.

[0489] example:

[0490] Does the property meet certain conditions, such as an area of ​​less than 100 square meters and being more than 30 years old?

[0491] Generative AI Planning

[0492] Based on the information that has been confirmed to be consistent, the server inputs the data into the generation AI, which then begins generating renovation plans. The generation AI then creates multiple plans, taking into account renovation examples from around the world and market rental data. These plans include full renovations, partial renovations, and interior changes.

[0493] example:

[0494] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[0495] Plan B: Partial renovation (living room and kitchen renovation)

[0496] Plan C: Interior changes (wallpaper and flooring changes)

[0497] Plan presentation and proposal

[0498] The server then presents the generated renovation plans to the user via a web interface. The user can compare the plans and select the one that best suits them. Each plan includes images, detailed descriptions, 3D modeling, and audio guides.

[0499] example:

[0500] User clicks to view details of Plan A.

[0501] The server displays the details of Plan A (project duration, budget, expected rent).

[0502] Generate quotes and contracts

[0503] Once the user selects the most suitable plan, the server automatically generates a quote and sends it electronically to the user. The user can check the quote online and submit revision requests as necessary. Finally, if the user agrees to the quote, a contract is automatically generated. The entire contract process is completed online, allowing the user to sign electronically.

[0504] example:

[0505] The user selects Plan A and clicks Request a Quote.

[0506] The server automatically generates a quote and sends it to the user.

[0507] The user confirms the contract details and completes the contract by signing electronically.

[0508] As described above, this invention provides a system that promotes the effective use of vacant houses and avoids abandonment, demolition, and increased tax burdens following legal reform. It also makes it possible to provide high-quality housing at affordable prices to the Y family generation.

[0509] The processing flow will be explained below.

[0510] Step 1:

[0511] The user accesses a dedicated web interface and enters basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, the user clicks the "Submit" button to send the information to the server.

[0512] Step 2:

[0513] The server receives the information sent by the user. It checks the basic and additional information for data consistency by checking whether the area and age of the property are within invalid ranges (area is less than 0, age is over 100 years, etc.). If an inconsistency is found, it returns an error message to the user.

[0514] Step 3:

[0515] The server inputs the information that has been confirmed to be consistent into the generation AI, which analyzes the received data and begins generating renovation plans by referencing housing examples and rental price data from around the world.

[0516] Step 4:

[0517] The generation AI creates multiple renovation plans (e.g., Plan A, Plan B, Plan C), including variations such as full renovation, partial renovation, and interior changes. The generated plans are returned to the server.

[0518] Step 5:

[0519] The server displays the renovation plans received from the AI ​​on a web interface. The user can review the multiple plans presented and compare them through images, detailed descriptions, 3D modeling, and audio guides for each plan.

[0520] Step 6:

[0521] Once the user selects the most suitable plan, he / she clicks the "Request a Quote" button, and the server automatically generates a quote based on the selected plan and electronically sends it to the user.

[0522] Step 7:

[0523] The user checks the estimate online and sends a request for revisions to the server if necessary. The server receives the request, uses the generation AI again to generate a revised estimate, and resends it to the user.

[0524] Step 8:

[0525] When the user agrees with the final quote, he clicks the "Generate Contract" button, and the server automatically generates a contract and sends it electronically to the user.

[0526] Step 9:

[0527] The user completes the electronic signature procedure online and sends it to the server, which officially concludes the contract.

[0528] Through these steps, the "Vacant House Utilization AI Planner" can quickly and efficiently provide users with plans for effective utilization of vacant houses, completing the entire process from negotiations to signing a contract in one go.

[0529] Example 1

[0530] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0531] In recent years, the increase in vacant houses has become a social problem, raising concerns about the resulting abandonment and demolition of these houses, as well as increased tax burdens following legal reforms. In response, there is a need for a system that can provide specific proposals for the effective use of vacant houses, quickly and efficiently generate renovation plans, and expedite contract procedures. Conventional methods involve separate steps, placing a heavy burden on users and lengthening the overall process.

[0532] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0533] In this invention, the server includes: a means for a user to input basic information and additional information about a property; a means for confirming the consistency of the basic information and additional information; a means for generating a renovation plan based on the confirmed consistency of the information; a means for presenting the renovation plan to the user; a means for generating an estimate and contract based on the renovation plan selected by the user; a means for electronically transmitting the estimate and contract to the user for online confirmation and correction; and a means for electronically signing online and completing the contract procedure. This makes it possible to consistently perform the entire process from generating an effective renovation plan for a vacant house to the contract procedure.

[0534] "User" refers to the person or entity that inputs information about a particular property and generates, reviews, or selects a renovation plan.

[0535] "Property" refers to the building or room that will be renovated using this system.

[0536] "Basic information" refers to the main attributes of the property, such as the area, age, and number of rooms.

[0537] "Additional information" refers to detailed information provided in addition to basic information, such as videos, photos, and comments about the property's current state.

[0538] "Integrity" means that the input data is valid and internal consistency is ensured.

[0539] A "renovation plan" refers to a proposed plan for remodeling or repairing a property based on the information entered.

[0540] "Quotation" refers to a detailed statement of costs based on the selected renovation plan.

[0541] "Contract" refers to a document that sets out the terms and conditions of the construction work to be carried out based on the renovation plan.

[0542] "Electronic transmission" refers to the server sending documents or information to a user using electronic means.

[0543] "Online" refers to processes or procedures conducted over the Internet or a network.

[0544] "Electronic Signature" means a legally recognized form of digital signature.

[0545] "Server" refers to a computer system that receives and processes user input information.

[0546] A "generative AI model" refers to a program that generates renovation plans using artificial intelligence technology.

[0547] A "prompt" is a sentence containing specific instructions to be input into an AI model to obtain a result.

[0548] This invention relates to a system that efficiently plans renovations of vacant houses and allows users to complete contract procedures online. The system uses hardware and software such as a web interface, a server, a generative AI model, a database, and an electronic signature system.

[0549] A specific embodiment of this system will now be described.

[0550] Overall system overview

[0551] This system allows users to input basic and additional information about a property through a web interface, and then generates a renovation plan based on that information and presents it to the user.The system also automatically generates estimates and contracts based on the plan selected by the user, allowing contract procedures to be completed online through electronic signatures.

[0552] Hardware and Software

[0553] Server: Receives input from users, processes it, and passes it to the generative AI model. It also checks consistency, generates renovation plans, and generates estimates and contracts.

[0554] Web Interface: Provides a screen for users to access and enter information. Uses web technologies such as HTML, CSS, and JavaScript.

[0555] Generative AI model: An artificial intelligence model that generates optimal renovation plans from input information. The plan is generated based on renovation examples and rental market data from around the world.

[0556] Database: Stores data such as information entered by users, generated renovation plans, estimates, and contracts.

[0557] Electronic Signature System: A system that allows users to electronically sign contracts online.

[0558] User operation example

[0559] Users access a dedicated web interface and enter basic information about their property (e.g., area, age, number of rooms, etc.) and then upload additional information such as videos and photos of the current state and comments.

[0560] Examples:

[0561] The user enters the following information: "40 years old, 150 square meters, 5 rooms."

[0562] A user uploads three photos of their living room with the comment "The living room wall is cracked."

[0563] Prompt Sentence Examples

[0564] We also provide specific examples of prompt sentences to be input into the generative AI model.

[0565] Example prompt sentence:

[0566] "A user owns a 40-year-old property. The property is 150 square meters and has a total of five rooms. The user has uploaded three photos along with a comment that the current living room wall is cracked. Please suggest the best renovation plan based on this information."

[0567] This system allows users to easily create renovation plans for vacant houses and complete contract procedures online, promoting the effective use of vacant houses and leading to the provision of high-quality housing.

[0568] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0569] Step 1:

[0570] The user accesses the web interface. The user accesses the specified URL from a web browser on their device. The input at this stage is the user's access request, and the output is the web interface displayed.

[0571] Step 2:

[0572] The user enters basic information. On the web interface, the user enters basic information about the property, such as the area, age, and number of rooms. This information is sent to the server, which receives the information and stores it in a database. The input data might be {area: 150 square meters, age: 40 years, number of rooms: 5}, and the output is the saved result of that data.

[0573] Specific working example:

[0574] The user enters the following information into the form: Area: 150 square meters, Age: 40 years, Number of rooms: 5.

[0575] Step 3:

[0576] The user inputs additional information. The user inputs additional information such as current video, photos, and comments through a web interface. This information is also sent to the server and stored in the database. The input data is photo files and text comments, and the output is the saved result of that data.

[0577] Specific working example:

[0578] A user uploaded three photos of the living room with the comment, "The living room wall is cracked."

[0579] Step 4:

[0580] The server verifies the integrity of the information. The server checks the integrity of the basic and additional information received from the user. It verifies that the data is valid and that all required information is present. The input is the information stored in the database and the output is the result of the integrity check.

[0581] Specific working example:

[0582] The server checks the information "150 square meters," "40 years," and "5 rooms" and verifies that there are no problems.

[0583] Step 5:

[0584] The server inputs data into the generative AI model. Based on the information whose consistency has been confirmed, the server generates a prompt statement to pass to the generative AI model. This prompt statement is the basis for generating a renovation plan. The input is the data whose consistency has been confirmed, and the output is the generated prompt statement.

[0585] Specific working example:

[0586] Prompt: "The user owns a 40-year-old property. It is 150 square meters and has five rooms. They have uploaded three photos, along with a comment about the cracks in the current living room wall. Based on this information, please suggest the best renovation plan."

[0587] Step 6:

[0588] The generative AI model generates renovation plans based on prompt statements sent from the server. The input is the prompt statement, and the output is multiple renovation plans.

[0589] Specific working example:

[0590] The AI ​​generated Plan A: Complete renovation (modern design, earthquake resistance reinforcement), Plan B: Renovation of the kitchen and living room, and Plan C: Interior changes (changing wallpaper and flooring).

[0591] Step 7:

[0592] The server presents the generated plan to the user. The server displays the generated renovation plan on a web interface and presents it to the user. The input is the generated renovation plan, and the output is the display result on the web interface.

[0593] Specific working example:

[0594] The server displays an overview and detailed information for Plan A, Plan B, and Plan C on a web page.

[0595] Step 8:

[0596] The user selects the optimal renovation plan. The user compares the presented plans and selects the optimal plan. This selection is sent to the server. The input is the user's selected plan, and the output is the selection information.

[0597] Specific working example:

[0598] The user selects Plan A and clicks the Select button.

[0599] Step 9:

[0600] The server automatically generates an estimate and sends it to the user. The server generates an estimate based on the selected plan and electronically sends it to the user. The input is the selected renovation plan, and the output is the estimate generation and transmission results.

[0601] Specific working example:

[0602] The server generates a quote and sends it to the user's email address.

[0603] Step 10:

[0604] The user checks the estimate and submits a request for revision. The user checks the estimate online and submits a request for revision to the server if necessary. The input is the estimate and the user's request for revision, and the output is the result received by the server.

[0605] Specific working example:

[0606] The user checks the quote and submits a correction request.

[0607] Step 11:

[0608] The server automatically generates the final contract and sends it to the user. If the user finally agrees to the quote, the server automatically generates and sends the contract. The input is the final adjusted quote, and the output is the generated contract and the transmission result.

[0609] Specific working example:

[0610] The server generates a contract and sends it to the user's email address.

[0611] Step 12:

[0612] The user electronically signs the contract and completes it. The user reviews the contract and completes it by signing electronically online. The input is the user's electronic signature, and the output is the contract completion status.

[0613] Specific working example:

[0614] The user electronically signs the contract to complete it.

[0615] These are the specific processing steps of the "Vacant House Utilization AI Planner." This system can efficiently carry out everything from generating renovation plans for vacant houses to contract procedures.

[0616] (Application example 1)

[0617] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0618] Currently, many factories face the problem of insufficient optimization of equipment and layout, making efficient operation difficult. In particular, excessive use of old equipment or inappropriate placement of new equipment can lead to reduced production efficiency and increased operating costs. Furthermore, the time and effort required for factory managers to input equipment and layout information makes it difficult to quickly create optimization plans. There is a need for a system that can solve these problems and support efficient factory operation.

[0619] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0620] In this invention, the server includes means for a user to input basic information and additional information about a vacant house, means for confirming consistency between the basic information and the additional information, means for generating a renovation plan based on the confirmed consistency of the information, means for presenting the renovation plan to the user, means for generating an estimate and contract based on the renovation plan selected by the user, means for a factory manager to input factory equipment information and layout information, means for confirming consistency of the factory equipment information and layout information, and means for generating an optimization plan for equipment placement and layout based on the generated plan. This allows the factory manager to quickly input equipment information and layout information and receive suggestions for efficient optimization plans.

[0621] "Basic information" refers to key data such as the area, age, number of rooms, and facility information of vacant houses and factories.

[0622] "Additional information" is supplementary data such as videos, photos, and comments about the current state of vacant houses and factories.

[0623] "Integrity" refers to checking the consistency and accuracy of the basic information and additional information entered.

[0624] A "renovation plan" is a proposed plan for renovating or changing the layout of vacant houses or factories, created using a generative AI model.

[0625] "User" refers to anyone who uses this system, such as an owner of a vacant house or a factory manager.

[0626] An "estimate" is a document that estimates costs based on the renovation plan selected by the user.

[0627] A "contract" is a formal agreement document regarding the implementation of the renovation plan selected by the user.

[0628] "Factory manager" refers to a person who manages factory equipment information and layout information and uses this system to obtain optimization plans.

[0629] "Facility information" is detailed information about the machines and equipment installed in the factory.

[0630] "Layout information" is information about the layout of facilities and equipment within a factory.

[0631] An "optimization plan" is a proposed plan for equipment placement and layout to maximize production efficiency within a factory.

[0632] A "generative AI model" is an artificial intelligence model that automatically generates renovation plans and optimization plans based on input information.

[0633] A "prompt sentence" is a question or instruction sentence that is displayed to the user to prompt them to make a specific input.

[0634] System Overview

[0635] This invention is a system that allows users to input basic and additional information about vacant houses and factories, and then uses a generative AI model to generate optimal renovation plans or facility layout optimization plans based on that information. The system operates through a web interface, and aims to complete the entire process online.

[0636] Hardware and software used

[0637] Hardware

[0638] Smart glasses (e.g., Microsoft HoloLens): A device that makes it easier for users to input information about factory equipment and layout.

[0639] Server (e.g., AWS EC2 instance): Computing resources that run AI models based on input information and generate plans.

[0640] software

[0641] Generative AI model: An artificial intelligence model that generates renovation and optimization plans based on input information.

[0642] Document Generator: Software for automatically generating quotes and contracts.

[0643] Processing flow

[0644] Enter user information

[0645] Users can input basic and additional information about vacant houses and factories through a web interface or smart glasses. For example, in the case of a factory, a factory manager can use smart glasses to capture the current equipment and layout information and add any necessary comments or notes.

[0646] Specific examples

[0647] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[0648] The factory manager enters a comment such as "There is an excessive amount of old equipment deployed."

[0649] Information consistency check

[0650] The server verifies the integrity of the basic and additional information entered, checking for incorrect or missing data and ensuring that each is consistent.

[0651] Generative AI Planning

[0652] Based on the information that has been confirmed to be consistent, the server uses a generative AI model to generate renovation plans and facility layout optimization plans, which include full renovations, partial renovations, and interior changes.

[0653] Specific examples

[0654] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[0655] Plan B: Partial renovation (living room and kitchen renovation)

[0656] Plan C: Interior changes (wallpaper and flooring changes)

[0657] Plan presentation and selection

[0658] The generated plans are presented to the user via a web interface, where the user can compare the plans and select the most suitable one.

[0659] Prompt Sentence Examples

[0660] Enter the number of your selected plan:

[0661] 1: Plan A - Full renovation

[0662] 2: Plan B - Partial Renovation

[0663] 3: Plan C - Interior Changes

[0664] Generate quotes and contracts

[0665] Once the user selects the most suitable plan, the server automatically generates a quote and sends it to the user electronically. If the user agrees to the quote, a contract is automatically generated and the contract procedure is completed through an electronic signature.

[0666] Specific examples

[0667] The user selects Plan A and clicks Request a Quote.

[0668] The server automatically generates a quote and sends it to the user.

[0669] The user confirms the contract details and completes the contract by signing electronically.

[0670] The system will enable the rapid and efficient renovation and optimization of vacant houses and factories.

[0671] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0672] Step 1:

[0673] The server accepts input from users via a web interface or smart glasses. Here, users enter basic information about the vacant house or factory (area, age, number of rooms, equipment information, etc.) and additional information (videos and photos of the current state, comments, etc.). The entered data is temporarily stored.

[0674] Input: Area, age, number of rooms, facility information, video, photos, comments

[0675] Output: Temporarily saved user input information

[0676] Step 2:

[0677] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data and ensuring that each is consistent, for example, checking that the number of rooms is not negative, that the square footage is realistic, etc.

[0678] Input: User-entered information

[0679] Output: User-entered information with integrity checked

[0680] Step 3:

[0681] The server inputs the confirmed information into a generative AI model and begins generating renovation or optimization plans. The generative AI model creates multiple plans based on housing examples from around the world, factory equipment data, and market rental data.

[0682] Input: User-entered information whose integrity is checked

[0683] Output: Generated plans (e.g., full renovation, partial renovation, interior modification, etc.)

[0684] Step 4:

[0685] The server presents the generated plans to the user through a web interface, where the user can compare them and select the most suitable plan, which includes images, detailed descriptions, 3D modeling, and audio guides.

[0686] Input: Generated plans

[0687] Output: Plan selected by user

[0688] Step 5:

[0689] The server automatically generates an estimate based on the plan selected by the user and electronically transmits it to the user, including details such as the renovation cost and required time.

[0690] Input: User selects plan

[0691] Output: Auto-generated quote

[0692] Step 6:

[0693] If the user agrees with the quote, the server automatically generates a contract, which is completed through an electronic signature and includes details of the work, a schedule, and legally binding terms.

[0694] Input: User accepts quote

[0695] Output: Auto-generated contract and completion of contract with electronic signature

[0696] In this way, the system can process a series of steps, from inputting information from the user to presenting the optimal plan and automatically generating estimates and contracts.

[0697] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0698] Our invention, the "Vacant House Utilization AI Planner," is a system that recognizes user emotions and optimizes the way renovation plans are presented by combining an emotion engine. The system allows users to input basic and additional information about a vacant house, and then uses a generative AI to generate an optimal renovation plan and present it to the user. Furthermore, by adjusting the proposed plan based on the user's emotions, the system can provide more personalized proposals. The system also aims to automatically generate estimates and contracts based on the plan selected by the user, allowing the contract process to be completed online through electronic signatures.

[0699] System configuration

[0700] The system consists of the following main components:

[0701] 1. User input means: A web interface for entering basic and additional information about vacant properties.

[0702] 2. Consistency check measures: Check the validity of the information entered.

[0703] 3. Renovation plan generation method: Based on the information whose consistency has been confirmed, the generation AI creates the optimal renovation plan.

[0704] 4. Emotion engine: Analyzes the user's facial expressions and voice to recognize emotions.

[0705] 5. Plan presentation method: Using data from the emotion engine, renovation plans are presented to the user.

[0706] 6. Estimate and contract generation means: Automatically generate estimates and contracts based on the renovation plan selected by the user.

[0707] User Input

[0708] Through the web interface, users input basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, users click the "Submit" button, which sends the input information to the server.

[0709] example:

[0710] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[0711] The user enters a comment about the current state, such as "Part of the wall is damaged."

[0712] Checking the integrity of information

[0713] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data, such as whether the area is less than or equal to 0 or the number of rooms is a negative number.

[0714] example:

[0715] Does the property meet certain conditions, such as an area of ​​less than 100 square meters and being more than 30 years old?

[0716] Generate renovation plans

[0717] Based on the information that has been confirmed to be consistent, the server inputs the data into the generation AI, which then begins generating renovation plans. The generation AI then creates multiple plans based on renovation examples from around the world and market rental data. These plans include full renovations, partial renovations, and interior changes.

[0718] example:

[0719] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[0720] Plan B: Partial renovation (living room and kitchen renovation)

[0721] Plan C: Interior changes (wallpaper and flooring changes)

[0722] Emotional engine regulation

[0723] When presenting the generated renovation plans, the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. Based on the emotion data acquired by the emotion engine, the server adjusts how the renovation plans are presented. For example, it may prioritize the display of plans that the user is interested in.

[0724] example:

[0725] If the user smiles at Plan A, the server will display the details of Plan A preferentially.

[0726] If the user shows signs of dissatisfaction with Plan B, the server will change the way Plan B is presented.

[0727] Generate quotes and contracts

[0728] Once the user selects the most suitable plan, the server automatically generates a quote and sends it electronically to the user. The user can check the quote online and submit revision requests as necessary. Finally, if the user agrees to the quote, a contract is automatically generated. The entire contract process is completed online, allowing the user to sign electronically.

[0729] example:

[0730] The user selects Plan A and clicks Request a Quote.

[0731] The server automatically generates a quote and sends it to the user.

[0732] The user confirms the contract details and completes the contract by signing electronically.

[0733] In this way, by combining an emotion engine that recognizes the user's emotions, the present invention enables the presentation of personalized renovation plans and efficient contract procedures.

[0734] The processing flow will be explained below.

[0735] (Specific steps for carrying out the invention)

[0736] Step 1:

[0737] The user accesses a dedicated web interface and enters basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, the user clicks the "Submit" button, and the input information is sent to the server.

[0738] Step 2:

[0739] The server receives the information sent by the user and checks the consistency of the basic information and additional information. It checks whether invalid data (e.g., area less than 0, age of building more than 100 years, etc.) is included. If an inconsistency is found, the server returns an error message to the user and prompts them to re-enter the information.

[0740] Step 3:

[0741] The server inputs the information that has been confirmed to be consistent into the generation AI, which then begins generating renovation plans based on the received data. At this point, multiple plans are created, referring to renovation examples and rental market data from around the world.

[0742] Step 4:

[0743] The generation AI returns renovation plans (e.g., Plan A, Plan B, and Plan C) to the server. Plan A includes specific details such as a full renovation (modern design, earthquake-resistance reinforcement), Plan B includes partial renovations (renovation of the living room and kitchen), and Plan C includes interior changes (changing wallpaper and flooring).

[0744] Step 5:

[0745] The server displays multiple renovation plans received from the generation AI on a web interface, allowing users to review the plans and view details of each plan (images, 3D modeling, audio guides, etc.).

[0746] Step 6:

[0747] While the user is checking the plan, the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The server receives the data from the emotion engine in real time and determines whether the user is interested or dislikes the plan.

[0748] Step 7:

[0749] The server adjusts how the plans are presented based on the user's emotions. For example, if the user smiles at Plan A, the server will prioritize displaying the details of Plan A, making it easier for the user to see the details. On the other hand, if the user shows dissatisfaction with Plan B, the server will reevaluate Plan B along with the other plans and adjust their order and content.

[0750] Step 8:

[0751] After the user selects the most suitable plan, he / she clicks the "Request a Quote" button. The server automatically generates a quote based on the selected plan and sends it electronically to the user. The user can check the quote online and, if necessary, submit a request for revisions to the server.

[0752] Step 9:

[0753] The server receives the correction request, uses the generation AI again to create a revised quotation, and sends the revised quotation back to the user.

[0754] Step 10:

[0755] When the user agrees to the final estimate, he or she clicks the "Generate Contract" button. The server automatically generates a contract and sends it electronically to the user. The user then confirms the contract contents and completes the contract procedure by signing electronically.

[0756] Through these steps, the "Vacant House Utilization AI Planner" can quickly and efficiently provide users with plans for effective utilization of vacant houses, and by utilizing its emotion engine, it can make more personalized proposals and complete the process from negotiation to contract in one continuous process.

[0757] Example 2

[0758] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0759] Conventional systems that propose renovation plans do not take the user's emotions into consideration, and therefore may not be able to present the optimal plan for the user. Furthermore, to efficiently proceed with contract procedures, it is essential to generate estimates and contracts online and to digitally sign them, but no system with this functionality existed.

[0760] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for the user to input basic information and additional information about the vacant house, a means for checking consistency, a means for generating a renovation plan, a means for adjusting and presenting the generated renovation plan based on the user's feelings, and a means for generating an estimate and contract based on the plan selected by the user and providing electronic signature procedures. This makes it possible to present an optimal renovation plan that takes the user's feelings into consideration and to carry out efficient online contract procedures.

[0761] "User" refers to an individual or corporation that uses the system to input information about vacant houses and select a renovation plan.

[0762] "Vacant house" refers to a building or house that has no occupants.

[0763] "Basic information" refers to key data about vacant houses, such as area, age, and number of rooms.

[0764] "Additional information" refers to supplementary data other than basic information, such as photos, videos, and comments about the vacant house.

[0765] "Integrity" refers to the process of verifying that entered data is accurate and complete.

[0766] A "renovation plan" refers to a specific proposal for renovating or remodeling a vacant house.

[0767] "Emotion" refers to the psychological state of the user as analyzed from their facial expressions and voice.

[0768] "Quotation" refers to a document that details the costs calculated based on the renovation plan.

[0769] "Contract" refers to the official agreement between the User and the System Provider regarding the implementation of the Renovation Plan.

[0770] "Electronic signature" refers to a digital form of signature used to sign a contract online.

[0771] The present invention, the "Vacant House Utilization AI Planner," is a system that recognizes user emotions and optimizes the presentation of renovation plans by combining an emotion engine. The system allows users to input basic and additional information about a vacant house, and then uses a generative AI model to generate an optimal renovation plan and present it to the user. Furthermore, by adjusting the proposed plan based on the user's emotions, the system can provide more personalized proposals. The system also aims to automatically generate estimates and contracts based on the plan selected by the user, allowing the contract procedure to be completed online through electronic signatures.

[0772] System configuration

[0773] The system consists of the following main components:

[0774] 1. User input means: The user inputs basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments on the current state, etc.) into the web interface via their terminal. Specifically, the user enters information into the provided input form and clicks the send button, which causes the terminal to send the necessary information to the server.

[0775] Examples:

[0776] Users upload information about a 30-year-old, 120-square-meter, four-room property, along with photos of its current condition.

[0777] The user enters a comment such as "Part of the wall is damaged" and presses the send button.

[0778] 2. Consistency check: The server checks the consistency of the received basic information and additional information. Specifically, it checks whether the area is less than or equal to 0 or the number of rooms is a negative number, and checks for invalid or missing data.

[0779] Examples:

[0780] The server stores the newly received information in a database.

[0781] If the server finds that the area is less than or equal to 0 or the number of rooms is negative, it generates an error message and sends it to the user.

[0782] If the server determines that the input data is valid, it proceeds to the next step.

[0783] 3. Renovation plan generation method: The server inputs the information that has been confirmed to be consistent into the generative AI model to generate a renovation plan. The generative AI model creates multiple plans based on building examples and rental market data from around the world. This process includes three types: full renovation, partial renovation, and interior remodeling.

[0784] Examples:

[0785] The server sends the input information (area, age of building, number of rooms, comments, photos) to the generative AI model.

[0786] The generative AI model generates Plan A (full renovation), Plan B (partial renovation), and Plan C (interior changes).

[0787] The server temporarily saves the generated plan.

[0788] 4. Adjustment by emotion engine: The server uses the emotion engine to analyze the user's facial expressions and voice to recognize their emotions. Based on the recognized emotion data, the server adjusts the way the renovation plan is presented. This allows the server to effectively present information that matches the user's interests and preferences.

[0789] Examples:

[0790] The server sends the facial expressions and tone of voice of the user while viewing Plan A to the emotion engine.

[0791] If the emotion engine detects that the user is smiling, the server will display the details of Plan A first.

[0792] For Plan B, which is less interesting to the user, the server updates the proposal and presents it from a different perspective.

[0793] 5. Estimate and contract generation means: Once the user selects the optimal renovation plan, the server automatically creates an estimate and contract and sends them electronically to the user. The user can review these documents online and request revisions as necessary. Finally, if the user agrees, the contract is concluded online.

[0794] Examples:

[0795] The user selects Plan A and clicks the Request a Quote button.

[0796] The server automatically generates a quote and contract and emails it to the user.

[0797] The user reviews the quote and contract and electronically signs them.

[0798] The server verifies the signature and notifies the user that the contract is valid.

[0799] Prompt Sentence Examples

[0800] Below are some example prompts to input to a generative AI model:

[0801] "Generate three renovation plans for a 30-year-old, 120-square-meter, 4-room vacant house: a full renovation, a partial renovation, and an interior change."

[0802] "If the user smiles at Plan A, prioritize showing the details of Plan A."

[0803] "Based on user selections, automatically generate quotes and contracts and complete the process until e-signature is complete."

[0804] The above are the specific steps for implementing the invention. This system takes into account the user's emotions, presents personalized renovation plans, and enables efficient contract procedures.

[0805] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0806] Step 1:

[0807] Users input basic and additional information about the vacant house into a web interface via their device and submit it. The input information includes the area, age of the building, number of rooms, video, photos, and comments about the current state of the house.

[0808] Specific behavior:

[0809] The user enters basic information such as "30 years old, 120 square meters, 4 rooms" into an input form on a web interface.

[0810] The user selects a photo file and clicks the upload button.

[0811] The user enters a comment such as "Part of the wall is damaged" and presses the send button.

[0812] Input: Basic information and additional information entered by the user

[0813] Output: User information sent to the server

[0814] Step 2:

[0815] The server verifies the integrity of the received user basic information and additional information, checking for any incorrect or missing data and verifying that the information is valid.

[0816] Specific behavior:

[0817] The server stores the newly received information in a database.

[0818] If the server finds that the area is less than or equal to 0 or the number of rooms is negative, it generates an error message and sends it to the user.

[0819] If the server determines that the input data is valid, it proceeds to the next step.

[0820] Input: User information received by the server

[0821] Output: Information that has been verified as consistent, or an error message

[0822] Step 3:

[0823] The server inputs the confirmed consistency information into a generative AI model to generate an optimal renovation plan. The generative AI model then references building examples and rental price data from around the world to create multiple renovation plans.

[0824] Specific behavior:

[0825] The server sends the input information (area, age of building, number of rooms, comments, photos) to the generative AI model.

[0826] The generative AI model generates Plan A (full renovation), Plan B (partial renovation), and Plan C (interior changes).

[0827] The server temporarily saves the generated plan.

[0828] Input: Information whose integrity has been verified

[0829] Output: Generated renovation plan

[0830] Step 4:

[0831] The server uses an emotion engine to analyze the user's facial expressions and voice to recognize their emotions. Based on the recognized emotion data, the server adjusts the way it presents renovation plans.

[0832] Specific behavior:

[0833] The server sends the facial expressions and tone of voice of the user while viewing Plan A to the emotion engine.

[0834] If the emotion engine detects that the user is smiling, the server will display the details of Plan A first.

[0835] For Plan B, which is less interesting to the user, the server updates the proposal and presents it from a different perspective.

[0836] Input: User's facial expression and voice data

[0837] Output: Renovation plan tailored based on emotions

[0838] Step 5:

[0839] Once the user selects the optimal renovation plan, the server automatically creates an estimate and contract and sends them electronically to the user. The user can review these documents online and request revisions as necessary. Finally, if the user agrees, the contract is concluded online.

[0840] Specific behavior:

[0841] The user selects Plan A and clicks the Request a Quote button.

[0842] The server automatically generates a quote and contract and emails it to the user.

[0843] The user reviews the quote and contract and electronically signs them.

[0844] The server verifies the signature and notifies the user that the contract is valid.

[0845] Input: Renovation plan selected by the user

[0846] Output: Generated quote and contract, online contract completion notification

[0847] (Application example 2)

[0848] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0849] Conventional renovation plan proposal systems present a uniform plan without considering the user's emotions, making it difficult to improve the user experience. Furthermore, when proposing renovation plans in a brick-and-mortar store, plans that reflect the user's emotions in real time are required, but no such system exists. Furthermore, streamlining online contract procedures is also an issue.

[0850] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to input basic information and additional information about a building, means for confirming consistency between the basic information and additional information, means for generating a renovation plan based on the confirmed consistency, means for analyzing the user's emotions using an emotion recognition engine and adjusting the presentation method of the renovation plan, means for presenting the renovation plan to the user, means for generating an estimate and a contract based on the renovation plan selected by the user, and means for providing an electronic signature procedure. This enables the presentation of a personalized renovation plan that reflects the user's emotions and efficient contract procedures in a physical store.

[0851] A "building" is a structure constructed for human habitation or business purposes.

[0852] "Basic information" refers to important data about the building, such as the building's area, age, and number of rooms.

[0853] "Additional information" is supplementary data that accompanies basic information such as building footage, photos, and comments on the current state of the building.

[0854] "Renovation Plan" means a specific plan or proposal for improving the interior or exterior of a building.

[0855] An "emotion recognition engine" refers to a system or function that analyzes a user's facial expressions and voice and recognizes their emotions.

[0856] "Integrity check measures" refers to the functions and processes that verify that the basic and additional information entered is accurate and complete.

[0857] "Means for adjusting presentation method" refers to the function or process of presenting information to the user in the most optimal format based on the emotion recognition engine.

[0858] An "quote" is a document detailing the costs to be incurred based on the renovation plan.

[0859] A "contract" is a legal document that details the agreements between the parties regarding the renovation plans.

[0860] "Electronic signature" refers to the technology and process for electronically authenticating and agreeing to contracts and estimates.

[0861] "Means for generating a renovation plan based on information whose consistency has been confirmed" refers to the function or process of creating an optimal renovation plan based on information entered by the user after verifying its accuracy.

[0862] The present invention provides a system that allows users to input basic and additional information about a building, generates an optimal renovation plan based on the input, and presents the plan through an emotion recognition engine. This system allows users to use smart glasses in a brick-and-mortar store, performs emotion recognition in real time, proposes a personalized renovation plan based on the user's emotions in real time, and finally completes the online contract procedure.

[0863] Hardware and software used

[0864] The system uses the following hardware and software:

[0865] 1. Smart glasses: worn by users in physical stores and support input and emotion recognition.

[0866] 2. Camera and video capture device: Captures the user's facial expressions in real time and provides data to the emotion recognition engine.

[0867] 3. Server: Organizes input data, generates renovation plans, analyzes emotion data, and automatically generates estimates and contracts.

[0868] Data processing and calculation

[0869] 1. Enter basic and additional information and check consistency:

[0870] Users enter basic building information (area, age, number of rooms) and additional information (video, photos, comments, etc.) through smart glasses.

[0871] The server checks the consistency of the entered basic information and additional information and verifies that there is no invalid data.

[0872] 2. Generate renovation plans:

[0873] The server then generates a renovation plan by sending a prompt to the generative AI model based on the information that has been verified to be consistent. An example of a prompt is as follows:

[0874] Vacant house information: Area 120 sqm, Age 30 years, Number of rooms 4, Comments: Part of wall damaged. Generate the optimal renovation plan.

[0875] The server receives and stores the generated multiple renovation plans.

[0876] 3. Emotion recognition and plan presentation adjustment:

[0877] When the user wears the smart glasses, the camera captures the user's facial expressions, which are then analyzed by an emotion recognition engine.

[0878] Based on the results of the emotion recognition engine, the server adjusts the way renovation plans are presented according to the user's emotions, for example, by prioritizing and displaying details of plans that the user is interested in.

[0879] 4. Generate quotes and contracts:

[0880] Once the user selects the optimal renovation plan, the server automatically generates an estimate and contract, and completes the online contract through an electronic signature procedure.

[0881] Specific examples

[0882] For example, a user wants to renovate a 30-year-old house, so they put on smart glasses in a brick-and-mortar showroom. Using the glasses, they input the building's area, number of rooms, and comments on current damage, and the data is sent to a server. The server checks the consistency of the information and sends prompts to a generative AI model to generate multiple renovation plans.

[0883] Then, as the user reviews their options, a camera captures their facial expressions in real time, and an emotion recognition engine analyzes their reactions: for example, if the user smiles at a particular renovation plan, the plan is displayed in detail.

[0884] The server automatically generates a quote for the plan the user finally selects, and once the user agrees to the terms, an electronic signature is carried out to complete the contract, making the entire process efficient and improving the user experience.

[0885] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0886] Step 1:

[0887] The user inputs basic building information (area, age, number of rooms) and additional information (video, photos, comments, etc.) through the smart glasses. The input information is sent from the smart glasses to the server. The input in this step is information about the user's building, and the output is that information is sent to the server. Specifically, the user operates the interface of the smart glasses to input data for each item.

[0888] Step 2:

[0889] The server checks the consistency of the basic information and additional information entered. The input is the building information sent in the previous step, and the output is the information whose consistency has been confirmed. The server checks for invalid or missing data to ensure reliable information. Specifically, the server validates the format of the data, for example, checking that the area is not a negative number.

[0890] Step 3:

[0891] Based on the information whose consistency has been confirmed, the server sends a prompt to the generative AI model to generate a renovation plan. The input is the building information whose consistency has been confirmed, and the output is multiple generated renovation plans. Specifically, the data is passed to the AI ​​model as a prompt in the following format:

[0892] Vacant house information: Area 120 sqm, Age 30 years, Number of rooms 4, Comments: Part of wall damaged. Generate the optimal renovation plan.

[0893] A generative AI model analyzes this and generates multiple renovation plans.

[0894] Step 4:

[0895] When a user wears the smart glasses, the camera captures the user's facial expressions in real time, and the emotion recognition engine analyzes the emotions. The input is real-time video data captured by the camera, and the output is emotion data. Specifically, the emotion recognition engine analyzes the user's facial features and classifies emotions based on those features.

[0896] Step 5:

[0897] The server adjusts the presentation method of the renovation plan according to the user's emotions based on the results of the emotion recognition engine. The input is the emotion data and the generated renovation plan, and the output is the presentation method of the renovation plan adjusted based on the emotion. Specifically, the server displays the plan for which the user smiles in detail, and replaces the plan for which the user shows dissatisfaction with another plan.

[0898] Step 6:

[0899] When the user selects the optimal renovation plan, the server automatically generates an estimate and contract based on that plan. The input is the renovation plan selected by the user, and the output is the automatically generated estimate and contract. Specifically, the server creates an estimate that lists the necessary costs and conditions based on the contents of the selected plan, and also generates a contract that details the contract contents.

[0900] Step 7:

[0901] The user reviews the generated quotation and contract and completes the contract through the electronic signature procedure. The input is the generated quotation and contract, and the output is an electronically signed contract. Specifically, the user reviews the contents of the quotation and contract through the interface of the smart glasses and then electronically signs, officially establishing the contract.

[0902] The above are the specific processing steps in this system.

[0903] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0904] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0905] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0906] [Third embodiment]

[0907] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0908] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0909] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0910] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0911] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0912] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0913] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0914] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0915] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0916] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0917] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0918] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0919] A specific embodiment of the "Vacant House Utilization AI Planner" of the present invention will be described.

[0920] Overall system overview

[0921] The system uses a web interface to allow users to input basic and additional information about a vacant house, and then uses AI to generate an optimal renovation plan and present it to the user.The system also automatically generates estimates and contracts based on the plan selected by the user, allowing the user to complete the contract process online with an electronic signature.

[0922] User Input

[0923] Users enter basic and additional information about the vacant house through a dedicated web interface. Specifically, in addition to basic information such as area, age, and number of rooms, they enter additional information such as videos and photos of the current state and comments. This information is sent to the server and checked for consistency before being passed on to the generation AI.

[0924] example:

[0925] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[0926] The user enters a comment about the current state, such as "Part of the wall is damaged."

[0927] Checking the integrity of information

[0928] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data, such as whether the area is less than or equal to 0 or the number of rooms is a negative number.

[0929] example:

[0930] Does the property meet certain conditions, such as an area of ​​less than 100 square meters and being more than 30 years old?

[0931] Generative AI Planning

[0932] Based on the information that has been confirmed to be consistent, the server inputs the data into the generation AI, which then begins generating renovation plans. The generation AI then creates multiple plans, taking into account renovation examples from around the world and market rental data. These plans include full renovations, partial renovations, and interior changes.

[0933] example:

[0934] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[0935] Plan B: Partial renovation (living room and kitchen renovation)

[0936] Plan C: Interior changes (wallpaper and flooring changes)

[0937] Plan presentation and proposal

[0938] The server then presents the generated renovation plans to the user via a web interface. The user can compare the plans and select the one that best suits them. Each plan includes images, detailed descriptions, 3D modeling, and audio guides.

[0939] example:

[0940] User clicks to view details of Plan A.

[0941] The server displays the details of Plan A (project duration, budget, expected rent).

[0942] Generate quotes and contracts

[0943] Once the user selects the most suitable plan, the server automatically generates a quote and sends it electronically to the user. The user can check the quote online and submit revision requests as necessary. Finally, if the user agrees to the quote, a contract is automatically generated. The entire contract process is completed online, allowing the user to sign electronically.

[0944] example:

[0945] The user selects Plan A and clicks Request a Quote.

[0946] The server automatically generates a quote and sends it to the user.

[0947] The user confirms the contract details and completes the contract by signing electronically.

[0948] As described above, this invention provides a system that promotes the effective use of vacant houses and avoids abandonment, demolition, and increased tax burdens following legal reform. It also makes it possible to provide high-quality housing at affordable prices to the Y family generation.

[0949] The processing flow will be explained below.

[0950] Step 1:

[0951] The user accesses a dedicated web interface and enters basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, the user clicks the "Submit" button to send the information to the server.

[0952] Step 2:

[0953] The server receives the information sent by the user. It checks the basic and additional information for data consistency by checking whether the area and age of the property are within invalid ranges (area is less than 0, age is over 100 years, etc.). If an inconsistency is found, it returns an error message to the user.

[0954] Step 3:

[0955] The server inputs the information that has been confirmed to be consistent into the generation AI, which analyzes the received data and begins generating renovation plans by referencing housing examples and rental price data from around the world.

[0956] Step 4:

[0957] The generation AI creates multiple renovation plans (e.g., Plan A, Plan B, Plan C), including variations such as full renovation, partial renovation, and interior changes. The generated plans are returned to the server.

[0958] Step 5:

[0959] The server displays the renovation plans received from the AI ​​on a web interface. The user can review the multiple plans presented and compare them through images, detailed descriptions, 3D modeling, and audio guides for each plan.

[0960] Step 6:

[0961] Once the user selects the most suitable plan, he / she clicks the "Request a Quote" button, and the server automatically generates a quote based on the selected plan and electronically sends it to the user.

[0962] Step 7:

[0963] The user checks the estimate online and sends a request for revisions to the server if necessary. The server receives the request, uses the generation AI again to generate a revised estimate, and resends it to the user.

[0964] Step 8:

[0965] When the user agrees with the final quote, he clicks the "Generate Contract" button, and the server automatically generates a contract and sends it electronically to the user.

[0966] Step 9:

[0967] The user completes the electronic signature procedure online and sends it to the server, which officially concludes the contract.

[0968] Through these steps, the "Vacant House Utilization AI Planner" can quickly and efficiently provide users with plans for effective utilization of vacant houses, completing the entire process from negotiations to signing a contract in one go.

[0969] Example 1

[0970] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0971] In recent years, the increase in vacant houses has become a social problem, raising concerns about the resulting abandonment and demolition of these houses, as well as increased tax burdens following legal reforms. In response, there is a need for a system that can provide specific proposals for the effective use of vacant houses, quickly and efficiently generate renovation plans, and expedite contract procedures. Conventional methods involve separate steps, placing a heavy burden on users and lengthening the overall process.

[0972] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0973] In this invention, the server includes: a means for a user to input basic information and additional information about a property; a means for confirming the consistency of the basic information and additional information; a means for generating a renovation plan based on the confirmed consistency of the information; a means for presenting the renovation plan to the user; a means for generating an estimate and contract based on the renovation plan selected by the user; a means for electronically transmitting the estimate and contract to the user for online confirmation and correction; and a means for electronically signing online and completing the contract procedure. This makes it possible to consistently perform the entire process from generating an effective renovation plan for a vacant house to the contract procedure.

[0974] "User" refers to the person or entity that inputs information about a particular property and generates, reviews, or selects a renovation plan.

[0975] "Property" refers to the building or room that will be renovated using this system.

[0976] "Basic information" refers to the main attributes of the property, such as the area, age, and number of rooms.

[0977] "Additional information" refers to detailed information provided in addition to basic information, such as videos, photos, and comments about the property's current state.

[0978] "Integrity" means that the input data is valid and internal consistency is ensured.

[0979] A "renovation plan" refers to a proposed plan for remodeling or repairing a property based on the information entered.

[0980] "Quotation" refers to a detailed statement of costs based on the selected renovation plan.

[0981] "Contract" refers to a document that sets out the terms and conditions of the construction work to be carried out based on the renovation plan.

[0982] "Electronic transmission" refers to the server sending documents or information to a user using electronic means.

[0983] "Online" refers to processes or procedures conducted over the Internet or a network.

[0984] "Electronic Signature" means a legally recognized form of digital signature.

[0985] "Server" refers to a computer system that receives and processes user input information.

[0986] A "generative AI model" refers to a program that generates renovation plans using artificial intelligence technology.

[0987] A "prompt" is a sentence containing specific instructions to be input into an AI model to obtain a result.

[0988] This invention relates to a system that efficiently plans renovations of vacant houses and allows users to complete contract procedures online. The system uses hardware and software such as a web interface, a server, a generative AI model, a database, and an electronic signature system.

[0989] A specific embodiment of this system will now be described.

[0990] Overall system overview

[0991] This system allows users to input basic and additional information about a property through a web interface, and then generates a renovation plan based on that information and presents it to the user.The system also automatically generates estimates and contracts based on the plan selected by the user, allowing contract procedures to be completed online through electronic signatures.

[0992] Hardware and Software

[0993] Server: Receives input from users, processes it, and passes it to the generative AI model. It also checks consistency, generates renovation plans, and generates estimates and contracts.

[0994] Web Interface: Provides a screen for users to access and enter information. Uses web technologies such as HTML, CSS, and JavaScript.

[0995] Generative AI model: An artificial intelligence model that generates optimal renovation plans from input information. The plan is generated based on renovation examples and rental market data from around the world.

[0996] Database: Stores data such as information entered by users, generated renovation plans, estimates, and contracts.

[0997] Electronic Signature System: A system that allows users to electronically sign contracts online.

[0998] User operation example

[0999] Users access a dedicated web interface and enter basic information about their property (e.g., area, age, number of rooms, etc.) and then upload additional information such as videos and photos of the current state and comments.

[1000] Examples:

[1001] The user enters the following information: "40 years old, 150 square meters, 5 rooms."

[1002] A user uploads three photos of their living room with the comment "The living room wall is cracked."

[1003] Prompt Sentence Examples

[1004] We also provide specific examples of prompt sentences to be input into the generative AI model.

[1005] Example prompt sentence:

[1006] "A user owns a 40-year-old property. The property is 150 square meters and has a total of five rooms. The user has uploaded three photos along with a comment that the current living room wall is cracked. Please suggest the best renovation plan based on this information."

[1007] This system allows users to easily create renovation plans for vacant houses and complete contract procedures online, promoting the effective use of vacant houses and leading to the provision of high-quality housing.

[1008] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1009] Step 1:

[1010] The user accesses the web interface. The user accesses the specified URL from a web browser on their device. The input at this stage is the user's access request, and the output is the web interface displayed.

[1011] Step 2:

[1012] The user enters basic information. On the web interface, the user enters basic information about the property, such as the area, age, and number of rooms. This information is sent to the server, which receives the information and stores it in a database. The input data might be {area: 150 square meters, age: 40 years, number of rooms: 5}, and the output is the saved result of that data.

[1013] Specific working example:

[1014] The user enters the following information into the form: Area: 150 square meters, Age: 40 years, Number of rooms: 5.

[1015] Step 3:

[1016] The user inputs additional information. The user inputs additional information such as current video, photos, and comments through a web interface. This information is also sent to the server and stored in the database. The input data is photo files and text comments, and the output is the saved result of that data.

[1017] Specific working example:

[1018] A user uploaded three photos of the living room with the comment, "The living room wall is cracked."

[1019] Step 4:

[1020] The server verifies the integrity of the information. The server checks the integrity of the basic and additional information received from the user. It verifies that the data is valid and that all required information is present. The input is the information stored in the database and the output is the result of the integrity check.

[1021] Specific working example:

[1022] The server checks the information "150 square meters," "40 years," and "5 rooms" and verifies that there are no problems.

[1023] Step 5:

[1024] The server inputs data into the generative AI model. Based on the information whose consistency has been confirmed, the server generates a prompt statement to pass to the generative AI model. This prompt statement is the basis for generating a renovation plan. The input is the data whose consistency has been confirmed, and the output is the generated prompt statement.

[1025] Specific working example:

[1026] Prompt: "The user owns a 40-year-old property. It is 150 square meters and has five rooms. They have uploaded three photos, along with a comment about the cracks in the current living room wall. Based on this information, please suggest the best renovation plan."

[1027] Step 6:

[1028] The generative AI model generates renovation plans based on prompt statements sent from the server. The input is the prompt statement, and the output is multiple renovation plans.

[1029] Specific working example:

[1030] The AI ​​generated Plan A: Complete renovation (modern design, earthquake resistance reinforcement), Plan B: Renovation of the kitchen and living room, and Plan C: Interior changes (changing wallpaper and flooring).

[1031] Step 7:

[1032] The server presents the generated plan to the user. The server displays the generated renovation plan on a web interface and presents it to the user. The input is the generated renovation plan, and the output is the display result on the web interface.

[1033] Specific working example:

[1034] The server displays an overview and detailed information for Plan A, Plan B, and Plan C on a web page.

[1035] Step 8:

[1036] The user selects the optimal renovation plan. The user compares the presented plans and selects the optimal plan. This selection is sent to the server. The input is the user's selected plan, and the output is the selection information.

[1037] Specific working example:

[1038] The user selects Plan A and clicks the Select button.

[1039] Step 9:

[1040] The server automatically generates an estimate and sends it to the user. The server generates an estimate based on the selected plan and electronically sends it to the user. The input is the selected renovation plan, and the output is the estimate generation and transmission results.

[1041] Specific working example:

[1042] The server generates a quote and sends it to the user's email address.

[1043] Step 10:

[1044] The user checks the estimate and submits a request for revision. The user checks the estimate online and submits a request for revision to the server if necessary. The input is the estimate and the user's request for revision, and the output is the result received by the server.

[1045] Specific working example:

[1046] The user checks the quote and submits a correction request.

[1047] Step 11:

[1048] The server automatically generates the final contract and sends it to the user. If the user finally agrees to the quote, the server automatically generates and sends the contract. The input is the final adjusted quote, and the output is the generated contract and the transmission result.

[1049] Specific working example:

[1050] The server generates a contract and sends it to the user's email address.

[1051] Step 12:

[1052] The user electronically signs the contract and completes it. The user reviews the contract and completes it by signing electronically online. The input is the user's electronic signature, and the output is the contract completion status.

[1053] Specific working example:

[1054] The user electronically signs the contract to complete it.

[1055] These are the specific processing steps of the "Vacant House Utilization AI Planner." This system can efficiently carry out everything from generating renovation plans for vacant houses to contract procedures.

[1056] (Application example 1)

[1057] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1058] Currently, many factories face the problem of insufficient optimization of equipment and layout, making efficient operation difficult. In particular, excessive use of old equipment or inappropriate placement of new equipment can lead to reduced production efficiency and increased operating costs. Furthermore, the time and effort required for factory managers to input equipment and layout information makes it difficult to quickly create optimization plans. There is a need for a system that can solve these problems and support efficient factory operation.

[1059] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1060] In this invention, the server includes means for a user to input basic information and additional information about a vacant house, means for confirming consistency between the basic information and the additional information, means for generating a renovation plan based on the confirmed consistency of the information, means for presenting the renovation plan to the user, means for generating an estimate and contract based on the renovation plan selected by the user, means for a factory manager to input factory equipment information and layout information, means for confirming consistency of the factory equipment information and layout information, and means for generating an optimization plan for equipment placement and layout based on the generated plan. This allows the factory manager to quickly input equipment information and layout information and receive suggestions for efficient optimization plans.

[1061] "Basic information" refers to key data such as the area, age, number of rooms, and facility information of vacant houses and factories.

[1062] "Additional information" is supplementary data such as videos, photos, and comments about the current state of vacant houses and factories.

[1063] "Integrity" refers to checking the consistency and accuracy of the basic information and additional information entered.

[1064] A "renovation plan" is a proposed plan for renovating or changing the layout of vacant houses or factories, created using a generative AI model.

[1065] "User" refers to anyone who uses this system, such as an owner of a vacant house or a factory manager.

[1066] An "estimate" is a document that estimates costs based on the renovation plan selected by the user.

[1067] A "contract" is a formal agreement document regarding the implementation of the renovation plan selected by the user.

[1068] "Factory manager" refers to a person who manages factory equipment information and layout information and uses this system to obtain optimization plans.

[1069] "Facility information" is detailed information about the machines and equipment installed in the factory.

[1070] "Layout information" is information about the layout of facilities and equipment within a factory.

[1071] An "optimization plan" is a proposed plan for equipment placement and layout to maximize production efficiency within a factory.

[1072] A "generative AI model" is an artificial intelligence model that automatically generates renovation plans and optimization plans based on input information.

[1073] A "prompt sentence" is a question or instruction sentence that is displayed to the user to prompt them to make a specific input.

[1074] System Overview

[1075] This invention is a system that allows users to input basic and additional information about vacant houses and factories, and then uses a generative AI model to generate optimal renovation plans or facility layout optimization plans based on that information. The system operates through a web interface, and aims to complete the entire process online.

[1076] Hardware and software used

[1077] Hardware

[1078] Smart glasses (e.g., Microsoft HoloLens): A device that makes it easier for users to input information about factory equipment and layout.

[1079] Server (e.g., AWS EC2 instance): Computing resources that run AI models based on input information and generate plans.

[1080] software

[1081] Generative AI model: An artificial intelligence model that generates renovation and optimization plans based on input information.

[1082] Document Generator: Software for automatically generating quotes and contracts.

[1083] Processing flow

[1084] Enter user information

[1085] Users can input basic and additional information about vacant houses and factories through a web interface or smart glasses. For example, in the case of a factory, a factory manager can use smart glasses to capture the current equipment and layout information and add any necessary comments or notes.

[1086] Specific examples

[1087] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[1088] The factory manager enters a comment such as "There is an excessive amount of old equipment deployed."

[1089] Information consistency check

[1090] The server verifies the integrity of the basic and additional information entered, checking for incorrect or missing data and ensuring that each is consistent.

[1091] Generative AI Planning

[1092] Based on the information that has been confirmed to be consistent, the server uses a generative AI model to generate renovation plans and facility layout optimization plans, which include full renovations, partial renovations, and interior changes.

[1093] Specific examples

[1094] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[1095] Plan B: Partial renovation (living room and kitchen renovation)

[1096] Plan C: Interior changes (wallpaper and flooring changes)

[1097] Plan presentation and selection

[1098] The generated plans are presented to the user via a web interface, where the user can compare the plans and select the most suitable one.

[1099] Prompt Sentence Examples

[1100] Enter the number of your selected plan:

[1101] 1: Plan A - Full renovation

[1102] 2: Plan B - Partial Renovation

[1103] 3: Plan C - Interior Changes

[1104] Generate quotes and contracts

[1105] Once the user selects the most suitable plan, the server automatically generates a quote and sends it to the user electronically. If the user agrees to the quote, a contract is automatically generated and the contract procedure is completed through an electronic signature.

[1106] Specific examples

[1107] The user selects Plan A and clicks Request a Quote.

[1108] The server automatically generates a quote and sends it to the user.

[1109] The user confirms the contract details and completes the contract by signing electronically.

[1110] The system will enable the rapid and efficient renovation and optimization of vacant houses and factories.

[1111] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1112] Step 1:

[1113] The server accepts input from users via a web interface or smart glasses. Here, users enter basic information about the vacant house or factory (area, age, number of rooms, equipment information, etc.) and additional information (videos and photos of the current state, comments, etc.). The entered data is temporarily stored.

[1114] Input: Area, age, number of rooms, facility information, video, photos, comments

[1115] Output: Temporarily saved user input information

[1116] Step 2:

[1117] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data and ensuring that each is consistent, for example, checking that the number of rooms is not negative, that the square footage is realistic, etc.

[1118] Input: User-entered information

[1119] Output: User-entered information with integrity checked

[1120] Step 3:

[1121] The server inputs the confirmed information into a generative AI model and begins generating renovation or optimization plans. The generative AI model creates multiple plans based on housing examples from around the world, factory equipment data, and market rental data.

[1122] Input: User-entered information whose integrity is checked

[1123] Output: Generated plans (e.g., full renovation, partial renovation, interior modification, etc.)

[1124] Step 4:

[1125] The server presents the generated plans to the user through a web interface, where the user can compare them and select the most suitable plan, which includes images, detailed descriptions, 3D modeling, and audio guides.

[1126] Input: Generated plans

[1127] Output: Plan selected by user

[1128] Step 5:

[1129] The server automatically generates an estimate based on the plan selected by the user and electronically transmits it to the user, including details such as the renovation cost and required time.

[1130] Input: User selects plan

[1131] Output: Auto-generated quote

[1132] Step 6:

[1133] If the user agrees with the quote, the server automatically generates a contract, which is completed through an electronic signature and includes details of the work, a schedule, and legally binding terms.

[1134] Input: User accepts quote

[1135] Output: Auto-generated contract and completion of contract with electronic signature

[1136] In this way, the system can process a series of steps, from inputting information from the user to presenting the optimal plan and automatically generating estimates and contracts.

[1137] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1138] Our invention, the "Vacant House Utilization AI Planner," is a system that recognizes user emotions and optimizes the way renovation plans are presented by combining an emotion engine. The system allows users to input basic and additional information about a vacant house, and then uses a generative AI to generate an optimal renovation plan and present it to the user. Furthermore, by adjusting the proposed plan based on the user's emotions, the system can provide more personalized proposals. The system also aims to automatically generate estimates and contracts based on the plan selected by the user, allowing the contract process to be completed online through electronic signatures.

[1139] System configuration

[1140] The system consists of the following main components:

[1141] 1. User input means: A web interface for entering basic and additional information about vacant properties.

[1142] 2. Consistency check measures: Check the validity of the information entered.

[1143] 3. Renovation plan generation method: Based on the information whose consistency has been confirmed, the generation AI creates the optimal renovation plan.

[1144] 4. Emotion engine: Analyzes the user's facial expressions and voice to recognize emotions.

[1145] 5. Plan presentation method: Using data from the emotion engine, renovation plans are presented to the user.

[1146] 6. Estimate and contract generation means: Automatically generate estimates and contracts based on the renovation plan selected by the user.

[1147] User Input

[1148] Through the web interface, users input basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, users click the "Submit" button, which sends the input information to the server.

[1149] example:

[1150] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[1151] The user enters a comment about the current state, such as "Part of the wall is damaged."

[1152] Checking the integrity of information

[1153] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data, such as whether the area is less than or equal to 0 or the number of rooms is a negative number.

[1154] example:

[1155] Does the property meet certain conditions, such as an area of ​​less than 100 square meters and being more than 30 years old?

[1156] Generate renovation plans

[1157] Based on the information that has been confirmed to be consistent, the server inputs the data into the generation AI, which then begins generating renovation plans. The generation AI then creates multiple plans based on renovation examples from around the world and market rental data. These plans include full renovations, partial renovations, and interior changes.

[1158] example:

[1159] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[1160] Plan B: Partial renovation (living room and kitchen renovation)

[1161] Plan C: Interior changes (wallpaper and flooring changes)

[1162] Emotional engine regulation

[1163] When presenting the generated renovation plans, the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. Based on the emotion data acquired by the emotion engine, the server adjusts how the renovation plans are presented. For example, it may prioritize the display of plans that the user is interested in.

[1164] example:

[1165] If the user smiles at Plan A, the server will display the details of Plan A preferentially.

[1166] If the user shows signs of dissatisfaction with Plan B, the server will change the way Plan B is presented.

[1167] Generate quotes and contracts

[1168] Once the user selects the most suitable plan, the server automatically generates a quote and sends it electronically to the user. The user can check the quote online and submit revision requests as necessary. Finally, if the user agrees to the quote, a contract is automatically generated. The entire contract process is completed online, allowing the user to sign electronically.

[1169] example:

[1170] The user selects Plan A and clicks Request a Quote.

[1171] The server automatically generates a quote and sends it to the user.

[1172] The user confirms the contract details and completes the contract by signing electronically.

[1173] In this way, by combining an emotion engine that recognizes the user's emotions, the present invention enables the presentation of personalized renovation plans and efficient contract procedures.

[1174] The processing flow will be explained below.

[1175] (Specific steps for carrying out the invention)

[1176] Step 1:

[1177] The user accesses a dedicated web interface and enters basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, the user clicks the "Submit" button, and the input information is sent to the server.

[1178] Step 2:

[1179] The server receives the information sent by the user and checks the consistency of the basic information and additional information. It checks whether invalid data (e.g., area less than 0, age of building more than 100 years, etc.) is included. If an inconsistency is found, the server returns an error message to the user and prompts them to re-enter the information.

[1180] Step 3:

[1181] The server inputs the information that has been confirmed to be consistent into the generation AI, which then begins generating renovation plans based on the received data. At this point, multiple plans are created, referring to renovation examples and rental market data from around the world.

[1182] Step 4:

[1183] The generation AI returns renovation plans (e.g., Plan A, Plan B, and Plan C) to the server. Plan A includes specific details such as a full renovation (modern design, earthquake-resistance reinforcement), Plan B includes partial renovations (renovation of the living room and kitchen), and Plan C includes interior changes (changing wallpaper and flooring).

[1184] Step 5:

[1185] The server displays multiple renovation plans received from the generation AI on a web interface, allowing users to review the plans and view details of each plan (images, 3D modeling, audio guides, etc.).

[1186] Step 6:

[1187] While the user is checking the plan, the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The server receives the data from the emotion engine in real time and determines whether the user is interested or dislikes the plan.

[1188] Step 7:

[1189] The server adjusts how the plans are presented based on the user's emotions. For example, if the user smiles at Plan A, the server will prioritize displaying the details of Plan A, making it easier for the user to see the details. On the other hand, if the user shows dissatisfaction with Plan B, the server will reevaluate Plan B along with the other plans and adjust their order and content.

[1190] Step 8:

[1191] After the user selects the most suitable plan, he / she clicks the "Request a Quote" button. The server automatically generates a quote based on the selected plan and sends it electronically to the user. The user can check the quote online and, if necessary, submit a request for revisions to the server.

[1192] Step 9:

[1193] The server receives the correction request, uses the generation AI again to create a revised quotation, and sends the revised quotation back to the user.

[1194] Step 10:

[1195] When the user agrees to the final estimate, he or she clicks the "Generate Contract" button. The server automatically generates a contract and sends it electronically to the user. The user then confirms the contract contents and completes the contract procedure by signing electronically.

[1196] Through these steps, the "Vacant House Utilization AI Planner" can quickly and efficiently provide users with plans for effective utilization of vacant houses, and by utilizing its emotion engine, it can make more personalized proposals and complete the process from negotiation to contract in one continuous process.

[1197] Example 2

[1198] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1199] Conventional systems that propose renovation plans do not take the user's emotions into consideration, and therefore may not be able to present the optimal plan for the user. Furthermore, to efficiently proceed with contract procedures, it is essential to generate estimates and contracts online and to digitally sign them, but no system with this functionality existed.

[1200] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for the user to input basic information and additional information about the vacant house, a means for checking consistency, a means for generating a renovation plan, a means for adjusting and presenting the generated renovation plan based on the user's feelings, and a means for generating an estimate and contract based on the plan selected by the user and providing electronic signature procedures. This makes it possible to present an optimal renovation plan that takes the user's feelings into consideration and to carry out efficient online contract procedures.

[1201] "User" refers to an individual or corporation that uses the system to input information about vacant houses and select a renovation plan.

[1202] "Vacant house" refers to a building or house that has no occupants.

[1203] "Basic information" refers to key data about vacant houses, such as area, age, and number of rooms.

[1204] "Additional information" refers to supplementary data other than basic information, such as photos, videos, and comments about the vacant house.

[1205] "Integrity" refers to the process of verifying that entered data is accurate and complete.

[1206] A "renovation plan" refers to a specific proposal for renovating or remodeling a vacant house.

[1207] "Emotion" refers to the psychological state of the user as analyzed from their facial expressions and voice.

[1208] "Quotation" refers to a document that details the costs calculated based on the renovation plan.

[1209] "Contract" refers to the official agreement between the User and the System Provider regarding the implementation of the Renovation Plan.

[1210] "Electronic signature" refers to a digital form of signature used to sign a contract online.

[1211] The present invention, the "Vacant House Utilization AI Planner," is a system that recognizes user emotions and optimizes the presentation of renovation plans by combining an emotion engine. The system allows users to input basic and additional information about a vacant house, and then uses a generative AI model to generate an optimal renovation plan and present it to the user. Furthermore, by adjusting the proposed plan based on the user's emotions, the system can provide more personalized proposals. The system also aims to automatically generate estimates and contracts based on the plan selected by the user, allowing the contract procedure to be completed online through electronic signatures.

[1212] System configuration

[1213] The system consists of the following main components:

[1214] 1. User input means: The user inputs basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments on the current state, etc.) into the web interface via their terminal. Specifically, the user enters information into the provided input form and clicks the send button, which causes the terminal to send the necessary information to the server.

[1215] Examples:

[1216] Users upload information about a 30-year-old, 120-square-meter, four-room property, along with photos of its current condition.

[1217] The user enters a comment such as "Part of the wall is damaged" and presses the send button.

[1218] 2. Consistency check: The server checks the consistency of the received basic information and additional information. Specifically, it checks whether the area is less than or equal to 0 or the number of rooms is a negative number, and checks for invalid or missing data.

[1219] Examples:

[1220] The server stores the newly received information in a database.

[1221] If the server finds that the area is less than or equal to 0 or the number of rooms is negative, it generates an error message and sends it to the user.

[1222] If the server determines that the input data is valid, it proceeds to the next step.

[1223] 3. Renovation plan generation method: The server inputs the information that has been confirmed to be consistent into the generative AI model to generate a renovation plan. The generative AI model creates multiple plans based on building examples and rental market data from around the world. This process includes three types: full renovation, partial renovation, and interior remodeling.

[1224] Examples:

[1225] The server sends the input information (area, age of building, number of rooms, comments, photos) to the generative AI model.

[1226] The generative AI model generates Plan A (full renovation), Plan B (partial renovation), and Plan C (interior changes).

[1227] The server temporarily saves the generated plan.

[1228] 4. Adjustment by emotion engine: The server uses the emotion engine to analyze the user's facial expressions and voice to recognize their emotions. Based on the recognized emotion data, the server adjusts the way the renovation plan is presented. This allows the server to effectively present information that matches the user's interests and preferences.

[1229] Examples:

[1230] The server sends the facial expressions and tone of voice of the user while viewing Plan A to the emotion engine.

[1231] If the emotion engine detects that the user is smiling, the server will display the details of Plan A first.

[1232] For Plan B, which is less interesting to the user, the server updates the proposal and presents it from a different perspective.

[1233] 5. Estimate and contract generation means: Once the user selects the optimal renovation plan, the server automatically creates an estimate and contract and sends them electronically to the user. The user can review these documents online and request revisions as necessary. Finally, if the user agrees, the contract is concluded online.

[1234] Examples:

[1235] The user selects Plan A and clicks the Request a Quote button.

[1236] The server automatically generates a quote and contract and emails it to the user.

[1237] The user reviews the quote and contract and electronically signs them.

[1238] The server verifies the signature and notifies the user that the contract is valid.

[1239] Prompt Sentence Examples

[1240] Below are some example prompts to input to a generative AI model:

[1241] "Generate three renovation plans for a 30-year-old, 120-square-meter, 4-room vacant house: a full renovation, a partial renovation, and an interior change."

[1242] "If the user smiles at Plan A, prioritize showing the details of Plan A."

[1243] "Based on user selections, automatically generate quotes and contracts and complete the process until e-signature is complete."

[1244] The above are the specific steps for implementing the invention. This system takes into account the user's emotions, presents personalized renovation plans, and enables efficient contract procedures.

[1245] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1246] Step 1:

[1247] Users input basic and additional information about the vacant house into a web interface via their device and submit it. The input information includes the area, age of the building, number of rooms, video, photos, and comments about the current state of the house.

[1248] Specific behavior:

[1249] The user enters basic information such as "30 years old, 120 square meters, 4 rooms" into an input form on a web interface.

[1250] The user selects a photo file and clicks the upload button.

[1251] The user enters a comment such as "Part of the wall is damaged" and presses the send button.

[1252] Input: Basic information and additional information entered by the user

[1253] Output: User information sent to the server

[1254] Step 2:

[1255] The server verifies the integrity of the received user basic information and additional information, checking for any incorrect or missing data and verifying that the information is valid.

[1256] Specific behavior:

[1257] The server stores the newly received information in a database.

[1258] If the server finds that the area is less than or equal to 0 or the number of rooms is negative, it generates an error message and sends it to the user.

[1259] If the server determines that the input data is valid, it proceeds to the next step.

[1260] Input: User information received by the server

[1261] Output: Information that has been verified as consistent, or an error message

[1262] Step 3:

[1263] The server inputs the confirmed consistency information into a generative AI model to generate an optimal renovation plan. The generative AI model then references building examples and rental price data from around the world to create multiple renovation plans.

[1264] Specific behavior:

[1265] The server sends the input information (area, age of building, number of rooms, comments, photos) to the generative AI model.

[1266] The generative AI model generates Plan A (full renovation), Plan B (partial renovation), and Plan C (interior changes).

[1267] The server temporarily saves the generated plan.

[1268] Input: Information whose integrity has been verified

[1269] Output: Generated renovation plan

[1270] Step 4:

[1271] The server uses an emotion engine to analyze the user's facial expressions and voice to recognize their emotions. Based on the recognized emotion data, the server adjusts the way it presents renovation plans.

[1272] Specific behavior:

[1273] The server sends the facial expressions and tone of voice of the user while viewing Plan A to the emotion engine.

[1274] If the emotion engine detects that the user is smiling, the server will display the details of Plan A first.

[1275] For Plan B, which is less interesting to the user, the server updates the proposal and presents it from a different perspective.

[1276] Input: User's facial expression and voice data

[1277] Output: Renovation plan tailored based on emotions

[1278] Step 5:

[1279] Once the user selects the optimal renovation plan, the server automatically creates an estimate and contract and sends them electronically to the user. The user can review these documents online and request revisions as necessary. Finally, if the user agrees, the contract is concluded online.

[1280] Specific behavior:

[1281] The user selects Plan A and clicks the Request a Quote button.

[1282] The server automatically generates a quote and contract and emails it to the user.

[1283] The user reviews the quote and contract and electronically signs them.

[1284] The server verifies the signature and notifies the user that the contract is valid.

[1285] Input: Renovation plan selected by the user

[1286] Output: Generated quote and contract, online contract completion notification

[1287] (Application example 2)

[1288] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1289] Conventional renovation plan proposal systems present a uniform plan without considering the user's emotions, making it difficult to improve the user experience. Furthermore, when proposing renovation plans in a brick-and-mortar store, plans that reflect the user's emotions in real time are required, but no such system exists. Furthermore, streamlining online contract procedures is also an issue.

[1290] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to input basic information and additional information about a building, means for confirming consistency between the basic information and additional information, means for generating a renovation plan based on the confirmed consistency, means for analyzing the user's emotions using an emotion recognition engine and adjusting the presentation method of the renovation plan, means for presenting the renovation plan to the user, means for generating an estimate and a contract based on the renovation plan selected by the user, and means for providing an electronic signature procedure. This enables the presentation of a personalized renovation plan that reflects the user's emotions and efficient contract procedures in a physical store.

[1291] A "building" is a structure constructed for human habitation or business purposes.

[1292] "Basic information" refers to important data about the building, such as the building's area, age, and number of rooms.

[1293] "Additional information" is supplementary data that accompanies basic information such as building footage, photos, and comments on the current state of the building.

[1294] "Renovation Plan" means a specific plan or proposal for improving the interior or exterior of a building.

[1295] An "emotion recognition engine" refers to a system or function that analyzes a user's facial expressions and voice and recognizes their emotions.

[1296] "Integrity check measures" refers to the functions and processes that verify that the basic and additional information entered is accurate and complete.

[1297] "Means for adjusting presentation method" refers to the function or process of presenting information to the user in the most optimal format based on the emotion recognition engine.

[1298] An "quote" is a document detailing the costs to be incurred based on the renovation plan.

[1299] A "contract" is a legal document that details the agreements between the parties regarding the renovation plans.

[1300] "Electronic signature" refers to the technology and process for electronically authenticating and agreeing to contracts and estimates.

[1301] "Means for generating a renovation plan based on information whose consistency has been confirmed" refers to the function or process of creating an optimal renovation plan based on information entered by the user after verifying its accuracy.

[1302] The present invention provides a system that allows users to input basic and additional information about a building, generates an optimal renovation plan based on the input, and presents the plan through an emotion recognition engine. This system allows users to use smart glasses in a brick-and-mortar store, performs emotion recognition in real time, proposes a personalized renovation plan based on the user's emotions in real time, and finally completes the online contract procedure.

[1303] Hardware and software used

[1304] The system uses the following hardware and software:

[1305] 1. Smart glasses: worn by users in physical stores and support input and emotion recognition.

[1306] 2. Camera and video capture device: Captures the user's facial expressions in real time and provides data to the emotion recognition engine.

[1307] 3. Server: Organizes input data, generates renovation plans, analyzes emotion data, and automatically generates estimates and contracts.

[1308] Data processing and calculation

[1309] 1. Enter basic and additional information and check consistency:

[1310] Users enter basic building information (area, age, number of rooms) and additional information (video, photos, comments, etc.) through smart glasses.

[1311] The server checks the consistency of the entered basic information and additional information and verifies that there is no invalid data.

[1312] 2. Generate renovation plans:

[1313] The server then generates a renovation plan by sending a prompt to the generative AI model based on the information that has been verified to be consistent. An example of a prompt is as follows:

[1314] Vacant house information: Area 120 sqm, Age 30 years, Number of rooms 4, Comments: Part of wall damaged. Generate the optimal renovation plan.

[1315] The server receives and stores the generated multiple renovation plans.

[1316] 3. Emotion recognition and plan presentation adjustment:

[1317] When the user wears the smart glasses, the camera captures the user's facial expressions, which are then analyzed by an emotion recognition engine.

[1318] Based on the results of the emotion recognition engine, the server adjusts the way renovation plans are presented according to the user's emotions, for example, by prioritizing and displaying details of plans that the user is interested in.

[1319] 4. Generate quotes and contracts:

[1320] Once the user selects the optimal renovation plan, the server automatically generates an estimate and contract, and completes the online contract through an electronic signature procedure.

[1321] Specific examples

[1322] For example, a user wants to renovate a 30-year-old house, so they put on smart glasses in a brick-and-mortar showroom. Using the glasses, they input the building's area, number of rooms, and comments on current damage, and the data is sent to a server. The server checks the consistency of the information and sends prompts to a generative AI model to generate multiple renovation plans.

[1323] Then, as the user reviews their options, a camera captures their facial expressions in real time, and an emotion recognition engine analyzes their reactions: for example, if the user smiles at a particular renovation plan, the plan is displayed in detail.

[1324] The server automatically generates a quote for the plan the user finally selects, and once the user agrees to the terms, an electronic signature is carried out to complete the contract, making the entire process efficient and improving the user experience.

[1325] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1326] Step 1:

[1327] The user inputs basic building information (area, age, number of rooms) and additional information (video, photos, comments, etc.) through the smart glasses. The input information is sent from the smart glasses to the server. The input in this step is information about the user's building, and the output is that information is sent to the server. Specifically, the user operates the interface of the smart glasses to input data for each item.

[1328] Step 2:

[1329] The server checks the consistency of the basic information and additional information entered. The input is the building information sent in the previous step, and the output is the information whose consistency has been confirmed. The server checks for invalid or missing data to ensure reliable information. Specifically, the server validates the format of the data, for example, checking that the area is not a negative number.

[1330] Step 3:

[1331] Based on the information whose consistency has been confirmed, the server sends a prompt to the generative AI model to generate a renovation plan. The input is the building information whose consistency has been confirmed, and the output is multiple generated renovation plans. Specifically, the data is passed to the AI ​​model as a prompt in the following format:

[1332] Vacant house information: Area 120 sqm, Age 30 years, Number of rooms 4, Comments: Part of wall damaged. Generate the optimal renovation plan.

[1333] A generative AI model analyzes this and generates multiple renovation plans.

[1334] Step 4:

[1335] When a user wears the smart glasses, the camera captures the user's facial expressions in real time, and the emotion recognition engine analyzes the emotions. The input is real-time video data captured by the camera, and the output is emotion data. Specifically, the emotion recognition engine analyzes the user's facial features and classifies emotions based on those features.

[1336] Step 5:

[1337] The server adjusts the presentation method of the renovation plan according to the user's emotions based on the results of the emotion recognition engine. The input is the emotion data and the generated renovation plan, and the output is the presentation method of the renovation plan adjusted based on the emotion. Specifically, the server displays the plan for which the user smiles in detail, and replaces the plan for which the user shows dissatisfaction with another plan.

[1338] Step 6:

[1339] When the user selects the optimal renovation plan, the server automatically generates an estimate and contract based on that plan. The input is the renovation plan selected by the user, and the output is the automatically generated estimate and contract. Specifically, the server creates an estimate that lists the necessary costs and conditions based on the contents of the selected plan, and also generates a contract that details the contract contents.

[1340] Step 7:

[1341] The user reviews the generated quotation and contract and completes the contract through the electronic signature procedure. The input is the generated quotation and contract, and the output is an electronically signed contract. Specifically, the user reviews the contents of the quotation and contract through the interface of the smart glasses and then electronically signs, officially establishing the contract.

[1342] The above are the specific processing steps in this system.

[1343] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1344] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1345] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1346] [Fourth embodiment]

[1347] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1348] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1349] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1350] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1351] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1352] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1353] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1354] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1355] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1356] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1357] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1358] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1359] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1360] A specific embodiment of the "Vacant House Utilization AI Planner" of the present invention will be described.

[1361] Overall system overview

[1362] The system uses a web interface to allow users to input basic and additional information about a vacant house, and then uses AI to generate an optimal renovation plan and present it to the user.The system also automatically generates estimates and contracts based on the plan selected by the user, allowing the user to complete the contract process online with an electronic signature.

[1363] User Input

[1364] Users enter basic and additional information about the vacant house through a dedicated web interface. Specifically, in addition to basic information such as area, age, and number of rooms, they enter additional information such as videos and photos of the current state and comments. This information is sent to the server and checked for consistency before being passed on to the generation AI.

[1365] example:

[1366] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[1367] The user enters a comment about the current state, such as "Part of the wall is damaged."

[1368] Checking the integrity of information

[1369] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data, such as whether the area is less than or equal to 0 or the number of rooms is a negative number.

[1370] example:

[1371] Does the property meet certain conditions, such as an area of ​​less than 100 square meters and being more than 30 years old?

[1372] Generative AI Planning

[1373] Based on the information that has been confirmed to be consistent, the server inputs the data into the generation AI, which then begins generating renovation plans. The generation AI then creates multiple plans, taking into account renovation examples from around the world and market rental data. These plans include full renovations, partial renovations, and interior changes.

[1374] example:

[1375] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[1376] Plan B: Partial renovation (living room and kitchen renovation)

[1377] Plan C: Interior changes (wallpaper and flooring changes)

[1378] Plan presentation and proposal

[1379] The server then presents the generated renovation plans to the user via a web interface. The user can compare the plans and select the one that best suits them. Each plan includes images, detailed descriptions, 3D modeling, and audio guides.

[1380] example:

[1381] User clicks to view details of Plan A.

[1382] The server displays the details of Plan A (project duration, budget, expected rent).

[1383] Generate quotes and contracts

[1384] Once the user selects the most suitable plan, the server automatically generates a quote and sends it electronically to the user. The user can check the quote online and submit revision requests as necessary. Finally, if the user agrees to the quote, a contract is automatically generated. The entire contract process is completed online, allowing the user to sign electronically.

[1385] example:

[1386] The user selects Plan A and clicks Request a Quote.

[1387] The server automatically generates a quote and sends it to the user.

[1388] The user confirms the contract details and completes the contract by signing electronically.

[1389] As described above, this invention provides a system that promotes the effective use of vacant houses and avoids abandonment, demolition, and increased tax burdens following legal reform. It also makes it possible to provide high-quality housing at affordable prices to the Y family generation.

[1390] The processing flow will be explained below.

[1391] Step 1:

[1392] The user accesses a dedicated web interface and enters basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, the user clicks the "Submit" button to send the information to the server.

[1393] Step 2:

[1394] The server receives the information sent by the user. It checks the basic and additional information for data consistency by checking whether the area and age of the property are within invalid ranges (area is less than 0, age is over 100 years, etc.). If an inconsistency is found, it returns an error message to the user.

[1395] Step 3:

[1396] The server inputs the information that has been confirmed to be consistent into the generation AI, which analyzes the received data and begins generating renovation plans by referencing housing examples and rental price data from around the world.

[1397] Step 4:

[1398] The generation AI creates multiple renovation plans (e.g., Plan A, Plan B, Plan C), including variations such as full renovation, partial renovation, and interior changes. The generated plans are returned to the server.

[1399] Step 5:

[1400] The server displays the renovation plans received from the AI ​​on a web interface. The user can review the multiple plans presented and compare them through images, detailed descriptions, 3D modeling, and audio guides for each plan.

[1401] Step 6:

[1402] Once the user selects the most suitable plan, he / she clicks the "Request a Quote" button, and the server automatically generates a quote based on the selected plan and electronically sends it to the user.

[1403] Step 7:

[1404] The user checks the estimate online and sends a request for revisions to the server if necessary. The server receives the request, uses the generation AI again to generate a revised estimate, and resends it to the user.

[1405] Step 8:

[1406] When the user agrees with the final quote, he clicks the "Generate Contract" button, and the server automatically generates a contract and sends it electronically to the user.

[1407] Step 9:

[1408] The user completes the electronic signature procedure online and sends it to the server, which officially concludes the contract.

[1409] Through these steps, the "Vacant House Utilization AI Planner" can quickly and efficiently provide users with plans for effective utilization of vacant houses, completing the entire process from negotiations to signing a contract in one go.

[1410] Example 1

[1411] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1412] In recent years, the increase in vacant houses has become a social problem, raising concerns about the resulting abandonment and demolition of these houses, as well as increased tax burdens following legal reforms. In response, there is a need for a system that can provide specific proposals for the effective use of vacant houses, quickly and efficiently generate renovation plans, and expedite contract procedures. Conventional methods involve separate steps, placing a heavy burden on users and lengthening the overall process.

[1413] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1414] In this invention, the server includes: a means for a user to input basic information and additional information about a property; a means for confirming the consistency of the basic information and additional information; a means for generating a renovation plan based on the confirmed consistency of the information; a means for presenting the renovation plan to the user; a means for generating an estimate and contract based on the renovation plan selected by the user; a means for electronically transmitting the estimate and contract to the user for online confirmation and correction; and a means for electronically signing online and completing the contract procedure. This makes it possible to consistently perform the entire process from generating an effective renovation plan for a vacant house to the contract procedure.

[1415] "User" refers to the person or entity that inputs information about a particular property and generates, reviews, or selects a renovation plan.

[1416] "Property" refers to the building or room that will be renovated using this system.

[1417] "Basic information" refers to the main attributes of the property, such as the area, age, and number of rooms.

[1418] "Additional information" refers to detailed information provided in addition to basic information, such as videos, photos, and comments about the property's current state.

[1419] "Integrity" means that the input data is valid and internal consistency is ensured.

[1420] A "renovation plan" refers to a proposed plan for remodeling or repairing a property based on the information entered.

[1421] "Quotation" refers to a detailed statement of costs based on the selected renovation plan.

[1422] "Contract" refers to a document that sets out the terms and conditions of the construction work to be carried out based on the renovation plan.

[1423] "Electronic transmission" refers to the server sending documents or information to a user using electronic means.

[1424] "Online" refers to processes or procedures conducted over the Internet or a network.

[1425] "Electronic Signature" means a legally recognized form of digital signature.

[1426] "Server" refers to a computer system that receives and processes user input information.

[1427] A "generative AI model" refers to a program that generates renovation plans using artificial intelligence technology.

[1428] A "prompt" is a sentence containing specific instructions to be input into an AI model to obtain a result.

[1429] This invention relates to a system that efficiently plans renovations of vacant houses and allows users to complete contract procedures online. The system uses hardware and software such as a web interface, a server, a generative AI model, a database, and an electronic signature system.

[1430] A specific embodiment of this system will now be described.

[1431] Overall system overview

[1432] This system allows users to input basic and additional information about a property through a web interface, and then generates a renovation plan based on that information and presents it to the user.The system also automatically generates estimates and contracts based on the plan selected by the user, allowing contract procedures to be completed online through electronic signatures.

[1433] Hardware and Software

[1434] Server: Receives input from users, processes it, and passes it to the generative AI model. It also checks consistency, generates renovation plans, and generates estimates and contracts.

[1435] Web Interface: Provides a screen for users to access and enter information. Uses web technologies such as HTML, CSS, and JavaScript.

[1436] Generative AI model: An artificial intelligence model that generates optimal renovation plans from input information. The plan is generated based on renovation examples and rental market data from around the world.

[1437] Database: Stores data such as information entered by users, generated renovation plans, estimates, and contracts.

[1438] Electronic Signature System: A system that allows users to electronically sign contracts online.

[1439] User operation example

[1440] Users access a dedicated web interface and enter basic information about their property (e.g., area, age, number of rooms, etc.) and then upload additional information such as videos and photos of the current state and comments.

[1441] Examples:

[1442] The user enters the following information: "40 years old, 150 square meters, 5 rooms."

[1443] A user uploads three photos of their living room with the comment "The living room wall is cracked."

[1444] Prompt Sentence Examples

[1445] We also provide specific examples of prompt sentences to be input into the generative AI model.

[1446] Example prompt sentence:

[1447] "A user owns a 40-year-old property. The property is 150 square meters and has a total of five rooms. The user has uploaded three photos along with a comment that the current living room wall is cracked. Please suggest the best renovation plan based on this information."

[1448] This system allows users to easily create renovation plans for vacant houses and complete contract procedures online, promoting the effective use of vacant houses and leading to the provision of high-quality housing.

[1449] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1450] Step 1:

[1451] The user accesses the web interface. The user accesses the specified URL from a web browser on their device. The input at this stage is the user's access request, and the output is the web interface displayed.

[1452] Step 2:

[1453] The user enters basic information. On the web interface, the user enters basic information about the property, such as the area, age, and number of rooms. This information is sent to the server, which receives the information and stores it in a database. The input data might be {area: 150 square meters, age: 40 years, number of rooms: 5}, and the output is the saved result of that data.

[1454] Specific working example:

[1455] The user enters the following information into the form: Area: 150 square meters, Age: 40 years, Number of rooms: 5.

[1456] Step 3:

[1457] The user inputs additional information. The user inputs additional information such as current video, photos, and comments through a web interface. This information is also sent to the server and stored in the database. The input data is photo files and text comments, and the output is the saved result of that data.

[1458] Specific working example:

[1459] A user uploaded three photos of the living room with the comment, "The living room wall is cracked."

[1460] Step 4:

[1461] The server verifies the integrity of the information. The server checks the integrity of the basic and additional information received from the user. It verifies that the data is valid and that all required information is present. The input is the information stored in the database and the output is the result of the integrity check.

[1462] Specific working example:

[1463] The server checks the information "150 square meters," "40 years," and "5 rooms" and verifies that there are no problems.

[1464] Step 5:

[1465] The server inputs data into the generative AI model. Based on the information whose consistency has been confirmed, the server generates a prompt statement to pass to the generative AI model. This prompt statement is the basis for generating a renovation plan. The input is the data whose consistency has been confirmed, and the output is the generated prompt statement.

[1466] Specific working example:

[1467] Prompt: "The user owns a 40-year-old property. It is 150 square meters and has five rooms. They have uploaded three photos, along with a comment about the cracks in the current living room wall. Based on this information, please suggest the best renovation plan."

[1468] Step 6:

[1469] The generative AI model generates renovation plans based on prompt statements sent from the server. The input is the prompt statement, and the output is multiple renovation plans.

[1470] Specific working example:

[1471] The AI ​​generated Plan A: Complete renovation (modern design, earthquake resistance reinforcement), Plan B: Renovation of the kitchen and living room, and Plan C: Interior changes (changing wallpaper and flooring).

[1472] Step 7:

[1473] The server presents the generated plan to the user. The server displays the generated renovation plan on a web interface and presents it to the user. The input is the generated renovation plan, and the output is the display result on the web interface.

[1474] Specific working example:

[1475] The server displays an overview and detailed information for Plan A, Plan B, and Plan C on a web page.

[1476] Step 8:

[1477] The user selects the optimal renovation plan. The user compares the presented plans and selects the optimal plan. This selection is sent to the server. The input is the user's selected plan, and the output is the selection information.

[1478] Specific working example:

[1479] The user selects Plan A and clicks the Select button.

[1480] Step 9:

[1481] The server automatically generates an estimate and sends it to the user. The server generates an estimate based on the selected plan and electronically sends it to the user. The input is the selected renovation plan, and the output is the estimate generation and transmission results.

[1482] Specific working example:

[1483] The server generates a quote and sends it to the user's email address.

[1484] Step 10:

[1485] The user checks the estimate and submits a request for revision. The user checks the estimate online and submits a request for revision to the server if necessary. The input is the estimate and the user's request for revision, and the output is the result received by the server.

[1486] Specific working example:

[1487] The user checks the quote and submits a correction request.

[1488] Step 11:

[1489] The server automatically generates the final contract and sends it to the user. If the user finally agrees to the quote, the server automatically generates and sends the contract. The input is the final adjusted quote, and the output is the generated contract and the transmission result.

[1490] Specific working example:

[1491] The server generates a contract and sends it to the user's email address.

[1492] Step 12:

[1493] The user electronically signs the contract and completes it. The user reviews the contract and completes it by signing electronically online. The input is the user's electronic signature, and the output is the contract completion status.

[1494] Specific working example:

[1495] The user electronically signs the contract to complete it.

[1496] These are the specific processing steps of the "Vacant House Utilization AI Planner." This system can efficiently carry out everything from generating renovation plans for vacant houses to contract procedures.

[1497] (Application example 1)

[1498] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1499] Currently, many factories face the problem of insufficient optimization of equipment and layout, making efficient operation difficult. In particular, excessive use of old equipment or inappropriate placement of new equipment can lead to reduced production efficiency and increased operating costs. Furthermore, the time and effort required for factory managers to input equipment and layout information makes it difficult to quickly create optimization plans. There is a need for a system that can solve these problems and support efficient factory operation.

[1500] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1501] In this invention, the server includes means for a user to input basic information and additional information about a vacant house, means for confirming consistency between the basic information and the additional information, means for generating a renovation plan based on the confirmed consistency of the information, means for presenting the renovation plan to the user, means for generating an estimate and contract based on the renovation plan selected by the user, means for a factory manager to input factory equipment information and layout information, means for confirming consistency of the factory equipment information and layout information, and means for generating an optimization plan for equipment placement and layout based on the generated plan. This allows the factory manager to quickly input equipment information and layout information and receive suggestions for efficient optimization plans.

[1502] "Basic information" refers to key data such as the area, age, number of rooms, and facility information of vacant houses and factories.

[1503] "Additional information" is supplementary data such as videos, photos, and comments about the current state of vacant houses and factories.

[1504] "Integrity" refers to checking the consistency and accuracy of the basic information and additional information entered.

[1505] A "renovation plan" is a proposed plan for renovating or changing the layout of vacant houses or factories, created using a generative AI model.

[1506] "User" refers to anyone who uses this system, such as an owner of a vacant house or a factory manager.

[1507] An "estimate" is a document that estimates costs based on the renovation plan selected by the user.

[1508] A "contract" is a formal agreement document regarding the implementation of the renovation plan selected by the user.

[1509] "Factory manager" refers to a person who manages factory equipment information and layout information and uses this system to obtain optimization plans.

[1510] "Facility information" is detailed information about the machines and equipment installed in the factory.

[1511] "Layout information" is information about the layout of facilities and equipment within a factory.

[1512] An "optimization plan" is a proposed plan for equipment placement and layout to maximize production efficiency within a factory.

[1513] A "generative AI model" is an artificial intelligence model that automatically generates renovation plans and optimization plans based on input information.

[1514] A "prompt sentence" is a question or instruction sentence that is displayed to the user to prompt them to make a specific input.

[1515] System Overview

[1516] This invention is a system that allows users to input basic and additional information about vacant houses and factories, and then uses a generative AI model to generate optimal renovation plans or facility layout optimization plans based on that information. The system operates through a web interface, and aims to complete the entire process online.

[1517] Hardware and software used

[1518] Hardware

[1519] Smart glasses (e.g., Microsoft HoloLens): A device that makes it easier for users to input information about factory equipment and layout.

[1520] Server (e.g., AWS EC2 instance): Computing resources that run AI models based on input information and generate plans.

[1521] software

[1522] Generative AI model: An artificial intelligence model that generates renovation and optimization plans based on input information.

[1523] Document Generator: Software for automatically generating quotes and contracts.

[1524] Processing flow

[1525] Enter user information

[1526] Users can input basic and additional information about vacant houses and factories through a web interface or smart glasses. For example, in the case of a factory, a factory manager can use smart glasses to capture the current equipment and layout information and add any necessary comments or notes.

[1527] Specific examples

[1528] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[1529] The factory manager enters a comment such as "There is an excessive amount of old equipment deployed."

[1530] Information consistency check

[1531] The server verifies the integrity of the basic and additional information entered, checking for incorrect or missing data and ensuring that each is consistent.

[1532] Generative AI Planning

[1533] Based on the information that has been confirmed to be consistent, the server uses a generative AI model to generate renovation plans and facility layout optimization plans, which include full renovations, partial renovations, and interior changes.

[1534] Specific examples

[1535] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[1536] Plan B: Partial renovation (living room and kitchen renovation)

[1537] Plan C: Interior changes (wallpaper and flooring changes)

[1538] Plan presentation and selection

[1539] The generated plans are presented to the user via a web interface, where the user can compare the plans and select the most suitable one.

[1540] Prompt Sentence Examples

[1541] Enter the number of your selected plan:

[1542] 1: Plan A - Full renovation

[1543] 2: Plan B - Partial Renovation

[1544] 3: Plan C - Interior Changes

[1545] Generate quotes and contracts

[1546] Once the user selects the most suitable plan, the server automatically generates a quote and sends it to the user electronically. If the user agrees to the quote, a contract is automatically generated and the contract procedure is completed through an electronic signature.

[1547] Specific examples

[1548] The user selects Plan A and clicks Request a Quote.

[1549] The server automatically generates a quote and sends it to the user.

[1550] The user confirms the contract details and completes the contract by signing electronically.

[1551] The system will enable the rapid and efficient renovation and optimization of vacant houses and factories.

[1552] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1553] Step 1:

[1554] The server accepts input from users via a web interface or smart glasses. Here, users enter basic information about the vacant house or factory (area, age, number of rooms, equipment information, etc.) and additional information (videos and photos of the current state, comments, etc.). The entered data is temporarily stored.

[1555] Input: Area, age, number of rooms, facility information, video, photos, comments

[1556] Output: Temporarily saved user input information

[1557] Step 2:

[1558] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data and ensuring that each is consistent, for example, checking that the number of rooms is not negative, that the square footage is realistic, etc.

[1559] Input: User-entered information

[1560] Output: User-entered information with integrity checked

[1561] Step 3:

[1562] The server inputs the confirmed information into a generative AI model and begins generating renovation or optimization plans. The generative AI model creates multiple plans based on housing examples from around the world, factory equipment data, and market rental data.

[1563] Input: User-entered information whose integrity is checked

[1564] Output: Generated plans (e.g., full renovation, partial renovation, interior modification, etc.)

[1565] Step 4:

[1566] The server presents the generated plans to the user through a web interface, where the user can compare them and select the most suitable plan, which includes images, detailed descriptions, 3D modeling, and audio guides.

[1567] Input: Generated plans

[1568] Output: Plan selected by user

[1569] Step 5:

[1570] The server automatically generates an estimate based on the plan selected by the user and electronically transmits it to the user, including details such as the renovation cost and required time.

[1571] Input: User selects plan

[1572] Output: Auto-generated quote

[1573] Step 6:

[1574] If the user agrees with the quote, the server automatically generates a contract, which is completed through an electronic signature and includes details of the work, a schedule, and legally binding terms.

[1575] Input: User accepts quote

[1576] Output: Auto-generated contract and completion of contract with electronic signature

[1577] In this way, the system can process a series of steps, from inputting information from the user to presenting the optimal plan and automatically generating estimates and contracts.

[1578] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1579] Our invention, the "Vacant House Utilization AI Planner," is a system that recognizes user emotions and optimizes the way renovation plans are presented by combining an emotion engine. The system allows users to input basic and additional information about a vacant house, and then uses a generative AI to generate an optimal renovation plan and present it to the user. Furthermore, by adjusting the proposed plan based on the user's emotions, the system can provide more personalized proposals. The system also aims to automatically generate estimates and contracts based on the plan selected by the user, allowing the contract process to be completed online through electronic signatures.

[1580] System configuration

[1581] The system consists of the following main components:

[1582] 1. User input means: A web interface for entering basic and additional information about vacant properties.

[1583] 2. Consistency check measures: Check the validity of the information entered.

[1584] 3. Renovation plan generation method: Based on the information whose consistency has been confirmed, the generation AI creates the optimal renovation plan.

[1585] 4. Emotion engine: Analyzes the user's facial expressions and voice to recognize emotions.

[1586] 5. Plan presentation method: Using data from the emotion engine, renovation plans are presented to the user.

[1587] 6. Estimate and contract generation means: Automatically generate estimates and contracts based on the renovation plan selected by the user.

[1588] User Input

[1589] Through the web interface, users input basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, users click the "Submit" button, which sends the input information to the server.

[1590] example:

[1591] A user uploaded information and photos of the current state of a property that was "30 years old, 120 square meters, 4 rooms."

[1592] The user enters a comment about the current state, such as "Part of the wall is damaged."

[1593] Checking the integrity of information

[1594] The server verifies the integrity of the basic and additional information entered, checking for invalid or missing data, such as whether the area is less than or equal to 0 or the number of rooms is a negative number.

[1595] example:

[1596] Does the property meet certain conditions, such as an area of ​​less than 100 square meters and being more than 30 years old?

[1597] Generate renovation plans

[1598] Based on the information that has been confirmed to be consistent, the server inputs the data into the generation AI, which then begins generating renovation plans. The generation AI then creates multiple plans based on renovation examples from around the world and market rental data. These plans include full renovations, partial renovations, and interior changes.

[1599] example:

[1600] Plan A: Full renovation (modern design, earthquake-resistance reinforcement)

[1601] Plan B: Partial renovation (living room and kitchen renovation)

[1602] Plan C: Interior changes (wallpaper and flooring changes)

[1603] Emotional engine regulation

[1604] When presenting the generated renovation plans, the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. Based on the emotion data acquired by the emotion engine, the server adjusts how the renovation plans are presented. For example, it may prioritize the display of plans that the user is interested in.

[1605] example:

[1606] If the user smiles at Plan A, the server will display the details of Plan A preferentially.

[1607] If the user shows signs of dissatisfaction with Plan B, the server will change the way Plan B is presented.

[1608] Generate quotes and contracts

[1609] Once the user selects the most suitable plan, the server automatically generates a quote and sends it electronically to the user. The user can check the quote online and submit revision requests as necessary. Finally, if the user agrees to the quote, a contract is automatically generated. The entire contract process is completed online, allowing the user to sign electronically.

[1610] example:

[1611] The user selects Plan A and clicks Request a Quote.

[1612] The server automatically generates a quote and sends it to the user.

[1613] The user confirms the contract details and completes the contract by signing electronically.

[1614] In this way, by combining an emotion engine that recognizes the user's emotions, the present invention enables the presentation of personalized renovation plans and efficient contract procedures.

[1615] The processing flow will be explained below.

[1616] (Specific steps for carrying out the invention)

[1617] Step 1:

[1618] The user accesses a dedicated web interface and enters basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments about the current state, etc.). After completing the input, the user clicks the "Submit" button, and the input information is sent to the server.

[1619] Step 2:

[1620] The server receives the information sent by the user and checks the consistency of the basic information and additional information. It checks whether invalid data (e.g., area less than 0, age of building more than 100 years, etc.) is included. If an inconsistency is found, the server returns an error message to the user and prompts them to re-enter the information.

[1621] Step 3:

[1622] The server inputs the information that has been confirmed to be consistent into the generation AI, which then begins generating renovation plans based on the received data. At this point, multiple plans are created, referring to renovation examples and rental market data from around the world.

[1623] Step 4:

[1624] The generation AI returns renovation plans (e.g., Plan A, Plan B, and Plan C) to the server. Plan A includes specific details such as a full renovation (modern design, earthquake-resistance reinforcement), Plan B includes partial renovations (renovation of the living room and kitchen), and Plan C includes interior changes (changing wallpaper and flooring).

[1625] Step 5:

[1626] The server displays multiple renovation plans received from the generation AI on a web interface, allowing users to review the plans and view details of each plan (images, 3D modeling, audio guides, etc.).

[1627] Step 6:

[1628] While the user is checking the plan, the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The server receives the data from the emotion engine in real time and determines whether the user is interested or dislikes the plan.

[1629] Step 7:

[1630] The server adjusts how the plans are presented based on the user's emotions. For example, if the user smiles at Plan A, the server will prioritize displaying the details of Plan A, making it easier for the user to see the details. On the other hand, if the user shows dissatisfaction with Plan B, the server will reevaluate Plan B along with the other plans and adjust their order and content.

[1631] Step 8:

[1632] After the user selects the most suitable plan, he / she clicks the "Request a Quote" button. The server automatically generates a quote based on the selected plan and sends it electronically to the user. The user can check the quote online and, if necessary, submit a request for revisions to the server.

[1633] Step 9:

[1634] The server receives the correction request, uses the generation AI again to create a revised quotation, and sends the revised quotation back to the user.

[1635] Step 10:

[1636] When the user agrees to the final estimate, he or she clicks the "Generate Contract" button. The server automatically generates a contract and sends it electronically to the user. The user then confirms the contract contents and completes the contract procedure by signing electronically.

[1637] Through these steps, the "Vacant House Utilization AI Planner" can quickly and efficiently provide users with plans for effective utilization of vacant houses, and by utilizing its emotion engine, it can make more personalized proposals and complete the process from negotiation to contract in one continuous process.

[1638] Example 2

[1639] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1640] Conventional systems that propose renovation plans do not take the user's emotions into consideration, and therefore may not be able to present the optimal plan for the user. Furthermore, to efficiently proceed with contract procedures, it is essential to generate estimates and contracts online and to digitally sign them, but no system with this functionality existed.

[1641] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for the user to input basic information and additional information about the vacant house, a means for checking consistency, a means for generating a renovation plan, a means for adjusting and presenting the generated renovation plan based on the user's feelings, and a means for generating an estimate and contract based on the plan selected by the user and providing electronic signature procedures. This makes it possible to present an optimal renovation plan that takes the user's feelings into consideration and to carry out efficient online contract procedures.

[1642] "User" refers to an individual or corporation that uses the system to input information about vacant houses and select a renovation plan.

[1643] "Vacant house" refers to a building or house that has no occupants.

[1644] "Basic information" refers to key data about vacant houses, such as area, age, and number of rooms.

[1645] "Additional information" refers to supplementary data other than basic information, such as photos, videos, and comments about the vacant house.

[1646] "Integrity" refers to the process of verifying that entered data is accurate and complete.

[1647] A "renovation plan" refers to a specific proposal for renovating or remodeling a vacant house.

[1648] "Emotion" refers to the psychological state of the user as analyzed from their facial expressions and voice.

[1649] "Quotation" refers to a document that details the costs calculated based on the renovation plan.

[1650] "Contract" refers to the official agreement between the User and the System Provider regarding the implementation of the Renovation Plan.

[1651] "Electronic signature" refers to a digital form of signature used to sign a contract online.

[1652] The present invention, the "Vacant House Utilization AI Planner," is a system that recognizes user emotions and optimizes the presentation of renovation plans by combining an emotion engine. The system allows users to input basic and additional information about a vacant house, and then uses a generative AI model to generate an optimal renovation plan and present it to the user. Furthermore, by adjusting the proposed plan based on the user's emotions, the system can provide more personalized proposals. The system also aims to automatically generate estimates and contracts based on the plan selected by the user, allowing the contract procedure to be completed online through electronic signatures.

[1653] System configuration

[1654] The system consists of the following main components:

[1655] 1. User input means: The user inputs basic information about the vacant house (area, age, number of rooms) and additional information (video, photos, comments on the current state, etc.) into the web interface via their terminal. Specifically, the user enters information into the provided input form and clicks the send button, which causes the terminal to send the necessary information to the server.

[1656] Examples:

[1657] Users upload information about a 30-year-old, 120-square-meter, four-room property, along with photos of its current condition.

[1658] The user enters a comment such as "Part of the wall is damaged" and presses the send button.

[1659] 2. Consistency check: The server checks the consistency of the received basic information and additional information. Specifically, it checks whether the area is less than or equal to 0 or the number of rooms is a negative number, and checks for invalid or missing data.

[1660] Examples:

[1661] The server stores the newly received information in a database.

[1662] If the server finds that the area is less than or equal to 0 or the number of rooms is negative, it generates an error message and sends it to the user.

[1663] If the server determines that the input data is valid, it proceeds to the next step.

[1664] 3. Renovation plan generation method: The server inputs the information that has been confirmed to be consistent into the generative AI model to generate a renovation plan. The generative AI model creates multiple plans based on building examples and rental market data from around the world. This process includes three types: full renovation, partial renovation, and interior remodeling.

[1665] Examples:

[1666] The server sends the input information (area, age of building, number of rooms, comments, photos) to the generative AI model.

[1667] The generative AI model generates Plan A (full renovation), Plan B (partial renovation), and Plan C (interior changes).

[1668] The server temporarily saves the generated plan.

[1669] 4. Adjustment by emotion engine: The server uses the emotion engine to analyze the user's facial expressions and voice to recognize their emotions. Based on the recognized emotion data, the server adjusts the way the renovation plan is presented. This allows the server to effectively present information that matches the user's interests and preferences.

[1670] Examples:

[1671] The server sends the facial expressions and tone of voice of the user while viewing Plan A to the emotion engine.

[1672] If the emotion engine detects that the user is smiling, the server will display the details of Plan A first.

[1673] For Plan B, which is less interesting to the user, the server updates the proposal and presents it from a different perspective.

[1674] 5. Estimate and contract generation means: Once the user selects the optimal renovation plan, the server automatically creates an estimate and contract and sends them electronically to the user. The user can review these documents online and request revisions as necessary. Finally, if the user agrees, the contract is concluded online.

[1675] Examples:

[1676] The user selects Plan A and clicks the Request a Quote button.

[1677] The server automatically generates a quote and contract and emails it to the user.

[1678] The user reviews the quote and contract and electronically signs them.

[1679] The server verifies the signature and notifies the user that the contract is valid.

[1680] Prompt Sentence Examples

[1681] Below are some example prompts to input to a generative AI model:

[1682] "Generate three renovation plans for a 30-year-old, 120-square-meter, 4-room vacant house: a full renovation, a partial renovation, and an interior change."

[1683] "If the user smiles at Plan A, prioritize showing the details of Plan A."

[1684] "Based on user selections, automatically generate quotes and contracts and complete the process until e-signature is complete."

[1685] The above are the specific steps for implementing the invention. This system takes into account the user's emotions, presents personalized renovation plans, and enables efficient contract procedures.

[1686] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1687] Step 1:

[1688] Users input basic and additional information about the vacant house into a web interface via their device and submit it. The input information includes the area, age of the building, number of rooms, video, photos, and comments about the current state of the house.

[1689] Specific behavior:

[1690] The user enters basic information such as "30 years old, 120 square meters, 4 rooms" into an input form on a web interface.

[1691] The user selects a photo file and clicks the upload button.

[1692] The user enters a comment such as "Part of the wall is damaged" and presses the send button.

[1693] Input: Basic information and additional information entered by the user

[1694] Output: User information sent to the server

[1695] Step 2:

[1696] The server verifies the integrity of the received user basic information and additional information, checking for any incorrect or missing data and verifying that the information is valid.

[1697] Specific behavior:

[1698] The server stores the newly received information in a database.

[1699] If the server finds that the area is less than or equal to 0 or the number of rooms is negative, it generates an error message and sends it to the user.

[1700] If the server determines that the input data is valid, it proceeds to the next step.

[1701] Input: User information received by the server

[1702] Output: Information that has been verified as consistent, or an error message

[1703] Step 3:

[1704] The server inputs the confirmed consistency information into a generative AI model to generate an optimal renovation plan. The generative AI model then references building examples and rental price data from around the world to create multiple renovation plans.

[1705] Specific behavior:

[1706] The server sends the input information (area, age of building, number of rooms, comments, photos) to the generative AI model.

[1707] The generative AI model generates Plan A (full renovation), Plan B (partial renovation), and Plan C (interior changes).

[1708] The server temporarily saves the generated plan.

[1709] Input: Information whose integrity has been verified

[1710] Output: Generated renovation plan

[1711] Step 4:

[1712] The server uses an emotion engine to analyze the user's facial expressions and voice to recognize their emotions. Based on the recognized emotion data, the server adjusts the way it presents renovation plans.

[1713] Specific behavior:

[1714] The server sends the facial expressions and tone of voice of the user while viewing Plan A to the emotion engine.

[1715] If the emotion engine detects that the user is smiling, the server will display the details of Plan A first.

[1716] For Plan B, which is less interesting to the user, the server updates the proposal and presents it from a different perspective.

[1717] Input: User's facial expression and voice data

[1718] Output: Renovation plan tailored based on emotions

[1719] Step 5:

[1720] Once the user selects the optimal renovation plan, the server automatically creates an estimate and contract and sends them electronically to the user. The user can review these documents online and request revisions as necessary. Finally, if the user agrees, the contract is concluded online.

[1721] Specific behavior:

[1722] The user selects Plan A and clicks the Request a Quote button.

[1723] The server automatically generates a quote and contract and emails it to the user.

[1724] The user reviews the quote and contract and electronically signs them.

[1725] The server verifies the signature and notifies the user that the contract is valid.

[1726] Input: Renovation plan selected by the user

[1727] Output: Generated quote and contract, online contract completion notification

[1728] (Application example 2)

[1729] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1730] Conventional renovation plan proposal systems present a uniform plan without considering the user's emotions, making it difficult to improve the user experience. Furthermore, when proposing renovation plans in a brick-and-mortar store, plans that reflect the user's emotions in real time are required, but no such system exists. Furthermore, streamlining online contract procedures is also an issue.

[1731] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to input basic information and additional information about a building, means for confirming consistency between the basic information and additional information, means for generating a renovation plan based on the confirmed consistency, means for analyzing the user's emotions using an emotion recognition engine and adjusting the presentation method of the renovation plan, means for presenting the renovation plan to the user, means for generating an estimate and a contract based on the renovation plan selected by the user, and means for providing an electronic signature procedure. This enables the presentation of a personalized renovation plan that reflects the user's emotions and efficient contract procedures in a physical store.

[1732] A "building" is a structure constructed for human habitation or business purposes.

[1733] "Basic information" refers to important data about the building, such as the building's area, age, and number of rooms.

[1734] "Additional information" is supplementary data that accompanies basic information such as building footage, photos, and comments on the current state of the building.

[1735] "Renovation Plan" means a specific plan or proposal for improving the interior or exterior of a building.

[1736] An "emotion recognition engine" refers to a system or function that analyzes a user's facial expressions and voice and recognizes their emotions.

[1737] "Integrity check measures" refers to the functions and processes that verify that the basic and additional information entered is accurate and complete.

[1738] "Means for adjusting presentation method" refers to the function or process of presenting information to the user in the most optimal format based on the emotion recognition engine.

[1739] An "quote" is a document detailing the costs to be incurred based on the renovation plan.

[1740] A "contract" is a legal document that details the agreements between the parties regarding the renovation plans.

[1741] "Electronic signature" refers to the technology and process for electronically authenticating and agreeing to contracts and estimates.

[1742] "Means for generating a renovation plan based on information whose consistency has been confirmed" refers to the function or process of creating an optimal renovation plan based on information entered by the user after verifying its accuracy.

[1743] The present invention provides a system that allows users to input basic and additional information about a building, generates an optimal renovation plan based on the input, and presents the plan through an emotion recognition engine. This system allows users to use smart glasses in a brick-and-mortar store, performs emotion recognition in real time, proposes a personalized renovation plan based on the user's emotions in real time, and finally completes the online contract procedure.

[1744] Hardware and software used

[1745] The system uses the following hardware and software:

[1746] 1. Smart glasses: worn by users in physical stores and support input and emotion recognition.

[1747] 2. Camera and video capture device: Captures the user's facial expressions in real time and provides data to the emotion recognition engine.

[1748] 3. Server: Organizes input data, generates renovation plans, analyzes emotion data, and automatically generates estimates and contracts.

[1749] Data processing and calculation

[1750] 1. Enter basic and additional information and check consistency:

[1751] Users enter basic building information (area, age, number of rooms) and additional information (video, photos, comments, etc.) through smart glasses.

[1752] The server checks the consistency of the entered basic information and additional information and verifies that there is no invalid data.

[1753] 2. Generate renovation plans:

[1754] The server then generates a renovation plan by sending a prompt to the generative AI model based on the information that has been verified to be consistent. An example of a prompt is as follows:

[1755] Vacant house information: Area 120 sqm, Age 30 years, Number of rooms 4, Comments: Part of wall damaged. Generate the optimal renovation plan.

[1756] The server receives and stores the generated multiple renovation plans.

[1757] 3. Emotion recognition and plan presentation adjustment:

[1758] When the user wears the smart glasses, the camera captures the user's facial expressions, which are then analyzed by an emotion recognition engine.

[1759] Based on the results of the emotion recognition engine, the server adjusts the way renovation plans are presented according to the user's emotions, for example, by prioritizing and displaying details of plans that the user is interested in.

[1760] 4. Generate quotes and contracts:

[1761] Once the user selects the optimal renovation plan, the server automatically generates an estimate and contract, and completes the online contract through an electronic signature procedure.

[1762] Specific examples

[1763] For example, a user wants to renovate a 30-year-old house, so they put on smart glasses in a brick-and-mortar showroom. Using the glasses, they input the building's area, number of rooms, and comments on current damage, and the data is sent to a server. The server checks the consistency of the information and sends prompts to a generative AI model to generate multiple renovation plans.

[1764] Then, as the user reviews their options, a camera captures their facial expressions in real time, and an emotion recognition engine analyzes their reactions: for example, if the user smiles at a particular renovation plan, the plan is displayed in detail.

[1765] The server automatically generates a quote for the plan the user finally selects, and once the user agrees to the terms, an electronic signature is carried out to complete the contract, making the entire process efficient and improving the user experience.

[1766] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1767] Step 1:

[1768] The user inputs basic building information (area, age, number of rooms) and additional information (video, photos, comments, etc.) through the smart glasses. The input information is sent from the smart glasses to the server. The input in this step is information about the user's building, and the output is that information is sent to the server. Specifically, the user operates the interface of the smart glasses to input data for each item.

[1769] Step 2:

[1770] The server checks the consistency of the basic information and additional information entered. The input is the building information sent in the previous step, and the output is the information whose consistency has been confirmed. The server checks for invalid or missing data to ensure reliable information. Specifically, the server validates the format of the data, for example, checking that the area is not a negative number.

[1771] Step 3:

[1772] Based on the information whose consistency has been confirmed, the server sends a prompt to the generative AI model to generate a renovation plan. The input is the building information whose consistency has been confirmed, and the output is multiple generated renovation plans. Specifically, the data is passed to the AI ​​model as a prompt in the following format:

[1773] Vacant house information: Area 120 sqm, Age 30 years, Number of rooms 4, Comments: Part of wall damaged. Generate the optimal renovation plan.

[1774] A generative AI model analyzes this and generates multiple renovation plans.

[1775] Step 4:

[1776] When a user wears the smart glasses, the camera captures the user's facial expressions in real time, and the emotion recognition engine analyzes the emotions. The input is real-time video data captured by the camera, and the output is emotion data. Specifically, the emotion recognition engine analyzes the user's facial features and classifies emotions based on those features.

[1777] Step 5:

[1778] The server adjusts the presentation method of the renovation plan according to the user's emotions based on the results of the emotion recognition engine. The input is the emotion data and the generated renovation plan, and the output is the presentation method of the renovation plan adjusted based on the emotion. Specifically, the server displays the plan for which the user smiles in detail, and replaces the plan for which the user shows dissatisfaction with another plan.

[1779] Step 6:

[1780] When the user selects the optimal renovation plan, the server automatically generates an estimate and contract based on that plan. The input is the renovation plan selected by the user, and the output is the automatically generated estimate and contract. Specifically, the server creates an estimate that lists the necessary costs and conditions based on the contents of the selected plan, and also generates a contract that details the contract contents.

[1781] Step 7:

[1782] The user reviews the generated quotation and contract and completes the contract through the electronic signature procedure. The input is the generated quotation and contract, and the output is an electronically signed contract. Specifically, the user reviews the contents of the quotation and contract through the interface of the smart glasses and then electronically signs, officially establishing the contract.

[1783] The above are the specific processing steps in this system.

[1784] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1785] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1786] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1787] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1788] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1789] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1790] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1791] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1792] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1793] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1794] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1795] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1796] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1797] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1798] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1799] The hardware resource for executing a specific process can be any of the following types of processors: A processor, for example, is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1800] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1801] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1802] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1803] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1804] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1805] The following is further disclosed regarding the above embodiment.

[1806] (Claim 1)

[1807] a means for a user to input basic and additional information about the vacant home;

[1808] means for verifying consistency between the basic information and the additional information;

[1809] A means for generating a renovation plan based on the information whose consistency has been confirmed;

[1810] A means for presenting the renovation plan to a user;

[1811] A means for generating an estimate and a contract based on a renovation plan selected by a user;

[1812] A system including:

[1813] (Claim 2)

[1814] The system according to claim 1, wherein the renovation plan generation means generates an optimal plan based on housing examples and rental price data from around the world.

[1815] (Claim 3)

[1816] 2. The system of claim 1, wherein the means for generating quotes and contracts provides a procedure for electronic signatures to users.

[1817] "Example 1"

[1818] (Claim 1)

[1819] a means for a user to input basic and additional information about the property;

[1820] means for verifying consistency between the basic information and the additional information;

[1821] A means for generating a renovation plan based on the information whose consistency has been confirmed;

[1822] A means for presenting the renovation plan to a user;

[1823] A means for generating an estimate and a contract based on a renovation plan selected by a user;

[1824] A means for electronically transmitting the estimate and contract to the user and for online confirmation and modification;

[1825] A means to electronically sign and complete contracts online;

[1826] A system including:

[1827] (Claim 2)

[1828] The system according to claim 1, wherein the renovation plan generation means generates an optimal plan based on property examples and rental price data from around the world.

[1829] (Claim 3)

[1830] 2. The system of claim 1, wherein the means for generating quotes and contracts provides a procedure for electronic signatures to users.

[1831] "Application Example 1"

[1832] (Claim 1)

[1833] a means for a user to input basic and additional information about the vacant home;

[1834] means for verifying consistency between the basic information and the additional information;

[1835] A means for generating a renovation plan based on the information whose consistency has been confirmed;

[1836] A means for presenting the renovation plan to a user;

[1837] A means for generating an estimate and a contract based on a renovation plan selected by a user;

[1838] A means for factory managers to input factory equipment information and layout information;

[1839] a means for verifying the consistency of the equipment information and layout information of the factory;

[1840] a means for generating an optimization plan for facility placement and layout based on the generated plan;

[1841] A system including:

[1842] (Claim 2)

[1843] The system according to claim 1, wherein the renovation plan generation means generates an optimal plan based on housing examples and rental price data from around the world.

[1844] (Claim 3)

[1845] 2. The system of claim 1, wherein the means for generating quotes and contracts provides a procedure for electronic signatures to users.

[1846] "Example 2: Combining Emotion Engines"

[1847] (Claim 1)

[1848] a means for a user to input basic and additional information about the vacant home;

[1849] means for verifying consistency between the basic information and the additional information;

[1850] A means for generating a renovation plan based on the information whose consistency has been confirmed;

[1851] A means for adjusting and presenting the generated renovation plan based on the user's emotions;

[1852] A means for generating an estimate and a contract based on the renovation plan selected by the user and providing an electronic signature procedure;

[1853] A system including:

[1854] (Claim 2)

[1855] The system according to claim 1, wherein the renovation plan generation means generates an optimal plan based on building examples and rental price data from around the world.

[1856] (Claim 3)

[1857] 2. The system of claim 1, wherein the emotion-based adjustment means analyzes the user's facial expressions and voice and adjusts the presentation method of the renovation plan based on emotion data.

[1858] "Application example 2 when combining emotion engines"

[1859] (Claim 1)

[1860] a means for a user to input basic and additional building information;

[1861] means for verifying consistency between the basic information and the additional information;

[1862] A means for generating a renovation plan based on the information whose consistency has been confirmed;

[1863] means for analyzing the user's emotions using an emotion recognition engine and adjusting the presentation method of the renovation plan;

[1864] means for presenting the renovation plan to a user;

[1865] A means for generating an estimate and a contract based on the renovation plan selected by the user;

[1866] a means for providing electronic signature procedures;

[1867] A system including:

[1868] (Claim 2)

[1869] 2. The system according to claim 1, wherein the renovation plan generating means generates an optimal plan based on building examples and rental market data from around the world.

[1870] (Claim 3)

[1871] 10. The system of claim 1, wherein the emotion recognition engine acquires user emotions using cameras or video capture devices in a physical store. [Explanation of symbols]

[1872] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for a user to input basic and additional information about the vacant home; means for verifying consistency between the basic information and the additional information; A means for generating a renovation plan based on the information whose consistency has been confirmed; A means for presenting the renovation plan to a user; A means for generating an estimate and a contract based on a renovation plan selected by a user; A system including:

2. The system according to claim 1 , wherein the renovation plan generating means generates an optimal plan based on housing examples and rental market data from around the world.

3. The system of claim 1 , wherein the quotation and contract generation means provides a procedure for electronic signatures to the user.

Images