System

Abstract

A system is provided.SOLUTION: A system comprising: means for collecting information input by a user; means for creating a user profile based on the collected information; means for generating AI dwelling options using the user profile; means for providing the generated dwelling options to the user; means for visually experiencing an interior of a dwelling through a virtual tour; means for performing budget control and cost estimation; and means for suggesting interior designs.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In today's housing market, users often have to consider many factors when choosing their ideal home, leaving them overwhelmed by the sheer volume of information. It's also difficult for them to find options that fit their individual preferences and budget. It's also difficult to visualize the interior of a property or get a detailed estimate of the cost of renovations. There's a need for a system that can solve these issues and help users make efficient and satisfying home selections. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems with a system that includes the following means: a means for collecting information entered by a user, a means for creating a user profile based on the collected information, a means for a generating AI to generate home options using the user profile, a means for providing the generated home options to the user, a means for allowing the user to visually experience the interior of the home through a virtual tour, a means for performing budget management and cost estimation, and a means for suggesting interior designs. This system allows users to efficiently find the home or renovation plan they desire. Furthermore, the system analyzes the user's preferences and budget from the collected information and makes optimal suggestions, thereby improving user satisfaction. A virtual tour function using virtual reality technology or three-dimensional graphics allows users to concretely imagine the interior of the home.

[0006] "User" refers to an individual or organization considering purchasing or renovating a home.

[0007] "Input information" refers to data that users provide to the system, such as their preferences, budget, requirements, etc.

[0008] "Means of collection" refers to the functions and processes used to capture, store, and manage information entered by users.

[0009] A "user profile" is a data structure generated based on user input that details individual preferences and budgets.

[0010] "Generative AI" refers to a system that uses artificial intelligence algorithms to generate optimal housing options based on a user profile.

[0011] "Housing Options" refers to housing and renovation options that fit a user's preferences, budget, and requirements.

[0012] A "virtual tour" refers to a system that uses virtual reality technology and three-dimensional graphics to allow users to visually experience the interior of a property and the space after renovation.

[0013] "Budget management" refers to a function that allows users to effectively manage the budget they set when purchasing or renovating, and control costs.

[0014] "Cost Estimator" refers to a system that calculates the overall cost required for renovations or home purchases and presents it to the user.

[0015] "Interior design" refers to the process and results of proposing the decoration and arrangement of an indoor environment, such as the color scheme, furniture arrangement, and lighting design of a living space.

[0016] "Virtual reality technology" refers to technology that allows users to experience a computer-generated virtual space as if it were real.

[0017] "3D graphics" refers to computer graphics techniques for displaying three-dimensional objects and spaces on a two-dimensional screen. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6]FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] The present invention provides a system that uses generative AI to propose optimal housing options to users considering purchasing or renovating a home. This system collects information entered by the user, creates a user profile based on that information, and the generative AI proposes optimal housing options, and also provides functions such as virtual tours, budget management, cost estimates, and interior design suggestions.

[0040] System Configuration

[0041] The system according to the present invention includes the following main components:

[0042] 1. Terminal - Provides an interface where users can enter information and review suggestions from the system.

[0043] 2. Server - The central system that receives user input, creates a user profile, and executes generative AI-driven suggestions.

[0044] 3. Generative AI model - an algorithm that generates the best housing options based on a user profile.

[0045] 4. Database - Stores user profiles, proposals, virtual tour data, cost estimate data, etc.

[0046] Program processing explanation

[0047] 1. Create a user profile

[0048] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0049] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0050] The terminal transmits the input information to the server.

[0051] The server creates a user profile based on the received information and stores it in a database.

[0052] 2. Generative AI suggestions

[0053] The server retrieves the user profile and performs analysis.

[0054] The server makes a request to the generative AI model to generate housing options that match the user's requirements.

[0055] The generative AI model generates multiple proposed properties and renovation plans that match the conditions.

[0056] The generative AI model sends the generated results back to the server.

[0057] The server sends the proposed options to the terminal.

[0058] The terminal displays proposed homes and renovation plans to the user in list form.

[0059] 3. Virtual Tour Feature

[0060] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0061] The device requests data for the virtual tour from the server.

[0062] The server provides virtual tour data (3D models and VR content).

[0063] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[0064] The user operates the terminal interface to virtually tour the interior of the property.

[0065] 4. Budget management and cost estimation features

[0066] The user selects the budget management tab and enters detailed information about the renovation.

[0067] The terminal transmits the user's input data to the server.

[0068] The server uses the received data to generate a comprehensive cost estimate.

[0069] The server transmits the cost estimate results to the terminal.

[0070] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[0071] 5. Interior design suggestion function

[0072] The user selects the interior design suggestions tab and enters their preferred style and color.

[0073] The terminal transmits the user's input data to the server.

[0074] The server analyzes the data and asks the generative AI model to propose interior designs.

[0075] A generative AI model generates interior design proposals.

[0076] The generative AI model sends the generated suggestions back to the server.

[0077] The server sends the interior design proposal to the terminal.

[0078] The device displays interior design suggestions to the user, providing a concrete image.

[0079] Specific examples

[0080] When a user is considering buying a home, the following sequence of events occurs:

[0081] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[0082] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0083] 3. The device sends the information to the server and a user profile is created.

[0084] 4. The server generates the optimal property based on the generative AI model.

[0085] 5. The proposed properties are displayed to the user, who can select the property they are interested in and enjoy a virtual tour.

[0086] 6. In addition, you can use the budget management function to check renovation cost estimates and receive interior design suggestions to make your ideal home a reality.

[0087] In this way, by using the system of the present invention, users can efficiently find the home they desire and smoothly make the decision that accompanies it.

[0088] The processing flow will be explained below.

[0089] Step 1:

[0090] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0091] Step 2:

[0092] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0093] Step 3:

[0094] The terminal converts the input information into JSON format and sends it to the server.

[0095] Step 4:

[0096] The server analyzes the received information and creates a user profile.

[0097] Step 5:

[0098] The server stores the user profile in a database.

[0099] Step 6:

[0100] The server retrieves the user profile and sends it to the generative AI model.

[0101] Step 7:

[0102] A generative AI model generates the best housing options based on the user's preferences and budget.

[0103] Step 8:

[0104] The generative AI model sends the generated options back to the server.

[0105] Step 9:

[0106] The server converts the proposed options into JSON format and sends it to the device.

[0107] Step 10:

[0108] The terminal displays proposed homes and renovation plans to the user in list form.

[0109] Step 11:

[0110] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0111] Step 12:

[0112] The terminal requests the virtual tour data from the server.

[0113] Step 13:

[0114] The server provides virtual tour data (3D models and VR content).

[0115] Step 14:

[0116] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[0117] Step 15:

[0118] The user operates the terminal interface to virtually tour the interior of the property.

[0119] Step 16:

[0120] The user selects the budget management tab and enters detailed information about the renovation.

[0121] Step 17:

[0122] The terminal converts the user's input data into JSON format and sends it to the server.

[0123] Step 18:

[0124] The server analyzes the received data and generates a comprehensive cost estimate.

[0125] Step 19:

[0126] The server transmits the cost estimate results to the terminal.

[0127] Step 20:

[0128] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[0129] Step 21:

[0130] The user selects the interior design suggestions tab and enters their preferred style and color.

[0131] Step 22:

[0132] The terminal converts the user's input data into JSON format and sends it to the server.

[0133] Step 23:

[0134] The server analyzes the data and asks the generative AI model to propose interior designs.

[0135] Step 24:

[0136] A generative AI model generates interior design suggestions such as color schemes, furniture placement, and lighting designs.

[0137] Step 25:

[0138] The generative AI model sends the generated suggestions back to the server.

[0139] Step 26:

[0140] The server converts the interior design proposal into JSON format and sends it to the device.

[0141] Step 27:

[0142] The device displays interior design suggestions to the user, providing a concrete image.

[0143] Example 1

[0144] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0145] Traditionally, when considering purchasing or renovating a home, users have to research a lot of information, which requires a lot of effort. It can be difficult to find the best home option, and users are required to manage their budget and propose interior design themselves. This slows down users' decision-making process and complicates the process of finding their ideal home. Therefore, there is a need for a system that allows users to efficiently find their ideal home.

[0146] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0147] In this invention, the server includes a means for collecting information entered by the user, a means for creating a user profile based on the collected information, and a means for the generation AI to generate housing options using the user profile, thereby enabling suggestions to help the user efficiently find their ideal home.

[0148] The server also includes means for providing the generated home options to the user, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, means for proposing interior designs, and means for receiving the proposals and displaying them to the user in a visually easy-to-understand list format, thereby enabling the user to compare and consider multiple home options and receive budget management and interior design proposals while virtually touring the interiors, thereby enabling smooth decision-making.

[0149] Furthermore, the server includes means for creating prompts for the generative AI based on a user profile, means for receiving and analyzing the output of the generative AI model, and means for downloading virtual tour data to the terminal and displaying a VR environment and three-dimensional graphics, thereby enabling the user to receive more specific and personalized home suggestions and providing a seamlessly integrated user experience throughout the entire process.

[0150] "Means for collecting information entered by the user" refers to the function of providing an interface for the user to enter their desired area, budget, size of the home, and other desired conditions, and securely transmitting that information to the server.

[0151] "Means for creating a user profile based on collected information" refers to the function of analyzing the information entered by the user and generating a digital profile that systematically summarizes the user's wishes and requirements.

[0152] "Means by which the generative AI generates housing options using a user profile" refers to the process by which the generative AI model generates optimal housing options based on a user profile.

[0153] "Means for providing users with generated housing options" refers to the function of providing an interface for presenting users with multiple housing options generated by the generative AI.

[0154] "Means for visually experiencing the interior of a home through a virtual tour" refers to a feature that uses virtual reality technology or three-dimensional graphics to allow a user to virtually tour the interior of a proposed home.

[0155] "Means for budget management and cost estimation" refers to a function that provides estimates for renovation and purchase costs based on the budget set by the user and helps the user execute the plan within the budget.

[0156] "Means for suggesting interior design" refers to a function that uses generative AI to suggest optimal interior design ideas based on the user's preferences and style.

[0157] "Means for receiving the proposals and displaying them to the user in a visually easy-to-understand list format" refers to the function of receiving the output from the generative AI and displaying it in a visual list format that is easy for the user to understand.

[0158] "Means for creating prompts for the generative AI based on a user profile" refers to the process of generating input sentences based on information in the user profile that enable the generative AI to make accurate suggestions.

[0159] "Means for receiving and analyzing the output of the generative AI model" refers to the function of receiving the proposed results from the generative AI, analyzing them, and converting them into a format that is useful to the user.

[0160] "Means for downloading virtual tour data to a terminal and displaying a VR environment or three-dimensional graphics" refers to the function of downloading virtual tour data from a server and displaying it as a VR environment or three-dimensional graphics on a terminal.

[0161] The present invention provides a system that uses generative AI to propose optimal housing options to users who are considering purchasing or renovating a home. The main components of this system include a terminal, a server, a generative AI model, and a database. The role of each component and the specific processing are explained below.

[0162] Hardware and software used

[0163] Terminal: A device that provides an interface for users to enter information and view system suggestions, such as a PC, smartphone, or tablet.

[0164] Server: A central computer system that receives user input, creates a user profile, and executes suggestions using generative AI models. This is often a cloud service or dedicated server equipment.

[0165] Generative AI model: An algorithm that generates optimal housing options based on a user profile. For example, generative AI technologies such as OpenAI's GPT-4 are used.

[0166] Database: Stores user profiles, proposals, virtual tour data, cost estimate data, etc. Generally, a relational database such as MySQL or PostgreSQL is used.

[0167] Specific implementation methods of the system

[0168] 1. Enter your user information:

[0169] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0170] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed" into a form.

[0171] The device sends the entered information to the server. For security reasons, the data is sent using a protocol such as HTTPS.

[0172] 2. Create a user profile:

[0173] The server analyzes the user information received from the terminal and creates a user profile.

[0174] The server stores the created user profile in a database, typically in JSON format.

[0175] 3. Generative AI suggestions:

[0176] The server retrieves the user profile from the database and generates appropriate prompts for the generative AI model, such as "Based on the user profile, please suggest a 3LDK property in Tokyo for up to 80 million yen. Please also include the condition that pets are allowed."

[0177] The generative AI model generates suggestions based on the input prompts and sends them back to the server.

[0178] 4. View Proposals:

[0179] The server sends the suggestions from the generating AI to the terminal.

[0180] The device receives the suggestions and displays them to the user in a visually easy-to-understand format, such as a list containing thumbnail images of properties and links to more detailed information.

[0181] 5. Virtual Tour Feature:

[0182] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0183] The device requests virtual tour data from the server, receives the data, and displays the VR environment and 3D graphics. For example, this can be achieved using Unity or Unreal Engine.

[0184] 6. Budget management and cost estimation features:

[0185] The user selects the budget management tab and enters detailed information about the renovation.

[0186] The terminal sends the input data to the server, which generates a cost estimate.

[0187] The terminal displays the estimate results to the user, allowing them to confirm whether they fit within their budget.

[0188] 7. Interior design proposal function:

[0189] The user selects the interior design suggestions tab and enters their preferred style and color.

[0190] The device sends the input data to the server, which then requests a generative AI model to generate interior design proposals.

[0191] The terminal receives the proposed results and provides a concrete image to the user.

[0192] Specific examples

[0193] For example, if a user is considering buying a home, they might input the following prompts into a generative AI model:

[0194] "Based on my user profile, please suggest 3 bedroom, 3 bedroom, 3 kitchen, and 3 bedroom apartments in Tokyo priced at under ¥80 million. Please also include the requirement that pets are allowed."

[0195] "Please suggest a renovation plan. My budget is within 10 million yen, and I'd particularly like to renovate the kitchen and bathroom."

[0196] "Please provide an interior design proposal based on the user's preferences. It should be modern in style, with white and blue as the main colors."

[0197] As described above, the system of the present invention is a system that allows users to efficiently find the home they desire and provides a series of support to help them realize their ideal home.

[0198] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0199] Step 1: Enter and submit user information

[0200] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0201] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed" into the form. This is the user's specific desired conditions and is important data that will be used in subsequent processing by the system.

[0202] The device verifies that the information is in the correct format and sends it to the server using a secure protocol (e.g., HTTPS).

[0203] Input: Information entered by the user (area, budget, size, conditions)

[0204] Output: User information sent to the server

[0205] Step 2: Create a user profile

[0206] The server analyzes the user information received from the terminal and checks whether the format is correct.

[0207] Based on the information received by the server, a user profile is created, which systematically summarizes the user's preferences and is stored in a database in JSON format or similar.

[0208] Input: User information sent from the device

[0209] Output: User profile stored in the database

[0210] Step 3: Generative AI suggestions

[0211] The server retrieves the user profile from the database and performs analysis.

[0212] The server creates a prompt for the generative AI model based on the user profile. For example, it generates a prompt such as, "Based on the user profile, please suggest a 3LDK property in Tokyo for up to 80 million yen. Please also include the condition that pets are allowed."

[0213] The server sends a prompt to the generative AI model, requesting it to generate multiple proposed properties and renovation plans.

[0214] The generative AI model generates suggestions that match the conditions and returns the results to the server.

[0215] Input: User profile retrieved from database

[0216] Output: Home recommendations returned by the generative AI model

[0217] Step 4: View the proposal

[0218] The server analyzes the proposals received from the generation AI and converts them into the required format, such as compiling information such as property name, price, location, and size in JSON format.

[0219] The server sends the proposal to the device.

[0220] The device receives the suggestions and displays them to the user in a visually appealing list format, including thumbnail images of the properties and links to more detailed information.

[0221] Input: Suggestions sent by the generative AI model

[0222] Output: Suggestions presented to the user in a visually friendly format

[0223] Step 5: Virtual Tour Feature

[0224] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0225] The device sends a request to the server containing the ID of the selected property.

[0226] The server retrieves the virtual tour data from the database and sends it to the device. The virtual tour data is stored as a 3D model or VR content.

[0227] The device receives the data and displays it using a VR-capable application or 3D rendering engine (such as Unity or Unreal Engine).

[0228] Users can operate the device to virtually tour the interior of a property, for example by using the arrow keys on the screen to move between rooms.

[0229] Input: Property ID selected by user

[0230] Output: Virtual tours displayed in VR environments and 3D graphics

[0231] Step 6: Budget management and cost estimation features

[0232] The user selects the budget management tab and enters detailed information about the renovation (for example, kitchen renovation, bathroom renovation requests, etc.).

[0233] The terminal sends the input data to the server.

[0234] The server generates a cost estimate for the renovation based on the data received, using internal algorithms and external APIs to provide an accurate cost estimate.

[0235] The server compiles the estimate results and sends them to the terminal.

[0236] The terminal visually displays the estimate results, allowing the user to check whether they fit within their budget.

[0237] Input: Renovation details entered by the user

[0238] Output: Generated cost estimate results

[0239] Step 7: Interior design suggestion function

[0240] The user selects the interior design suggestion tab and inputs the preferred style and color (e.g., modern style, white and blue).

[0241] The terminal sends the input data to the server.

[0242] The server analyzes the data and asks the generative AI model to propose an interior design, specifically generating a prompt such as, "Please propose a modern interior design with white and blue as the main colors."

[0243] The generative AI model generates interior design proposals and sends them back to the server.

[0244] The server parses the proposal and sends it to the device.

[0245] The device visually displays specific interior design suggestions to the user, such as furniture placement, wall colors, and decoration ideas, using images and text.

[0246] Input: Style and color information entered by the user

[0247] Output: Interior design proposals generated by the generative AI model

[0248] (Application example 1)

[0249] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0250] In modern society, when users purchase or renovate a home, it takes a lot of time and effort to gather a lot of information and find the best option. This makes it difficult for users to efficiently find a home that meets their desired criteria. Users also need the convenience of being able to see the interior of a property without visiting the site. Furthermore, proper budget management, cost estimation, and receiving interior design proposals are also important challenges.

[0251] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0252] In this invention, the server includes means for collecting information input by a user, means for creating a user profile based on the collected information, means for a generation AI to generate home options using the user profile, means for providing the generated home options to the user, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, means for proposing interior designs, and means for presenting multiple options by switching between properties using virtual reality technology. This allows users to efficiently find their desired home, and enables them to use a virtual environment to check the interior of the property and receive budget management and interior design suggestions.

[0253] The "means for collecting information entered by the user" is a function that provides an interface for the user to input desired conditions and requests and transmits them to the server.

[0254] The "means for creating a user profile based on collected information" refers to a function that analyzes collected user information and organizes and stores user attributes in a database based on individual characteristics and requests.

[0255] "Means for the generative AI to generate housing options using user profiles" refers to a function that allows the generative AI to execute an algorithm to propose optimal housing and renovation plans based on user profile data.

[0256] "Means for providing users with generated housing options" means a function that provides users with information about the housing suggested by the generating AI in visual or text format.

[0257] "Means for visually experiencing the interior of a home through a virtual tour" refers to a function that allows a user to virtually tour the interior of a property using virtual reality technology and three-dimensional graphics.

[0258] The "means for budget management and cost estimation" is a function that calculates the costs of renovations and purchases based on the budget information entered by the user and checks whether they are within the budget.

[0259] The "means for proposing interior designs" is a function that uses AI to propose optimal interior designs based on the user's preferences and budget.

[0260] "Means for presenting multiple options by switching between properties using virtual reality technology" refers to a function that allows a user to view different properties while switching between them in a virtual reality environment and compare multiple options.

[0261] MODE FOR CARRYING OUT THE INVENTION

[0262] The present invention relates to a system for streamlining the process of users considering purchasing or renovating a home. This system includes a terminal for users to input information, a server that processes the information and generates proposals, and a database that stores this data. The specific system configuration and processing are described below.

[0263] System Configuration

[0264] 1. Terminal

[0265] This device provides an interface for users to input information such as the desired area, budget, size of the home, etc. The device can be a smartphone or a head-mounted display (HMD).

[0266] 2. Server

[0267] The server receives the information sent by the terminal and creates a user profile, in particular by analyzing the data based on the user's preferences and needs.

[0268] A generative AI model runs on the server and generates optimal housing options based on the user's profile.

[0269] The server transmits the virtual tour data and cost estimate data to the terminal and provides them to the user.

[0270] 3. Database

[0271] The database stores user profiles, generated home options, virtual tour data, cost estimate data, interior design suggestions, and more.

[0272] Program processing explanation

[0273] 1. Create a user profile

[0274] The terminal displays an input form to the user that asks, "Please enter your desired area, budget, size of home, and other desired conditions."

[0275] For example, the user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0276] The device sends the entered information to the server, which creates a user profile based on the received information and stores it in a database.

[0277] 2. Generative AI suggestions

[0278] The server retrieves the user profile and uses a generative AI model to generate housing options that match the user's preferences.

[0279] The generative AI model generates multiple proposed properties and renovation plans that match the user's criteria and returns the results to the server, which then sends the proposals to the device and provides them to the user.

[0280] 3. Virtual Tour Feature

[0281] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0282] The terminal requests data for the virtual tour from the server, and the server provides the virtual tour data (3D models and VR content).

[0283] The device downloads the virtual tour data and displays the VR environment and 3D graphics, allowing users to virtually tour the interior of the property by operating the device's interface.

[0284] 4. Budget management and cost estimation features

[0285] The user selects the budget management tab and enters detailed information about the renovation.

[0286] The terminal transmits the user's input data to the server, which uses the received data to generate a comprehensive cost estimate and transmits the result to the terminal.

[0287] The terminal displays the cost estimate results to the user, allowing them to confirm whether the cost is within their budget.

[0288] 5. Interior design suggestion function

[0289] Users select the interior design suggestions tab and enter their preferred style and color.

[0290] The device sends the user's input data to the server, which analyzes the data and requests the generative AI model to propose interior design ideas.

[0291] The generative AI model generates interior design proposals and sends them back to the server, which then sends them to the device to provide the user with a concrete image.

[0292] Specific examples

[0293] If a user is considering buying a home:

[0294] 1. The device will display "Please enter your desired area, budget, home size, and other desired conditions."

[0295] 2. The user enters "Tokyo, 80 million yen, 3LDK, pets allowed."

[0296] 3. The device sends the information to the server, which creates a user profile and stores it in a database.

[0297] 4. The server generates optimal property options based on the generative AI model. The suggested properties are displayed to the user, who selects the property that interests them.

[0298] 5. Users can use the virtual tour feature to visually inspect the property, as well as manage their budget and see cost estimates.

[0299] 6. Finally, you will receive interior design suggestions to help you realize your dream home.

[0300] Example prompt sentence:

[0301] Enter the housing requirements you are looking for.

[0302] Region: Tokyo

[0303] Budget: 80 million yen

[0304] Size of the home: 3LDK

[0305] Other desired conditions:Pets allowed

[0306] In this way, by using the system of the present invention, users can efficiently find the home they desire, and can also use the virtual environment to view the interior of the property and receive budget management and interior design suggestions.

[0307] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0308] Step 1:

[0309] The user inputs their desired conditions. Specifically, the device displays an input form that asks, "Please enter your desired area, budget, home size, and other desired conditions." The user inputs the conditions, and the device sends the information to the server. Based on the input, data on the area, budget, home size, and other desired conditions is collected.

[0310] Step 2:

[0311] The server analyzes the received user information and creates a user profile. The server saves the user profile in a database based on the collected information. The server processes the data to generate the user profile using the entered data such as area, budget, size of the home, and other desired conditions.

[0312] Step 3:

[0313] The server generates housing options using a generative AI model based on the user profile. Specifically, the server inputs the user profile data into the generative AI model and receives a list of optimal housing options as output. This list includes properties and renovation plans that meet the user's criteria.

[0314] Step 4:

[0315] The server sends the generated housing options to the terminal, which displays the proposed housing options in a list format to the user. The output includes information about the proposed home and renovation plan.

[0316] Step 5:

[0317] The user selects a property they are interested in and clicks the virtual tour button. The device requests virtual tour data from the server, and the server sends the virtual tour data (3D models and VR content) to the device. The ID of the property selected by the user is used as input, and the virtual tour data is provided as output.

[0318] Step 6:

[0319] The device receives the virtual tour data and displays it to the user as a VR environment or 3D graphics. Through the device interface, the user can virtually tour the interior of the property, allowing the user to see the interior without actually visiting the property.

[0320] Step 7:

[0321] The user selects the budget management tab and enters detailed information about the renovation. The device sends that information to the server, which generates a cost estimate based on the received data. The detailed information about the renovation is used as input, and a comprehensive cost estimate is generated as output.

[0322] Step 8:

[0323] The server sends the cost estimate results to the terminal, which then displays them to the user, who can check whether they fit within their budget. The cost estimate results show the total cost of the renovation.

[0324] Step 9:

[0325] The user selects the interior design suggestions tab and enters their preferred style and color. The device sends that information to the server, which then inputs the data into a generative AI model to generate interior design suggestions. The user's preferred style and color are used as input, and the interior design suggestions are generated as output.

[0326] Step 10:

[0327] The server sends the generated interior design proposal to the terminal, which then displays the proposal to the user. The user can check the proposed interior design and get a concrete image of it. Detailed information about the interior design proposal is provided as an output.

[0328] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0329] This invention provides a system that combines a conventional home purchase and renovation suggestion system with an emotion engine that recognizes the user's emotions and optimizes the proposal content based on those emotions. This system has the function of analyzing the user's emotions and proposing optimal housing options and interior designs based on those emotions.

[0330] System Configuration

[0331] The system according to the present invention includes the following main components:

[0332] 1. Terminal - Provides an interface where users can input information, review system suggestions, and perform emotion recognition.

[0333] 2. Server - The central system that receives user input, creates a user profile, and executes generative AI-driven suggestions. It also analyzes emotional data using the emotion engine.

[0334] 3. Generative AI model - an algorithm that generates the best housing options based on a user profile.

[0335] 4. Sentiment Engine - An algorithm that analyzes user sentiment and incorporates that data into suggestions.

[0336] 5. Database - Stores user profiles, proposals, virtual tour data, cost estimate data, sentiment data, etc.

[0337] Program processing explanation

[0338] 1. Create a user profile

[0339] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0340] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0341] The terminal transmits the input information to the server.

[0342] The server creates a user profile based on the received information and stores it in a database.

[0343] 2. Generative AI suggestions

[0344] The server retrieves the user profile and sends it to the generative AI model.

[0345] A generative AI model generates the best housing options based on the user's profile.

[0346] The generative AI model sends the generated options back to the server.

[0347] The server converts the proposed options into JSON format and sends it to the device.

[0348] The terminal displays proposed homes and renovation plans to the user in list form.

[0349] 3. Emotion Recognition by Emotion Engine

[0350] It provides an interface for devices to recognize user emotions, for example by monitoring the user's facial expressions, voice, and operation patterns.

[0351] Emotional data is collected as users browse suggested options.

[0352] The device transmits the emotion data to the server.

[0353] The server analyzes the emotion data using an emotion engine.

[0354] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[0355] 4. Recalibrate your emotional recommendations

[0356] A generative AI model receives data from the emotion engine and adjusts its suggestions.

[0357] A generative AI model generates reconditioned housing options.

[0358] The generative AI model sends the refinement results back to the server.

[0359] The server sends the retuned proposal to the device.

[0360] The device displays optimized suggestions to the user.

[0361] Specific examples

[0362] When a user is considering buying a home, the following sequence of events occurs:

[0363] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[0364] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0365] 3. The device sends the information to the server and a user profile is created.

[0366] 4. The server uses the generative AI model to generate the optimal property and displays the proposal to the user.

[0367] 5. The device monitors the user's emotions and collects emotional data.

[0368] 6. The emotion engine analyzes the emotion data and provides data for recalibration to the generative AI model.

[0369] 7. The generative AI model generates new suggestions and displays them back to the user via the server.

[0370] 8. Additionally, users can find their ideal home using virtual tours, budget management, and interior design suggestions.

[0371] In this way, by using the system of the present invention, users can receive more personalized home suggestions that match their emotions and efficiently find their ideal home.

[0372] The processing flow will be explained below.

[0373] Step 1:

[0374] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0375] Step 2:

[0376] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0377] Step 3:

[0378] The terminal converts the input information into JSON format and sends it to the server.

[0379] Step 4:

[0380] The server analyzes the received information and creates a user profile.

[0381] Step 5:

[0382] The server stores the user profile in a database.

[0383] Step 6:

[0384] The server retrieves the user profile and sends it to the generative AI model.

[0385] Step 7:

[0386] A generative AI model generates the best housing options based on the user's profile.

[0387] Step 8:

[0388] The generative AI model sends the generated options back to the server.

[0389] Step 9:

[0390] The server converts the proposed options into JSON format and sends it to the device.

[0391] Step 10:

[0392] The terminal displays proposed homes and renovation plans to the user in list form.

[0393] Step 11:

[0394] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0395] Step 12:

[0396] The terminal requests the virtual tour data from the server.

[0397] Step 13:

[0398] The server provides virtual tour data (3D models and VR content).

[0399] Step 14:

[0400] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[0401] Step 15:

[0402] The user operates the terminal interface to virtually tour the interior of the property.

[0403] Step 16:

[0404] The device monitors the user's facial expressions, voice, and operation patterns to collect emotional data.

[0405] Step 17:

[0406] The device converts the collected emotion data into JSON format and sends it to the server.

[0407] Step 18:

[0408] The server analyzes the emotion data using an emotion engine.

[0409] Step 19:

[0410] Based on the analysis results, the server sends data to the generative AI model to readjust the suggestions.

[0411] Step 20:

[0412] A generative AI model takes emotional data into account and recreates optimized housing options.

[0413] Step 21:

[0414] The generative AI model sends the regenerated options back to the server.

[0415] Step 22:

[0416] The server converts the regenerated proposal into JSON format and sends it to the device.

[0417] Step 23:

[0418] The device redisplays the optimized suggestions to the user.

[0419] Step 24:

[0420] The user checks the re-proposed property and renovation plan.

[0421] Step 25:

[0422] The user selects the budget management tab and enters detailed information about the renovation.

[0423] Step 26:

[0424] The terminal converts the user's input data into JSON format and sends it to the server.

[0425] Step 27:

[0426] The server analyzes the received data and generates a comprehensive cost estimate.

[0427] Step 28:

[0428] The server transmits the cost estimate results to the terminal.

[0429] Step 29:

[0430] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[0431] Step 30:

[0432] The user selects the interior design suggestions tab and enters their preferred style and color.

[0433] Step 31:

[0434] The terminal converts the user's input data into JSON format and sends it to the server.

[0435] Step 32:

[0436] The server analyzes the data and asks the generative AI model to propose interior designs.

[0437] Step 33:

[0438] A generative AI model generates interior design suggestions such as color schemes, furniture placement, and lighting designs.

[0439] Step 34:

[0440] The generative AI model sends the generated suggestions back to the server.

[0441] Step 35:

[0442] The server converts the interior design proposal into JSON format and sends it to the device.

[0443] Step 36:

[0444] The device displays interior design suggestions to the user, providing a concrete image.

[0445] Through this series of steps, users can receive more personalized home suggestions based on their emotions and input information.

[0446] Example 2

[0447] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0448] Conventional home purchasing and renovation suggestion systems are unable to adequately respond to individual users' emotions and preferences, resulting in the significant time and effort required for users to find their ideal home. In particular, there was a lack of technology that could recognize users' emotions in real time and make suggestions accordingly. This made it difficult for users to quickly find the home that best suits them.

[0449] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0450] In this invention, the server includes means for collecting information input by a user, means for creating a user profile based on the collected information, means for a generation AI to generate home options using the user profile, means for providing the generated home options to the user, means for recognizing and collecting user emotions, means for analyzing the collected emotion data and providing the generation AI with data for readjusting the proposal, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, and means for suggesting interior designs. This enables personalized proposals based on the user's emotions and preferences, allowing the user to quickly find their ideal home.

[0451] The "means for collecting information entered by the user" is a means that has the function of collecting information such as desired conditions and budget entered by the user through the terminal as data.

[0452] The "means for creating a user profile based on collected information" is a function that generates a profile corresponding to each individual user based on collected information such as the user's desired conditions and budget.

[0453] "Means for generative AI to generate housing options using user profiles" refers to a function in which a generative AI model uses data from user profiles to algorithmically generate appropriate housing and renovation options.

[0454] "Means for providing users with generated housing options" means a function that presents users with housing and renovation options created by a generative AI model.

[0455] "Means for recognizing and collecting user emotions" refers to a function that analyzes the user's facial expressions, voice, operation patterns, etc., and recognizes and collects emotions in real time.

[0456] "Means for analyzing collected emotional data and providing data to the generative AI for readjusting suggestions" refers to a function that analyzes collected emotional data and provides feedback to the generative AI model based on the results to readjust the content of suggestions.

[0457] "Means for visually experiencing the interior of a home through a virtual tour" refers to a function that allows a user to visually experience the interior of a home using virtual reality technology or three-dimensional graphics.

[0458] The "means for budget management and cost estimation" is a function that calculates and manages the total cost of a home or renovation based on the user's budget information.

[0459] The "means for proposing interior designs" has the function of proposing the most suitable interior design based on the user's desired conditions and feelings.

[0460] This invention relates to a system that recognizes a user's emotions and proposes optimal housing options based on those emotions. The system aims to increase user satisfaction by collecting and analyzing the user's emotional data in real time and readjusting the proposals based on the results.

[0461] System Configuration

[0462] The system according to the present invention includes the following main components:

[0463] 1. Device - Provides the interface where users input information, confirm system suggestions, and perform emotion recognition. Specific examples include personal computers, smartphones, and tablets. The device has a web browser or a dedicated application installed.

[0464] 2. Server - This is the central system that receives user input, creates a user profile, and executes generative AI-based suggestions. It also analyzes emotional data using an emotion engine. Specifically, it includes a web server, database server, and AI server.

[0465] 3. Generative AI model - An algorithm that generates optimal housing options based on a user profile. It uses machine learning algorithms to generate multiple housing options.

[0466] 4. Emotion Engine - An algorithm that analyzes user emotions and incorporates that data into suggestions. It analyzes user emotions in real time through facial expression recognition and voice analysis.

[0467] 5. Database - A system for storing user profiles, proposals, virtual tour data, cost estimate data, emotion data, etc. Specifically, a database management system such as MySQL or MongoDB is used.

[0468] Program processing

[0469] Creating a User Profile

[0470] The terminal displays to the user, "Please enter your desired area, budget, size of home, and other desired conditions."

[0471] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0472] The terminal transmits the input information to the server.

[0473] The server creates a user profile based on the received information and stores it in a database.

[0474] Generative AI suggestions

[0475] The server retrieves the user profile and sends it to the generative AI model.

[0476] A generative AI model generates optimal housing options based on a user's profile.

[0477] The generative AI model sends the generated options back to the server.

[0478] The server converts the proposed options into JSON format and sends it to the device.

[0479] The terminal displays proposed homes and renovation plans to the user in list form.

[0480] Emotion recognition by emotion engine

[0481] The device provides an interface for recognizing the user's emotions, including software for facial expression recognition using a camera and microphone, and voice analysis.

[0482] Emotional data is collected as users browse suggested options.

[0483] The terminal transmits the emotion data to the server.

[0484] The server analyzes the emotion data using an emotion engine.

[0485] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[0486] Recalibrating sentiment-based suggestions

[0487] The generative AI model receives data from the emotion engine and adjusts its suggestions.

[0488] A generative AI model generates reconditioned housing options.

[0489] The generative AI model sends the refinement results back to the server.

[0490] The server sends the retuned proposal to the terminal.

[0491] The terminal displays the optimized suggestions to the user.

[0492] Specific examples

[0493] If a user is considering buying a home, the process goes like this:

[0494] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[0495] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0496] 3. The device sends the information to the server and a user profile is created.

[0497] 4. The server uses the generative AI model to generate the optimal property and displays the proposal to the user.

[0498] 5. The device monitors the user's emotions and collects emotional data.

[0499] 6. The emotion engine analyzes the emotion data and provides data for recalibration to the generative AI model.

[0500] 7. The generative AI model generates new suggestions and displays them back to the user via the server.

[0501] Example prompt sentence:

[0502] Please enter your desired area, budget, size of home, and other desired conditions.

[0503] In this way, by using the system of the present invention, users can receive more personalized home suggestions that match their emotions and efficiently find their ideal home.

[0504] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0505] Step 1:

[0506] Entering user information

[0507] The terminal displays a form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0508] Input: Prompt: "Please enter your desired area, budget, home size, and other desired conditions."

[0509] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0510] Specific actions: The user enters information using the keyboard and clicks the "Submit" button.

[0511] Step 2:

[0512] Submitting information and creating profiles

[0513] The terminal transmits the input user information to the server.

[0514] Input: Information entered by the user (Tokyo, 80 million yen, 3LDK, pets allowed).

[0515] Output: JSON formatted data.

[0516] Specific operation: The device converts the information into JSON format and sends it to the server as an HTTP POST request.

[0517] The server creates a user profile based on the received information and stores it in a database.

[0518] Specific operation: The server parses the received JSON data, generates a user profile, and saves it as a new entry in a database (e.g., MySQL).

[0519] Step 3:

[0520] Invoking a generative AI model

[0521] The server retrieves the user profile and sends it to the generative AI model.

[0522] Input: User profile stored in the database.

[0523] Output: The generated housing options.

[0524] What it does: The server queries the user profile from the database and sends the data in JSON format to the API of the generative AI model.

[0525] A generative AI model generates optimal housing options based on the user profile and sends them back to the server.

[0526] How it works: The generative AI model uses machine learning algorithms to generate housing options and returns the results to the server as a response.

[0527] Step 4:

[0528] Proposal content provided

[0529] The server converts the generated housing options into JSON format and sends it to the device.

[0530] Input: Home options returned from a generative AI model.

[0531] Output: JSON formatted data sent to the device.

[0532] Specific operation: The server formats the generated options into JSON and sends it to the terminal as an HTTP response.

[0533] The terminal displays proposed homes and renovation plans to the user in list form.

[0534] Specific behavior: The device parses the received JSON data and renders a list of suggestions in the user interface.

[0535] Step 5:

[0536] Collecting Emotional Data

[0537] The terminal provides an interface for recognizing the user's emotions.

[0538] Input: User's facial expressions, voice, operation patterns, etc.

[0539] Output: Collected emotion data.

[0540] Specific operation: Software that uses the camera and microphone to recognize facial expressions and perform voice analysis is launched.

[0541] Emotional data is collected as the user browses through the suggested options.

[0542] How it works: As you scroll through the suggested options, the camera captures your facial expressions and the microphone records your tone of voice.

[0543] Step 6:

[0544] Sending and analyzing emotional data

[0545] The terminal transmits the emotion data to the server.

[0546] Input: Collected emotion data.

[0547] Output: The data sent to the server.

[0548] Specific operation: The collected facial expression data and voice data are sent to the server in real time.

[0549] The server analyzes the emotion data using an emotion engine.

[0550] Specific operation: The server calls the emotion engine's API and converts facial expression data and voice data into emotion indexes and text labels.

[0551] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[0552] Input: Parsed emotion data.

[0553] Output: Data for recalibration.

[0554] How it works: The results of the sentiment analysis are sent to the generative AI model's API, which then uses the data to generate new suggestions based on the user's emotional state.

[0555] Step 7:

[0556] Readjusting the proposal

[0557] The generative AI model receives data from the emotion engine and refines its suggestions.

[0558] Input: Data from the emotion engine.

[0559] Output: Rebalanced housing options.

[0560] How it works: A generative AI model uses emotion data to reconstruct housing options that the user is likely to find more comfortable.

[0561] The generative AI model generates retuned housing options and sends them back to the server.

[0562] What happens: The newly generated housing options are converted into JSON format and sent as a response from the generative AI model's API to the server.

[0563] Step 8:

[0564] Providing a rebalanced proposal

[0565] The server sends the retuned proposal to the terminal.

[0566] Input: Reconditioned proposal data returned from the generative AI model.

[0567] Output: JSON formatted data sent to the device.

[0568] Specific operation: The retuned proposal data is sent to the terminal as an HTTP response.

[0569] The terminal displays the optimized suggestions to the user.

[0570] Specific operation: The device parses the received data and displays it to the user in a list format as the final proposal screen.

[0571] This allows users to get the best housing options based on their feelings and preferences in real time.

[0572] (Application example 2)

[0573] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0574] Conventional home purchase and renovation recommendation systems lack personalized recommendations based on the user's emotions and preferences, and lack optimal solutions to increase user satisfaction. Furthermore, the recommendations are static, making it difficult to respond to real-time changes in the user's emotions. A means to resolve these issues and provide more accurate recommendations is needed.

[0575] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0576] In this invention, the server includes: means for collecting information input by a user; means for creating a user profile based on the collected information; means for a generative AI to generate home options using the user profile; means for providing the generated home options to the user; means for allowing the user to visually experience the interior of the home through a virtual tour; means for performing budget management and cost estimation; means for proposing interior designs; emotion recognition means for analyzing the user's emotion data and adjusting the proposal content based on the results; and means including a generative AI model that readjusts the proposal content using the emotion data collected by the emotion recognition means. This enables the provision of personalized proposals that reflect the user's emotions and the adjustment of the proposal content in real time.

[0577] A "user profile" is a collection of data created based on information entered by the user (such as desired area, budget, size of home, etc.).

[0578] A "generative AI model" is an artificial intelligence algorithm that uses a user profile to generate optimal suggestions.

[0579] "Emotion recognition means" is a technology for collecting and analyzing user emotional data and adjusting the content of suggestions based on the results.

[0580] A "virtual tour" is a means of allowing a user to visually experience the interior of a home using virtual reality technology or three-dimensional graphics.

[0581] The "interior design suggestion means" is a system component that provides optimal interior options based on the user's preferences and feelings.

[0582] The "budget management and cost estimation means" is a system component that manages the budget and estimates costs based on information input by the user.

[0583] "Emotion data" refers to data such as a user's facial expressions, voice, and operation patterns, and is data used to analyze the user's emotional state based on this data.

[0584] The "adjusted proposal content" refers to proposed housing and interior options that have been readjusted based on the emotional data analyzed by the emotion recognition means.

[0585] The "collection means" is a means for having the user input desired conditions and information and recording them.

[0586] This invention combines a conventional home purchase and renovation recommendation system with an emotion engine that recognizes user emotions and optimizes recommendations based on those emotions. The system collects and analyzes user input and uses a generative AI model to suggest optimal housing options and interior designs.

[0587] System Configuration

[0588] The system according to the present invention includes the following main components:

[0589] 1. Terminal - Provides an interface for users to input information, review system suggestions, and perform emotion recognition.

[0590] 2. Server - The central system that receives user input, creates a user profile, and uses generative AI models to make suggestions. It also analyzes emotional data using an emotion engine.

[0591] 3. Generative AI Models - Artificial intelligence algorithms that generate optimal home options and interior designs based on user profiles.

[0592] 4. Sentiment Engine - An algorithm that analyzes user sentiment and incorporates that data into suggestions.

[0593] 5. Database - A system for storing user profiles, suggestions, sentiment data, etc.

[0594] Program processing

[0595] The device provides the user with an interface for entering desired area, budget, home size, and other desired conditions. For example, if a user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed," the device collects that information and sends it to the server. The server creates a user profile based on the received information and stores it in a database.

[0596] The server then retrieves the user profile and sends it to the generative AI model, which generates the best housing options based on the user's profile, using prompts like this:

[0597] User Profile:

[0598] Region: Tokyo

[0599] Budget: 80 million yen

[0600] Size of the home: 3LDK

[0601] Other desired conditions:Pets allowed

[0602] Based on this, generate the best housing options that meet the following criteria:

[0603] Trendy Design

[0604] Pet Friendly

[0605] Color coordination suggestions

[0606] The generated options are sent back to the server and sent to the terminal, which displays these suggestions to the user.

[0607] Next, as the user browses the suggested options, the device collects the user's emotional data (facial expressions, voice, operation patterns, etc.). For example, if the user expresses interest in a particular interior design, that emotional data is sent to the server. The server uses an emotion engine to analyze the emotional data and sends data to the generative AI model to readjust the suggestions based on the results.

[0608] The generative AI model generates new proposals and sends the reconfiguration results back to the device via the server, which then displays them to the user, allowing them to receive more personalized home proposals.

[0609] As described above, by using the system of the present invention, users can receive personalized home suggestions tailored to their emotions and efficiently find their ideal home. The hardware used includes smartphones, smart glasses, and head-mounted displays, and the software used includes the Flask framework, OpenCV, and generative AI models (e.g., GPT-4).

[0610] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0611] Step 1:

[0612] The terminal displays an interface for the user to input the desired area, budget, size of the home, and other desired conditions.

[0613] (Input) The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0614] (Data processing / calculation) The terminal collects the input information as data.

[0615] (Output) Data that sends collected information to the server.

[0616] Step 2:

[0617] The server creates a user profile based on the received user input information.

[0618] (Input) User input information sent from the terminal.

[0619] The (data processing / calculation) server analyzes the information and stores the user profile in a database.

[0620] (Output) The saved user profile.

[0621] Step 3:

[0622] The server retrieves the user profile and sends it to the generative AI model.

[0623] (Input) User profile stored in the database.

[0624] (Data processing / calculation) Generate prompt sentences based on the user profile in the generative AI model.

[0625] (Output) Prompt to the generative AI model:

[0626] User Profile:

[0627] Region: Tokyo

[0628] Budget: 80 million yen

[0629] Size of the home: 3LDK

[0630] Other desired conditions:Pets allowed

[0631] Based on this, generate the best housing options that meet the following criteria:

[0632] Trendy Design

[0633] Pet Friendly

[0634] Color coordination suggestions

[0635] Step 4:

[0636] A generative AI model generates the best housing options based on the prompt received.

[0637] (Input) The prompt sent by the server.

[0638] (Data processing / calculation) Generative AI model generates options based on user profile.

[0639] (Output) The generated housing options.

[0640] Step 5:

[0641] The server transmits the generated housing options to the terminal.

[0642] (Input) Housing options returned by the generative AI model.

[0643] (Data processing / calculation) The server converts the generated options into JSON format.

[0644] (Output) Option data in JSON format.

[0645] Step 6:

[0646] The terminal displays suggested housing options to the user.

[0647] (Input) Option data sent by the server in JSON format.

[0648] (Data processing / calculation) The terminal analyzes the data and displays it in a visual interface.

[0649] (Output) The housing options displayed to the user.

[0650] Step 7:

[0651] The terminal collects emotion data of the user.

[0652] (Input) Facial expressions, voice, operation patterns, etc. when the user browses the suggested options.

[0653] (Data processing / calculation) The terminal collects emotional data through sensors and cameras.

[0654] (Output) Collected emotion data.

[0655] Step 8:

[0656] The server analyzes the emotion data using an emotion engine.

[0657] (Input) Emotion data sent from the device.

[0658] (Data processing / calculation) The server starts the emotion engine and analyzes the emotion data.

[0659] (Output) Analysis result data.

[0660] Step 9:

[0661] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[0662] (Input) Parsed emotion data.

[0663] (Data processing / calculation) Generate prompt sentences for readjustment to the generated AI model.

[0664] (Output) Reprompt sentence to the generative AI model.

[0665] Step 10:

[0666] A generative AI model generates retuned recommendations.

[0667] (Input) The reprompt sent by the server.

[0668] (Data processing / calculation) The generative AI model takes emotion data into account to generate new suggestions.

[0669] (Output) Retuned proposed options.

[0670] Step 11:

[0671] The server sends the retuned proposal to the terminal.

[0672] (Input) The suggested retuning options returned by the generative AI model.

[0673] (Data processing / calculation) The server converts the proposed options into JSON format.

[0674] (Output) Recalibration options data in JSON format.

[0675] Step 12:

[0676] The terminal displays the retuned proposal to the user.

[0677] (Input) Recalibration options data sent by the server in JSON format.

[0678] (Data processing / calculation) The terminal analyzes the data and displays it in a visual interface.

[0679] (Output) The rebalanced housing options displayed to the user.

[0680] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0681] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0682] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0683] [Second embodiment]

[0684] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0685] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0686] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0687] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0688] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0689] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0690] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0691] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0692] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0693] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0694] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0695] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0696] The present invention provides a system that uses generative AI to propose optimal housing options to users considering purchasing or renovating a home. This system collects information entered by the user, creates a user profile based on that information, and the generative AI proposes optimal housing options, and also provides functions such as virtual tours, budget management, cost estimates, and interior design suggestions.

[0697] System Configuration

[0698] The system according to the present invention includes the following main components:

[0699] 1. Terminal - Provides an interface where users can enter information and review suggestions from the system.

[0700] 2. Server - The central system that receives user input, creates a user profile, and executes generative AI-driven suggestions.

[0701] 3. Generative AI model - an algorithm that generates the best housing options based on a user profile.

[0702] 4. Database - Stores user profiles, proposals, virtual tour data, cost estimate data, etc.

[0703] Program processing explanation

[0704] 1. Create a user profile

[0705] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0706] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0707] The terminal transmits the input information to the server.

[0708] The server creates a user profile based on the received information and stores it in a database.

[0709] 2. Generative AI suggestions

[0710] The server retrieves the user profile and performs analysis.

[0711] The server makes a request to the generative AI model to generate housing options that match the user's requirements.

[0712] The generative AI model generates multiple proposed properties and renovation plans that match the conditions.

[0713] The generative AI model sends the generated results back to the server.

[0714] The server sends the proposed options to the terminal.

[0715] The terminal displays proposed homes and renovation plans to the user in list form.

[0716] 3. Virtual Tour Feature

[0717] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0718] The device requests data for the virtual tour from the server.

[0719] The server provides virtual tour data (3D models and VR content).

[0720] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[0721] The user operates the terminal interface to virtually tour the interior of the property.

[0722] 4. Budget management and cost estimation features

[0723] The user selects the budget management tab and enters detailed information about the renovation.

[0724] The terminal transmits the user's input data to the server.

[0725] The server uses the received data to generate a comprehensive cost estimate.

[0726] The server transmits the cost estimate results to the terminal.

[0727] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[0728] 5. Interior design suggestion function

[0729] The user selects the interior design suggestions tab and enters their preferred style and color.

[0730] The terminal transmits the user's input data to the server.

[0731] The server analyzes the data and asks the generative AI model to propose interior designs.

[0732] A generative AI model generates interior design proposals.

[0733] The generative AI model sends the generated suggestions back to the server.

[0734] The server sends the interior design proposal to the terminal.

[0735] The device displays interior design suggestions to the user, providing a concrete image.

[0736] Specific examples

[0737] When a user is considering buying a home, the following sequence of events occurs:

[0738] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[0739] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0740] 3. The device sends the information to the server and a user profile is created.

[0741] 4. The server generates the optimal property based on the generative AI model.

[0742] 5. The proposed properties are displayed to the user, who can select the property they are interested in and enjoy a virtual tour.

[0743] 6. In addition, you can use the budget management function to check renovation cost estimates and receive interior design suggestions to make your ideal home a reality.

[0744] In this way, by using the system of the present invention, users can efficiently find the home they desire and smoothly make the decision that accompanies it.

[0745] The processing flow will be explained below.

[0746] Step 1:

[0747] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0748] Step 2:

[0749] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0750] Step 3:

[0751] The terminal converts the input information into JSON format and sends it to the server.

[0752] Step 4:

[0753] The server analyzes the received information and creates a user profile.

[0754] Step 5:

[0755] The server stores the user profile in a database.

[0756] Step 6:

[0757] The server retrieves the user profile and sends it to the generative AI model.

[0758] Step 7:

[0759] A generative AI model generates the best housing options based on the user's preferences and budget.

[0760] Step 8:

[0761] The generative AI model sends the generated options back to the server.

[0762] Step 9:

[0763] The server converts the proposed options into JSON format and sends it to the device.

[0764] Step 10:

[0765] The terminal displays proposed homes and renovation plans to the user in list form.

[0766] Step 11:

[0767] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0768] Step 12:

[0769] The terminal requests the virtual tour data from the server.

[0770] Step 13:

[0771] The server provides virtual tour data (3D models and VR content).

[0772] Step 14:

[0773] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[0774] Step 15:

[0775] The user operates the terminal interface to virtually tour the interior of the property.

[0776] Step 16:

[0777] The user selects the budget management tab and enters detailed information about the renovation.

[0778] Step 17:

[0779] The terminal converts the user's input data into JSON format and sends it to the server.

[0780] Step 18:

[0781] The server analyzes the received data and generates a comprehensive cost estimate.

[0782] Step 19:

[0783] The server transmits the cost estimate results to the terminal.

[0784] Step 20:

[0785] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[0786] Step 21:

[0787] The user selects the interior design suggestions tab and enters their preferred style and color.

[0788] Step 22:

[0789] The terminal converts the user's input data into JSON format and sends it to the server.

[0790] Step 23:

[0791] The server analyzes the data and asks the generative AI model to propose interior designs.

[0792] Step 24:

[0793] A generative AI model generates interior design suggestions such as color schemes, furniture placement, and lighting designs.

[0794] Step 25:

[0795] The generative AI model sends the generated suggestions back to the server.

[0796] Step 26:

[0797] The server converts the interior design proposal into JSON format and sends it to the device.

[0798] Step 27:

[0799] The device displays interior design suggestions to the user, providing a concrete image.

[0800] Example 1

[0801] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0802] Traditionally, when considering purchasing or renovating a home, users have to research a lot of information, which requires a lot of effort. It can be difficult to find the best home option, and users are required to manage their budget and propose interior design themselves. This slows down users' decision-making process and complicates the process of finding their ideal home. Therefore, there is a need for a system that allows users to efficiently find their ideal home.

[0803] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0804] In this invention, the server includes a means for collecting information entered by the user, a means for creating a user profile based on the collected information, and a means for the generation AI to generate housing options using the user profile, thereby enabling suggestions to help the user efficiently find their ideal home.

[0805] The server also includes means for providing the generated home options to the user, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, means for proposing interior designs, and means for receiving the proposals and displaying them to the user in a visually easy-to-understand list format, thereby enabling the user to compare and consider multiple home options and receive budget management and interior design proposals while virtually touring the interiors, thereby enabling smooth decision-making.

[0806] Furthermore, the server includes means for creating prompts for the generative AI based on a user profile, means for receiving and analyzing the output of the generative AI model, and means for downloading virtual tour data to the terminal and displaying a VR environment and three-dimensional graphics, thereby enabling the user to receive more specific and personalized home suggestions and providing a seamlessly integrated user experience throughout the entire process.

[0807] "Means for collecting information entered by the user" refers to the function of providing an interface for the user to enter their desired area, budget, size of the home, and other desired conditions, and securely transmitting that information to the server.

[0808] "Means for creating a user profile based on collected information" refers to the function of analyzing the information entered by the user and generating a digital profile that systematically summarizes the user's wishes and requirements.

[0809] "Means by which the generative AI generates housing options using a user profile" refers to the process by which the generative AI model generates optimal housing options based on a user profile.

[0810] "Means for providing users with generated housing options" refers to the function of providing an interface for presenting users with multiple housing options generated by the generative AI.

[0811] "Means for visually experiencing the interior of a home through a virtual tour" refers to a feature that uses virtual reality technology or three-dimensional graphics to allow a user to virtually tour the interior of a proposed home.

[0812] "Means for budget management and cost estimation" refers to a function that provides estimates for renovation and purchase costs based on the budget set by the user and helps the user execute the plan within the budget.

[0813] "Means for suggesting interior design" refers to a function that uses generative AI to suggest optimal interior design ideas based on the user's preferences and style.

[0814] "Means for receiving the proposals and displaying them to the user in a visually easy-to-understand list format" refers to the function of receiving the output from the generative AI and displaying it in a visual list format that is easy for the user to understand.

[0815] "Means for creating prompts for the generative AI based on a user profile" refers to the process of generating input sentences based on information in the user profile that enable the generative AI to make accurate suggestions.

[0816] "Means for receiving and analyzing the output of the generative AI model" refers to the function of receiving the proposed results from the generative AI, analyzing them, and converting them into a format that is useful to the user.

[0817] "Means for downloading virtual tour data to a terminal and displaying a VR environment or three-dimensional graphics" refers to the function of downloading virtual tour data from a server and displaying it as a VR environment or three-dimensional graphics on a terminal.

[0818] The present invention provides a system that uses generative AI to propose optimal housing options to users who are considering purchasing or renovating a home. The main components of this system include a terminal, a server, a generative AI model, and a database. The role of each component and the specific processing are explained below.

[0819] Hardware and software used

[0820] Terminal: A device that provides an interface for users to enter information and view system suggestions, such as a PC, smartphone, or tablet.

[0821] Server: A central computer system that receives user input, creates a user profile, and executes suggestions using generative AI models. This is often a cloud service or dedicated server equipment.

[0822] Generative AI model: An algorithm that generates optimal housing options based on a user profile. For example, generative AI technologies such as OpenAI's GPT-4 are used.

[0823] Database: Stores user profiles, proposals, virtual tour data, cost estimate data, etc. Generally, a relational database such as MySQL or PostgreSQL is used.

[0824] Specific implementation methods of the system

[0825] 1. Enter your user information:

[0826] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0827] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed" into a form.

[0828] The device sends the entered information to the server. For security reasons, the data is sent using a protocol such as HTTPS.

[0829] 2. Create a user profile:

[0830] The server analyzes the user information received from the terminal and creates a user profile.

[0831] The server stores the created user profile in a database, typically in JSON format.

[0832] 3. Generative AI suggestions:

[0833] The server retrieves the user profile from the database and generates appropriate prompts for the generative AI model, such as "Based on the user profile, please suggest a 3LDK property in Tokyo for up to 80 million yen. Please also include the condition that pets are allowed."

[0834] The generative AI model generates suggestions based on the input prompts and sends them back to the server.

[0835] 4. View Proposals:

[0836] The server sends the suggestions from the generating AI to the terminal.

[0837] The device receives the suggestions and displays them to the user in a visually easy-to-understand format, such as a list containing thumbnail images of properties and links to more detailed information.

[0838] 5. Virtual Tour Feature:

[0839] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0840] The device requests virtual tour data from the server, receives the data, and displays the VR environment and 3D graphics. For example, this can be achieved using Unity or Unreal Engine.

[0841] 6. Budget management and cost estimation features:

[0842] The user selects the budget management tab and enters detailed information about the renovation.

[0843] The terminal sends the input data to the server, which generates a cost estimate.

[0844] The terminal displays the estimate results to the user, allowing them to confirm whether they fit within their budget.

[0845] 7. Interior design proposal function:

[0846] The user selects the interior design suggestions tab and enters their preferred style and color.

[0847] The device sends the input data to the server, which then requests a generative AI model to generate interior design proposals.

[0848] The terminal receives the proposed results and provides a concrete image to the user.

[0849] Specific examples

[0850] For example, if a user is considering buying a home, they might input the following prompts into a generative AI model:

[0851] "Based on my user profile, please suggest 3 bedroom, 3 bedroom, 3 kitchen, and 3 bedroom apartments in Tokyo priced at under ¥80 million. Please also include the requirement that pets are allowed."

[0852] "Please suggest a renovation plan. My budget is within 10 million yen, and I'd particularly like to renovate the kitchen and bathroom."

[0853] "Please provide an interior design proposal based on the user's preferences. It should be modern in style, with white and blue as the main colors."

[0854] As described above, the system of the present invention is a system that allows users to efficiently find the home they desire and provides a series of support to help them realize their ideal home.

[0855] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0856] Step 1: Enter and submit user information

[0857] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0858] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed" into the form. This is the user's specific desired conditions and is important data that will be used in subsequent processing by the system.

[0859] The device verifies that the information is in the correct format and sends it to the server using a secure protocol (e.g., HTTPS).

[0860] Input: Information entered by the user (area, budget, size, conditions)

[0861] Output: User information sent to the server

[0862] Step 2: Create a user profile

[0863] The server analyzes the user information received from the terminal and checks whether the format is correct.

[0864] Based on the information received by the server, a user profile is created, which systematically summarizes the user's preferences and is stored in a database in JSON format or similar.

[0865] Input: User information sent from the device

[0866] Output: User profile stored in the database

[0867] Step 3: Generative AI suggestions

[0868] The server retrieves the user profile from the database and performs analysis.

[0869] The server creates a prompt for the generative AI model based on the user profile. For example, it generates a prompt such as, "Based on the user profile, please suggest a 3LDK property in Tokyo for up to 80 million yen. Please also include the condition that pets are allowed."

[0870] The server sends a prompt to the generative AI model, requesting it to generate multiple proposed properties and renovation plans.

[0871] The generative AI model generates suggestions that match the conditions and returns the results to the server.

[0872] Input: User profile retrieved from database

[0873] Output: Home recommendations returned by the generative AI model

[0874] Step 4: View the proposal

[0875] The server analyzes the proposals received from the generation AI and converts them into the required format, such as compiling information such as property name, price, location, and size in JSON format.

[0876] The server sends the proposal to the device.

[0877] The device receives the suggestions and displays them to the user in a visually appealing list format, including thumbnail images of the properties and links to more detailed information.

[0878] Input: Suggestions sent by the generative AI model

[0879] Output: Suggestions presented to the user in a visually friendly format

[0880] Step 5: Virtual Tour Feature

[0881] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0882] The device sends a request to the server containing the ID of the selected property.

[0883] The server retrieves the virtual tour data from the database and sends it to the device. The virtual tour data is stored as a 3D model or VR content.

[0884] The device receives the data and displays it using a VR-capable application or 3D rendering engine (such as Unity or Unreal Engine).

[0885] Users can operate the device to virtually tour the interior of a property, for example by using the arrow keys on the screen to move between rooms.

[0886] Input: Property ID selected by user

[0887] Output: Virtual tours displayed in VR environments and 3D graphics

[0888] Step 6: Budget management and cost estimation features

[0889] The user selects the budget management tab and enters detailed information about the renovation (for example, kitchen renovation, bathroom renovation requests, etc.).

[0890] The terminal sends the input data to the server.

[0891] The server generates a cost estimate for the renovation based on the data received, using internal algorithms and external APIs to provide an accurate cost estimate.

[0892] The server compiles the estimate results and sends them to the terminal.

[0893] The terminal visually displays the estimate results, allowing the user to check whether they fit within their budget.

[0894] Input: Renovation details entered by the user

[0895] Output: Generated cost estimate results

[0896] Step 7: Interior design suggestion function

[0897] The user selects the interior design suggestion tab and inputs the preferred style and color (e.g., modern style, white and blue).

[0898] The terminal sends the input data to the server.

[0899] The server analyzes the data and asks the generative AI model to propose an interior design, specifically generating a prompt such as, "Please propose a modern interior design with white and blue as the main colors."

[0900] The generative AI model generates interior design proposals and sends them back to the server.

[0901] The server parses the proposal and sends it to the device.

[0902] The device visually displays specific interior design suggestions to the user, such as furniture placement, wall colors, and decoration ideas, using images and text.

[0903] Input: Style and color information entered by the user

[0904] Output: Interior design proposals generated by the generative AI model

[0905] (Application example 1)

[0906] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0907] In modern society, when users purchase or renovate a home, it takes a lot of time and effort to gather a lot of information and find the best option. This makes it difficult for users to efficiently find a home that meets their desired criteria. Users also need the convenience of being able to see the interior of a property without visiting the site. Furthermore, proper budget management, cost estimation, and receiving interior design proposals are also important challenges.

[0908] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0909] In this invention, the server includes means for collecting information input by a user, means for creating a user profile based on the collected information, means for a generation AI to generate home options using the user profile, means for providing the generated home options to the user, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, means for proposing interior designs, and means for presenting multiple options by switching between properties using virtual reality technology. This allows users to efficiently find their desired home, and enables them to use a virtual environment to check the interior of the property and receive budget management and interior design suggestions.

[0910] The "means for collecting information entered by the user" is a function that provides an interface for the user to input desired conditions and requests and transmits them to the server.

[0911] The "means for creating a user profile based on collected information" refers to a function that analyzes collected user information and organizes and stores user attributes in a database based on individual characteristics and requests.

[0912] "Means for the generative AI to generate housing options using user profiles" refers to a function that allows the generative AI to execute an algorithm to propose optimal housing and renovation plans based on user profile data.

[0913] "Means for providing users with generated housing options" means a function that provides users with information about the housing suggested by the generating AI in visual or text format.

[0914] "Means for visually experiencing the interior of a home through a virtual tour" refers to a function that allows a user to virtually tour the interior of a property using virtual reality technology and three-dimensional graphics.

[0915] The "means for budget management and cost estimation" is a function that calculates the costs of renovations and purchases based on the budget information entered by the user and checks whether they are within the budget.

[0916] The "means for proposing interior designs" is a function that uses AI to propose optimal interior designs based on the user's preferences and budget.

[0917] "Means for presenting multiple options by switching between properties using virtual reality technology" refers to a function that allows a user to view different properties while switching between them in a virtual reality environment and compare multiple options.

[0918] MODE FOR CARRYING OUT THE INVENTION

[0919] The present invention relates to a system for streamlining the process of users considering purchasing or renovating a home. This system includes a terminal for users to input information, a server that processes the information and generates proposals, and a database that stores this data. The specific system configuration and processing are described below.

[0920] System Configuration

[0921] 1. Terminal

[0922] This device provides an interface for users to input information such as the desired area, budget, size of the home, etc. The device can be a smartphone or a head-mounted display (HMD).

[0923] 2. Server

[0924] The server receives the information sent by the terminal and creates a user profile, in particular by analyzing the data based on the user's preferences and needs.

[0925] A generative AI model runs on the server and generates optimal housing options based on the user's profile.

[0926] The server transmits the virtual tour data and cost estimate data to the terminal and provides them to the user.

[0927] 3. Database

[0928] The database stores user profiles, generated home options, virtual tour data, cost estimate data, interior design suggestions, and more.

[0929] Program processing explanation

[0930] 1. Create a user profile

[0931] The terminal displays an input form to the user that asks, "Please enter your desired area, budget, size of home, and other desired conditions."

[0932] For example, the user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0933] The device sends the entered information to the server, which creates a user profile based on the received information and stores it in a database.

[0934] 2. Generative AI suggestions

[0935] The server retrieves the user profile and uses a generative AI model to generate housing options that match the user's preferences.

[0936] The generative AI model generates multiple proposed properties and renovation plans that match the user's criteria and returns the results to the server, which then sends the proposals to the device and provides them to the user.

[0937] 3. Virtual Tour Feature

[0938] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[0939] The terminal requests data for the virtual tour from the server, and the server provides the virtual tour data (3D models and VR content).

[0940] The device downloads the virtual tour data and displays the VR environment and 3D graphics, allowing users to virtually tour the interior of the property by operating the device's interface.

[0941] 4. Budget management and cost estimation features

[0942] The user selects the budget management tab and enters detailed information about the renovation.

[0943] The terminal transmits the user's input data to the server, which uses the received data to generate a comprehensive cost estimate and transmits the result to the terminal.

[0944] The terminal displays the cost estimate results to the user, allowing them to confirm whether the cost is within their budget.

[0945] 5. Interior design suggestion function

[0946] Users select the interior design suggestions tab and enter their preferred style and color.

[0947] The device sends the user's input data to the server, which analyzes the data and requests the generative AI model to propose interior design ideas.

[0948] The generative AI model generates interior design proposals and sends them back to the server, which then sends them to the device to provide the user with a concrete image.

[0949] Specific examples

[0950] If a user is considering buying a home:

[0951] 1. The device will display "Please enter your desired area, budget, home size, and other desired conditions."

[0952] 2. The user enters "Tokyo, 80 million yen, 3LDK, pets allowed."

[0953] 3. The device sends the information to the server, which creates a user profile and stores it in a database.

[0954] 4. The server generates optimal property options based on the generative AI model. The suggested properties are displayed to the user, who selects the property that interests them.

[0955] 5. Users can use the virtual tour feature to visually inspect the property, as well as manage their budget and see cost estimates.

[0956] 6. Finally, you will receive interior design suggestions to help you realize your dream home.

[0957] Example prompt sentence:

[0958] Enter the housing requirements you are looking for.

[0959] Region: Tokyo

[0960] Budget: 80 million yen

[0961] Size of the home: 3LDK

[0962] Other desired conditions:Pets allowed

[0963] In this way, by using the system of the present invention, users can efficiently find the home they desire, and can also use the virtual environment to view the interior of the property and receive budget management and interior design suggestions.

[0964] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0965] Step 1:

[0966] The user inputs their desired conditions. Specifically, the device displays an input form that asks, "Please enter your desired area, budget, home size, and other desired conditions." The user inputs the conditions, and the device sends the information to the server. Based on the input, data on the area, budget, home size, and other desired conditions is collected.

[0967] Step 2:

[0968] The server analyzes the received user information and creates a user profile. The server saves the user profile in a database based on the collected information. The server processes the data to generate the user profile using the entered data such as area, budget, size of the home, and other desired conditions.

[0969] Step 3:

[0970] The server generates housing options using a generative AI model based on the user profile. Specifically, the server inputs the user profile data into the generative AI model and receives a list of optimal housing options as output. This list includes properties and renovation plans that meet the user's criteria.

[0971] Step 4:

[0972] The server sends the generated housing options to the terminal, which displays the proposed housing options in a list format to the user. The output includes information about the proposed home and renovation plan.

[0973] Step 5:

[0974] The user selects a property they are interested in and clicks the virtual tour button. The device requests virtual tour data from the server, and the server sends the virtual tour data (3D models and VR content) to the device. The ID of the property selected by the user is used as input, and the virtual tour data is provided as output.

[0975] Step 6:

[0976] The device receives the virtual tour data and displays it to the user as a VR environment or 3D graphics. Through the device interface, the user can virtually tour the interior of the property, allowing the user to see the interior without actually visiting the property.

[0977] Step 7:

[0978] The user selects the budget management tab and enters detailed information about the renovation. The device sends that information to the server, which generates a cost estimate based on the received data. The detailed information about the renovation is used as input, and a comprehensive cost estimate is generated as output.

[0979] Step 8:

[0980] The server sends the cost estimate results to the terminal, which then displays them to the user, who can check whether they fit within their budget. The cost estimate results show the total cost of the renovation.

[0981] Step 9:

[0982] The user selects the interior design suggestions tab and enters their preferred style and color. The device sends that information to the server, which then inputs the data into a generative AI model to generate interior design suggestions. The user's preferred style and color are used as input, and the interior design suggestions are generated as output.

[0983] Step 10:

[0984] The server sends the generated interior design proposal to the terminal, which then displays the proposal to the user. The user can check the proposed interior design and get a concrete image of it. Detailed information about the interior design proposal is provided as an output.

[0985] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0986] This invention provides a system that combines a conventional home purchase and renovation suggestion system with an emotion engine that recognizes the user's emotions and optimizes the proposal content based on those emotions. This system has the function of analyzing the user's emotions and proposing optimal housing options and interior designs based on those emotions.

[0987] System Configuration

[0988] The system according to the present invention includes the following main components:

[0989] 1. Terminal - Provides an interface where users can input information, review system suggestions, and perform emotion recognition.

[0990] 2. Server - The central system that receives user input, creates a user profile, and executes generative AI-driven suggestions. It also analyzes emotional data using the emotion engine.

[0991] 3. Generative AI model - an algorithm that generates the best housing options based on a user profile.

[0992] 4. Sentiment Engine - An algorithm that analyzes user sentiment and incorporates that data into suggestions.

[0993] 5. Database - Stores user profiles, proposals, virtual tour data, cost estimate data, sentiment data, etc.

[0994] Program processing explanation

[0995] 1. Create a user profile

[0996] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[0997] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[0998] The terminal transmits the input information to the server.

[0999] The server creates a user profile based on the received information and stores it in a database.

[1000] 2. Generative AI suggestions

[1001] The server retrieves the user profile and sends it to the generative AI model.

[1002] A generative AI model generates the best housing options based on the user's profile.

[1003] The generative AI model sends the generated options back to the server.

[1004] The server converts the proposed options into JSON format and sends it to the device.

[1005] The terminal displays proposed homes and renovation plans to the user in list form.

[1006] 3. Emotion Recognition by Emotion Engine

[1007] It provides an interface for devices to recognize user emotions, for example by monitoring the user's facial expressions, voice, and operation patterns.

[1008] Emotional data is collected as users browse suggested options.

[1009] The device transmits the emotion data to the server.

[1010] The server analyzes the emotion data using an emotion engine.

[1011] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[1012] 4. Recalibrate your emotional recommendations

[1013] A generative AI model receives data from the emotion engine and adjusts its suggestions.

[1014] A generative AI model generates reconditioned housing options.

[1015] The generative AI model sends the refinement results back to the server.

[1016] The server sends the retuned proposal to the device.

[1017] The device displays optimized suggestions to the user.

[1018] Specific examples

[1019] When a user is considering buying a home, the following sequence of events occurs:

[1020] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[1021] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1022] 3. The device sends the information to the server and a user profile is created.

[1023] 4. The server uses the generative AI model to generate the optimal property and displays the proposal to the user.

[1024] 5. The device monitors the user's emotions and collects emotional data.

[1025] 6. The emotion engine analyzes the emotion data and provides data for recalibration to the generative AI model.

[1026] 7. The generative AI model generates new suggestions and displays them back to the user via the server.

[1027] 8. Additionally, users can find their ideal home using virtual tours, budget management, and interior design suggestions.

[1028] In this way, by using the system of the present invention, users can receive more personalized home suggestions that match their emotions and efficiently find their ideal home.

[1029] The processing flow will be explained below.

[1030] Step 1:

[1031] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[1032] Step 2:

[1033] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1034] Step 3:

[1035] The terminal converts the input information into JSON format and sends it to the server.

[1036] Step 4:

[1037] The server analyzes the received information and creates a user profile.

[1038] Step 5:

[1039] The server stores the user profile in a database.

[1040] Step 6:

[1041] The server retrieves the user profile and sends it to the generative AI model.

[1042] Step 7:

[1043] A generative AI model generates the best housing options based on the user's profile.

[1044] Step 8:

[1045] The generative AI model sends the generated options back to the server.

[1046] Step 9:

[1047] The server converts the proposed options into JSON format and sends it to the device.

[1048] Step 10:

[1049] The terminal displays proposed homes and renovation plans to the user in list form.

[1050] Step 11:

[1051] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[1052] Step 12:

[1053] The terminal requests the virtual tour data from the server.

[1054] Step 13:

[1055] The server provides virtual tour data (3D models and VR content).

[1056] Step 14:

[1057] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[1058] Step 15:

[1059] The user operates the terminal interface to virtually tour the interior of the property.

[1060] Step 16:

[1061] The device monitors the user's facial expressions, voice, and operation patterns to collect emotional data.

[1062] Step 17:

[1063] The device converts the collected emotion data into JSON format and sends it to the server.

[1064] Step 18:

[1065] The server analyzes the emotion data using an emotion engine.

[1066] Step 19:

[1067] Based on the analysis results, the server sends data to the generative AI model to readjust the suggestions.

[1068] Step 20:

[1069] A generative AI model takes emotional data into account and recreates optimized housing options.

[1070] Step 21:

[1071] The generative AI model sends the regenerated options back to the server.

[1072] Step 22:

[1073] The server converts the regenerated proposal into JSON format and sends it to the device.

[1074] Step 23:

[1075] The device redisplays the optimized suggestions to the user.

[1076] Step 24:

[1077] The user checks the re-proposed property and renovation plan.

[1078] Step 25:

[1079] The user selects the budget management tab and enters detailed information about the renovation.

[1080] Step 26:

[1081] The terminal converts the user's input data into JSON format and sends it to the server.

[1082] Step 27:

[1083] The server analyzes the received data and generates a comprehensive cost estimate.

[1084] Step 28:

[1085] The server transmits the cost estimate results to the terminal.

[1086] Step 29:

[1087] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[1088] Step 30:

[1089] The user selects the interior design suggestions tab and enters their preferred style and color.

[1090] Step 31:

[1091] The terminal converts the user's input data into JSON format and sends it to the server.

[1092] Step 32:

[1093] The server analyzes the data and asks the generative AI model to propose interior designs.

[1094] Step 33:

[1095] A generative AI model generates interior design suggestions such as color schemes, furniture placement, and lighting designs.

[1096] Step 34:

[1097] The generative AI model sends the generated suggestions back to the server.

[1098] Step 35:

[1099] The server converts the interior design proposal into JSON format and sends it to the device.

[1100] Step 36:

[1101] The device displays interior design suggestions to the user, providing a concrete image.

[1102] Through this series of steps, users can receive more personalized home suggestions based on their emotions and input information.

[1103] Example 2

[1104] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1105] Conventional home purchasing and renovation suggestion systems are unable to adequately respond to individual users' emotions and preferences, resulting in the significant time and effort required for users to find their ideal home. In particular, there was a lack of technology that could recognize users' emotions in real time and make suggestions accordingly. This made it difficult for users to quickly find the home that best suits them.

[1106] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1107] In this invention, the server includes means for collecting information input by a user, means for creating a user profile based on the collected information, means for a generation AI to generate home options using the user profile, means for providing the generated home options to the user, means for recognizing and collecting user emotions, means for analyzing the collected emotion data and providing the generation AI with data for readjusting the proposal, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, and means for suggesting interior designs. This enables personalized proposals based on the user's emotions and preferences, allowing the user to quickly find their ideal home.

[1108] The "means for collecting information entered by the user" is a means that has the function of collecting information such as desired conditions and budget entered by the user through the terminal as data.

[1109] The "means for creating a user profile based on collected information" is a function that generates a profile corresponding to each individual user based on collected information such as the user's desired conditions and budget.

[1110] "Means for generative AI to generate housing options using user profiles" refers to a function in which a generative AI model uses data from user profiles to algorithmically generate appropriate housing and renovation options.

[1111] "Means for providing users with generated housing options" means a function that presents users with housing and renovation options created by a generative AI model.

[1112] "Means for recognizing and collecting user emotions" refers to a function that analyzes the user's facial expressions, voice, operation patterns, etc., and recognizes and collects emotions in real time.

[1113] "Means for analyzing collected emotional data and providing data to the generative AI for readjusting suggestions" refers to a function that analyzes collected emotional data and provides feedback to the generative AI model based on the results to readjust the content of suggestions.

[1114] "Means for visually experiencing the interior of a home through a virtual tour" refers to a function that allows a user to visually experience the interior of a home using virtual reality technology or three-dimensional graphics.

[1115] The "means for budget management and cost estimation" is a function that calculates and manages the total cost of a home or renovation based on the user's budget information.

[1116] The "means for proposing interior designs" has the function of proposing the most suitable interior design based on the user's desired conditions and feelings.

[1117] This invention relates to a system that recognizes a user's emotions and proposes optimal housing options based on those emotions. The system aims to increase user satisfaction by collecting and analyzing the user's emotional data in real time and readjusting the proposals based on the results.

[1118] System Configuration

[1119] The system according to the present invention includes the following main components:

[1120] 1. Device - Provides the interface where users input information, confirm system suggestions, and perform emotion recognition. Specific examples include personal computers, smartphones, and tablets. The device has a web browser or a dedicated application installed.

[1121] 2. Server - This is the central system that receives user input, creates a user profile, and executes generative AI-based suggestions. It also analyzes emotional data using an emotion engine. Specifically, it includes a web server, database server, and AI server.

[1122] 3. Generative AI model - An algorithm that generates optimal housing options based on a user profile. It uses machine learning algorithms to generate multiple housing options.

[1123] 4. Emotion Engine - An algorithm that analyzes user emotions and incorporates that data into suggestions. It analyzes user emotions in real time through facial expression recognition and voice analysis.

[1124] 5. Database - A system for storing user profiles, proposals, virtual tour data, cost estimate data, emotion data, etc. Specifically, a database management system such as MySQL or MongoDB is used.

[1125] Program processing

[1126] Creating a User Profile

[1127] The terminal displays to the user, "Please enter your desired area, budget, size of home, and other desired conditions."

[1128] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1129] The terminal transmits the input information to the server.

[1130] The server creates a user profile based on the received information and stores it in a database.

[1131] Generative AI suggestions

[1132] The server retrieves the user profile and sends it to the generative AI model.

[1133] A generative AI model generates optimal housing options based on a user's profile.

[1134] The generative AI model sends the generated options back to the server.

[1135] The server converts the proposed options into JSON format and sends it to the device.

[1136] The terminal displays proposed homes and renovation plans to the user in list form.

[1137] Emotion recognition by emotion engine

[1138] The device provides an interface for recognizing the user's emotions, including software for facial expression recognition using a camera and microphone, and voice analysis.

[1139] Emotional data is collected as users browse suggested options.

[1140] The terminal transmits the emotion data to the server.

[1141] The server analyzes the emotion data using an emotion engine.

[1142] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[1143] Recalibrating sentiment-based suggestions

[1144] The generative AI model receives data from the emotion engine and adjusts its suggestions.

[1145] A generative AI model generates reconditioned housing options.

[1146] The generative AI model sends the refinement results back to the server.

[1147] The server sends the retuned proposal to the terminal.

[1148] The terminal displays the optimized suggestions to the user.

[1149] Specific examples

[1150] If a user is considering buying a home, the process goes like this:

[1151] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[1152] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1153] 3. The device sends the information to the server and a user profile is created.

[1154] 4. The server uses the generative AI model to generate the optimal property and displays the proposal to the user.

[1155] 5. The device monitors the user's emotions and collects emotional data.

[1156] 6. The emotion engine analyzes the emotion data and provides data for recalibration to the generative AI model.

[1157] 7. The generative AI model generates new suggestions and displays them back to the user via the server.

[1158] Example prompt sentence:

[1159] Please enter your desired area, budget, size of home, and other desired conditions.

[1160] In this way, by using the system of the present invention, users can receive more personalized home suggestions that match their emotions and efficiently find their ideal home.

[1161] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1162] Step 1:

[1163] Entering user information

[1164] The terminal displays a form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[1165] Input: Prompt: "Please enter your desired area, budget, home size, and other desired conditions."

[1166] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1167] Specific actions: The user enters information using the keyboard and clicks the "Submit" button.

[1168] Step 2:

[1169] Submitting information and creating profiles

[1170] The terminal transmits the input user information to the server.

[1171] Input: Information entered by the user (Tokyo, 80 million yen, 3LDK, pets allowed).

[1172] Output: JSON formatted data.

[1173] Specific operation: The device converts the information into JSON format and sends it to the server as an HTTP POST request.

[1174] The server creates a user profile based on the received information and stores it in a database.

[1175] Specific operation: The server parses the received JSON data, generates a user profile, and saves it as a new entry in a database (e.g., MySQL).

[1176] Step 3:

[1177] Invoking a generative AI model

[1178] The server retrieves the user profile and sends it to the generative AI model.

[1179] Input: User profile stored in the database.

[1180] Output: The generated housing options.

[1181] What it does: The server queries the user profile from the database and sends the data in JSON format to the API of the generative AI model.

[1182] A generative AI model generates optimal housing options based on the user profile and sends them back to the server.

[1183] How it works: The generative AI model uses machine learning algorithms to generate housing options and returns the results to the server as a response.

[1184] Step 4:

[1185] Proposal content provided

[1186] The server converts the generated housing options into JSON format and sends it to the device.

[1187] Input: Home options returned from a generative AI model.

[1188] Output: JSON formatted data sent to the device.

[1189] Specific operation: The server formats the generated options into JSON and sends it to the terminal as an HTTP response.

[1190] The terminal displays proposed homes and renovation plans to the user in list form.

[1191] Specific behavior: The device parses the received JSON data and renders a list of suggestions in the user interface.

[1192] Step 5:

[1193] Collecting Emotional Data

[1194] The terminal provides an interface for recognizing the user's emotions.

[1195] Input: User's facial expressions, voice, operation patterns, etc.

[1196] Output: Collected emotion data.

[1197] Specific operation: Software that uses the camera and microphone to recognize facial expressions and perform voice analysis is launched.

[1198] Emotional data is collected as the user browses through the suggested options.

[1199] How it works: As you scroll through the suggested options, the camera captures your facial expressions and the microphone records your tone of voice.

[1200] Step 6:

[1201] Sending and analyzing emotional data

[1202] The terminal transmits the emotion data to the server.

[1203] Input: Collected emotion data.

[1204] Output: The data sent to the server.

[1205] Specific operation: The collected facial expression data and voice data are sent to the server in real time.

[1206] The server analyzes the emotion data using an emotion engine.

[1207] Specific operation: The server calls the emotion engine's API and converts facial expression data and voice data into emotion indexes and text labels.

[1208] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[1209] Input: Parsed emotion data.

[1210] Output: Data for recalibration.

[1211] How it works: The results of the sentiment analysis are sent to the generative AI model's API, which then uses the data to generate new suggestions based on the user's emotional state.

[1212] Step 7:

[1213] Readjusting the proposal

[1214] The generative AI model receives data from the emotion engine and refines its suggestions.

[1215] Input: Data from the emotion engine.

[1216] Output: Rebalanced housing options.

[1217] How it works: A generative AI model uses emotion data to reconstruct housing options that the user is likely to find more comfortable.

[1218] The generative AI model generates retuned housing options and sends them back to the server.

[1219] What happens: The newly generated housing options are converted into JSON format and sent as a response from the generative AI model's API to the server.

[1220] Step 8:

[1221] Providing a rebalanced proposal

[1222] The server sends the retuned proposal to the terminal.

[1223] Input: Reconditioned proposal data returned from the generative AI model.

[1224] Output: JSON formatted data sent to the device.

[1225] Specific operation: The retuned proposal data is sent to the terminal as an HTTP response.

[1226] The terminal displays the optimized suggestions to the user.

[1227] Specific operation: The device parses the received data and displays it to the user in a list format as the final proposal screen.

[1228] This allows users to get the best housing options based on their feelings and preferences in real time.

[1229] (Application example 2)

[1230] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1231] Conventional home purchase and renovation recommendation systems lack personalized recommendations based on the user's emotions and preferences, and lack optimal solutions to increase user satisfaction. Furthermore, the recommendations are static, making it difficult to respond to real-time changes in the user's emotions. A means to resolve these issues and provide more accurate recommendations is needed.

[1232] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1233] In this invention, the server includes: means for collecting information input by a user; means for creating a user profile based on the collected information; means for a generative AI to generate home options using the user profile; means for providing the generated home options to the user; means for allowing the user to visually experience the interior of the home through a virtual tour; means for performing budget management and cost estimation; means for proposing interior designs; emotion recognition means for analyzing the user's emotion data and adjusting the proposal content based on the results; and means including a generative AI model that readjusts the proposal content using the emotion data collected by the emotion recognition means. This enables the provision of personalized proposals that reflect the user's emotions and the adjustment of the proposal content in real time.

[1234] A "user profile" is a collection of data created based on information entered by the user (such as desired area, budget, size of home, etc.).

[1235] A "generative AI model" is an artificial intelligence algorithm that uses a user profile to generate optimal suggestions.

[1236] "Emotion recognition means" is a technology for collecting and analyzing user emotional data and adjusting the content of suggestions based on the results.

[1237] A "virtual tour" is a means of allowing a user to visually experience the interior of a home using virtual reality technology or three-dimensional graphics.

[1238] The "interior design suggestion means" is a system component that provides optimal interior options based on the user's preferences and feelings.

[1239] The "budget management and cost estimation means" is a system component that manages the budget and estimates costs based on information input by the user.

[1240] "Emotion data" refers to data such as a user's facial expressions, voice, and operation patterns, and is data used to analyze the user's emotional state based on this data.

[1241] The "adjusted proposal content" refers to proposed housing and interior options that have been readjusted based on the emotional data analyzed by the emotion recognition means.

[1242] The "collection means" is a means for having the user input desired conditions and information and recording them.

[1243] This invention combines a conventional home purchase and renovation recommendation system with an emotion engine that recognizes user emotions and optimizes recommendations based on those emotions. The system collects and analyzes user input and uses a generative AI model to suggest optimal housing options and interior designs.

[1244] System Configuration

[1245] The system according to the present invention includes the following main components:

[1246] 1. Terminal - Provides an interface for users to input information, review system suggestions, and perform emotion recognition.

[1247] 2. Server - The central system that receives user input, creates a user profile, and uses generative AI models to make suggestions. It also analyzes emotional data using an emotion engine.

[1248] 3. Generative AI Models - Artificial intelligence algorithms that generate optimal home options and interior designs based on user profiles.

[1249] 4. Sentiment Engine - An algorithm that analyzes user sentiment and incorporates that data into suggestions.

[1250] 5. Database - A system for storing user profiles, suggestions, sentiment data, etc.

[1251] Program processing

[1252] The device provides the user with an interface for entering desired area, budget, home size, and other desired conditions. For example, if a user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed," the device collects that information and sends it to the server. The server creates a user profile based on the received information and stores it in a database.

[1253] The server then retrieves the user profile and sends it to the generative AI model, which generates the best housing options based on the user's profile, using prompts like this:

[1254] User Profile:

[1255] Region: Tokyo

[1256] Budget: 80 million yen

[1257] Size of the home: 3LDK

[1258] Other desired conditions:Pets allowed

[1259] Based on this, generate the best housing options that meet the following criteria:

[1260] Trendy Design

[1261] Pet Friendly

[1262] Color coordination suggestions

[1263] The generated options are sent back to the server and sent to the terminal, which displays these suggestions to the user.

[1264] Next, as the user browses the suggested options, the device collects the user's emotional data (facial expressions, voice, operation patterns, etc.). For example, if the user expresses interest in a particular interior design, that emotional data is sent to the server. The server uses an emotion engine to analyze the emotional data and sends data to the generative AI model to readjust the suggestions based on the results.

[1265] The generative AI model generates new proposals and sends the reconfiguration results back to the device via the server, which then displays them to the user, allowing them to receive more personalized home proposals.

[1266] As described above, by using the system of the present invention, users can receive personalized home suggestions tailored to their emotions and efficiently find their ideal home. The hardware used includes smartphones, smart glasses, and head-mounted displays, and the software used includes the Flask framework, OpenCV, and generative AI models (e.g., GPT-4).

[1267] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1268] Step 1:

[1269] The terminal displays an interface for the user to input the desired area, budget, size of the home, and other desired conditions.

[1270] (Input) The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1271] (Data processing / calculation) The terminal collects the input information as data.

[1272] (Output) Data that sends collected information to the server.

[1273] Step 2:

[1274] The server creates a user profile based on the received user input information.

[1275] (Input) User input information sent from the terminal.

[1276] The (data processing / calculation) server analyzes the information and stores the user profile in a database.

[1277] (Output) The saved user profile.

[1278] Step 3:

[1279] The server retrieves the user profile and sends it to the generative AI model.

[1280] (Input) User profile stored in the database.

[1281] (Data processing / calculation) Generate prompt sentences based on the user profile in the generative AI model.

[1282] (Output) Prompt to the generative AI model:

[1283] User Profile:

[1284] Region: Tokyo

[1285] Budget: 80 million yen

[1286] Size of the home: 3LDK

[1287] Other desired conditions:Pets allowed

[1288] Based on this, generate the best housing options that meet the following criteria:

[1289] Trendy Design

[1290] Pet Friendly

[1291] Color coordination suggestions

[1292] Step 4:

[1293] A generative AI model generates the best housing options based on the prompt received.

[1294] (Input) The prompt sent by the server.

[1295] (Data processing / calculation) Generative AI model generates options based on user profile.

[1296] (Output) The generated housing options.

[1297] Step 5:

[1298] The server transmits the generated housing options to the terminal.

[1299] (Input) Housing options returned by the generative AI model.

[1300] (Data processing / calculation) The server converts the generated options into JSON format.

[1301] (Output) Option data in JSON format.

[1302] Step 6:

[1303] The terminal displays suggested housing options to the user.

[1304] (Input) Option data sent by the server in JSON format.

[1305] (Data processing / calculation) The terminal analyzes the data and displays it in a visual interface.

[1306] (Output) The housing options displayed to the user.

[1307] Step 7:

[1308] The terminal collects emotion data of the user.

[1309] (Input) Facial expressions, voice, operation patterns, etc. when the user browses the suggested options.

[1310] (Data processing / calculation) The terminal collects emotional data through sensors and cameras.

[1311] (Output) Collected emotion data.

[1312] Step 8:

[1313] The server analyzes the emotion data using an emotion engine.

[1314] (Input) Emotion data sent from the device.

[1315] (Data processing / calculation) The server starts the emotion engine and analyzes the emotion data.

[1316] (Output) Analysis result data.

[1317] Step 9:

[1318] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[1319] (Input) Parsed emotion data.

[1320] (Data processing / calculation) Generate prompt sentences for readjustment to the generated AI model.

[1321] (Output) Reprompt sentence to the generative AI model.

[1322] Step 10:

[1323] A generative AI model generates retuned recommendations.

[1324] (Input) The reprompt sent by the server.

[1325] (Data processing / calculation) The generative AI model takes emotion data into account to generate new suggestions.

[1326] (Output) Retuned proposed options.

[1327] Step 11:

[1328] The server sends the retuned proposal to the terminal.

[1329] (Input) The suggested retuning options returned by the generative AI model.

[1330] (Data processing / calculation) The server converts the proposed options into JSON format.

[1331] (Output) Recalibration options data in JSON format.

[1332] Step 12:

[1333] The terminal displays the retuned proposal to the user.

[1334] (Input) Recalibration options data sent by the server in JSON format.

[1335] (Data processing / calculation) The terminal analyzes the data and displays it in a visual interface.

[1336] (Output) The rebalanced housing options displayed to the user.

[1337] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1338] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1339] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1340] [Third embodiment]

[1341] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1342] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1343] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1344] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1345] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1346] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1347] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1348] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1349] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1350] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1351] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1352] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1353] The present invention provides a system that uses generative AI to propose optimal housing options to users considering purchasing or renovating a home. This system collects information entered by the user, creates a user profile based on that information, and the generative AI proposes optimal housing options, and also provides functions such as virtual tours, budget management, cost estimates, and interior design suggestions.

[1354] System Configuration

[1355] The system according to the present invention includes the following main components:

[1356] 1. Terminal - Provides an interface where users can enter information and review suggestions from the system.

[1357] 2. Server - The central system that receives user input, creates a user profile, and executes generative AI-driven suggestions.

[1358] 3. Generative AI model - an algorithm that generates the best housing options based on a user profile.

[1359] 4. Database - Stores user profiles, proposals, virtual tour data, cost estimate data, etc.

[1360] Program processing explanation

[1361] 1. Create a user profile

[1362] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[1363] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1364] The terminal transmits the input information to the server.

[1365] The server creates a user profile based on the received information and stores it in a database.

[1366] 2. Generative AI suggestions

[1367] The server retrieves the user profile and performs analysis.

[1368] The server makes a request to the generative AI model to generate housing options that match the user's requirements.

[1369] The generative AI model generates multiple proposed properties and renovation plans that match the conditions.

[1370] The generative AI model sends the generated results back to the server.

[1371] The server sends the proposed options to the terminal.

[1372] The terminal displays proposed homes and renovation plans to the user in list form.

[1373] 3. Virtual Tour Feature

[1374] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[1375] The device requests data for the virtual tour from the server.

[1376] The server provides virtual tour data (3D models and VR content).

[1377] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[1378] The user operates the terminal interface to virtually tour the interior of the property.

[1379] 4. Budget management and cost estimation features

[1380] The user selects the budget management tab and enters detailed information about the renovation.

[1381] The terminal transmits the user's input data to the server.

[1382] The server uses the received data to generate a comprehensive cost estimate.

[1383] The server transmits the cost estimate results to the terminal.

[1384] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[1385] 5. Interior design suggestion function

[1386] The user selects the interior design suggestions tab and enters their preferred style and color.

[1387] The terminal transmits the user's input data to the server.

[1388] The server analyzes the data and asks the generative AI model to propose interior designs.

[1389] A generative AI model generates interior design proposals.

[1390] The generative AI model sends the generated suggestions back to the server.

[1391] The server sends the interior design proposal to the terminal.

[1392] The device displays interior design suggestions to the user, providing a concrete image.

[1393] Specific examples

[1394] When a user is considering buying a home, the following sequence of events occurs:

[1395] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[1396] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1397] 3. The device sends the information to the server and a user profile is created.

[1398] 4. The server generates the optimal property based on the generative AI model.

[1399] 5. The proposed properties are displayed to the user, who can select the property they are interested in and enjoy a virtual tour.

[1400] 6. In addition, you can use the budget management function to check renovation cost estimates and receive interior design suggestions to make your ideal home a reality.

[1401] In this way, by using the system of the present invention, users can efficiently find the home they desire and smoothly make the decision that accompanies it.

[1402] The processing flow will be explained below.

[1403] Step 1:

[1404] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[1405] Step 2:

[1406] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1407] Step 3:

[1408] The terminal converts the input information into JSON format and sends it to the server.

[1409] Step 4:

[1410] The server analyzes the received information and creates a user profile.

[1411] Step 5:

[1412] The server stores the user profile in a database.

[1413] Step 6:

[1414] The server retrieves the user profile and sends it to the generative AI model.

[1415] Step 7:

[1416] A generative AI model generates the best housing options based on the user's preferences and budget.

[1417] Step 8:

[1418] The generative AI model sends the generated options back to the server.

[1419] Step 9:

[1420] The server converts the proposed options into JSON format and sends it to the device.

[1421] Step 10:

[1422] The terminal displays proposed homes and renovation plans to the user in list form.

[1423] Step 11:

[1424] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[1425] Step 12:

[1426] The terminal requests the virtual tour data from the server.

[1427] Step 13:

[1428] The server provides virtual tour data (3D models and VR content).

[1429] Step 14:

[1430] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[1431] Step 15:

[1432] The user operates the terminal interface to virtually tour the interior of the property.

[1433] Step 16:

[1434] The user selects the budget management tab and enters detailed information about the renovation.

[1435] Step 17:

[1436] The terminal converts the user's input data into JSON format and sends it to the server.

[1437] Step 18:

[1438] The server analyzes the received data and generates a comprehensive cost estimate.

[1439] Step 19:

[1440] The server transmits the cost estimate results to the terminal.

[1441] Step 20:

[1442] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[1443] Step 21:

[1444] The user selects the interior design suggestions tab and enters their preferred style and color.

[1445] Step 22:

[1446] The terminal converts the user's input data into JSON format and sends it to the server.

[1447] Step 23:

[1448] The server analyzes the data and asks the generative AI model to propose interior designs.

[1449] Step 24:

[1450] A generative AI model generates interior design suggestions such as color schemes, furniture placement, and lighting designs.

[1451] Step 25:

[1452] The generative AI model sends the generated suggestions back to the server.

[1453] Step 26:

[1454] The server converts the interior design proposal into JSON format and sends it to the device.

[1455] Step 27:

[1456] The device displays interior design suggestions to the user, providing a concrete image.

[1457] Example 1

[1458] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1459] Traditionally, when considering purchasing or renovating a home, users have to research a lot of information, which requires a lot of effort. It can be difficult to find the best home option, and users are required to manage their budget and propose interior design themselves. This slows down users' decision-making process and complicates the process of finding their ideal home. Therefore, there is a need for a system that allows users to efficiently find their ideal home.

[1460] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1461] In this invention, the server includes a means for collecting information entered by the user, a means for creating a user profile based on the collected information, and a means for the generation AI to generate housing options using the user profile, thereby enabling suggestions to help the user efficiently find their ideal home.

[1462] The server also includes means for providing the generated home options to the user, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, means for proposing interior designs, and means for receiving the proposals and displaying them to the user in a visually easy-to-understand list format, thereby enabling the user to compare and consider multiple home options and receive budget management and interior design proposals while virtually touring the interiors, thereby enabling smooth decision-making.

[1463] Furthermore, the server includes means for creating prompts for the generative AI based on a user profile, means for receiving and analyzing the output of the generative AI model, and means for downloading virtual tour data to the terminal and displaying a VR environment and three-dimensional graphics, thereby enabling the user to receive more specific and personalized home suggestions and providing a seamlessly integrated user experience throughout the entire process.

[1464] "Means for collecting information entered by the user" refers to the function of providing an interface for the user to enter their desired area, budget, size of the home, and other desired conditions, and securely transmitting that information to the server.

[1465] "Means for creating a user profile based on collected information" refers to the function of analyzing the information entered by the user and generating a digital profile that systematically summarizes the user's wishes and requirements.

[1466] "Means by which the generative AI generates housing options using a user profile" refers to the process by which the generative AI model generates optimal housing options based on a user profile.

[1467] "Means for providing users with generated housing options" refers to the function of providing an interface for presenting users with multiple housing options generated by the generative AI.

[1468] "Means for visually experiencing the interior of a home through a virtual tour" refers to a feature that uses virtual reality technology or three-dimensional graphics to allow a user to virtually tour the interior of a proposed home.

[1469] "Means for budget management and cost estimation" refers to a function that provides estimates for renovation and purchase costs based on the budget set by the user and helps the user execute the plan within the budget.

[1470] "Means for suggesting interior design" refers to a function that uses generative AI to suggest optimal interior design ideas based on the user's preferences and style.

[1471] "Means for receiving the proposals and displaying them to the user in a visually easy-to-understand list format" refers to the function of receiving the output from the generative AI and displaying it in a visual list format that is easy for the user to understand.

[1472] "Means for creating prompts for the generative AI based on a user profile" refers to the process of generating input sentences based on information in the user profile that enable the generative AI to make accurate suggestions.

[1473] "Means for receiving and analyzing the output of the generative AI model" refers to the function of receiving the proposed results from the generative AI, analyzing them, and converting them into a format that is useful to the user.

[1474] "Means for downloading virtual tour data to a terminal and displaying a VR environment or three-dimensional graphics" refers to the function of downloading virtual tour data from a server and displaying it as a VR environment or three-dimensional graphics on a terminal.

[1475] The present invention provides a system that uses generative AI to propose optimal housing options to users who are considering purchasing or renovating a home. The main components of this system include a terminal, a server, a generative AI model, and a database. The role of each component and the specific processing are explained below.

[1476] Hardware and software used

[1477] Terminal: A device that provides an interface for users to enter information and view system suggestions, such as a PC, smartphone, or tablet.

[1478] Server: A central computer system that receives user input, creates a user profile, and executes suggestions using generative AI models. This is often a cloud service or dedicated server equipment.

[1479] Generative AI model: An algorithm that generates optimal housing options based on a user profile. For example, generative AI technologies such as OpenAI's GPT-4 are used.

[1480] Database: Stores user profiles, proposals, virtual tour data, cost estimate data, etc. Generally, a relational database such as MySQL or PostgreSQL is used.

[1481] Specific implementation methods of the system

[1482] 1. Enter your user information:

[1483] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[1484] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed" into a form.

[1485] The device sends the entered information to the server. For security reasons, the data is sent using a protocol such as HTTPS.

[1486] 2. Create a user profile:

[1487] The server analyzes the user information received from the terminal and creates a user profile.

[1488] The server stores the created user profile in a database, typically in JSON format.

[1489] 3. Generative AI suggestions:

[1490] The server retrieves the user profile from the database and generates appropriate prompts for the generative AI model, such as "Based on the user profile, please suggest a 3LDK property in Tokyo for up to 80 million yen. Please also include the condition that pets are allowed."

[1491] The generative AI model generates suggestions based on the input prompts and sends them back to the server.

[1492] 4. View Proposals:

[1493] The server sends the suggestions from the generating AI to the terminal.

[1494] The device receives the suggestions and displays them to the user in a visually easy-to-understand format, such as a list containing thumbnail images of properties and links to more detailed information.

[1495] 5. Virtual Tour Feature:

[1496] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[1497] The device requests virtual tour data from the server, receives the data, and displays the VR environment and 3D graphics. For example, this can be achieved using Unity or Unreal Engine.

[1498] 6. Budget management and cost estimation features:

[1499] The user selects the budget management tab and enters detailed information about the renovation.

[1500] The terminal sends the input data to the server, which generates a cost estimate.

[1501] The terminal displays the estimate results to the user, allowing them to confirm whether they fit within their budget.

[1502] 7. Interior design proposal function:

[1503] The user selects the interior design suggestions tab and enters their preferred style and color.

[1504] The device sends the input data to the server, which then requests a generative AI model to generate interior design proposals.

[1505] The terminal receives the proposed results and provides a concrete image to the user.

[1506] Specific examples

[1507] For example, if a user is considering buying a home, they might input the following prompts into a generative AI model:

[1508] "Based on my user profile, please suggest 3 bedroom, 3 bedroom, 3 kitchen, and 3 bedroom apartments in Tokyo priced at under ¥80 million. Please also include the requirement that pets are allowed."

[1509] "Please suggest a renovation plan. My budget is within 10 million yen, and I'd particularly like to renovate the kitchen and bathroom."

[1510] "Please provide an interior design proposal based on the user's preferences. It should be modern in style, with white and blue as the main colors."

[1511] As described above, the system of the present invention is a system that allows users to efficiently find the home they desire and provides a series of support to help them realize their ideal home.

[1512] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1513] Step 1: Enter and submit user information

[1514] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[1515] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed" into the form. This is the user's specific desired conditions and is important data that will be used in subsequent processing by the system.

[1516] The device verifies that the information is in the correct format and sends it to the server using a secure protocol (e.g., HTTPS).

[1517] Input: Information entered by the user (area, budget, size, conditions)

[1518] Output: User information sent to the server

[1519] Step 2: Create a user profile

[1520] The server analyzes the user information received from the terminal and checks whether the format is correct.

[1521] Based on the information received by the server, a user profile is created, which systematically summarizes the user's preferences and is stored in a database in JSON format or similar.

[1522] Input: User information sent from the device

[1523] Output: User profile stored in the database

[1524] Step 3: Generative AI suggestions

[1525] The server retrieves the user profile from the database and performs analysis.

[1526] The server creates a prompt for the generative AI model based on the user profile. For example, it generates a prompt such as, "Based on the user profile, please suggest a 3LDK property in Tokyo for up to 80 million yen. Please also include the condition that pets are allowed."

[1527] The server sends a prompt to the generative AI model, requesting it to generate multiple proposed properties and renovation plans.

[1528] The generative AI model generates suggestions that match the conditions and returns the results to the server.

[1529] Input: User profile retrieved from database

[1530] Output: Home recommendations returned by the generative AI model

[1531] Step 4: View the proposal

[1532] The server analyzes the proposals received from the generation AI and converts them into the required format, such as compiling information such as property name, price, location, and size in JSON format.

[1533] The server sends the proposal to the device.

[1534] The device receives the suggestions and displays them to the user in a visually appealing list format, including thumbnail images of the properties and links to more detailed information.

[1535] Input: Suggestions sent by the generative AI model

[1536] Output: Suggestions presented to the user in a visually friendly format

[1537] Step 5: Virtual Tour Feature

[1538] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[1539] The device sends a request to the server containing the ID of the selected property.

[1540] The server retrieves the virtual tour data from the database and sends it to the device. The virtual tour data is stored as a 3D model or VR content.

[1541] The device receives the data and displays it using a VR-capable application or 3D rendering engine (such as Unity or Unreal Engine).

[1542] Users can operate the device to virtually tour the interior of a property, for example by using the arrow keys on the screen to move between rooms.

[1543] Input: Property ID selected by user

[1544] Output: Virtual tours displayed in VR environments and 3D graphics

[1545] Step 6: Budget management and cost estimation features

[1546] The user selects the budget management tab and enters detailed information about the renovation (for example, kitchen renovation, bathroom renovation requests, etc.).

[1547] The terminal sends the input data to the server.

[1548] The server generates a cost estimate for the renovation based on the data received, using internal algorithms and external APIs to provide an accurate cost estimate.

[1549] The server compiles the estimate results and sends them to the terminal.

[1550] The terminal visually displays the estimate results, allowing the user to check whether they fit within their budget.

[1551] Input: Renovation details entered by the user

[1552] Output: Generated cost estimate results

[1553] Step 7: Interior design suggestion function

[1554] The user selects the interior design suggestion tab and inputs the preferred style and color (e.g., modern style, white and blue).

[1555] The terminal sends the input data to the server.

[1556] The server analyzes the data and asks the generative AI model to propose an interior design, specifically generating a prompt such as, "Please propose a modern interior design with white and blue as the main colors."

[1557] The generative AI model generates interior design proposals and sends them back to the server.

[1558] The server parses the proposal and sends it to the device.

[1559] The device visually displays specific interior design suggestions to the user, such as furniture placement, wall colors, and decoration ideas, using images and text.

[1560] Input: Style and color information entered by the user

[1561] Output: Interior design proposals generated by the generative AI model

[1562] (Application example 1)

[1563] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1564] In modern society, when users purchase or renovate a home, it takes a lot of time and effort to gather a lot of information and find the best option. This makes it difficult for users to efficiently find a home that meets their desired criteria. Users also need the convenience of being able to see the interior of a property without visiting the site. Furthermore, proper budget management, cost estimation, and receiving interior design proposals are also important challenges.

[1565] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1566] In this invention, the server includes means for collecting information input by a user, means for creating a user profile based on the collected information, means for a generation AI to generate home options using the user profile, means for providing the generated home options to the user, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, means for proposing interior designs, and means for presenting multiple options by switching between properties using virtual reality technology. This allows users to efficiently find their desired home, and enables them to use a virtual environment to check the interior of the property and receive budget management and interior design suggestions.

[1567] The "means for collecting information entered by the user" is a function that provides an interface for the user to input desired conditions and requests and transmits them to the server.

[1568] The "means for creating a user profile based on collected information" refers to a function that analyzes collected user information and organizes and stores user attributes in a database based on individual characteristics and requests.

[1569] "Means for the generative AI to generate housing options using user profiles" refers to a function that allows the generative AI to execute an algorithm to propose optimal housing and renovation plans based on user profile data.

[1570] "Means for providing users with generated housing options" means a function that provides users with information about the housing suggested by the generating AI in visual or text format.

[1571] "Means for visually experiencing the interior of a home through a virtual tour" refers to a function that allows a user to virtually tour the interior of a property using virtual reality technology and three-dimensional graphics.

[1572] The "means for budget management and cost estimation" is a function that calculates the costs of renovations and purchases based on the budget information entered by the user and checks whether they are within the budget.

[1573] The "means for proposing interior designs" is a function that uses AI to propose optimal interior designs based on the user's preferences and budget.

[1574] "Means for presenting multiple options by switching between properties using virtual reality technology" refers to a function that allows a user to view different properties while switching between them in a virtual reality environment and compare multiple options.

[1575] MODE FOR CARRYING OUT THE INVENTION

[1576] The present invention relates to a system for streamlining the process of users considering purchasing or renovating a home. This system includes a terminal for users to input information, a server that processes the information and generates proposals, and a database that stores this data. The specific system configuration and processing are described below.

[1577] System Configuration

[1578] 1. Terminal

[1579] This device provides an interface for users to input information such as the desired area, budget, size of the home, etc. The device can be a smartphone or a head-mounted display (HMD).

[1580] 2. Server

[1581] The server receives the information sent by the terminal and creates a user profile, in particular by analyzing the data based on the user's preferences and needs.

[1582] A generative AI model runs on the server and generates optimal housing options based on the user's profile.

[1583] The server transmits the virtual tour data and cost estimate data to the terminal and provides them to the user.

[1584] 3. Database

[1585] The database stores user profiles, generated home options, virtual tour data, cost estimate data, interior design suggestions, and more.

[1586] Program processing explanation

[1587] 1. Create a user profile

[1588] The terminal displays an input form to the user that asks, "Please enter your desired area, budget, size of home, and other desired conditions."

[1589] For example, the user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1590] The device sends the entered information to the server, which creates a user profile based on the received information and stores it in a database.

[1591] 2. Generative AI suggestions

[1592] The server retrieves the user profile and uses a generative AI model to generate housing options that match the user's preferences.

[1593] The generative AI model generates multiple proposed properties and renovation plans that match the user's criteria and returns the results to the server, which then sends the proposals to the device and provides them to the user.

[1594] 3. Virtual Tour Feature

[1595] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[1596] The terminal requests data for the virtual tour from the server, and the server provides the virtual tour data (3D models and VR content).

[1597] The device downloads the virtual tour data and displays the VR environment and 3D graphics, allowing users to virtually tour the interior of the property by operating the device's interface.

[1598] 4. Budget management and cost estimation features

[1599] The user selects the budget management tab and enters detailed information about the renovation.

[1600] The terminal transmits the user's input data to the server, which uses the received data to generate a comprehensive cost estimate and transmits the result to the terminal.

[1601] The terminal displays the cost estimate results to the user, allowing them to confirm whether the cost is within their budget.

[1602] 5. Interior design suggestion function

[1603] Users select the interior design suggestions tab and enter their preferred style and color.

[1604] The device sends the user's input data to the server, which analyzes the data and requests the generative AI model to propose interior design ideas.

[1605] The generative AI model generates interior design proposals and sends them back to the server, which then sends them to the device to provide the user with a concrete image.

[1606] Specific examples

[1607] If a user is considering buying a home:

[1608] 1. The device will display "Please enter your desired area, budget, home size, and other desired conditions."

[1609] 2. The user enters "Tokyo, 80 million yen, 3LDK, pets allowed."

[1610] 3. The device sends the information to the server, which creates a user profile and stores it in a database.

[1611] 4. The server generates optimal property options based on the generative AI model. The suggested properties are displayed to the user, who selects the property that interests them.

[1612] 5. Users can use the virtual tour feature to visually inspect the property, as well as manage their budget and see cost estimates.

[1613] 6. Finally, you will receive interior design suggestions to help you realize your dream home.

[1614] Example prompt sentence:

[1615] Enter the housing requirements you are looking for.

[1616] Region: Tokyo

[1617] Budget: 80 million yen

[1618] Size of the home: 3LDK

[1619] Other desired conditions:Pets allowed

[1620] In this way, by using the system of the present invention, users can efficiently find the home they desire, and can also use the virtual environment to view the interior of the property and receive budget management and interior design suggestions.

[1621] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1622] Step 1:

[1623] The user inputs their desired conditions. Specifically, the device displays an input form that asks, "Please enter your desired area, budget, home size, and other desired conditions." The user inputs the conditions, and the device sends the information to the server. Based on the input, data on the area, budget, home size, and other desired conditions is collected.

[1624] Step 2:

[1625] The server analyzes the received user information and creates a user profile. The server saves the user profile in a database based on the collected information. The server processes the data to generate the user profile using the entered data such as area, budget, size of the home, and other desired conditions.

[1626] Step 3:

[1627] The server generates housing options using a generative AI model based on the user profile. Specifically, the server inputs the user profile data into the generative AI model and receives a list of optimal housing options as output. This list includes properties and renovation plans that meet the user's criteria.

[1628] Step 4:

[1629] The server sends the generated housing options to the terminal, which displays the proposed housing options in a list format to the user. The output includes information about the proposed home and renovation plan.

[1630] Step 5:

[1631] The user selects a property they are interested in and clicks the virtual tour button. The device requests virtual tour data from the server, and the server sends the virtual tour data (3D models and VR content) to the device. The ID of the property selected by the user is used as input, and the virtual tour data is provided as output.

[1632] Step 6:

[1633] The device receives the virtual tour data and displays it to the user as a VR environment or 3D graphics. Through the device interface, the user can virtually tour the interior of the property, allowing the user to see the interior without actually visiting the property.

[1634] Step 7:

[1635] The user selects the budget management tab and enters detailed information about the renovation. The device sends that information to the server, which generates a cost estimate based on the received data. The detailed information about the renovation is used as input, and a comprehensive cost estimate is generated as output.

[1636] Step 8:

[1637] The server sends the cost estimate results to the terminal, which then displays them to the user, who can check whether they fit within their budget. The cost estimate results show the total cost of the renovation.

[1638] Step 9:

[1639] The user selects the interior design suggestions tab and enters their preferred style and color. The device sends that information to the server, which then inputs the data into a generative AI model to generate interior design suggestions. The user's preferred style and color are used as input, and the interior design suggestions are generated as output.

[1640] Step 10:

[1641] The server sends the generated interior design proposal to the terminal, which then displays the proposal to the user. The user can check the proposed interior design and get a concrete image of it. Detailed information about the interior design proposal is provided as an output.

[1642] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1643] This invention provides a system that combines a conventional home purchase and renovation suggestion system with an emotion engine that recognizes the user's emotions and optimizes the proposal content based on those emotions. This system has the function of analyzing the user's emotions and proposing optimal housing options and interior designs based on those emotions.

[1644] System Configuration

[1645] The system according to the present invention includes the following main components:

[1646] 1. Terminal - Provides an interface where users can input information, review system suggestions, and perform emotion recognition.

[1647] 2. Server - The central system that receives user input, creates a user profile, and executes generative AI-driven suggestions. It also analyzes emotional data using the emotion engine.

[1648] 3. Generative AI model - an algorithm that generates the best housing options based on a user profile.

[1649] 4. Sentiment Engine - An algorithm that analyzes user sentiment and incorporates that data into suggestions.

[1650] 5. Database - Stores user profiles, proposals, virtual tour data, cost estimate data, sentiment data, etc.

[1651] Program processing explanation

[1652] 1. Create a user profile

[1653] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[1654] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1655] The terminal transmits the input information to the server.

[1656] The server creates a user profile based on the received information and stores it in a database.

[1657] 2. Generative AI suggestions

[1658] The server retrieves the user profile and sends it to the generative AI model.

[1659] A generative AI model generates the best housing options based on the user's profile.

[1660] The generative AI model sends the generated options back to the server.

[1661] The server converts the proposed options into JSON format and sends it to the device.

[1662] The terminal displays proposed homes and renovation plans to the user in list form.

[1663] 3. Emotion Recognition by Emotion Engine

[1664] It provides an interface for devices to recognize user emotions, for example by monitoring the user's facial expressions, voice, and operation patterns.

[1665] Emotional data is collected as users browse suggested options.

[1666] The device transmits the emotion data to the server.

[1667] The server analyzes the emotion data using an emotion engine.

[1668] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[1669] 4. Recalibrate your emotional recommendations

[1670] A generative AI model receives data from the emotion engine and adjusts its suggestions.

[1671] A generative AI model generates reconditioned housing options.

[1672] The generative AI model sends the refinement results back to the server.

[1673] The server sends the retuned proposal to the device.

[1674] The device displays optimized suggestions to the user.

[1675] Specific examples

[1676] When a user is considering buying a home, the following sequence of events occurs:

[1677] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[1678] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1679] 3. The device sends the information to the server and a user profile is created.

[1680] 4. The server uses the generative AI model to generate the optimal property and displays the proposal to the user.

[1681] 5. The device monitors the user's emotions and collects emotional data.

[1682] 6. The emotion engine analyzes the emotion data and provides data for recalibration to the generative AI model.

[1683] 7. The generative AI model generates new suggestions and displays them back to the user via the server.

[1684] 8. Additionally, users can find their ideal home using virtual tours, budget management, and interior design suggestions.

[1685] In this way, by using the system of the present invention, users can receive more personalized home suggestions that match their emotions and efficiently find their ideal home.

[1686] The processing flow will be explained below.

[1687] Step 1:

[1688] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[1689] Step 2:

[1690] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1691] Step 3:

[1692] The terminal converts the input information into JSON format and sends it to the server.

[1693] Step 4:

[1694] The server analyzes the received information and creates a user profile.

[1695] Step 5:

[1696] The server stores the user profile in a database.

[1697] Step 6:

[1698] The server retrieves the user profile and sends it to the generative AI model.

[1699] Step 7:

[1700] A generative AI model generates the best housing options based on the user's profile.

[1701] Step 8:

[1702] The generative AI model sends the generated options back to the server.

[1703] Step 9:

[1704] The server converts the proposed options into JSON format and sends it to the device.

[1705] Step 10:

[1706] The terminal displays proposed homes and renovation plans to the user in list form.

[1707] Step 11:

[1708] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[1709] Step 12:

[1710] The terminal requests the virtual tour data from the server.

[1711] Step 13:

[1712] The server provides virtual tour data (3D models and VR content).

[1713] Step 14:

[1714] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[1715] Step 15:

[1716] The user operates the terminal interface to virtually tour the interior of the property.

[1717] Step 16:

[1718] The device monitors the user's facial expressions, voice, and operation patterns to collect emotional data.

[1719] Step 17:

[1720] The device converts the collected emotion data into JSON format and sends it to the server.

[1721] Step 18:

[1722] The server analyzes the emotion data using an emotion engine.

[1723] Step 19:

[1724] Based on the analysis results, the server sends data to the generative AI model to readjust the suggestions.

[1725] Step 20:

[1726] A generative AI model takes emotional data into account and recreates optimized housing options.

[1727] Step 21:

[1728] The generative AI model sends the regenerated options back to the server.

[1729] Step 22:

[1730] The server converts the regenerated proposal into JSON format and sends it to the device.

[1731] Step 23:

[1732] The device redisplays the optimized suggestions to the user.

[1733] Step 24:

[1734] The user checks the re-proposed property and renovation plan.

[1735] Step 25:

[1736] The user selects the budget management tab and enters detailed information about the renovation.

[1737] Step 26:

[1738] The terminal converts the user's input data into JSON format and sends it to the server.

[1739] Step 27:

[1740] The server analyzes the received data and generates a comprehensive cost estimate.

[1741] Step 28:

[1742] The server transmits the cost estimate results to the terminal.

[1743] Step 29:

[1744] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[1745] Step 30:

[1746] The user selects the interior design suggestions tab and enters their preferred style and color.

[1747] Step 31:

[1748] The terminal converts the user's input data into JSON format and sends it to the server.

[1749] Step 32:

[1750] The server analyzes the data and asks the generative AI model to propose interior designs.

[1751] Step 33:

[1752] A generative AI model generates interior design suggestions such as color schemes, furniture placement, and lighting designs.

[1753] Step 34:

[1754] The generative AI model sends the generated suggestions back to the server.

[1755] Step 35:

[1756] The server converts the interior design proposal into JSON format and sends it to the device.

[1757] Step 36:

[1758] The device displays interior design suggestions to the user, providing a concrete image.

[1759] Through this series of steps, users can receive more personalized home suggestions based on their emotions and input information.

[1760] Example 2

[1761] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1762] Conventional home purchasing and renovation suggestion systems are unable to adequately respond to individual users' emotions and preferences, resulting in the significant time and effort required for users to find their ideal home. In particular, there was a lack of technology that could recognize users' emotions in real time and make suggestions accordingly. This made it difficult for users to quickly find the home that best suits them.

[1763] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1764] In this invention, the server includes means for collecting information input by a user, means for creating a user profile based on the collected information, means for a generation AI to generate home options using the user profile, means for providing the generated home options to the user, means for recognizing and collecting user emotions, means for analyzing the collected emotion data and providing the generation AI with data for readjusting the proposal, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, and means for suggesting interior designs. This enables personalized proposals based on the user's emotions and preferences, allowing the user to quickly find their ideal home.

[1765] The "means for collecting information entered by the user" is a means that has the function of collecting information such as desired conditions and budget entered by the user through the terminal as data.

[1766] The "means for creating a user profile based on collected information" is a function that generates a profile corresponding to each individual user based on collected information such as the user's desired conditions and budget.

[1767] "Means for generative AI to generate housing options using user profiles" refers to a function in which a generative AI model uses data from user profiles to algorithmically generate appropriate housing and renovation options.

[1768] "Means for providing users with generated housing options" means a function that presents users with housing and renovation options created by a generative AI model.

[1769] "Means for recognizing and collecting user emotions" refers to a function that analyzes the user's facial expressions, voice, operation patterns, etc., and recognizes and collects emotions in real time.

[1770] "Means for analyzing collected emotional data and providing data to the generative AI for readjusting suggestions" refers to a function that analyzes collected emotional data and provides feedback to the generative AI model based on the results to readjust the content of suggestions.

[1771] "Means for visually experiencing the interior of a home through a virtual tour" refers to a function that allows a user to visually experience the interior of a home using virtual reality technology or three-dimensional graphics.

[1772] The "means for budget management and cost estimation" is a function that calculates and manages the total cost of a home or renovation based on the user's budget information.

[1773] The "means for proposing interior designs" has the function of proposing the most suitable interior design based on the user's desired conditions and feelings.

[1774] This invention relates to a system that recognizes a user's emotions and proposes optimal housing options based on those emotions. The system aims to increase user satisfaction by collecting and analyzing the user's emotional data in real time and readjusting the proposals based on the results.

[1775] System Configuration

[1776] The system according to the present invention includes the following main components:

[1777] 1. Device - Provides the interface where users input information, confirm system suggestions, and perform emotion recognition. Specific examples include personal computers, smartphones, and tablets. The device has a web browser or a dedicated application installed.

[1778] 2. Server - This is the central system that receives user input, creates a user profile, and executes generative AI-based suggestions. It also analyzes emotional data using an emotion engine. Specifically, it includes a web server, database server, and AI server.

[1779] 3. Generative AI model - An algorithm that generates optimal housing options based on a user profile. It uses machine learning algorithms to generate multiple housing options.

[1780] 4. Emotion Engine - An algorithm that analyzes user emotions and incorporates that data into suggestions. It analyzes user emotions in real time through facial expression recognition and voice analysis.

[1781] 5. Database - A system for storing user profiles, proposals, virtual tour data, cost estimate data, emotion data, etc. Specifically, a database management system such as MySQL or MongoDB is used.

[1782] Program processing

[1783] Creating a User Profile

[1784] The terminal displays to the user, "Please enter your desired area, budget, size of home, and other desired conditions."

[1785] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1786] The terminal transmits the input information to the server.

[1787] The server creates a user profile based on the received information and stores it in a database.

[1788] Generative AI suggestions

[1789] The server retrieves the user profile and sends it to the generative AI model.

[1790] A generative AI model generates optimal housing options based on a user's profile.

[1791] The generative AI model sends the generated options back to the server.

[1792] The server converts the proposed options into JSON format and sends it to the device.

[1793] The terminal displays proposed homes and renovation plans to the user in list form.

[1794] Emotion recognition by emotion engine

[1795] The device provides an interface for recognizing the user's emotions, including software for facial expression recognition using a camera and microphone, and voice analysis.

[1796] Emotional data is collected as users browse suggested options.

[1797] The terminal transmits the emotion data to the server.

[1798] The server analyzes the emotion data using an emotion engine.

[1799] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[1800] Recalibrating sentiment-based suggestions

[1801] The generative AI model receives data from the emotion engine and adjusts its suggestions.

[1802] A generative AI model generates reconditioned housing options.

[1803] The generative AI model sends the refinement results back to the server.

[1804] The server sends the retuned proposal to the terminal.

[1805] The terminal displays the optimized suggestions to the user.

[1806] Specific examples

[1807] If a user is considering buying a home, the process goes like this:

[1808] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[1809] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1810] 3. The device sends the information to the server and a user profile is created.

[1811] 4. The server uses the generative AI model to generate the optimal property and displays the proposal to the user.

[1812] 5. The device monitors the user's emotions and collects emotional data.

[1813] 6. The emotion engine analyzes the emotion data and provides data for recalibration to the generative AI model.

[1814] 7. The generative AI model generates new suggestions and displays them back to the user via the server.

[1815] Example prompt sentence:

[1816] Please enter your desired area, budget, size of home, and other desired conditions.

[1817] In this way, by using the system of the present invention, users can receive more personalized home suggestions that match their emotions and efficiently find their ideal home.

[1818] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1819] Step 1:

[1820] Entering user information

[1821] The terminal displays a form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[1822] Input: Prompt: "Please enter your desired area, budget, home size, and other desired conditions."

[1823] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1824] Specific actions: The user enters information using the keyboard and clicks the "Submit" button.

[1825] Step 2:

[1826] Submitting information and creating profiles

[1827] The terminal transmits the input user information to the server.

[1828] Input: Information entered by the user (Tokyo, 80 million yen, 3LDK, pets allowed).

[1829] Output: JSON formatted data.

[1830] Specific operation: The device converts the information into JSON format and sends it to the server as an HTTP POST request.

[1831] The server creates a user profile based on the received information and stores it in a database.

[1832] Specific operation: The server parses the received JSON data, generates a user profile, and saves it as a new entry in a database (e.g., MySQL).

[1833] Step 3:

[1834] Invoking a generative AI model

[1835] The server retrieves the user profile and sends it to the generative AI model.

[1836] Input: User profile stored in the database.

[1837] Output: The generated housing options.

[1838] What it does: The server queries the user profile from the database and sends the data in JSON format to the API of the generative AI model.

[1839] A generative AI model generates optimal housing options based on the user profile and sends them back to the server.

[1840] How it works: The generative AI model uses machine learning algorithms to generate housing options and returns the results to the server as a response.

[1841] Step 4:

[1842] Proposal content provided

[1843] The server converts the generated housing options into JSON format and sends it to the device.

[1844] Input: Home options returned from a generative AI model.

[1845] Output: JSON formatted data sent to the device.

[1846] Specific operation: The server formats the generated options into JSON and sends it to the terminal as an HTTP response.

[1847] The terminal displays proposed homes and renovation plans to the user in list form.

[1848] Specific behavior: The device parses the received JSON data and renders a list of suggestions in the user interface.

[1849] Step 5:

[1850] Collecting Emotional Data

[1851] The terminal provides an interface for recognizing the user's emotions.

[1852] Input: User's facial expressions, voice, operation patterns, etc.

[1853] Output: Collected emotion data.

[1854] Specific operation: Software that uses the camera and microphone to recognize facial expressions and perform voice analysis is launched.

[1855] Emotional data is collected as the user browses through the suggested options.

[1856] How it works: As you scroll through the suggested options, the camera captures your facial expressions and the microphone records your tone of voice.

[1857] Step 6:

[1858] Sending and analyzing emotional data

[1859] The terminal transmits the emotion data to the server.

[1860] Input: Collected emotion data.

[1861] Output: The data sent to the server.

[1862] Specific operation: The collected facial expression data and voice data are sent to the server in real time.

[1863] The server analyzes the emotion data using an emotion engine.

[1864] Specific operation: The server calls the emotion engine's API and converts facial expression data and voice data into emotion indexes and text labels.

[1865] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[1866] Input: Parsed emotion data.

[1867] Output: Data for recalibration.

[1868] How it works: The results of the sentiment analysis are sent to the generative AI model's API, which then uses the data to generate new suggestions based on the user's emotional state.

[1869] Step 7:

[1870] Readjusting the proposal

[1871] The generative AI model receives data from the emotion engine and refines its suggestions.

[1872] Input: Data from the emotion engine.

[1873] Output: Rebalanced housing options.

[1874] How it works: A generative AI model uses emotion data to reconstruct housing options that the user is likely to find more comfortable.

[1875] The generative AI model generates retuned housing options and sends them back to the server.

[1876] What happens: The newly generated housing options are converted into JSON format and sent as a response from the generative AI model's API to the server.

[1877] Step 8:

[1878] Providing a rebalanced proposal

[1879] The server sends the retuned proposal to the terminal.

[1880] Input: Reconditioned proposal data returned from the generative AI model.

[1881] Output: JSON formatted data sent to the device.

[1882] Specific operation: The retuned proposal data is sent to the terminal as an HTTP response.

[1883] The terminal displays the optimized suggestions to the user.

[1884] Specific operation: The device parses the received data and displays it to the user in a list format as the final proposal screen.

[1885] This allows users to get the best housing options based on their feelings and preferences in real time.

[1886] (Application example 2)

[1887] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1888] Conventional home purchase and renovation recommendation systems lack personalized recommendations based on the user's emotions and preferences, and lack optimal solutions to increase user satisfaction. Furthermore, the recommendations are static, making it difficult to respond to real-time changes in the user's emotions. A means to resolve these issues and provide more accurate recommendations is needed.

[1889] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1890] In this invention, the server includes: means for collecting information input by a user; means for creating a user profile based on the collected information; means for a generative AI to generate home options using the user profile; means for providing the generated home options to the user; means for allowing the user to visually experience the interior of the home through a virtual tour; means for performing budget management and cost estimation; means for proposing interior designs; emotion recognition means for analyzing the user's emotion data and adjusting the proposal content based on the results; and means including a generative AI model that readjusts the proposal content using the emotion data collected by the emotion recognition means. This enables the provision of personalized proposals that reflect the user's emotions and the adjustment of the proposal content in real time.

[1891] A "user profile" is a collection of data created based on information entered by the user (such as desired area, budget, size of home, etc.).

[1892] A "generative AI model" is an artificial intelligence algorithm that uses a user profile to generate optimal suggestions.

[1893] "Emotion recognition means" is a technology for collecting and analyzing user emotional data and adjusting the content of suggestions based on the results.

[1894] A "virtual tour" is a means of allowing a user to visually experience the interior of a home using virtual reality technology or three-dimensional graphics.

[1895] The "interior design suggestion means" is a system component that provides optimal interior options based on the user's preferences and feelings.

[1896] The "budget management and cost estimation means" is a system component that manages the budget and estimates costs based on information input by the user.

[1897] "Emotion data" refers to data such as a user's facial expressions, voice, and operation patterns, and is data used to analyze the user's emotional state based on this data.

[1898] The "adjusted proposal content" refers to proposed housing and interior options that have been readjusted based on the emotional data analyzed by the emotion recognition means.

[1899] The "collection means" is a means for having the user input desired conditions and information and recording them.

[1900] This invention combines a conventional home purchase and renovation recommendation system with an emotion engine that recognizes user emotions and optimizes recommendations based on those emotions. The system collects and analyzes user input and uses a generative AI model to suggest optimal housing options and interior designs.

[1901] System Configuration

[1902] The system according to the present invention includes the following main components:

[1903] 1. Terminal - Provides an interface for users to input information, review system suggestions, and perform emotion recognition.

[1904] 2. Server - The central system that receives user input, creates a user profile, and uses generative AI models to make suggestions. It also analyzes emotional data using an emotion engine.

[1905] 3. Generative AI Models - Artificial intelligence algorithms that generate optimal home options and interior designs based on user profiles.

[1906] 4. Sentiment Engine - An algorithm that analyzes user sentiment and incorporates that data into suggestions.

[1907] 5. Database - A system for storing user profiles, suggestions, sentiment data, etc.

[1908] Program processing

[1909] The device provides the user with an interface for entering desired area, budget, home size, and other desired conditions. For example, if a user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed," the device collects that information and sends it to the server. The server creates a user profile based on the received information and stores it in a database.

[1910] The server then retrieves the user profile and sends it to the generative AI model, which generates the best housing options based on the user's profile, using prompts like this:

[1911] User Profile:

[1912] Region: Tokyo

[1913] Budget: 80 million yen

[1914] Size of the home: 3LDK

[1915] Other desired conditions:Pets allowed

[1916] Based on this, generate the best housing options that meet the following criteria:

[1917] Trendy Design

[1918] Pet Friendly

[1919] Color coordination suggestions

[1920] The generated options are sent back to the server and sent to the terminal, which displays these suggestions to the user.

[1921] Next, as the user browses the suggested options, the device collects the user's emotional data (facial expressions, voice, operation patterns, etc.). For example, if the user expresses interest in a particular interior design, that emotional data is sent to the server. The server uses an emotion engine to analyze the emotional data and sends data to the generative AI model to readjust the suggestions based on the results.

[1922] The generative AI model generates new proposals and sends the reconfiguration results back to the device via the server, which then displays them to the user, allowing them to receive more personalized home proposals.

[1923] As described above, by using the system of the present invention, users can receive personalized home suggestions tailored to their emotions and efficiently find their ideal home. The hardware used includes smartphones, smart glasses, and head-mounted displays, and the software used includes the Flask framework, OpenCV, and generative AI models (e.g., GPT-4).

[1924] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1925] Step 1:

[1926] The terminal displays an interface for the user to input the desired area, budget, size of the home, and other desired conditions.

[1927] (Input) The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[1928] (Data processing / calculation) The terminal collects the input information as data.

[1929] (Output) Data that sends collected information to the server.

[1930] Step 2:

[1931] The server creates a user profile based on the received user input information.

[1932] (Input) User input information sent from the terminal.

[1933] The (data processing / calculation) server analyzes the information and stores the user profile in a database.

[1934] (Output) The saved user profile.

[1935] Step 3:

[1936] The server retrieves the user profile and sends it to the generative AI model.

[1937] (Input) User profile stored in the database.

[1938] (Data processing / calculation) Generate prompt sentences based on the user profile in the generative AI model.

[1939] (Output) Prompt to the generative AI model:

[1940] User Profile:

[1941] Region: Tokyo

[1942] Budget: 80 million yen

[1943] Size of the home: 3LDK

[1944] Other desired conditions:Pets allowed

[1945] Based on this, generate the best housing options that meet the following criteria:

[1946] Trendy Design

[1947] Pet Friendly

[1948] Color coordination suggestions

[1949] Step 4:

[1950] A generative AI model generates the best housing options based on the prompt received.

[1951] (Input) The prompt sent by the server.

[1952] (Data processing / calculation) Generative AI model generates options based on user profile.

[1953] (Output) The generated housing options.

[1954] Step 5:

[1955] The server transmits the generated housing options to the terminal.

[1956] (Input) Housing options returned by the generative AI model.

[1957] (Data processing / calculation) The server converts the generated options into JSON format.

[1958] (Output) Option data in JSON format.

[1959] Step 6:

[1960] The terminal displays suggested housing options to the user.

[1961] (Input) Option data sent by the server in JSON format.

[1962] (Data processing / calculation) The terminal analyzes the data and displays it in a visual interface.

[1963] (Output) The housing options displayed to the user.

[1964] Step 7:

[1965] The terminal collects emotion data of the user.

[1966] (Input) Facial expressions, voice, operation patterns, etc. when the user browses the suggested options.

[1967] (Data processing / calculation) The terminal collects emotional data through sensors and cameras.

[1968] (Output) Collected emotion data.

[1969] Step 8:

[1970] The server analyzes the emotion data using an emotion engine.

[1971] (Input) Emotion data sent from the device.

[1972] (Data processing / calculation) The server starts the emotion engine and analyzes the emotion data.

[1973] (Output) Analysis result data.

[1974] Step 9:

[1975] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[1976] (Input) Parsed emotion data.

[1977] (Data processing / calculation) Generate prompt sentences for readjustment to the generated AI model.

[1978] (Output) Reprompt sentence to the generative AI model.

[1979] Step 10:

[1980] A generative AI model generates retuned recommendations.

[1981] (Input) The reprompt sent by the server.

[1982] (Data processing / calculation) The generative AI model takes emotion data into account to generate new suggestions.

[1983] (Output) Retuned proposed options.

[1984] Step 11:

[1985] The server sends the retuned proposal to the terminal.

[1986] (Input) The suggested retuning options returned by the generative AI model.

[1987] (Data processing / calculation) The server converts the proposed options into JSON format.

[1988] (Output) Recalibration options data in JSON format.

[1989] Step 12:

[1990] The terminal displays the retuned proposal to the user.

[1991] (Input) Recalibration options data sent by the server in JSON format.

[1992] (Data processing / calculation) The terminal analyzes the data and displays it in a visual interface.

[1993] (Output) The rebalanced housing options displayed to the user.

[1994] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1995] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1996] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1997] [Fourth embodiment]

[1998] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1999] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2000] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2001] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2002] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2003] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2004] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2005] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2006] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2007] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2008] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2009] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2010] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2011] The present invention provides a system that uses generative AI to propose optimal housing options to users considering purchasing or renovating a home. This system collects information entered by the user, creates a user profile based on that information, and the generative AI proposes optimal housing options, and also provides functions such as virtual tours, budget management, cost estimates, and interior design suggestions.

[2012] System Configuration

[2013] The system according to the present invention includes the following main components:

[2014] 1. Terminal - Provides an interface where users can enter information and review suggestions from the system.

[2015] 2. Server - The central system that receives user input, creates a user profile, and executes generative AI-driven suggestions.

[2016] 3. Generative AI model - an algorithm that generates the best housing options based on a user profile.

[2017] 4. Database - Stores user profiles, proposals, virtual tour data, cost estimate data, etc.

[2018] Program processing explanation

[2019] 1. Create a user profile

[2020] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[2021] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[2022] The terminal transmits the input information to the server.

[2023] The server creates a user profile based on the received information and stores it in a database.

[2024] 2. Generative AI suggestions

[2025] The server retrieves the user profile and performs analysis.

[2026] The server makes a request to the generative AI model to generate housing options that match the user's requirements.

[2027] The generative AI model generates multiple proposed properties and renovation plans that match the conditions.

[2028] The generative AI model sends the generated results back to the server.

[2029] The server sends the proposed options to the terminal.

[2030] The terminal displays proposed homes and renovation plans to the user in list form.

[2031] 3. Virtual Tour Feature

[2032] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[2033] The device requests data for the virtual tour from the server.

[2034] The server provides virtual tour data (3D models and VR content).

[2035] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[2036] The user operates the terminal interface to virtually tour the interior of the property.

[2037] 4. Budget management and cost estimation features

[2038] The user selects the budget management tab and enters detailed information about the renovation.

[2039] The terminal transmits the user's input data to the server.

[2040] The server uses the received data to generate a comprehensive cost estimate.

[2041] The server transmits the cost estimate results to the terminal.

[2042] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[2043] 5. Interior design suggestion function

[2044] The user selects the interior design suggestions tab and enters their preferred style and color.

[2045] The terminal transmits the user's input data to the server.

[2046] The server analyzes the data and asks the generative AI model to propose interior designs.

[2047] A generative AI model generates interior design proposals.

[2048] The generative AI model sends the generated suggestions back to the server.

[2049] The server sends the interior design proposal to the terminal.

[2050] The device displays interior design suggestions to the user, providing a concrete image.

[2051] Specific examples

[2052] When a user is considering buying a home, the following sequence of events occurs:

[2053] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[2054] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[2055] 3. The device sends the information to the server and a user profile is created.

[2056] 4. The server generates the optimal property based on the generative AI model.

[2057] 5. The proposed properties are displayed to the user, who can select the property they are interested in and enjoy a virtual tour.

[2058] 6. In addition, you can use the budget management function to check renovation cost estimates and receive interior design suggestions to make your ideal home a reality.

[2059] In this way, by using the system of the present invention, users can efficiently find the home they desire and smoothly make the decision that accompanies it.

[2060] The processing flow will be explained below.

[2061] Step 1:

[2062] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[2063] Step 2:

[2064] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[2065] Step 3:

[2066] The terminal converts the input information into JSON format and sends it to the server.

[2067] Step 4:

[2068] The server analyzes the received information and creates a user profile.

[2069] Step 5:

[2070] The server stores the user profile in a database.

[2071] Step 6:

[2072] The server retrieves the user profile and sends it to the generative AI model.

[2073] Step 7:

[2074] A generative AI model generates the best housing options based on the user's preferences and budget.

[2075] Step 8:

[2076] The generative AI model sends the generated options back to the server.

[2077] Step 9:

[2078] The server converts the proposed options into JSON format and sends it to the device.

[2079] Step 10:

[2080] The terminal displays proposed homes and renovation plans to the user in list form.

[2081] Step 11:

[2082] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[2083] Step 12:

[2084] The terminal requests the virtual tour data from the server.

[2085] Step 13:

[2086] The server provides virtual tour data (3D models and VR content).

[2087] Step 14:

[2088] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[2089] Step 15:

[2090] The user operates the terminal interface to virtually tour the interior of the property.

[2091] Step 16:

[2092] The user selects the budget management tab and enters detailed information about the renovation.

[2093] Step 17:

[2094] The terminal converts the user's input data into JSON format and sends it to the server.

[2095] Step 18:

[2096] The server analyzes the received data and generates a comprehensive cost estimate.

[2097] Step 19:

[2098] The server transmits the cost estimate results to the terminal.

[2099] Step 20:

[2100] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[2101] Step 21:

[2102] The user selects the interior design suggestions tab and enters their preferred style and color.

[2103] Step 22:

[2104] The terminal converts the user's input data into JSON format and sends it to the server.

[2105] Step 23:

[2106] The server analyzes the data and asks the generative AI model to propose interior designs.

[2107] Step 24:

[2108] A generative AI model generates interior design suggestions such as color schemes, furniture placement, and lighting designs.

[2109] Step 25:

[2110] The generative AI model sends the generated suggestions back to the server.

[2111] Step 26:

[2112] The server converts the interior design proposal into JSON format and sends it to the device.

[2113] Step 27:

[2114] The device displays interior design suggestions to the user, providing a concrete image.

[2115] Example 1

[2116] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2117] Traditionally, when considering purchasing or renovating a home, users have to research a lot of information, which requires a lot of effort. It can be difficult to find the best home option, and users are required to manage their budget and propose interior design themselves. This slows down users' decision-making process and complicates the process of finding their ideal home. Therefore, there is a need for a system that allows users to efficiently find their ideal home.

[2118] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2119] In this invention, the server includes a means for collecting information entered by the user, a means for creating a user profile based on the collected information, and a means for the generation AI to generate housing options using the user profile, thereby enabling suggestions to help the user efficiently find their ideal home.

[2120] The server also includes means for providing the generated home options to the user, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, means for proposing interior designs, and means for receiving the proposals and displaying them to the user in a visually easy-to-understand list format, thereby enabling the user to compare and consider multiple home options and receive budget management and interior design proposals while virtually touring the interiors, thereby enabling smooth decision-making.

[2121] Furthermore, the server includes means for creating prompts for the generative AI based on a user profile, means for receiving and analyzing the output of the generative AI model, and means for downloading virtual tour data to the terminal and displaying a VR environment and three-dimensional graphics, thereby enabling the user to receive more specific and personalized home suggestions and providing a seamlessly integrated user experience throughout the entire process.

[2122] "Means for collecting information entered by the user" refers to the function of providing an interface for the user to enter their desired area, budget, size of the home, and other desired conditions, and securely transmitting that information to the server.

[2123] "Means for creating a user profile based on collected information" refers to the function of analyzing the information entered by the user and generating a digital profile that systematically summarizes the user's wishes and requirements.

[2124] "Means by which the generative AI generates housing options using a user profile" refers to the process by which the generative AI model generates optimal housing options based on a user profile.

[2125] "Means for providing users with generated housing options" refers to the function of providing an interface for presenting users with multiple housing options generated by the generative AI.

[2126] "Means for visually experiencing the interior of a home through a virtual tour" refers to a feature that uses virtual reality technology or three-dimensional graphics to allow a user to virtually tour the interior of a proposed home.

[2127] "Means for budget management and cost estimation" refers to a function that provides estimates for renovation and purchase costs based on the budget set by the user and helps the user execute the plan within the budget.

[2128] "Means for suggesting interior design" refers to a function that uses generative AI to suggest optimal interior design ideas based on the user's preferences and style.

[2129] "Means for receiving the proposals and displaying them to the user in a visually easy-to-understand list format" refers to the function of receiving the output from the generative AI and displaying it in a visual list format that is easy for the user to understand.

[2130] "Means for creating prompts for the generative AI based on a user profile" refers to the process of generating input sentences based on information in the user profile that enable the generative AI to make accurate suggestions.

[2131] "Means for receiving and analyzing the output of the generative AI model" refers to the function of receiving the proposed results from the generative AI, analyzing them, and converting them into a format that is useful to the user.

[2132] "Means for downloading virtual tour data to a terminal and displaying a VR environment or three-dimensional graphics" refers to the function of downloading virtual tour data from a server and displaying it as a VR environment or three-dimensional graphics on a terminal.

[2133] The present invention provides a system that uses generative AI to propose optimal housing options to users who are considering purchasing or renovating a home. The main components of this system include a terminal, a server, a generative AI model, and a database. The role of each component and the specific processing are explained below.

[2134] Hardware and software used

[2135] Terminal: A device that provides an interface for users to enter information and view system suggestions, such as a PC, smartphone, or tablet.

[2136] Server: A central computer system that receives user input, creates a user profile, and executes suggestions using generative AI models. This is often a cloud service or dedicated server equipment.

[2137] Generative AI model: An algorithm that generates optimal housing options based on a user profile. For example, generative AI technologies such as OpenAI's GPT-4 are used.

[2138] Database: Stores user profiles, proposals, virtual tour data, cost estimate data, etc. Generally, a relational database such as MySQL or PostgreSQL is used.

[2139] Specific implementation methods of the system

[2140] 1. Enter your user information:

[2141] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[2142] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed" into a form.

[2143] The device sends the entered information to the server. For security reasons, the data is sent using a protocol such as HTTPS.

[2144] 2. Create a user profile:

[2145] The server analyzes the user information received from the terminal and creates a user profile.

[2146] The server stores the created user profile in a database, typically in JSON format.

[2147] 3. Generative AI suggestions:

[2148] The server retrieves the user profile from the database and generates appropriate prompts for the generative AI model, such as "Based on the user profile, please suggest a 3LDK property in Tokyo for up to 80 million yen. Please also include the condition that pets are allowed."

[2149] The generative AI model generates suggestions based on the input prompts and sends them back to the server.

[2150] 4. View Proposals:

[2151] The server sends the suggestions from the generating AI to the terminal.

[2152] The device receives the suggestions and displays them to the user in a visually easy-to-understand format, such as a list containing thumbnail images of properties and links to more detailed information.

[2153] 5. Virtual Tour Feature:

[2154] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[2155] The device requests virtual tour data from the server, receives the data, and displays the VR environment and 3D graphics. For example, this can be achieved using Unity or Unreal Engine.

[2156] 6. Budget management and cost estimation features:

[2157] The user selects the budget management tab and enters detailed information about the renovation.

[2158] The terminal sends the input data to the server, which generates a cost estimate.

[2159] The terminal displays the estimate results to the user, allowing them to confirm whether they fit within their budget.

[2160] 7. Interior design proposal function:

[2161] The user selects the interior design suggestions tab and enters their preferred style and color.

[2162] The device sends the input data to the server, which then requests a generative AI model to generate interior design proposals.

[2163] The terminal receives the proposed results and provides a concrete image to the user.

[2164] Specific examples

[2165] For example, if a user is considering buying a home, they might input the following prompts into a generative AI model:

[2166] "Based on my user profile, please suggest 3 bedroom, 3 bedroom, 3 kitchen, and 3 bedroom apartments in Tokyo priced at under ¥80 million. Please also include the requirement that pets are allowed."

[2167] "Please suggest a renovation plan. My budget is within 10 million yen, and I'd particularly like to renovate the kitchen and bathroom."

[2168] "Please provide an interior design proposal based on the user's preferences. It should be modern in style, with white and blue as the main colors."

[2169] As described above, the system of the present invention is a system that allows users to efficiently find the home they desire and provides a series of support to help them realize their ideal home.

[2170] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2171] Step 1: Enter and submit user information

[2172] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[2173] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed" into the form. This is the user's specific desired conditions and is important data that will be used in subsequent processing by the system.

[2174] The device verifies that the information is in the correct format and sends it to the server using a secure protocol (e.g., HTTPS).

[2175] Input: Information entered by the user (area, budget, size, conditions)

[2176] Output: User information sent to the server

[2177] Step 2: Create a user profile

[2178] The server analyzes the user information received from the terminal and checks whether the format is correct.

[2179] Based on the information received by the server, a user profile is created, which systematically summarizes the user's preferences and is stored in a database in JSON format or similar.

[2180] Input: User information sent from the device

[2181] Output: User profile stored in the database

[2182] Step 3: Generative AI suggestions

[2183] The server retrieves the user profile from the database and performs analysis.

[2184] The server creates a prompt for the generative AI model based on the user profile. For example, it generates a prompt such as, "Based on the user profile, please suggest a 3LDK property in Tokyo for up to 80 million yen. Please also include the condition that pets are allowed."

[2185] The server sends a prompt to the generative AI model, requesting it to generate multiple proposed properties and renovation plans.

[2186] The generative AI model generates suggestions that match the conditions and returns the results to the server.

[2187] Input: User profile retrieved from database

[2188] Output: Home recommendations returned by the generative AI model

[2189] Step 4: View the proposal

[2190] The server analyzes the proposals received from the generation AI and converts them into the required format, such as compiling information such as property name, price, location, and size in JSON format.

[2191] The server sends the proposal to the device.

[2192] The device receives the suggestions and displays them to the user in a visually appealing list format, including thumbnail images of the properties and links to more detailed information.

[2193] Input: Suggestions sent by the generative AI model

[2194] Output: Suggestions presented to the user in a visually friendly format

[2195] Step 5: Virtual Tour Feature

[2196] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[2197] The device sends a request to the server containing the ID of the selected property.

[2198] The server retrieves the virtual tour data from the database and sends it to the device. The virtual tour data is stored as a 3D model or VR content.

[2199] The device receives the data and displays it using a VR-capable application or 3D rendering engine (such as Unity or Unreal Engine).

[2200] Users can operate the device to virtually tour the interior of a property, for example by using the arrow keys on the screen to move between rooms.

[2201] Input: Property ID selected by user

[2202] Output: Virtual tours displayed in VR environments and 3D graphics

[2203] Step 6: Budget management and cost estimation features

[2204] The user selects the budget management tab and enters detailed information about the renovation (for example, kitchen renovation, bathroom renovation requests, etc.).

[2205] The terminal sends the input data to the server.

[2206] The server generates a cost estimate for the renovation based on the data received, using internal algorithms and external APIs to provide an accurate cost estimate.

[2207] The server compiles the estimate results and sends them to the terminal.

[2208] The terminal visually displays the estimate results, allowing the user to check whether they fit within their budget.

[2209] Input: Renovation details entered by the user

[2210] Output: Generated cost estimate results

[2211] Step 7: Interior design suggestion function

[2212] The user selects the interior design suggestion tab and inputs the preferred style and color (e.g., modern style, white and blue).

[2213] The terminal sends the input data to the server.

[2214] The server analyzes the data and asks the generative AI model to propose an interior design, specifically generating a prompt such as, "Please propose a modern interior design with white and blue as the main colors."

[2215] The generative AI model generates interior design proposals and sends them back to the server.

[2216] The server parses the proposal and sends it to the device.

[2217] The device visually displays specific interior design suggestions to the user, such as furniture placement, wall colors, and decoration ideas, using images and text.

[2218] Input: Style and color information entered by the user

[2219] Output: Interior design proposals generated by the generative AI model

[2220] (Application example 1)

[2221] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2222] In modern society, when users purchase or renovate a home, it takes a lot of time and effort to gather a lot of information and find the best option. This makes it difficult for users to efficiently find a home that meets their desired criteria. Users also need the convenience of being able to see the interior of a property without visiting the site. Furthermore, proper budget management, cost estimation, and receiving interior design proposals are also important challenges.

[2223] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2224] In this invention, the server includes means for collecting information input by a user, means for creating a user profile based on the collected information, means for a generation AI to generate home options using the user profile, means for providing the generated home options to the user, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, means for proposing interior designs, and means for presenting multiple options by switching between properties using virtual reality technology. This allows users to efficiently find their desired home, and enables them to use a virtual environment to check the interior of the property and receive budget management and interior design suggestions.

[2225] The "means for collecting information entered by the user" is a function that provides an interface for the user to input desired conditions and requests and transmits them to the server.

[2226] The "means for creating a user profile based on collected information" refers to a function that analyzes collected user information and organizes and stores user attributes in a database based on individual characteristics and requests.

[2227] "Means for the generative AI to generate housing options using user profiles" refers to a function that allows the generative AI to execute an algorithm to propose optimal housing and renovation plans based on user profile data.

[2228] "Means for providing users with generated housing options" means a function that provides users with information about the housing suggested by the generating AI in visual or text format.

[2229] "Means for visually experiencing the interior of a home through a virtual tour" refers to a function that allows a user to virtually tour the interior of a property using virtual reality technology and three-dimensional graphics.

[2230] The "means for budget management and cost estimation" is a function that calculates the costs of renovations and purchases based on the budget information entered by the user and checks whether they are within the budget.

[2231] The "means for proposing interior designs" is a function that uses AI to propose optimal interior designs based on the user's preferences and budget.

[2232] "Means for presenting multiple options by switching between properties using virtual reality technology" refers to a function that allows a user to view different properties while switching between them in a virtual reality environment and compare multiple options.

[2233] MODE FOR CARRYING OUT THE INVENTION

[2234] The present invention relates to a system for streamlining the process of users considering purchasing or renovating a home. This system includes a terminal for users to input information, a server that processes the information and generates proposals, and a database that stores this data. The specific system configuration and processing are described below.

[2235] System Configuration

[2236] 1. Terminal

[2237] This device provides an interface for users to input information such as the desired area, budget, size of the home, etc. The device can be a smartphone or a head-mounted display (HMD).

[2238] 2. Server

[2239] The server receives the information sent by the terminal and creates a user profile, in particular by analyzing the data based on the user's preferences and needs.

[2240] A generative AI model runs on the server and generates optimal housing options based on the user's profile.

[2241] The server transmits the virtual tour data and cost estimate data to the terminal and provides them to the user.

[2242] 3. Database

[2243] The database stores user profiles, generated home options, virtual tour data, cost estimate data, interior design suggestions, and more.

[2244] Program processing explanation

[2245] 1. Create a user profile

[2246] The terminal displays an input form to the user that asks, "Please enter your desired area, budget, size of home, and other desired conditions."

[2247] For example, the user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[2248] The device sends the entered information to the server, which creates a user profile based on the received information and stores it in a database.

[2249] 2. Generative AI suggestions

[2250] The server retrieves the user profile and uses a generative AI model to generate housing options that match the user's preferences.

[2251] The generative AI model generates multiple proposed properties and renovation plans that match the user's criteria and returns the results to the server, which then sends the proposals to the device and provides them to the user.

[2252] 3. Virtual Tour Feature

[2253] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[2254] The terminal requests data for the virtual tour from the server, and the server provides the virtual tour data (3D models and VR content).

[2255] The device downloads the virtual tour data and displays the VR environment and 3D graphics, allowing users to virtually tour the interior of the property by operating the device's interface.

[2256] 4. Budget management and cost estimation features

[2257] The user selects the budget management tab and enters detailed information about the renovation.

[2258] The terminal transmits the user's input data to the server, which uses the received data to generate a comprehensive cost estimate and transmits the result to the terminal.

[2259] The terminal displays the cost estimate results to the user, allowing them to confirm whether the cost is within their budget.

[2260] 5. Interior design suggestion function

[2261] Users select the interior design suggestions tab and enter their preferred style and color.

[2262] The device sends the user's input data to the server, which analyzes the data and requests the generative AI model to propose interior design ideas.

[2263] The generative AI model generates interior design proposals and sends them back to the server, which then sends them to the device to provide the user with a concrete image.

[2264] Specific examples

[2265] If a user is considering buying a home:

[2266] 1. The device will display "Please enter your desired area, budget, home size, and other desired conditions."

[2267] 2. The user enters "Tokyo, 80 million yen, 3LDK, pets allowed."

[2268] 3. The device sends the information to the server, which creates a user profile and stores it in a database.

[2269] 4. The server generates optimal property options based on the generative AI model. The suggested properties are displayed to the user, who selects the property that interests them.

[2270] 5. Users can use the virtual tour feature to visually inspect the property, as well as manage their budget and see cost estimates.

[2271] 6. Finally, you will receive interior design suggestions to help you realize your dream home.

[2272] Example prompt sentence:

[2273] Enter the housing requirements you are looking for.

[2274] Region: Tokyo

[2275] Budget: 80 million yen

[2276] Size of the home: 3LDK

[2277] Other desired conditions:Pets allowed

[2278] In this way, by using the system of the present invention, users can efficiently find the home they desire, and can also use the virtual environment to view the interior of the property and receive budget management and interior design suggestions.

[2279] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2280] Step 1:

[2281] The user inputs their desired conditions. Specifically, the device displays an input form that asks, "Please enter your desired area, budget, home size, and other desired conditions." The user inputs the conditions, and the device sends the information to the server. Based on the input, data on the area, budget, home size, and other desired conditions is collected.

[2282] Step 2:

[2283] The server analyzes the received user information and creates a user profile. The server saves the user profile in a database based on the collected information. The server processes the data to generate the user profile using the entered data such as area, budget, size of the home, and other desired conditions.

[2284] Step 3:

[2285] The server generates housing options using a generative AI model based on the user profile. Specifically, the server inputs the user profile data into the generative AI model and receives a list of optimal housing options as output. This list includes properties and renovation plans that meet the user's criteria.

[2286] Step 4:

[2287] The server sends the generated housing options to the terminal, which displays the proposed housing options in a list format to the user. The output includes information about the proposed home and renovation plan.

[2288] Step 5:

[2289] The user selects a property they are interested in and clicks the virtual tour button. The device requests virtual tour data from the server, and the server sends the virtual tour data (3D models and VR content) to the device. The ID of the property selected by the user is used as input, and the virtual tour data is provided as output.

[2290] Step 6:

[2291] The device receives the virtual tour data and displays it to the user as a VR environment or 3D graphics. Through the device interface, the user can virtually tour the interior of the property, allowing the user to see the interior without actually visiting the property.

[2292] Step 7:

[2293] The user selects the budget management tab and enters detailed information about the renovation. The device sends that information to the server, which generates a cost estimate based on the received data. The detailed information about the renovation is used as input, and a comprehensive cost estimate is generated as output.

[2294] Step 8:

[2295] The server sends the cost estimate results to the terminal, which then displays them to the user, who can check whether they fit within their budget. The cost estimate results show the total cost of the renovation.

[2296] Step 9:

[2297] The user selects the interior design suggestions tab and enters their preferred style and color. The device sends that information to the server, which then inputs the data into a generative AI model to generate interior design suggestions. The user's preferred style and color are used as input, and the interior design suggestions are generated as output.

[2298] Step 10:

[2299] The server sends the generated interior design proposal to the terminal, which then displays the proposal to the user. The user can check the proposed interior design and get a concrete image of it. Detailed information about the interior design proposal is provided as an output.

[2300] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2301] This invention provides a system that combines a conventional home purchase and renovation suggestion system with an emotion engine that recognizes the user's emotions and optimizes the proposal content based on those emotions. This system has the function of analyzing the user's emotions and proposing optimal housing options and interior designs based on those emotions.

[2302] System Configuration

[2303] The system according to the present invention includes the following main components:

[2304] 1. Terminal - Provides an interface where users can input information, review system suggestions, and perform emotion recognition.

[2305] 2. Server - The central system that receives user input, creates a user profile, and executes generative AI-driven suggestions. It also analyzes emotional data using the emotion engine.

[2306] 3. Generative AI model - an algorithm that generates the best housing options based on a user profile.

[2307] 4. Sentiment Engine - An algorithm that analyzes user sentiment and incorporates that data into suggestions.

[2308] 5. Database - Stores user profiles, proposals, virtual tour data, cost estimate data, sentiment data, etc.

[2309] Program processing explanation

[2310] 1. Create a user profile

[2311] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[2312] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[2313] The terminal transmits the input information to the server.

[2314] The server creates a user profile based on the received information and stores it in a database.

[2315] 2. Generative AI suggestions

[2316] The server retrieves the user profile and sends it to the generative AI model.

[2317] A generative AI model generates the best housing options based on the user's profile.

[2318] The generative AI model sends the generated options back to the server.

[2319] The server converts the proposed options into JSON format and sends it to the device.

[2320] The terminal displays proposed homes and renovation plans to the user in list form.

[2321] 3. Emotion Recognition by Emotion Engine

[2322] It provides an interface for devices to recognize user emotions, for example by monitoring the user's facial expressions, voice, and operation patterns.

[2323] Emotional data is collected as users browse suggested options.

[2324] The device transmits the emotion data to the server.

[2325] The server analyzes the emotion data using an emotion engine.

[2326] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[2327] 4. Recalibrate your emotional recommendations

[2328] A generative AI model receives data from the emotion engine and adjusts its suggestions.

[2329] A generative AI model generates reconditioned housing options.

[2330] The generative AI model sends the refinement results back to the server.

[2331] The server sends the retuned proposal to the device.

[2332] The device displays optimized suggestions to the user.

[2333] Specific examples

[2334] When a user is considering buying a home, the following sequence of events occurs:

[2335] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[2336] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[2337] 3. The device sends the information to the server and a user profile is created.

[2338] 4. The server uses the generative AI model to generate the optimal property and displays the proposal to the user.

[2339] 5. The device monitors the user's emotions and collects emotional data.

[2340] 6. The emotion engine analyzes the emotion data and provides data for recalibration to the generative AI model.

[2341] 7. The generative AI model generates new suggestions and displays them back to the user via the server.

[2342] 8. Additionally, users can find their ideal home using virtual tours, budget management, and interior design suggestions.

[2343] In this way, by using the system of the present invention, users can receive more personalized home suggestions that match their emotions and efficiently find their ideal home.

[2344] The processing flow will be explained below.

[2345] Step 1:

[2346] The terminal displays an input form to the user asking, "Please enter your desired area, budget, size of home, and other desired conditions."

[2347] Step 2:

[2348] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[2349] Step 3:

[2350] The terminal converts the input information into JSON format and sends it to the server.

[2351] Step 4:

[2352] The server analyzes the received information and creates a user profile.

[2353] Step 5:

[2354] The server stores the user profile in a database.

[2355] Step 6:

[2356] The server retrieves the user profile and sends it to the generative AI model.

[2357] Step 7:

[2358] A generative AI model generates the best housing options based on the user's profile.

[2359] Step 8:

[2360] The generative AI model sends the generated options back to the server.

[2361] Step 9:

[2362] The server converts the proposed options into JSON format and sends it to the device.

[2363] Step 10:

[2364] The terminal displays proposed homes and renovation plans to the user in list form.

[2365] Step 11:

[2366] The user selects a property of interest from the proposed properties and clicks the virtual tour button.

[2367] Step 12:

[2368] The terminal requests the virtual tour data from the server.

[2369] Step 13:

[2370] The server provides virtual tour data (3D models and VR content).

[2371] Step 14:

[2372] The device downloads the virtual tour data and displays the VR environment and 3D graphics.

[2373] Step 15:

[2374] The user operates the terminal interface to virtually tour the interior of the property.

[2375] Step 16:

[2376] The device monitors the user's facial expressions, voice, and operation patterns to collect emotional data.

[2377] Step 17:

[2378] The device converts the collected emotion data into JSON format and sends it to the server.

[2379] Step 18:

[2380] The server analyzes the emotion data using an emotion engine.

[2381] Step 19:

[2382] Based on the analysis results, the server sends data to the generative AI model to readjust the suggestions.

[2383] Step 20:

[2384] A generative AI model takes emotional data into account and recreates optimized housing options.

[2385] Step 21:

[2386] The generative AI model sends the regenerated options back to the server.

[2387] Step 22:

[2388] The server converts the regenerated proposal into JSON format and sends it to the device.

[2389] Step 23:

[2390] The device redisplays the optimized suggestions to the user.

[2391] Step 24:

[2392] The user checks the re-proposed property and renovation plan.

[2393] Step 25:

[2394] The user selects the budget management tab and enters detailed information about the renovation.

[2395] Step 26:

[2396] The terminal converts the user's input data into JSON format and sends it to the server.

[2397] Step 27:

[2398] The server analyzes the received data and generates a comprehensive cost estimate.

[2399] Step 28:

[2400] The server transmits the cost estimate results to the terminal.

[2401] Step 29:

[2402] The terminal displays the cost estimate results to the user, prompting them to confirm whether the cost is within their budget.

[2403] Step 30:

[2404] The user selects the interior design suggestions tab and enters their preferred style and color.

[2405] Step 31:

[2406] The terminal converts the user's input data into JSON format and sends it to the server.

[2407] Step 32:

[2408] The server analyzes the data and asks the generative AI model to propose interior designs.

[2409] Step 33:

[2410] A generative AI model generates interior design suggestions such as color schemes, furniture placement, and lighting designs.

[2411] Step 34:

[2412] The generative AI model sends the generated suggestions back to the server.

[2413] Step 35:

[2414] The server converts the interior design proposal into JSON format and sends it to the device.

[2415] Step 36:

[2416] The device displays interior design suggestions to the user, providing a concrete image.

[2417] Through this series of steps, users can receive more personalized home suggestions based on their emotions and input information.

[2418] Example 2

[2419] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2420] Conventional home purchasing and renovation suggestion systems are unable to adequately respond to individual users' emotions and preferences, resulting in the significant time and effort required for users to find their ideal home. In particular, there was a lack of technology that could recognize users' emotions in real time and make suggestions accordingly. This made it difficult for users to quickly find the home that best suits them.

[2421] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2422] In this invention, the server includes means for collecting information input by a user, means for creating a user profile based on the collected information, means for a generation AI to generate home options using the user profile, means for providing the generated home options to the user, means for recognizing and collecting user emotions, means for analyzing the collected emotion data and providing the generation AI with data for readjusting the proposal, means for allowing the user to visually experience the interior of the home through a virtual tour, means for performing budget management and cost estimation, and means for suggesting interior designs. This enables personalized proposals based on the user's emotions and preferences, allowing the user to quickly find their ideal home.

[2423] The "means for collecting information entered by the user" is a means that has the function of collecting information such as desired conditions and budget entered by the user through the terminal as data.

[2424] The "means for creating a user profile based on collected information" is a function that generates a profile corresponding to each individual user based on collected information such as the user's desired conditions and budget.

[2425] "Means for generative AI to generate housing options using user profiles" refers to a function in which a generative AI model uses data from user profiles to algorithmically generate appropriate housing and renovation options.

[2426] "Means for providing users with generated housing options" means a function that presents users with housing and renovation options created by a generative AI model.

[2427] "Means for recognizing and collecting user emotions" refers to a function that analyzes the user's facial expressions, voice, operation patterns, etc., and recognizes and collects emotions in real time.

[2428] "Means for analyzing collected emotional data and providing data to the generative AI for readjusting suggestions" refers to a function that analyzes collected emotional data and provides feedback to the generative AI model based on the results to readjust the content of suggestions.

[2429] "Means for visually experiencing the interior of a home through a virtual tour" refers to a function that allows a user to visually experience the interior of a home using virtual reality technology or three-dimensional graphics.

[2430] The "means for budget management and cost estimation" is a function that calculates and manages the total cost of a home or renovation based on the user's budget information.

[2431] The "means for proposing interior designs" has the function of proposing the most suitable interior design based on the user's desired conditions and feelings.

[2432] This invention relates to a system that recognizes a user's emotions and proposes optimal housing options based on those emotions. The system aims to increase user satisfaction by collecting and analyzing the user's emotional data in real time and readjusting the proposals based on the results.

[2433] System Configuration

[2434] The system according to the present invention includes the following main components:

[2435] 1. Device - Provides the interface where users input information, confirm system suggestions, and perform emotion recognition. Specific examples include personal computers, smartphones, and tablets. The device has a web browser or a dedicated application installed.

[2436] 2. Server - This is the central system that receives user input, creates a user profile, and executes generative AI-based suggestions. It also analyzes emotional data using an emotion engine. Specifically, it includes a web server, database server, and AI server.

[2437] 3. Generative AI model - An algorithm that generates optimal housing options based on a user profile. It uses machine learning algorithms to generate multiple housing options.

[2438] 4. Emotion Engine - An algorithm that analyzes user emotions and incorporates that data into suggestions. It analyzes user emotions in real time through facial expression recognition and voice analysis.

[2439] 5. Database - A system for storing user profiles, proposals, virtual tour data, cost estimate data, emotion data, etc. Specifically, a database management system such as MySQL or MongoDB is used.

[2440] Program processing

[2441] Creating a User Profile

[2442] The terminal displays to the user, "Please enter your desired area, budget, size of home, and other desired conditions."

[2443] The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[2444] The terminal transmits the input information to the server.

[2445] The server creates a user profile based on the received information and stores it in a database.

[2446] Generative AI suggestions

[2447] The server retrieves the user profile and sends it to the generative AI model.

[2448] A generative AI model generates optimal housing options based on a user's profile.

[2449] The generative AI model sends the generated options back to the server.

[2450] The server converts the proposed options into JSON format and sends it to the device.

[2451] The terminal displays proposed homes and renovation plans to the user in list form.

[2452] Emotion recognition by emotion engine

[2453] The device provides an interface for recognizing the user's emotions, including software for facial expression recognition using a camera and microphone, and voice analysis.

[2454] Emotional data is collected as users browse suggested options.

[2455] The terminal transmits the emotion data to the server.

[2456] The server analyzes the emotion data using an emotion engine.

[2457] The server sends data to the generative AI model to readjust the suggestions based on the analysis results.

[2458] Recalibrating sentiment-based suggestions

[2459] The generative AI model receives data from the emotion engine and adjusts its suggestions.

[2460] A generative AI model generates reconditioned housing options.

[2461] The generative AI model sends the refinement results back to the server.

[2462] The server sends the retuned proposal to the terminal.

[2463] The terminal displays the optimized suggestions to the user.

[2464] Specific examples

[2465] If a user is considering buying a home, the process goes like this:

[2466] 1. The device will display a screen that says, "Please enter your desired area, budget, home size, and other desired conditions."

[2467] 2. The user enters information such as "Tokyo, 80 million yen, 3LDK, pets allowed."

[2468] 3. The device sends the information to the server and a user profile is created.

[2469] 4. The server uses the generative AI model to generate the optimal property and displays the proposal to the user.

[2470] 5. The device monitors the user's emotions and collects emotional data.

[2471] 6. The emotion engine analyzes the emotion data and provides data for recalibration to the generative AI model.

[2472] 7. The generative AI model generates new suggestions and displays them back to the user via the server.

[2473] Example prompt sentence:

[2474] Please enter your desired area, budget, size of home, and other desired conditions.

[2475] In this way, by using the system of the present invention, users can receive more...

Claims

1. a means for collecting information entered by a user; means for creating a user profile based on the collected information; a means for the AI ​​to generate housing options using the user profile; a means for providing the generated housing options to a user; A means to visually experience the interior of a home through a virtual tour, a means of carrying out budgetary control and cost estimation; A means of proposing interior design, A system including:

2. A means of analyzing user preferences and budgets from the collected information; A means to optimize the housing options proposed based on the analysis results, and The system of claim 1 further comprising:

3. means for performing a virtual tour using virtual reality technology or three-dimensional graphics; The system of claim 1 further comprising:

Images