System

Abstract

To provide a system.SOLUTION: The system includes: generation means for inputting a specific prompt sentence into a generative AI model, thereby automatically generating a blueprint of a housing desired by a user on the basis of user house-related information including the design, the style and the condition of the house and real estate information; means for proposing the housing on the basis of the generated blueprint; means for adjusting the interior design and the layout in the blueprint of the housing on the basis of an emotion engine for recognizing the emotion of the user and the emotion; and means for displaying the adjusted blueprint by using a virtual reality display device.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When users design a home that suits their preferences and wishes, they need to consider a lot of information, making the process complicated. It is also difficult to properly utilize real estate information to design a home. [Means for solving the problem]

[0005] As a means for solving this problem, the system of the present invention includes a generation means for automatically generating a blueprint of a house based on user home-related information including the user's preferred home design, style, and conditions and real estate information by inputting a specific prompt sentence into a generative AI model, a means for proposing the house based on the generated blueprint, an emotion engine for recognizing the user's emotions, a means for adjusting the interior and floor plan included in the blueprint of the house based on the emotions, and a means for displaying the adjusted blueprint using a virtual reality display device. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the disclosed technique will be described below with reference to the accompanying drawings.

[0008] do.

[0009] First, the terms used in the following description will be explained.

[0010] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0011] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0012] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0013] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0014] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0015] [First embodiment]

[0016] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0017] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0018] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0019] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0020] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0021] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0022] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0023] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0024] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0025] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0026] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0027] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0028] "Example 1"

[0029] In one embodiment of the present invention, a user saves an image of a home they like from a social media platform such as Instagram and inputs that image information into the system. The user also inputs desired information into the system, such as their family composition, desired address, price range, whether or not they want to renovate, whether they want a house or an apartment, etc. The system automatically generates a blueprint for the home based on this preference information and desired information.

[0030] "Example 2"

[0031] Furthermore, this system obtains land and building information from real estate information websites and automatically generates house blueprints based on this information. Specifically, it proposes window orientation, size, floor plan, etc., taking into account the shape of the land and building, location conditions, etc.

[0032] "Example 3"

[0033] For example, if a user inputs an image of a modern exterior saved on Instagram and information such as a desire for a detached house in Tokyo for a family of four with a budget of 50 million yen, the system will automatically generate a blueprint for a detached house in Tokyo with a modern exterior based on this information.The system will also suggest window orientation, size, floor plan, etc. based on information on land and buildings in Tokyo obtained from a real estate information website.

[0034] The processing flow of each embodiment will be described below.

[0035] "Example 1"

[0036] Step 1: A user saves an image of a house they like from a social media site such as Instagram.

[0037] Step 2: The user inputs the saved image information into this system.

[0038] Step 3: The user enters desired information into the system, such as their family composition, desired address, price range, whether or not they want to renovate, whether they want a house or an apartment, etc.

[0039] Step 4: The system automatically generates a house blueprint based on this preference and desired information.

[0040] "Example 2"

[0041] Step 1: This system obtains land and building information from a real estate information website.

[0042] Step 2: The system automatically generates a house blueprint based on the acquired land and building information. Specifically, it proposes window orientation, size, floor plan, etc., taking into account the shape of the land and building, location conditions, etc.

[0043] "Example 3"

[0044] Step 1: The user enters an image of a modern exterior they have saved on Instagram, along with information such as a family of four looking for a detached house in Tokyo with a budget of 50 million yen.

[0045] Step 2: Based on this information, the system automatically generates blueprints for a detached house in Tokyo with a modern exterior.

[0046] Step 3: The system proposes window orientation, size, floor plan, etc. based on information about land and buildings in Tokyo obtained from a real estate information website.

[0047] Example 1

[0048] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0049] Conventional home design systems have had difficulty automatically generating blueprints that reflect the user's preferences and wishes. Furthermore, due to a lack of effective means for users to utilize image information acquired from social media, it was not possible to reflect the user's specific preferences in the design. Furthermore, when proposing a home based on the generated blueprints, it was difficult to make proposals that matched the user's wishes.

[0050] The specification process by the specification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving image information saved by the user as input and analyzing this information to identify the user's preferences, means for generating and inputting a prompt sentence to the generative AI model, and means for proposing a house based on the generated blueprint. This makes it possible to automatically generate a house blueprint that reflects the user's specific preferences and wishes, and to propose a house that meets the user's wishes.

[0051] "User preference information" is information about the design and style of a home that the user prefers, and includes images and text data obtained from social media.

[0052] "Desired information" refers to the specific conditions and requirements for the home the user desires, including information such as family composition, desired address, price range, whether or not the home has been renovated, and whether it is a detached house or an apartment.

[0053] "Image Information" refers to image data of a home obtained by a user from social media or other sources and uploaded to the system.

[0054] A "generative AI model" is an artificial intelligence model that automatically generates house blueprints based on a user's preferences and desires, and uses natural language processing and image analysis technology.

[0055] A "prompt sentence" is an instruction sentence input to a generative AI model, and is generated based on the user's preference and desired information.

[0056] A "home blueprint" is a blueprint of a home generated based on the user's preference information and desired information, and includes a specific layout and design.

[0057] A "housing proposal" is a proposal for a house made to a user based on the generated house blueprint, and includes content that matches the user's wishes.

[0058] This invention is based on the premise that users save images of their favorite homes from social media such as Instagram and input the image information into the system. The user also inputs desired information into the system, such as their family composition, desired address, price range, whether or not they want to renovate, whether they want a house or an apartment, etc. Based on this information, the system automatically generates a blueprint for the home.

[0059] Hardware and software used

[0060] The server receives the image information and desired information entered by the user and stores it in a database. Specifically, it uses the following hardware and software:

[0061] Server: High-performance cloud server (e.g., Amazon Web Services, Google Cloud Platform)

[0062] Database: Relational database (e.g., MySQL (registered trademark), PostgreSQL)

[0063] Generative AI models: AI models that use natural language processing and image analysis techniques (e.g., OpenAI's GPT-4 (registered trademark), DALL-E)

[0064] Image analysis software: Computer vision technology (e.g., TENSORFLOW®, PyTorch)

[0065] Data processing and calculation

[0066] The server receives the image file uploaded by the user and the desired information entered, and stores this data in a database. Based on the stored data, it generates and inputs a prompt to the generative AI model. The generative AI model generates a house blueprint based on the prompt and provides it to the user via the server.

[0067] Specific examples

[0068] For example, let's say a user saves an image of a modern home design from Instagram and enters the following preferences:

[0069] Family composition: 4 people (2 adults, 2 children)

[0070] Desired address: Tokyo

[0071] Price range: Under 50 million yen

[0072] Renovation status: Yes

[0073] Detached house or apartment: Detached house

[0074] With this information, the server inputs the following prompt into the generative AI model:

[0075] Based on images of modern-design homes saved by users from Instagram, generate blueprints for homes that match the following desired information:

[0076] Family composition: 4 people (2 adults, 2 children)

[0077] Desired address: Tokyo

[0078] Price range: Under 50 million yen

[0079] Renovation status: Yes

[0080] Detached house or apartment: Detached house

[0081] Based on this prompt, the generative AI model generates a house blueprint that matches the user's wishes and provides it to the user via the server. The user can then review the blueprint received on their device and, if necessary, modify their desired information to generate a new blueprint.

[0082] In this way, it becomes possible to automatically generate house designs that reflect the specific preferences and wishes of the user, and to propose a house that meets the user's wishes.

[0083] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0084] Step 1:

[0085] A user saves an image of a house they like from a social media platform such as Instagram. A user uses a smartphone or computer to find and save an image of a house they like from a social media platform such as Instagram. The input is image data obtained from the social media platform, and the output is an image file saved on the user's device.

[0086] Step 2:

[0087] The user uploads the saved image to the system. The user accesses the system's website or application and uploads the saved image of the house. Specifically, the user clicks the upload button and selects the saved image file. The input is the image file saved on the user's device, and the output is the image data sent to the server.

[0088] Step 3:

[0089] The user inputs desired information such as family composition, desired address, price range, whether or not the property has been renovated, whether it is a detached house or an apartment, etc. The user inputs desired information into the system's input form, such as family composition (e.g., 2 adults, 2 children), desired address (e.g., Tokyo), price range (e.g., under 50 million yen), whether or not the property has been renovated (e.g., renovated), and whether or not it is a detached house or an apartment (e.g., detached house). The input is the desired information entered by the user, and the output is the desired information sent to the server.

[0090] Step 4:

[0091] The server receives image information and desired information from the user and stores it in a database. The server receives image files uploaded by the user and desired information entered, and stores this data in a database. When storing, it associates it with the user ID and manages it. The input is the image information and desired information sent by the user, and the output is the data stored in the database.

[0092] Step 5:

[0093] The server generates and inputs prompt sentences to the generative AI model based on the stored data. The server generates prompt sentences to input to the generative AI model based on the image information and desired information stored in the database. For example, it generates prompt sentences like the following:

[0094] Based on images of modern-design homes saved by users from Instagram, generate blueprints for homes that match the following desired information:

[0095] Family composition: 4 people (2 adults, 2 children)

[0096] Desired address: Tokyo

[0097] Price range: Under 50 million yen

[0098] Renovation status: Yes

[0099] Detached house or apartment: Detached house

[0100] The input is image information stored in the database and desired information, and the output is a prompt sentence that is input into the generative AI model.

[0101] Step 6:

[0102] A generative AI model generates a house blueprint based on a prompt. A generative AI model (e.g., OpenAI's GPT-4 or DALL-E) generates a house blueprint based on a prompt sent from a server. The generative AI model uses image analysis and natural language processing technology to create a blueprint that meets the user's needs. The input is the prompt, and the output is the generated house blueprint.

[0103] Step 7:

[0104] The server sends the generated blueprint to the user's device. The server sends the blueprint received from the generative AI model to the user's device. The user can download or view the blueprint through the system's website or application. The input is the generated house blueprint, and the output is the blueprint sent to the user's device.

[0105] Step 8:

[0106] The user checks the blueprint. The user checks the blueprint received on their terminal. They can check whether the blueprint meets their requirements, and if necessary, they can modify the desired information and generate a new blueprint. The input is the blueprint sent to the user's terminal, and the output is the user's confirmation result.

[0107] (Application example 1)

[0108] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0109] Conventional home design systems have difficulty automatically generating blueprints that reflect a user's preferences and wishes. Especially when a user has a specific image in mind, specialized knowledge is required to reflect that image in the blueprint. Furthermore, when a user checks a home design in a physical store, it is difficult to generate and display blueprints in real time. This leads to problems such as reduced user satisfaction and delayed home purchase decisions.

[0110] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0111] In this invention, the server includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for analyzing a house image taken by the user and extracting its features, means for generating a prompt sentence based on the extracted features and the user's desired information and generating the house blueprint using a generative AI model, and means for presenting the generated blueprint to the user on a display device. This allows a house blueprint that reflects the user's specific image to be generated in real time and can be confirmed in a physical store.

[0112] "User preference information" is information that indicates the user's personal tastes and design preferences for homes.

[0113] "Desired information" is information that indicates the specific requests and conditions that the user has for a home (family composition, desired address, price range, whether or not it has been renovated, whether it is a detached house or an apartment, etc.).

[0114] "Real estate information" refers to information that indicates detailed data about real estate properties (location, price, floor plan, age, etc.).

[0115] A "home blueprint" is a drawing that specifically shows the structure, layout, and design of a home.

[0116] "Means for automatic generation" refers to devices or programs that have the function of automatically creating blueprints using algorithms or AI models based on input information.

[0117] The "means for making a proposal" is a device or program that has the function of making a housing proposal to the user based on the generated design drawings.

[0118] "House images" are photos and image data of houses taken by users.

[0119] The "analyzing means" refers to a device or program that has the function of analyzing input image data and extracting its features.

[0120] A "means for extracting features" is a device or program that has the function of extracting important features from data obtained by image analysis.

[0121] A "prompt sentence" is a text-based input sentence that provides instructions to a generative AI model.

[0122] A "generative AI model" is an artificial intelligence model that generates blueprints and other data based on input prompts.

[0123] A "display device" is a device (such as a display or VR headset) that visually presents the generated design drawing to the user.

[0124] A system for implementing this invention includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for analyzing a house image taken by the user and extracting its features, means for generating a prompt sentence based on the extracted features and the user's desired information and generating a house blueprint using a generative AI model, and means for presenting the generated blueprint to the user via a display device.

[0125] Hardware and software used

[0126] Hardware

[0127] Smartphone or tablet (iOS or ANDROID): Used by the user to take pictures of the home and enter information.

[0128] Smart glasses (e.g., Google Glass®): Used to analyze images taken by the user in real time.

[0129] A large screen display or VR headset (e.g., Oculus Rift): Used to present the generated blueprints to the user.

[0130] software

[0131] Image recognition library (e.g., OpenCV): Used to analyze house images taken by the user and extract their features.

[0132] Generative AI models (e.g., GPT-4, DALL-E): Used to generate house blueprints based on prompts.

[0133] Databases (e.g., Firebase): Used to store and manage user preferences, wishes, and property information.

[0134] A front-end framework (e.g., React Native) is used to build the user interface.

[0135] Processing flow

[0136] 1. User Input

[0137] Users use their smartphone or tablet to take pictures of their preferred homes and upload them to the application, then enter information such as family composition, desired address, price range, whether or not the home has been renovated, and whether they want a detached house or an apartment.

[0138] 2. Image Analysis

[0139] The server uses an image recognition library (OpenCV) to analyze the uploaded house images and extract their features.

[0140] 3. Prompt generation

[0141] The server generates a prompt sentence for the generative AI model (GPT-4) based on the extracted features and the user's desired information.

[0142] Prompt Sentence Examples

[0143] Based on the images and desired information provided by the user, generate a blueprint for a house that meets the following criteria:

[0144] Family composition: 4 people

[0145] Preferred address: Tokyo

[0146] Price range: Under 50 million yen

[0147] Renovation: Yes

[0148] Detached house

[0149] Modern design

[0150] 4. Generate blueprints

[0151] The server uses a generative AI model (DALL-E) to generate a house blueprint based on the prompt.

[0152] 5. Displaying the results

[0153] The generated blueprints are presented to users via a large screen display or VR headset, allowing them to see their ideal home design in real time in a physical store.

[0154] Specific examples

[0155] For example, a user can upload a photo of a modern living room taken with their smartphone and input desired information such as "family size: 4 people, desired address: Tokyo, price range: within 50 million yen, renovation: yes, detached house." Based on this information, the server generates a blueprint of a modern detached house for a family of 4 in Tokyo that can be renovated and costs within 50 million yen, and presents it to the user.

[0156] In this way, users can see their ideal home design in real time at a physical store.

[0157] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0158] Step 1:

[0159] Users use their smartphone or tablet to take pictures of their preferred homes and upload them to the application, then enter information such as family composition, desired address, price range, whether or not the home has been renovated, and whether they want a detached house or an apartment.

[0160] Input: Home image, family composition, desired address, price range, whether it needs to be renovated, desired information such as whether it is a detached house or an apartment, etc.

[0161] Output: Uploaded house images and desired information

[0162] Step 2:

[0163] The server uses an image recognition library (OpenCV) to analyze the uploaded house images and extract their features.

[0164] Input: Uploaded house image

[0165] Output: Extracted image features

[0166] Specific operation: Using an image recognition library, edge detection and color analysis are performed on house images to extract features.

[0167] Step 3:

[0168] The server generates a prompt sentence for the generative AI model (GPT-4) based on the extracted features and the user's desired information.

[0169] Input: extracted image features, desired information

[0170] Output: Generated prompt statement

[0171] Specific operation: The extracted features are combined with the desired information to create a prompt sentence to be input into the generative AI model.

[0172] Step 4:

[0173] The server uses a generative AI model (DALL-E) to generate a house blueprint based on the prompt.

[0174] Input: Generated prompt text

[0175] Output: The generated house blueprint

[0176] Specific operation: A prompt sentence is input into the generative AI model to generate a house blueprint.

[0177] Step 5:

[0178] The server presents the generated blueprints to the user via a large-screen display or VR headset.

[0179] Input: Generated house blueprint

[0180] Output: The design presented to the user

[0181] Specific operation: The generated design is sent to a display or VR headset so that the user can visually check it.

[0182] In this way, users can see their ideal home design in real time at a physical store.

[0183] Example 2

[0184] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0185] Conventional home design systems have had the problem of requiring a great deal of time and effort to reflect the user's preferences and desired information. It was also difficult to efficiently obtain real estate information and automatically generate optimal home design plans based on that information. This made it difficult to quickly provide a home design that satisfied the user.

[0186] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0187] In this invention, the server includes means for acquiring land and building information from a real estate information site, means for storing the acquired information in a data frame and processing the data, means for generating a prompt sentence to be input to a generative AI model based on the processed data, means for automatically generating a house blueprint using the generative AI model, and means for proposing a house based on the generated blueprint, thereby enabling the rapid and efficient provision of a house blueprint that reflects the user's preferences and desired information.

[0188] A "real estate information site" is a website that provides information about land and buildings.

[0189] "Land and building information" refers to detailed data such as the shape of the land, the location of the building, the orientation and size of the windows, and the layout.

[0190] A "data frame" is a two-dimensional data structure consisting of rows and columns, and is used to store and manipulate data.

[0191] "Data processing" is the process of converting acquired data into a form that is easy to analyze and use, and includes filling in missing values ​​and normalizing data.

[0192] A "generative AI model" is a model that uses artificial intelligence to perform a specific task, in this case to automatically generate blueprints for a house.

[0193] A "prompt sentence" is an instruction sentence to be input into the generative AI model, and is generated based on information about the land and building.

[0194] A "house blueprint" is a drawing that shows the floor plan and structure of a house, and serves as the basis for architectural planning.

[0195] A "housing proposal" is a proposal made to the user regarding the design and layout of a house based on the generated blueprint.

[0196] MODE FOR CARRYING OUT THE INVENTION

[0197] This invention relates to a system that acquires land and building information from a real estate information site and automatically generates house blueprints based on this information. A specific embodiment of this system will be described below.

[0198] 1. Program Generation

[0199] The server generates a program to retrieve land and building information from real estate information websites. This program is developed using Python and performs web scraping using libraries such as BeautifulSoup and Selenium.

[0200] 2. Data acquisition and processing

[0201] The server runs the generated program and retrieves land and building information from real estate information websites. Specifically, it collects data such as the shape of the land, the building's location, window orientation, size, and floor plan. The collected data is stored in a data frame using the Pandas library, and any necessary data processing is performed, such as filling in missing values ​​and normalizing the data.

[0202] 3. Prompt generation for the generative AI model

[0203] The server generates prompts to be input into the generative AI model based on the processed data. The prompts include information such as the shape of the land and building, location conditions, window orientation, size, and layout.

[0204] Example prompt sentence:

[0205] Based on the land information for Shibuya Ward, Tokyo, please generate a house blueprint while taking into consideration the following conditions.

[0206] Land shape: Rectangular

[0207] Building location: South facing

[0208] Window orientation: South

[0209] Window size: Large

[0210] Floor plan: 3LDK

[0211] 4. Generate house blueprints

[0212] The server inputs the generated prompt sentence into a generative AI model (e.g., a generative AI model) to generate a house blueprint. The generative AI model then proposes an optimal blueprint based on the prompt sentence.

[0213] 5. Displaying the results

[0214] The server displays the generated house plan on the user's device, where the user can review the proposed plan and request modifications if necessary.

[0215] Specific examples

[0216] If a user wants to generate a house blueprint based on land information for Shibuya Ward, Tokyo, the server inputs the following prompt statement into the generative AI model:

[0217] Example prompt sentence:

[0218] Based on the land information for Shibuya Ward, Tokyo, please generate a house blueprint while taking into consideration the following conditions.

[0219] Land shape: Rectangular

[0220] Building location: South facing

[0221] Window orientation: South

[0222] Window size: Large

[0223] Floor plan: 3LDK

[0224] The generative AI model will then suggest a house blueprint based on the prompt, which will then be displayed on the device for the user to review.

[0225] In this way, the present invention makes it possible to quickly and efficiently provide a house design plan that reflects the user's preferences and desired information.

[0226] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0227] Program processing flow

[0228] Step 1: Obtain property information

[0229] The server retrieves land and building information from real estate information websites using Python and libraries such as BeautifulSoup and Selenium for web scraping.

[0230] Input: URL of real estate information site

[0231] Output: Land and building information (e.g., land shape, building location, window orientation, size, floor plan)

[0232] Specific behavior:

[0233] The server uses Selenium to automatically control the browser and access the specified URL, then parses the HTML using BeautifulSoup to extract the required information.

[0234] Step 2: Data processing

[0235] The server stores the acquired real estate information in a data frame using the Pandas library and performs any necessary data processing, such as filling in missing values ​​and normalizing the data.

[0236] Input: Land and building information

[0237] Output: The processed data frame

[0238] Specific behavior:

[0239] The server converts the retrieved data into a data frame using the Pandas read_html function, then uses the fillna function to impute missing values ​​and the normalize function to normalize the data.

[0240] Step 3: Generate prompts for the generative AI model

[0241] The server generates prompts to be input into the generative AI model based on the processed data. The prompts include information such as the shape of the land and building, location conditions, window orientation, size, and layout.

[0242] Input: The processed data frame

[0243] Output: prompt statement

[0244] Specific behavior:

[0245] The server extracts the necessary information from the data frame and generates a prompt sentence like this:

[0246] Based on the land information for Shibuya Ward, Tokyo, please generate a house blueprint while taking into consideration the following conditions.

[0247] Land shape: Rectangular

[0248] Building location: South facing

[0249] Window orientation: South

[0250] Window size: Large

[0251] Floor plan: 3LDK

[0252] Step 4: Generate the house plan

[0253] The server inputs the generated prompt sentence into a generative AI model (e.g., a generative AI model) to generate a house blueprint. The generative AI model then proposes an optimal blueprint based on the prompt sentence.

[0254] Input: prompt statement

[0255] Output: House blueprint

[0256] Specific behavior:

[0257] The server sends a prompt to the generative AI model's API and receives a blueprint proposal in return. For example, the server sends the prompt using the openai.Completion.create function.

[0258] Step 5: View the results

[0259] The server displays the generated house plan on the user's device, where the user can review the proposed plan and request modifications if necessary.

[0260] Input: House blueprint

[0261] Output: Blueprint displayed on the user's device

[0262] Specific behavior:

[0263] The server formats the generated blueprint in HTML format and sends it to the user's device, where the user can view the blueprint through a browser.

[0264] (Application example 2)

[0265] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0266] Conventional home design systems have difficulty reflecting users' preferences and desired information, and the automatic generation of blueprints based on real estate information is also limited. Furthermore, interior design for physical stores requires specialized knowledge and is not easily performed by ordinary users. For this reason, there is a demand for a system that allows users to easily design homes and stores that meet their desires.

[0267] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for automatically generating an interior design of a physical store based on information acquired from a real estate information provider site, means for creating a prompt sentence for generating the blueprint using a generative AI model, and means for generating the actual blueprint using the generative AI model. This enables users to easily design a house or store that suits their needs.

[0268] "User preference information" is information about the style, function, and design that the user desires in the design of a house or store.

[0269] "Desired information" is information about the specific conditions and requirements that a user desires in the design of a house or store.

[0270] "Real estate information" refers to information relating to the shape, location, area, etc. of land and buildings.

[0271] A "blueprint" is a drawing that shows the floor plan of a house or store, the direction and size of windows, and the interior layout.

[0272] A "real estate information site" is a website that provides information about land and buildings on the Internet.

[0273] "Interior design" refers to planning the layout and design of the interior space of a store or home.

[0274] A "generative AI model" is an algorithm or program that uses artificial intelligence to automatically generate blueprints and designs.

[0275] A "prompt" is an instruction to be input into a generative AI model, and is a sentence that contains the conditions and requirements for generating blueprints and designs.

[0276] A system for implementing the present invention includes a server, a user terminal, and a generative AI model. A specific embodiment of this system will be described below.

[0277] First, the user terminal receives the user's preference information and desired information as input. This information is about the style, function, and design that the user desires in the design of a house or store. The user terminal then transmits this information to the server.

[0278] Next, the server acquires real estate information from a real estate information website. This real estate information includes the shape of the land and building, location conditions, area, etc. The server automatically generates blueprints for homes and stores based on the acquired real estate information.

[0279] The server uses the generative AI model to create a prompt to generate a blueprint. This prompt includes the user's preferences, wishes, and real estate information. For example, the following prompt might be generated:

[0280] "Land shape: Rectangular, Location: Urban area, Window orientation: South facing, Lighting position: Center of ceiling"

[0281] Based on the generated prompt, a generative AI model generates the actual design. For example, OpenAI's GPT-3 (registered trademark) is used as a generative AI model. This model takes the prompt as input and outputs a design.

[0282] The generated blueprints are sent from the server to the user's terminal and presented to the user, who can then check the design of the house or store based on the blueprints and make any necessary modifications.

[0283] This system allows users to easily design homes and stores that meet their needs. Specifically, users can easily generate and check blueprints using a smartphone or computer. This allows users to create designs that meet their needs without specialized knowledge.

[0284] The above is a specific embodiment for carrying out the present invention.

[0285] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0286] Step 1:

[0287] The user terminal receives the user's preference information and desired information as input. The user uses a smartphone or PC to input information about the style, functions, and design desired for the design of a home or store. The input information is saved in the user terminal.

[0288] Step 2:

[0289] The user terminal transmits the input preference information and desired information to the server, where the information is stored in a database.

[0290] Step 3:

[0291] The server obtains real estate information from a real estate information provider site. The server uses an API to send a request to the real estate information provider site and obtains information such as the shape of the land and building, location conditions, and area. The obtained real estate information is stored on the server.

[0292] Step 4:

[0293] The server creates a prompt to generate a blueprint based on the acquired real estate information and the user's preferences and wishes. The prompt includes information such as the shape of the land, location conditions, window orientation, and lighting position. For example, a prompt such as "Land shape: rectangular, location conditions: urban area, window orientation: south-facing, lighting position: center of ceiling" may be generated.

[0294] Step 5:

[0295] The server uses a generative AI model to generate a blueprint using the prompt sentence as input. For example, OpenAI's GPT-3 is used as the generative AI model. After receiving the prompt sentence as input, the generative AI model outputs a blueprint. The generated blueprint is saved on the server.

[0296] Step 6:

[0297] The server sends the generated blueprint to the user's device, which then presents the received blueprint to the user, who can then view it on their smartphone or computer screen.

[0298] Step 7:

[0299] The user can check the design of their home or store based on the presented blueprint and make any necessary modifications. The modified information is sent back to the server, and a new blueprint is generated. This allows the user to realize a design that suits their needs.

[0300] Example 3

[0301] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0302] Conventional home design systems have difficulty automatically generating blueprints that reflect the user's preferences and wishes, and are unable to provide optimal design proposals based on real estate information. For this reason, there is a need to efficiently provide home designs that meet the user's needs.

[0303] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0304] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for sending a prompt message and an image to the generating AI model and generating the blueprint, means for acquiring land and building information from a real estate information provider site, means for proposing an optimal design based on the acquired real estate information, and means for displaying the generated blueprint and the proposed content to the user. This makes it possible to automatically generate a house blueprint that reflects the user's preferences and wishes and to propose an optimal design based on the real estate information.

[0305] "User preference information" is information that indicates the user's personal preferences, such as the design, style, and functions desired in the design of a house.

[0306] "Desired information" refers to specific conditions and requirements that a user desires in a home design, such as family composition, budget, location, and the like.

[0307] "Real estate information" refers to detailed data on land and buildings, such as price, area, and surrounding environment.

[0308] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate blueprints based on user input.

[0309] A "prompt sentence" is a text-based input sentence that provides instructions to a generative AI model.

[0310] A "blueprint" is a drawing that shows the structure, layout, and design of a house.

[0311] A "real estate information site" is an online platform that provides information about land and buildings.

[0312] "Optimal design proposal" refers to proposing the most suitable home design based on the user's preferences, wishes, and real estate information.

[0313] The "display means" refers to a method or device for visually presenting the generated design drawings and proposal contents to the user.

[0314] This invention is a system that automatically generates house blueprints based on user preference information and desired information, and proposes optimal designs based on real estate information. Specific embodiments of this system are described below.

[0315] System configuration

[0316] This system consists of three main elements: a server, a terminal, and a user. The server receives input information from the user, generates blueprints using a generative AI model, and makes optimal design proposals based on real estate information. The terminal provides an interface for users to enter information and check the results. Users access the system through their terminal and enter the necessary information.

[0317] Hardware and software used

[0318] Server: A server with high-performance computing power is required. Specifically, use a cloud-based server (e.g., Amazon Web Services or Google Cloud Platform).

[0319] Terminal: The device through which a user enters information. This can be a computer, tablet, smartphone, or other device that can connect to the internet.

[0320] Generative AI models: As generative AI models, we use advanced artificial intelligence models such as OpenAI's GPT-4 and DALL-E.

[0321] Real estate information sites: Use online platforms (e.g., SUUMO or At Home) to obtain real estate information.

[0322] Data processing and calculation

[0323] 1. User information input: The user accesses the form on a web browser using a device, uploads a modern-looking image saved on Instagram, and then enters their family composition (four people), desired area (Tokyo), and budget (50 million yen).

[0324] 2. Prompt generation: The server receives the information entered by the user and generates a prompt to be input to the generative AI model. Specifically, it generates a prompt like this:

[0325] "Automatically generate blueprints for a detached house in Tokyo for a family of four for less than 50 million yen, based on a modern exterior image saved by a user on Instagram."

[0326] 3. Send to the generative AI model: The server sends the generated prompt and the image uploaded by the user to the generative AI model via an API.

[0327] 4. Blueprint Generation: Based on the received prompt and image, the generative AI model generates a blueprint for a modern-looking house in Tokyo. The blueprint includes details such as window orientation, size, and floor plan. The generated blueprint is then sent back to the server.

[0328] 5. Acquisition of real estate information: The server uses the API of a real estate information provider to acquire information on land and buildings in Tokyo. The acquired information includes land prices, building areas, and surrounding environments.

[0329] 6. Optimal design proposal: Based on the acquired real estate information, the server proposes the optimal window orientation, size, floor plan, etc. for the generated blueprint. For example, by proposing a blueprint with many south-facing windows, a sunny living environment can be provided.

[0330] 7. Displaying the results: The server displays the final design and proposals to the user. The user can view this information in a web browser and make corrections or regenerate it as needed. An interactive UI is used for displaying the results, making it easy for the user to operate.

[0331] Specific examples

[0332] If the user enters the following information:

[0333] Modern exterior image saved from Instagram

[0334] family of 4

[0335] Looking for a detached house in Tokyo

[0336] The budget is 50 million yen

[0337] The server generates the following prompt:

[0338] "Automatically generate blueprints for a detached house in Tokyo for a family of four for less than 50 million yen, based on a modern exterior image saved by a user on Instagram."

[0339] The generative AI model generates a design drawing based on the prompt text and images, and the server proposes the optimal window orientation, size, and floor plan based on data acquired from a real estate information website. The flow of the specification process in Example 3 will be described with reference to Figure 15.

[0340] Step 1:

[0341] The user enters the information.

[0342] Users access a form on a web browser using their device, upload a photo of a modern-looking house they saved on Instagram, and then enter their family composition (four people), desired area (Tokyo), and budget (50 million yen). This information is then sent to the server.

[0343] Input: Images saved on Instagram, family composition, desired area, budget

[0344] Output: User preference and wishes

[0345] Step 2:

[0346] The server generates a prompt.

[0347] The server receives the information entered by the user and generates a prompt to be input to the generative AI model. Specifically, it generates the following prompt:

[0348] "Automatically generate blueprints for a detached house in Tokyo for a family of four for less than 50 million yen, based on a modern exterior image saved by a user on Instagram."

[0349] Input: User preferences and wishes

[0350] Output: The prompt to send to the generative AI model

[0351] Step 3:

[0352] The server sends the prompt text and image to the generative AI model.

[0353] The server sends the generated prompt text and the user-uploaded image to the generative AI model via an API.

[0354] Input: prompt text, user uploaded image

[0355] Output: Input data to a generative AI model

[0356] Step 4:

[0357] A generative AI model generates blueprints.

[0358] The generative AI model generates a blueprint of a modern-looking house in Tokyo based on the prompt text and images it receives. The blueprint includes details such as window orientation, size, and floor plan. The generated blueprint is then sent back to the server.

[0359] Input: prompt text, user uploaded image

[0360] Output: Generated blueprint

[0361] Step 5:

[0362] The server retrieves the property information.

[0363] The server uses the API of a real estate information website to obtain information on land and buildings in Tokyo, including land prices, building areas, and surrounding areas.

[0364] Input: API of real estate information provider

[0365] Output: Retrieved property information

[0366] Step 6:

[0367] The server will make optimal design suggestions.

[0368] Based on the acquired real estate information, the server proposes optimal window orientation, size, and floor plan for the generated blueprint. For example, by proposing a blueprint with many south-facing windows, a sunny living environment can be provided.

[0369] Input: Generated blueprints, acquired real estate information

[0370] Output: Optimal design proposal

[0371] Step 7:

[0372] The server displays the results to the user.

[0373] The server displays the final design and proposals to the user, who can then view the information in a web browser and modify or regenerate it as needed. An interactive UI is used for display, allowing users to easily operate the system.

[0374] Input: Final design, proposal details

[0375] Output: The results that are displayed to the user

[0376] (Application example 3)

[0377] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0378] Conventional home design systems have difficulty automatically generating blueprints that reflect the user's preferences and wishes, and are unable to effectively utilize real estate information to propose blueprints. Furthermore, they are unable to utilize images saved by the user or information from social media, making it difficult to provide blueprints that meet the user's specific needs. This has led to the issue of being unable to increase user satisfaction.

[0379] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0380] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for generating a prompt sentence based on an image saved by the user and generating a blueprint using a generative AI model, and means for proposing window orientation, size, floor plan, etc. based on land and building information acquired from a real estate information website. This enables the automatic generation of blueprints according to the user's specific needs and the effective use of real estate information.

[0381] "User preference information" is information about the design and style desired by the user, and is obtained from social media, saved images, etc.

[0382] "Desired information" is information about the conditions and requirements for the home desired by the user, including specific preferences such as family structure, budget, and area.

[0383] A "home blueprint" is a drawing that shows the exterior of a home, the layout, the orientation and size of windows, etc., and is automatically generated based on the user's preferences and wishes.

[0384] "Real estate information" refers to information about land and buildings, and is obtained from real estate information websites and the like.

[0385] A "generative AI model" is a model that uses artificial intelligence to generate blueprints and proposals from specific input information.

[0386] A "prompt sentence" is an instruction sentence to be input into a generative AI model, and is generated based on the user's preferences and desired information.

[0387] A "real estate information site" is a website that provides information about land and buildings, and users can access and obtain the information.

[0388] "Window orientation, size, floor plan, etc." are important elements in home design and are suggested based on the user's wishes and real estate information.

[0389] A system for implementing this invention includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for generating a prompt sentence based on an image saved by the user and generating a blueprint using a generative AI model, and means for proposing window orientation, size, floor plan, etc. based on land and building information obtained from a real estate information provider site.

[0390] System Program

[0391] The server receives preference and desired information entered by the user via a device such as a smartphone or PC. This information includes images obtained from social media such as Instagram, as well as information such as family composition, budget, and desired area. The server then generates a prompt based on this information. This prompt is then input into a generative AI model, which then generates a blueprint for the home.

[0392] Based on the generated prompt, the generative AI model automatically generates a house blueprint. This blueprint reflects the user's preferences and wishes, including specific exterior and floor plans. Furthermore, the server suggests window orientation, size, floor plan, etc. based on land and building information obtained from real estate information websites.

[0393] Hardware and software used

[0394] This system uses the following hardware and software:

[0395] Hardware: Servers, user devices (smartphones, PCs, etc.)

[0396] Software: Generative AI models (e.g., OpenAI's GPT-3), prompt generators, image capture programs (e.g., requests, PIL)

[0397] Specific examples

[0398] For example, if a user enters the following criteria:

[0399] Instagram Image URL: https: / / example.com / instagram_image.jpg

[0400] Family composition: 4 people family

[0401] Preferred area: Tokyo

[0402] Budget: 50 million yen

[0403] The generated prompt text is:

[0404] Based on a modern exterior image saved by a user on Instagram, the user is looking for a detached house in Tokyo for a family of four with a budget of 50 million yen. Generate a blueprint of a detached house with a modern exterior based on this information.

[0405] When this prompt is input into the generative AI model, the model automatically generates a home blueprint that matches the user's preferences. The generated blueprint reflects the user's desired modern exterior and a floor plan that suits the family composition. Specific suggestions are also made, such as window orientation, size, and floor plan, based on land and building information obtained from real estate information websites.

[0406] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0407] Step 1:

[0408] Users input their preferences and desired information from devices such as smartphones or PCs. This includes image URLs obtained from social media such as Instagram, as well as information such as family composition, budget, and desired area. The input information is sent to the server.

[0409] Input: Instagram image URL, family composition, budget, desired area

[0410] Output: User preferences and wishes sent to the server

[0411] Step 2:

[0412] The server receives the preference and desired information sent by the user. Based on the received information, it processes the data to generate a prompt. Specifically, it obtains the image URL and converts information such as family composition, budget, and desired area into text format.

[0413] Input: User preferences and wishes

[0414] Output: Data for generating prompts

[0415] Step 3:

[0416] The server downloads the image based on the image URL and loads it as an image object. This process uses the requests library and the PIL library.

[0417] Input: Image URL

[0418] Output: Image object

[0419] Step 4:

[0420] The server generates a prompt sentence based on the image object and user information in text format. The generated prompt sentence is an instruction sentence to be input to the generative AI model.

[0421] Input: Image object, user information in text format

[0422] Output: prompt statement

[0423] Step 5:

[0424] The server inputs the generated prompt sentences into a generative AI model to automatically generate a house blueprint, using a generative AI model such as OpenAI's GPT-3.

[0425] Input: prompt statement

[0426] Output: Procedurally generated house blueprint

[0427] Step 6:

[0428] The server acquires information about the land and building from a real estate information website, including the orientation and size of windows, floor plan, etc.

[0429] Input: URL of real estate information site

[0430] Output: Land and building information

[0431] Step 7:

[0432] Based on the acquired real estate information, the server makes specific suggestions for the generated house blueprint, such as window orientation, size, and floor plan.

[0433] Input: Land and building information, automatically generated house blueprint

[0434] Output: House blueprint with concrete proposals

[0435] Step 8:

[0436] The server sends the final design to the user's device and makes a proposal to the user, who can then review the proposed design and modify or regenerate it as necessary.

[0437] Input: Home blueprints with specific proposals

[0438] Output: The final design sent to the user's device

[0439] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0440] "Example 1"

[0441] One embodiment of the present invention incorporates an emotion engine that recognizes the user's emotions and adjusts the home's blueprint based on the user's emotions. Specifically, when the user is feeling happy, the emotion engine suggests bright interior colors and an open floor plan. On the other hand, when the user is feeling depressed, the emotion engine suggests calm interior colors and a floor plan that emphasizes privacy.

[0442] "Example 2"

[0443] The emotion engine also adjusts home suggestions based on the user's emotions: when the user is feeling happy, it suggests luxurious homes, while when the user is feeling depressed, it suggests simple and functional homes.

[0444] "Example 3"

[0445] For example, when a user gets a new job and feels happy, the emotion engine recognizes that joy and automatically generates a blueprint for a luxurious home. This blueprint features large windows, a spacious living room, and high-quality interior materials. On the other hand, when a user loses their job and feels depressed, the emotion engine recognizes that depression and automatically generates a blueprint for a simple, functional home. This blueprint has the minimum number of rooms and functions necessary, and is cost-effective.

[0446] The processing flow of each embodiment will be described below.

[0447] "Example 1"

[0448] Step 1: The emotion engine recognizes the user's emotion.

[0449] Step 2: The emotion engine adjusts the home design based on the user's emotions, suggesting lighter colors and open floor plans when the user is feeling happy.

[0450] Step 3: On the other hand, if the user is feeling depressed, we suggest interiors with calming colors and floor plans that prioritize privacy.

[0451] "Example 2"

[0452] Step 1: The emotion engine recognizes the user's emotion.

[0453] Step 2: The emotion engine tailors the home suggestions based on the user's emotions, specifically suggesting luxurious homes when the user is feeling happy.

[0454] Step 3: On the other hand, if the user is feeling down, we suggest a simple and functional home.

[0455] "Example 3"

[0456] Step 1: When a user gets a new job and feels happy, the emotion engine recognizes that happiness.

[0457] Step 2: The emotion engine automatically generates blueprints for a luxurious home, featuring large windows, a spacious living room, and luxurious interior materials.

[0458] Step 3: On the other hand, if the user loses their job and feels depressed, the emotion engine will recognize that feeling.

[0459] Step 4: The emotion engine automatically generates a simple and functional house blueprint, with the minimum number of rooms and features required, while keeping costs down.

[0460] Example 1

[0461] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0462] Conventional home design systems have difficulty automatically generating blueprints that reflect the user's preferences and desired information. Furthermore, because the blueprints are not adjusted to take the user's emotions into account, user satisfaction cannot be increased. Furthermore, there is a lack of means to effectively utilize information from social media and real estate information sites. This has led to the issue of being unable to realize home designs that meet the diverse needs of users.

[0463] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0464] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a home blueprint based on this information, means for receiving real estate information as input and automatically generating a home blueprint based on this information, means for proposing a home based on the generated blueprint, means for recognizing the user's emotions and adjusting the home blueprint based on the emotions, and means for proposing interior and floor plans based on the user's emotions. This enables the automatic generation of home blueprints that reflect the user's preferences and desired information, and also allows the blueprints to be adjusted taking the user's emotions into consideration, thereby increasing user satisfaction. Furthermore, by effectively utilizing information from social media and real estate information sites, home designs that meet the diverse needs of users can be realized.

[0465] "User preference information" refers to images and text information about homes that a user obtains from social media or other sources on the Internet.

[0466] "Desired information" refers to specific requests entered by the user, such as family composition, desired address, price range, whether or not the property has been renovated, whether it is a detached house or an apartment, etc.

[0467] "Real estate information" refers to detailed property information obtained from real estate information websites and other databases.

[0468] "Home blueprints" refer to drawings of the floor plan, interior, and exterior of a home that are automatically generated based on the user's preferences, wishes, and real estate information.

[0469] "Means for recognizing emotions" refers to algorithms or software that analyze emotions from a user's facial expressions or input text and determine their emotional state.

[0470] "Means for adjusting blueprints" refers to algorithms or software that alter or modify the content of home blueprints based on perceived user sentiment.

[0471] "Means for suggesting interior design and floor plan" refers to algorithms and software that suggest optimal interior design and floor plan based on the user's emotions and desired information.

[0472] "Social media" refers to a platform for users to share information on the Internet.

[0473] "Real estate information site" refers to a website or online service that provides detailed information about properties.

[0474] MODE FOR CARRYING OUT THE INVENTION

[0475] This invention is a system that automatically generates house blueprints based on a user's preference information and desired information, and further adjusts the blueprints taking the user's feelings into consideration. This system is composed of the following elements: a server, a terminal, and a user.

[0476] System configuration

[0477] 1. User operations

[0478] Users save their favorite home images from social media on the Internet and upload them to the system.

[0479] Users input desired information into the system, such as family composition, desired address, price range, whether or not the property needs to be renovated, and whether they want a detached house or an apartment.

[0480] 2. Server Processing

[0481] The server receives house images uploaded by users and extracts image features using image recognition algorithms (e.g., TensorFlow, OpenCV).

[0482] The server analyzes the desired information entered by the user using a natural language processing engine (e.g., GPT-3) and organizes it as structured data.

[0483] The server combines data from image recognition algorithms and natural language processing engines to generate blueprints for the home.

[0484] The server uses an emotion engine to recognize the user's emotions and analyzes the emotions from the user's facial expressions and input text.

[0485] The server adjusts the blueprint based on the user's perceived emotions, suggesting, for example, bright interior colors and an open floor plan if the user is feeling happy.

[0486] The server generates the final adjusted design and provides it to the user.

[0487] Hardware and software used

[0488] Hardware: High-performance server (e.g., server with NVIDIA GPU)

[0489] Software: Image recognition algorithms (e.g., TensorFlow, OpenCV), natural language processing engines (e.g., GPT-3), emotion recognition engines

[0490] Specific examples

[0491] For example, suppose a user uploads an image of a modern-designed home saved from Instagram to the system and enters desired information such as family composition (four-person family), desired address (Tokyo), price range (up to 50 million yen), whether or not it has been renovated (yes), and whether or not it is a detached house or an apartment (detached house).

[0492] The server first uses an image recognition algorithm to extract modern design features from home images, then uses a natural language processing engine to analyze the user's desired information and generate floor plans suitable for a family of four, designs suitable for residential areas in Tokyo, specifications that can be realized within 50 million yen, designs that take renovation into consideration, and plans for detached homes.

[0493] Furthermore, if the emotion engine recognizes the user's emotion as "joy," the server will suggest bright interior colors and an open living room. Finally, the server integrates this information and provides the user with the optimal home design plan.

[0494] Prompt Sentence Examples

[0495] The user entered images of modern-designed homes saved from social media, along with desired information such as family size (four people), desired address (Tokyo), price range (under 50 million yen), whether or not the home has been renovated (yes), and whether or not it is a detached house or condominium (detached house). Based on this information, please generate a blueprint for the home. If the user's emotion is "joy," please suggest a bright interior design and an open floor plan.

[0496] In this way, the system can automatically generate a house blueprint based on the user's preferences and wishes, and further adjust the blueprint to take into account the user's emotions.

[0497] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0498] Step 1:

[0499] The user saves images of their favorite homes and inputs them into the system.

[0500] Specifically, the user downloads a home image of their choice from a social media site on the Internet and uploads the image through the system interface.

[0501] Input: Home images taken from social media

[0502] Output: House images uploaded to the system

[0503] Step 2:

[0504] The user enters desired information into the system.

[0505] Specifically, the user enters desired information such as family composition, desired address, price range, whether the property needs to be renovated, whether it is a detached house or an apartment, etc. through the system interface.

[0506] Input: Family composition, desired address, price range, whether or not it needs to be renovated, whether you want a house or an apartment, and other desired information

[0507] Output: Preferences entered into the system

[0508] Step 3:

[0509] The server analyzes the house image using an image recognition algorithm.

[0510] Specifically, the server receives the uploaded house images and uses image recognition algorithms (e.g., TensorFlow, OpenCV) to extract image features, such as the building's exterior, interior style, and color tone.

[0511] Input: House images uploaded to the system

[0512] Output: Image feature data (building exterior, interior style, color, etc.)

[0513] Step 4:

[0514] The server analyzes the desired information using a natural language processing engine.

[0515] Specifically, the server analyzes the desired information entered by the user using a natural language processing engine (e.g., GPT-3) and organizes it as structured data. For example, it understands information such as family composition, desired address, and price range, and stores it in a database.

[0516] Input: Preferences entered into the system

[0517] Output: Structured preference data

[0518] Step 5:

[0519] The server integrates the analysis results and generates a blueprint for the house.

[0520] Specifically, the server combines data obtained from image recognition algorithms and natural language processing engines to generate blueprints for a home, including floor plans, interiors, and exteriors based on the user's preferences and wishes.

[0521] Input: Image feature data, structured desired information data

[0522] Output: House blueprint

[0523] Step 6:

[0524] The server uses an emotion engine to recognize the user's emotion.

[0525] Specifically, the server uses an emotion engine to recognize the user's emotions, analyzing the text and facial expression data entered by the user into the system to determine the user's current emotional state.

[0526] Input: User text input, facial expression data

[0527] Output: User's emotional state data

[0528] Step 7:

[0529] The server adjusts the blueprint based on the user's emotions.

[0530] Specifically, the server adjusts the blueprint based on the user's emotions. For example, if the user is feeling happy, it will suggest bright interior colors and an open floor plan. On the other hand, if the user is feeling depressed, it will suggest calm interior colors and a floor plan that prioritizes privacy.

[0531] Input: User emotional state data, house blueprints

[0532] Output: Adjusted house blueprint

[0533] Step 8:

[0534] The server provides the final design to the user.

[0535] Specifically, the server generates a final, adjusted design drawing and provides it to the user, who can review the drawing through the system interface and provide feedback as needed.

[0536] Input: Adjusted house blueprint

[0537] Output: The final design provided to the user

[0538] (Application example 1)

[0539] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0540] Conventional home design systems can generate blueprints based on the user's preferences and desired information, but they have the problem of not being able to adjust the blueprints to take the user's emotions into account. Also, when users consult about home design or renovation in a physical store, it is difficult to make suggestions that reflect their emotions in real time. This has led to the issue of not being able to increase user satisfaction.

[0541] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0542] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for recognizing the user's emotions and adjusting the house blueprint based on the emotions, and means for analyzing the user's facial expressions using a smart device and recognizing emotions, thereby enabling the generation and proposal of a house blueprint that reflects the user's emotions in real time.

[0543] "User preference information" refers to images of homes that the user has acquired from social media such as Instagram, and information indicating the user's personal preferences.

[0544] "Desired information" is information indicating the user's specific requests, such as desired family composition, address, price range, whether or not the property has been renovated, whether it is a detached house or an apartment, etc.

[0545] "Real estate information" refers to detailed information such as the location, price, layout, and age of the property, obtained from a real estate information website.

[0546] The "automatic blueprint generation means" refers to a system or algorithm for automatically generating a blueprint for a house based on the user's preference information, desired information, and real estate information.

[0547] The "proposal means" is a system or algorithm for proposing a house to the user based on the generated design drawings.

[0548] An "emotion recognizer" is a system or algorithm that recognizes a user's emotions and adjusts the house blueprint based on those emotions.

[0549] A "smart device" is a device, such as a smartphone or smart glasses, that analyzes a user's facial expressions and recognizes their emotions.

[0550] "Facial expression analysis means" refers to a system or algorithm that uses a smart device to analyze a user's facial expressions and recognize their emotions.

[0551] The system for implementing this invention automatically generates a house blueprint based on a user's preference information, desired information, and real estate information, and adjusts the blueprint by recognizing the user's emotions. Specific embodiments are described below.

[0552] System Configuration

[0553] 1. Hardware:

[0554] Smart devices: Devices such as smartphones and smart glasses that analyze the user's facial expressions and recognize emotions.

[0555] Server: A server for data processing and blueprint generation.

[0556] 2. Software:

[0557] Emotion recognition model: A machine learning model for analyzing a user's facial expressions and recognizing their emotions (e.g., an emotion recognition model using Keras).

[0558] Blueprint generation algorithm: An algorithm that automatically generates house blueprints based on the user's preferences, desires, and real estate information.

[0559] Data Acquisition Module: A module for acquiring necessary information from social media and real estate information sites.

[0560] Processing flow

[0561] 1. Enter your preferences and wishes:

[0562] Users upload images of homes saved from social media such as Instagram to the app and enter information such as family composition, desired address, price range, whether it has been renovated, and whether it is a detached house or an apartment.

[0563] 2. Obtaining real estate information:

[0564] The server obtains detailed information such as the location, price, layout, and age of the property from a real estate information site.

[0565] 3. Emotion recognition:

[0566] The smart device is used to analyze the user's facial expressions and recognize the user's emotions using an emotion recognition model.

[0567] 4. Automatic generation of blueprints:

[0568] The server automatically generates house blueprints using a blueprint generation algorithm based on the user's preference information, desired information, real estate information, and recognized emotion information.

[0569] 5. Suggestion:

[0570] Based on the generated blueprints, the system makes housing proposals to the user, including proposals for interior design and layout based on the user's emotions.

[0571] Specific examples

[0572] For example, a user can upload an image saved from Instagram to the app and input their desired address and price range. The app then analyzes the user's facial expressions through smart glasses and recognizes their emotions. Based on this information, the server automatically generates blueprints and proposes them to the user.

[0573] Prompt Sentence Examples

[0574] Users upload a photo of a home they have saved from Instagram and enter information such as family composition, desired address, price range, whether it has been renovated, whether it is a detached house or an apartment, etc. The system analyzes facial expressions through smart glasses and recognizes emotions. Based on this information, it automatically generates the optimal home blueprint.

[0575] In this way, a home design assistant system based on the user's emotions and desired information can be realized.

[0576] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0577] Step 1:

[0578] The user uploads an image of a house saved from a social media site such as Instagram to the device.

[0579] Input: Image file of a house

[0580] Output: Uploaded image data

[0581] Specific operation: A user uploads a saved image of a house to the application using a smartphone or smart glasses. The application then sends the image data to the server.

[0582] Step 2:

[0583] The user inputs desired information such as family composition, desired address, price range, whether or not the property has been renovated, and whether or not they want a detached house or an apartment into the terminal.

[0584] Input: Family composition, address, price range, whether renovated, type of home

[0585] Output: User preference data

[0586] Specific operation: The user enters the desired information into the application's input form and presses the submit button. The application then sends the entered data to the server.

[0587] Step 3:

[0588] The server obtains detailed information such as the property's location, price, floor plan, and age from a real estate information site.

[0589] Input: API of real estate information provider

[0590] Output: Real estate information data

[0591] Specific operation: The server calls the API of the real estate information provider site to obtain the required real estate information. The obtained data is stored in an internal database.

[0592] Step 4:

[0593] The terminal analyzes the user's facial expressions using a smart device and recognizes the user's emotions using an emotion recognition model.

[0594] Input: User facial expression image

[0595] Output: User emotion data

[0596] Specific operation: The camera on the smart device captures the user's facial expression and sends the image data to the server. The server then analyzes the facial image using an emotion recognition model and recognizes the user's emotion.

[0597] Step 5:

[0598] The server automatically generates a house blueprint using a blueprint generation algorithm based on the user's preference information, desired information, real estate information, and emotional information.

[0599] Input: User preference information, desired information, real estate information, emotional information

[0600] Output: Procedurally generated house blueprint

[0601] Specific operation: The server integrates all input data and executes the blueprint generation algorithm, which generates blueprints taking into account the interior and floor plan according to the user's emotions.

[0602] Step 6:

[0603] The server proposes a house to the user based on the generated blueprint.

[0604] Input: Procedurally generated house blueprint

[0605] Output: Suggestions to the user

[0606] Specific operation: The server presents the generated blueprint to the user and proposes interior and floor plans according to the user's emotions. The user can confirm the proposals through the application.

[0607] Example 2

[0608] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0609] Conventional home design systems can generate blueprints based on the user's preferences and desired information, but they have the problem of not being able to make proposals that take the user's emotions into account. Furthermore, it is difficult to effectively utilize real estate information when designing a home, making it impossible to make optimal proposals for the user. Furthermore, there is a need to improve user satisfaction by making home proposals that reflect the user's emotions.

[0610] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0611] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, and means for analyzing the user's emotions and adjusting the proposed house based on the analysis results. This makes it possible to propose an optimal house blueprint based not only on the user's preferences and desired information but also on their emotions.

[0612] "User preference information" is information that indicates the user's personal preferences and wishes regarding housing.

[0613] "Desired information" is information that indicates the specific conditions and requests that the user has for a house.

[0614] "Real estate information" refers to information that includes detailed data on the shape, location, price, etc. of land and buildings.

[0615] A "blueprint" is a drawing that shows the layout and structure of a house, as well as the orientation and size of windows.

[0616] A "proposal" is a specific plan for the design and layout of a house that is provided to the user.

[0617] "Analyzing emotions" means identifying and evaluating a user's emotional state from their facial expressions, behavior, input data, etc.

[0618] "Adjusting" means changing and optimizing the proposal based on the analysis results.

[0619] This invention is a system that automatically generates house blueprints and proposes optimal housing by taking into consideration user preference information, desired information, real estate information, and the user's emotions. Specific embodiments of this system are described below.

[0620] System configuration

[0621] 1. Acquisition of real estate information

[0622] The server obtains information about land and buildings from a real estate information website. In this case, the server collects data using a specific API. For example, it uses the API of the real estate information website.

[0623] 2. Data analysis and processing

[0624] The server analyzes the acquired land and building information and extracts data such as shape and location conditions, using a data analysis library.

[0625] 3. Automatic generation of house blueprints

[0626] The server automatically generates a house blueprint based on the analyzed data. Specifically, it takes into account the shape of the land and the location conditions, and suggests window orientation, size, floor plan, etc. This process uses the design software's API.

[0627] 4. Emotional Engine Adjustment

[0628] The device analyzes the user's emotions using an emotion engine, which uses an emotion analysis API. If the user is feeling happy, the device will suggest a luxurious home. On the other hand, if the user is feeling depressed, the device will suggest a simple and functional home.

[0629] Specific examples

[0630] Example 1: Getting real estate information

[0631] The server uses the API of a real estate information site to obtain land information for a specific area. For example, it sends an API request like the following:

[0632] "Take the land information for San Francisco and generate blueprints that suggest luxury homes if the user is happy, or simple homes if the user is depressed."

[0633] Example 2: Data analysis and processing

[0634] The server analyzes the acquired data using a data analysis library, for example to extract information about the shape of the land and its location, and prepares it for use in the next step.

[0635] Example 3: Automatic generation of house blueprints

[0636] The server generates blueprints using the design software's API, proposing things like window orientation, size, and floor plan, taking into account the shape of the land and the location conditions.

[0637] Example 4: Adjustment by Emotion Engine

[0638] The device uses an emotion analysis API to analyze the user's emotions, suggesting, for example, a luxurious home if the user is happy, or a simple home if the user is depressed.

[0639] In this way, it is possible to propose optimal house plans that are based not only on the user's preferences and desired information, but also on their emotions. This system can improve user satisfaction.

[0640] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0641] Step 1:

[0642] The server retrieves land and building information from a real estate information website. Specifically, the server sends an API request and receives JSON data containing land information for the specified area. The input is the API request parameters (e.g., area, property type), and the output is the retrieved real estate information JSON data.

[0643] Step 2:

[0644] The server converts the acquired JSON data into a data frame using a data analysis library. Specifically, the server reads the JSON data using the pandas library and converts it into a data frame. The input is the acquired JSON data, and the output is the real estate information in data frame format.

[0645] Step 3:

[0646] The server extracts the necessary data from the data frame. Specifically, it extracts information such as the shape and location of the land and prepares it for use in the next step. The input is real estate information in data frame format, and the output is the extracted data on the shape and location of the land.

[0647] Step 4:

[0648] The server uses the design software's API to generate a house blueprint. Specifically, it takes into account the shape of the land and the location conditions and proposes window orientation, size, floor plan, etc. The input is the extracted data on the shape of the land and the location conditions, and the output is the generated house blueprint.

[0649] Step 5:

[0650] The device uses an emotion analysis API to analyze the user's emotions. Specifically, it identifies and evaluates the user's emotional state from their facial expressions, behavior, and input data. The input is the user's image and text data, and the output is analyzed emotional data.

[0651] Step 6:

[0652] The device adjusts the housing suggestions based on the analysis results. Specifically, it suggests a luxurious home if the user is happy, and a simple home if the user is depressed. The input is the analyzed emotion data and the generated home blueprint, and the output is the adjusted home suggestion.

[0653] In this way, by clarifying the specific operations and inputs and outputs performed at each processing step, the processing flow of the system program has been explained in detail.

[0654] (Application example 2)

[0655] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0656] Conventional home design systems were able to automatically generate blueprints based on user preferences, desired information, and real estate information, but they were unable to adjust proposals based on the user's emotions or display blueprints using virtual reality. This made it difficult to provide home proposals that were in tune with the user's emotions or a more realistic experience. This led to the issue of being unable to increase user satisfaction.

[0657] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0658] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for receiving user emotion information as input and adjusting the house proposal based on this information, and means for displaying the generated blueprint using a virtual reality display device. This makes it possible to adjust the house proposal based on the user's emotion, and provides a realistic experience using virtual reality.

[0659] "User preference information" is information that indicates the user's personal preferences and wishes regarding housing.

[0660] "Desired information" is information that indicates the specific conditions and requests that the user has for a house.

[0661] "Real estate information" refers to information that includes detailed data about land and buildings.

[0662] A "house blueprint" is a drawing that shows in detail the layout, structure, and facilities of a house.

[0663] "Emotion information" is information that indicates the user's current emotional state.

[0664] A "virtual reality display device" is a device for visually displaying a virtual space.

[0665] "Automatic generation means" refers to a device or program that has the function of automatically creating a design drawing based on input information.

[0666] The "means for adjusting the proposal" refers to a device or program that has the function of changing and optimizing the proposal content based on the user's emotional information.

[0667] The "display means" refers to a device or program that has the function of visually presenting the generated design drawing to the user.

[0668] The system for implementing this invention automatically generates a blueprint of a house based on the user's preference information, desired information, real estate information, and emotional information, and presents it to the user using a virtual reality display device. Specific embodiments are described below.

[0669] System Configuration

[0670] The system consists of the following main components:

[0671] 1. User terminal: A device such as a smartphone or head-mounted display that collects user input information and displays it in virtual reality.

[0672] 2. Server: Receives the user's preference information, desired information, real estate information, and emotional information, and automatically generates a house blueprint.

[0673] 3. Emotion engine: Analyzes the user's emotional information and adjusts housing suggestions.

[0674] 4. Design generation engine: Generates house blueprints based on real estate information and the user's preferences and wishes.

[0675] 5. Virtual reality display device: The generated design drawing is displayed in a virtual reality space.

[0676] Program processing

[0677] The server processes the data in the following steps:

[0678] 1. Data acquisition: Obtain preference information, desired information, and real estate information from the user's device. Obtain user emotion information using the emotion engine.

[0679] 2. Blueprint generation: Using a design generation engine, a blueprint for the house is automatically generated based on the acquired information.

[0680] 3. Proposal adjustment: Using the emotion engine, we adjust the housing proposal based on the user's emotion information.

[0681] 4. Virtual reality display: The generated design drawing is presented to the user using a virtual reality display device.

[0682] Hardware and software used

[0683] Hardware: Smartphones, head-mounted displays, servers

[0684] Software: EmotionEngine, DesignGenerator, VRDisplay

[0685] Specific examples

[0686] For example, if a user experiences home design using a smartphone, a luxurious home will be suggested when the user is happy, and a simple and functional home will be suggested when the user is depressed.The user can wear a head-mounted display and experience the generated blueprints in a realistic virtual reality space.

[0687] Prompt Sentence Examples

[0688] "Generate blueprints that suggest luxury homes when the user is happy."

[0689] "Generate blueprints that suggest simple and functional homes for users when they're feeling down."

[0690] In this way, it is possible to provide a home proposal that responds to the user's emotions and a realistic experience using virtual reality.

[0691] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0692] Step 1:

[0693] The user terminal receives the user's preference information and desired information as input. The user inputs their preferences and specific requests for housing using a smartphone or head-mounted display. This information is then sent to the server.

[0694] Input: User's preference information, desired information

[0695] Output: User preference information and desired information sent to the server

[0696] Step 2:

[0697] The server obtains real estate information from real estate information websites, accessing the websites via API and collecting detailed data on land and buildings.

[0698] Input: URL of real estate information site

[0699] Output: Retrieved property information

[0700] Step 3:

[0701] The user device acquires the user's emotional information using an emotion engine. It analyzes the user's facial expressions and voice to detect their current emotional state. The emotional information is then sent to the server.

[0702] Input: User's facial expression, voice

[0703] Output: Emotion information sent to the server

[0704] Step 4:

[0705] The server uses a design generation engine to automatically generate house blueprints based on the acquired preference information, desired information, and real estate information. The design generation engine analyzes this information and designs the optimal floor plan and structure.

[0706] Input: User preferences, wishes, real estate information

[0707] Output: The generated house blueprint

[0708] Step 5:

[0709] The server uses an emotion engine to tailor the home suggestions based on the user's emotional information, for example, suggesting luxurious homes if the user is happy, and simple and functional homes if the user is depressed.

[0710] Input: Generated house blueprint, emotion information

[0711] Output: Adjusted housing proposals

[0712] Step 6:

[0713] The server uses a virtual reality display device to present the generated blueprint to the user, who can then wear a head-mounted display and experience the blueprint in a realistic virtual reality space.

[0714] Input: Adjusted housing proposals

[0715] Output: House blueprint displayed in virtual reality space

[0716] In this way, it is possible to provide a home proposal that responds to the user's emotions and a realistic experience using virtual reality.

[0717] Example 3

[0718] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0719] Conventional home design systems have had the problem that it is difficult to automatically generate blueprints that reflect the user's preferences and desired information, and generating blueprints that take real estate information into account is also time-consuming. Furthermore, because they are unable to generate blueprints that take the user's emotional state into account, it is not possible to increase the user's psychological satisfaction. There is a need for a system that can solve these problems and automatically generate home blueprints that meet the diverse needs of users.

[0720] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0721] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, and means for recognizing the user's emotional state and adjusting the house blueprint in accordance with the emotional state. This makes it possible to automatically generate a house blueprint that takes into account the user's preference, desired information, real estate information, and even the emotional state.

[0722] "User preference information" is information about the user's preferred designs and styles, and is obtained from social media, etc.

[0723] "Desired information" is information relating to specific requirements such as the location of the house desired by the user, budget, and family composition.

[0724] "Real estate information" refers to information about land and buildings obtained from real estate information websites.

[0725] "Emotional state" is information that indicates the user's current psychological state and is recognized by the emotion engine.

[0726] A "blueprint" is a drawing that shows the structure, floor plan, window orientation and size of a house, etc.

[0727] "Automatic generation" means that the system automatically creates blueprints based on the user's input, real estate information, and emotional state.

[0728] "Proposal" refers to showing the user a specific house design and layout based on the generated blueprint.

[0729] MODE FOR CARRYING OUT THE INVENTION

[0730] This invention is a system that automatically generates house blueprints based on a user's preference information, desired information, real estate information, and emotional state, and proposes the blueprints to the user. A specific embodiment of this system is described below.

[0731] Hardware and software used

[0732] Hardware: Server, user terminal (PC, smartphone)

[0733] Software: Generative AI models (e.g., GPT-4), emotion recognition engines, database management systems (e.g., MySQL), real estate listing site APIs

[0734] System Operation Overview

[0735] 1. Enter your user information

[0736] Users use the device to enter information such as images saved on Instagram, family composition, desired home location (within Tokyo), and budget (50 million yen).

[0737] Example: "We are a family of four looking for a modern-looking house in Tokyo with a budget of ¥50 million."

[0738] 2. Data submission and analysis

[0739] The terminal transmits the input information to the server.

[0740] The server analyzes the received information and inputs it as a prompt sentence into the generative AI model.

[0741] Example prompt: "Generate a blueprint based on a photo of a modern exterior that a user saved from Instagram, describing a family of four looking for a detached house in Tokyo with a budget of ¥50 million."

[0742] 3. Generate blueprints

[0743] The server inputs a prompt statement into the generative AI model and generates a blueprint.

[0744] The server suggests window orientation, size, floor plan, etc. based on information about land and buildings in Tokyo obtained from a real estate information website.

[0745] 4. Emotion recognition and blueprint adjustment

[0746] The server uses an emotion engine to recognize the user's emotional state.

[0747] The server adjusts the blueprint based on the results of the emotion engine.

[0748] Example prompt: "The user is excited about their new job. Generate blueprints for a luxurious home with large windows, a spacious living room, and high-quality interior materials."

[0749] 5. Providing blueprints

[0750] The server transmits the generated design drawing to the user terminal.

[0751] The terminal displays the received design drawing to the user.

[0752] Specific examples

[0753] User input: "We are a family of four looking for a modern-looking house in Tokyo with a budget of ¥50 million."

[0754] Prompt: "Generate a blueprint based on a user's saved Instagram image of a modern exterior, a family of four looking for a detached house in Tokyo with a budget of ¥50 million."

[0755] Emotion-aware prompt: "The user is excited about their new job. Generate blueprints for a luxurious home with large windows, a spacious living room, and high-quality interior materials."

[0756] This system enables the automatic generation of house design plans that take into account the user's preferences, desired information, real estate information, and even emotional state. This allows for house designs that meet the diverse needs of users. The flow of the specific processing in Example 3 will be described with reference to FIG. 21.

[0757] Step 1:

[0758] Entering user information

[0759] Users use their device to enter information such as images saved on Instagram, family composition, desired home location (within Tokyo), and budget (50 million yen).

[0760] Input: User preferences and wishes

[0761] Output: The entered information is saved on the device.

[0762] Specific operation: The user enters information into the input form on the terminal and clicks the "Submit" button.

[0763] Step 2:

[0764] Data transmission and analysis

[0765] The terminal transmits the input information to the server.

[0766] Input: Information entered by the user

[0767] Output: User information sent to the server

[0768] Specific operation: The device uses an HTTP request to send input data to the server.

[0769] The server analyzes the received information and inputs it as a prompt sentence into the generative AI model.

[0770] Input: User information sent from the device

[0771] Output: Prompt sentence to be input to the generative AI model

[0772] What it does: The server analyzes the data and generates a prompt like this: "Generate a blueprint based on a photo of a modern exterior that the user saved on Instagram, a family of four looking for a detached house in Tokyo, and a budget of 50 million yen."

[0773] Step 3:

[0774] Blueprint generation

[0775] The server inputs a prompt statement into the generative AI model and generates a blueprint.

[0776] Input: prompt statement

[0777] Output: Generated blueprint data

[0778] Specific operation: The server sends a prompt to a generative AI model (e.g., GPT-4) and receives the blueprint data returned by the model.

[0779] The server suggests window orientation, size, floor plan, etc. based on information about land and buildings in Tokyo obtained from a real estate information website.

[0780] Input: Information obtained from real estate information site

[0781] Output: Proposed window orientation, size, floor plan, etc.

[0782] Specific operation: The server uses the API to obtain real estate information and reflects it in the blueprint.

[0783] Step 4:

[0784] Emotion recognition and blueprint adjustment

[0785] The server uses an emotion engine to recognize the user's emotional state.

[0786] Input: User emotion data

[0787] Output: Perceived emotional state

[0788] Specific operation: The server sends the user's emotional data to the emotion engine and analyzes the emotional state.

[0789] The server adjusts the blueprint based on the results of the emotion engine.

[0790] Input: Perceived emotional state

[0791] Output: Adjusted blueprint

[0792] Specific behavior: The server receives the results of the emotion engine and generates a prompt like the following: "The user is excited about his new job. Please generate blueprints for a luxurious home with large windows, a spacious living room, and high-quality interior materials."

[0793] Step 5:

[0794] Providing blueprints

[0795] The server transmits the generated design drawing to the user terminal.

[0796] Input: Generated blueprint data

[0797] Output: Blueprint sent to user device

[0798] Specific operation: The server sends the blueprint data to the user terminal as an HTTP response.

[0799] The terminal displays the received design drawing to the user.

[0800] Input: Blueprint data sent from the server

[0801] Output: The blueprint displayed to the user

[0802] Specific operation: The terminal analyzes the received blueprint data and displays it on the user interface.

[0803] (Application example 3)

[0804] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0805] Conventional home design systems have difficulty automatically generating blueprints that reflect the user's preferences and desired information, and proposals based on real estate information are also limited. Furthermore, they lack the means to generate blueprints that take the user's emotional state into account, or to visually confirm the generated blueprints as 3D models. This makes it difficult to increase user satisfaction.

[0806] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0807] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for receiving the user's emotional state as input and automatically generating a house blueprint based on this, and means for displaying the generated blueprint as a 3D model. This enables the automatic generation of a house blueprint that reflects the user's preferences, wishes, and emotional state, and visual confirmation of the blueprint.

[0808] "User preference information" is information about the user's preferred designs and styles, and is obtained from social media and image storage services.

[0809] "Desired information" is information about the conditions and specifications of the house desired by the user, including family composition, budget, location, and the like.

[0810] "Real estate information" refers to information about land and buildings obtained from real estate information websites, including details such as price, area, and location.

[0811] "Emotional state" is information that indicates the user's current feelings and mood, and includes emotions such as joy and sadness.

[0812] A "blueprint" is a drawing that shows the structure, layout, and design of a house, and is automatically generated based on the user's preferences, wishes, real estate information, and emotional state.

[0813] A "3D model" is a three-dimensional visual model created based on blueprints, allowing users to see the exterior and interior of a house in three dimensions.

[0814] "Automatic generation" is the process by which the system automatically creates blueprints and 3D models based on user input and acquired data.

[0815] "Proposal" refers to the act of showing the user specific characteristics of the house, such as the orientation and size of windows and the layout, based on the generated blueprint.

[0816] The system for implementing this invention automatically generates a house design plan based on a user's preference information, desired information, real estate information, and emotional state, and displays it as a 3D model. A specific embodiment of this system is described below.

[0817] System Configuration

[0818] The system consists of a user terminal, a server, and a display device. User terminals include smartphones and head-mounted displays (HMDs). The server processes data and automatically generates blueprints using generative AI models. The display device displays the generated blueprints as 3D models.

[0819] Hardware and software used

[0820] Hardware: Smartphone, Head-Mounted Display (HMD), Server

[0821] Software: Python, OpenAI API, 3D modeling libraries

[0822] Data processing and calculation

[0823] 1. Receiving user input:

[0824] The user terminal receives as input the user's preference information (e.g., images obtained from social media), desired information (e.g., family composition, budget, location), and emotional state (e.g., joy or sadness).

[0825] 2. Obtaining real estate information:

[0826] The server retrieves information about land and buildings in Tokyo from real estate information websites, including details such as price, area, and location.

[0827] 3. Automatic generation of blueprints:

[0828] The server uses a generative AI model (e.g., OpenAI's GPT-3) to automatically generate a house blueprint based on the user's input information and the acquired real estate information. An example of a prompt for the generative AI model is as follows:

[0829] User input: {'image': 'modern_house_image.jpg', 'family_size': 4, 'location': 'Tokyo', 'budget': 5000, 'emotion': 'happy'}

[0830] Property Data: {'Land Information': '...', 'Building Information': '...'}

[0831] Generate a blueprint.

[0832] 4. Creating and viewing 3D models:

[0833] The server uses a 3D modeling library to create a 3D model based on the generated design drawings, and the created 3D model is displayed on the display device of the user's device (smartphone or HMD).

[0834] Specific examples

[0835] If a user provides an image of a modern exterior saved on Instagram, requests a detached house in Tokyo for a family of four, and inputs a budget of 50 million yen, the server will automatically generate a blueprint of a modern-looking house in Tokyo based on this information. Similarly, if a user expresses joy at getting a new job, the emotion engine will recognize this joy and automatically generate a blueprint of a luxurious home featuring large windows, a spacious living room, and high-quality interior materials.

[0836] In this way, it becomes possible to automatically generate and visually confirm house plans that reflect the user's preferences, wishes, and emotional state.

[0837] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0838] Step 1:

[0839] Users use a smartphone or a head-mounted display (HMD) to input preference information (e.g., images obtained from social media), desired information (e.g., family composition, budget, location), and emotional state (e.g., joy or sadness).

[0840] Input: User preference information, wishes, emotional state

[0841] Output: User input data

[0842] Specific behavior: The user enters information into an application's input form and presses the submit button.

[0843] Step 2:

[0844] The server obtains information about land and buildings within Tokyo from a real estate information site.

[0845] Input: User's desired information (e.g. location)

[0846] Output: Real estate information data

[0847] Specific operation: The server uses the API to send a request to the real estate information site and obtain the required data.

[0848] Step 3:

[0849] The server uses a generative AI model (e.g., OpenAI's GPT-3) to automatically generate a house blueprint based on user input and acquired real estate information.

[0850] Input: User-entered data, property information data

[0851] Output: House design data

[0852] Specific operation: The server sends a prompt to the generative AI model to generate a blueprint. An example of the prompt is as follows:

[0853] User input: {'image': 'modern_house_image.jpg', 'family_size': 4, 'location': 'Tokyo', 'budget': 5000, 'emotion': 'happy'}

[0854] Property Data: {'Land Information': '...', 'Building Information': '...'}

[0855] Generate a blueprint.

[0856] Step 4:

[0857] The server creates a 3D model using a 3D modeling library based on the generated design drawing.

[0858] Input: House blueprint data

[0859] Output: 3D model data

[0860] Specific operation: The server inputs the design data into the 3D modeling library and generates a 3D model.

[0861] Step 5:

[0862] The server sends the generated 3D model to the user's device, which displays it.

[0863] Input: 3D model data

[0864] Output: 3D model displayed on the user's device

[0865] Specific operation: The server sends the 3D model data to the user's device, which then displays it on a display device (smartphone or HMD).

[0866] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0867] The data generation model 58 is a so-called generative AI (Artificial Intelligence).

[0868] An example of the data generation model 58 is ChatGPT (registered trademark)<URL: https: / / openai.com / blog / chatgpt> ) and other generative AIs.

[0869] The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in the form of data such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0870] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[0871] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0872] [Second embodiment]

[0873] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0874] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0875] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0876] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0877] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0878] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0879] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0880] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0881] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0882] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0883] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0884] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0885] "Example 1"

[0886] In one embodiment of the present invention, a user saves an image of a home they like from a social media platform such as Instagram and inputs that image information into the system. The user also inputs desired information into the system, such as their family composition, desired address, price range, whether or not they want to renovate, whether they want a house or an apartment, etc. The system automatically generates a blueprint for the home based on this preference information and desired information.

[0887] "Example 2"

[0888] Furthermore, this system obtains land and building information from real estate information websites and automatically generates house blueprints based on this information. Specifically, it proposes window orientation, size, floor plan, etc., taking into account the shape of the land and building, location conditions, etc.

[0889] "Example 3"

[0890] For example, if a user inputs an image of a modern exterior saved on Instagram and information such as a desire for a detached house in Tokyo for a family of four with a budget of 50 million yen, the system will automatically generate a blueprint for a detached house in Tokyo with a modern exterior based on this information.The system will also suggest window orientation, size, floor plan, etc. based on information on land and buildings in Tokyo obtained from a real estate information website.

[0891] The processing flow of each embodiment will be described below.

[0892] "Example 1"

[0893] Step 1: A user saves an image of a house they like from a social media site such as Instagram.

[0894] Step 2: The user inputs the saved image information into this system.

[0895] Step 3: The user enters desired information into the system, such as their family composition, desired address, price range, whether or not they want to renovate, whether they want a house or an apartment, etc.

[0896] Step 4: The system automatically generates a house blueprint based on this preference and desired information.

[0897] "Example 2"

[0898] Step 1: This system obtains land and building information from a real estate information website.

[0899] Step 2: The system automatically generates a house blueprint based on the acquired land and building information. Specifically, it proposes window orientation, size, floor plan, etc., taking into account the shape of the land and building, location conditions, etc.

[0900] "Example 3"

[0901] Step 1: The user enters an image of a modern exterior they have saved on Instagram, along with information such as a family of four looking for a detached house in Tokyo with a budget of 50 million yen.

[0902] Step 2: Based on this information, the system automatically generates blueprints for a detached house in Tokyo with a modern exterior.

[0903] Step 3: The system proposes window orientation, size, floor plan, etc. based on information about land and buildings in Tokyo obtained from a real estate information website.

[0904] Example 1

[0905] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0906] Conventional home design systems have had difficulty automatically generating blueprints that reflect the user's preferences and wishes. Furthermore, due to a lack of effective means for users to utilize image information acquired from social media, it was not possible to reflect the user's specific preferences in the design. Furthermore, when proposing a home based on the generated blueprints, it was difficult to make proposals that matched the user's wishes.

[0907] The specification process by the specification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving image information saved by the user as input and analyzing this information to identify the user's preferences, means for generating and inputting a prompt sentence to the generative AI model, and means for proposing a house based on the generated blueprint. This makes it possible to automatically generate a house blueprint that reflects the user's specific preferences and wishes, and to propose a house that meets the user's wishes.

[0908] "User preference information" is information about the design and style of a home that the user prefers, and includes images and text data obtained from social media.

[0909] "Desired information" refers to the specific conditions and requirements for the home the user desires, including information such as family composition, desired address, price range, whether or not the home has been renovated, and whether it is a detached house or an apartment.

[0910] "Image Information" refers to image data of a home obtained by a user from social media or other sources and uploaded to the system.

[0911] A "generative AI model" is an artificial intelligence model that automatically generates house blueprints based on a user's preferences and desires, and uses natural language processing and image analysis technology.

[0912] A "prompt sentence" is an instruction sentence input to a generative AI model, and is generated based on the user's preference and desired information.

[0913] A "home blueprint" is a blueprint of a home generated based on the user's preference information and desired information, and includes a specific layout and design.

[0914] A "housing proposal" is a proposal for a house made to a user based on the generated house blueprint, and includes content that matches the user's wishes.

[0915] This invention is based on the premise that users save images of their favorite homes from social media such as Instagram and input the image information into the system. The user also inputs desired information into the system, such as their family composition, desired address, price range, whether or not they want to renovate, whether they want a house or an apartment, etc. Based on this information, the system automatically generates a blueprint for the home.

[0916] Hardware and software used

[0917] The server receives the image information and desired information entered by the user and stores it in a database. Specifically, it uses the following hardware and software:

[0918] Server: High-performance cloud server (e.g., Amazon Web Services, Google Cloud Platform)

[0919] Database: Relational database (e.g. MySQL, PostgreSQL)

[0920] Generative AI models: AI models that use natural language processing and image analysis techniques (e.g., OpenAI's GPT-4, DALL-E)

[0921] Image analysis software: Computer vision technologies (e.g., TensorFlow, PyTorch)

[0922] Data processing and calculation

[0923] The server receives the image file uploaded by the user and the desired information entered, and stores this data in a database. Based on the stored data, it generates and inputs a prompt to the generative AI model. The generative AI model generates a house blueprint based on the prompt and provides it to the user via the server.

[0924] Specific examples

[0925] For example, let's say a user saves an image of a modern home design from Instagram and enters the following preferences:

[0926] Family composition: 4 people (2 adults, 2 children)

[0927] Desired address: Tokyo

[0928] Price range: Under 50 million yen

[0929] Renovation status: Yes

[0930] Detached house or apartment: Detached house

[0931] With this information, the server inputs the following prompt into the generative AI model:

[0932] Based on images of modern-design homes saved by users from Instagram, generate blueprints for homes that match the following desired information:

[0933] Family composition: 4 people (2 adults, 2 children)

[0934] Desired address: Tokyo

[0935] Price range: Under 50 million yen

[0936] Renovation status: Yes

[0937] Detached house or apartment: Detached house

[0938] Based on this prompt, the generative AI model generates a house blueprint that matches the user's wishes and provides it to the user via the server. The user can then review the blueprint received on their device and, if necessary, modify the desired information to generate a new blueprint.

[0939] In this way, it becomes possible to automatically generate house designs that reflect the specific preferences and wishes of the user, and to propose a house that meets the user's wishes.

[0940] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0941] Step 1:

[0942] A user saves an image of a house they like from a social media platform such as Instagram. A user uses a smartphone or computer to find and save an image of a house they like from a social media platform such as Instagram. The input is image data obtained from the social media platform, and the output is an image file saved on the user's device.

[0943] Step 2:

[0944] The user uploads the saved image to the system. The user accesses the system's website or application and uploads the saved image of the house. Specifically, the user clicks the upload button and selects the saved image file. The input is the image file saved on the user's device, and the output is the image data sent to the server.

[0945] Step 3:

[0946] The user inputs desired information such as family composition, desired address, price range, whether or not the property has been renovated, whether it is a detached house or an apartment, etc. The user inputs desired information into the system's input form, such as family composition (e.g., 2 adults, 2 children), desired address (e.g., Tokyo), price range (e.g., under 50 million yen), whether or not the property has been renovated (e.g., renovated), and whether or not it is a detached house or an apartment (e.g., detached house). The input is the desired information entered by the user, and the output is the desired information sent to the server.

[0947] Step 4:

[0948] The server receives image information and desired information from the user and stores it in a database. The server receives image files uploaded by the user and desired information entered, and stores this data in a database. When storing, it associates it with the user ID and manages it. The input is the image information and desired information sent by the user, and the output is the data stored in the database.

[0949] Step 5:

[0950] The server generates and inputs prompt sentences to the generative AI model based on the stored data. The server generates prompt sentences to input to the generative AI model based on the image information and desired information stored in the database. For example, it generates prompt sentences like the following:

[0951] Based on images of modern-design homes saved by users from Instagram, generate blueprints for homes that match the following desired information:

[0952] Family composition: 4 people (2 adults, 2 children)

[0953] Desired address: Tokyo

[0954] Price range: Under 50 million yen

[0955] Renovation status: Yes

[0956] Detached house or apartment: Detached house

[0957] The input is image information stored in the database and desired information, and the output is a prompt sentence that is input into the generative AI model.

[0958] Step 6:

[0959] A generative AI model generates a house blueprint based on a prompt. A generative AI model (e.g., OpenAI's GPT-4 or DALL-E) generates a house blueprint based on a prompt sent from a server. The generative AI model uses image analysis and natural language processing technology to create a blueprint that meets the user's needs. The input is the prompt, and the output is the generated house blueprint.

[0960] Step 7:

[0961] The server sends the generated blueprint to the user's device. The server sends the blueprint received from the generative AI model to the user's device. The user can download or view the blueprint through the system's website or application. The input is the generated house blueprint, and the output is the blueprint sent to the user's device.

[0962] Step 8:

[0963] The user checks the blueprint. The user checks the blueprint received on their terminal. They can check whether the blueprint meets their requirements, and if necessary, they can modify the desired information and generate a new blueprint. The input is the blueprint sent to the user's terminal, and the output is the user's confirmation result.

[0964] (Application example 1)

[0965] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0966] Conventional home design systems have difficulty automatically generating blueprints that reflect a user's preferences and wishes. Especially when a user has a specific image in mind, specialized knowledge is required to reflect that image in the blueprint. Furthermore, when a user checks a home design in a physical store, it is difficult to generate and display blueprints in real time. This leads to problems such as reduced user satisfaction and delayed home purchase decisions.

[0967] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0968] In this invention, the server includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for analyzing a house image taken by the user and extracting its features, means for generating a prompt sentence based on the extracted features and the user's desired information and generating the house blueprint using a generative AI model, and means for presenting the generated blueprint to the user on a display device. This allows a house blueprint that reflects the user's specific image to be generated in real time and can be confirmed in a physical store.

[0969] "User preference information" is information that indicates the user's personal tastes and design preferences for homes.

[0970] "Desired information" is information that indicates the specific requests and conditions that the user has for a home (family composition, desired address, price range, whether or not it has been renovated, whether it is a detached house or an apartment, etc.).

[0971] "Real estate information" refers to information that indicates detailed data about real estate properties (location, price, floor plan, age, etc.).

[0972] A "home blueprint" is a drawing that specifically shows the structure, layout, and design of a home.

[0973] "Means for automatic generation" refers to devices or programs that have the function of automatically creating blueprints using algorithms or AI models based on input information.

[0974] The "means for making a proposal" is a device or program that has the function of making a housing proposal to the user based on the generated design drawings.

[0975] "House images" are photos and image data of houses taken by users.

[0976] The "analyzing means" refers to a device or program that has the function of analyzing input image data and extracting its features.

[0977] A "means for extracting features" is a device or program that has the function of extracting important features from data obtained by image analysis.

[0978] A "prompt sentence" is a text-based input sentence that provides instructions to a generative AI model.

[0979] A "generative AI model" is an artificial intelligence model that generates blueprints and other data based on input prompts.

[0980] A "display device" is a device (such as a display or VR headset) that visually presents the generated design drawing to the user.

[0981] A system for implementing this invention includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for analyzing a house image taken by the user and extracting its features, means for generating a prompt sentence based on the extracted features and the user's desired information and generating a house blueprint using a generative AI model, and means for presenting the generated blueprint to the user via a display device.

[0982] Hardware and software used

[0983] Hardware

[0984] A smartphone or tablet (iOS or Android) that users use to take pictures of their home and enter information.

[0985] Smart glasses (e.g., Google Glass): Used to analyze images taken by the user in real time.

[0986] A large screen display or VR headset (e.g., Oculus Rift): Used to present the generated blueprints to the user.

[0987] software

[0988] Image recognition library (e.g., OpenCV): Used to analyze house images taken by the user and extract their features.

[0989] Generative AI models (e.g., GPT-4, DALL-E): Used to generate house blueprints based on prompts.

[0990] Databases (e.g., Firebase): Used to store and manage user preferences, wishes, and property information.

[0991] A front-end framework (e.g., React Native) is used to build the user interface.

[0992] Processing flow

[0993] 1. User Input

[0994] Users use their smartphone or tablet to take pictures of their preferred homes and upload them to the application, then enter information such as family composition, desired address, price range, whether or not the home has been renovated, and whether they want a detached house or an apartment.

[0995] 2. Image Analysis

[0996] The server uses an image recognition library (OpenCV) to analyze the uploaded house images and extract their features.

[0997] 3. Prompt generation

[0998] The server generates a prompt sentence for the generative AI model (GPT-4) based on the extracted features and the user's desired information.

[0999] Prompt Sentence Examples

[1000] Based on the images and desired information provided by the user, generate a blueprint for a house that meets the following criteria:

[1001] Family composition: 4 people

[1002] Preferred address: Tokyo

[1003] Price range: Under 50 million yen

[1004] Renovation: Yes

[1005] Detached house

[1006] Modern design

[1007] 4. Generate blueprints

[1008] The server uses a generative AI model (DALL-E) to generate a house blueprint based on the prompt.

[1009] 5. Displaying the results

[1010] The generated blueprints are presented to users via a large screen display or VR headset, allowing them to see their ideal home design in real time in a physical store.

[1011] Specific examples

[1012] For example, a user can upload a photo of a modern living room taken with their smartphone and input desired information such as "family size: 4 people, desired address: Tokyo, price range: within 50 million yen, renovation: yes, detached house." Based on this information, the server generates a blueprint of a modern detached house for a family of 4 in Tokyo that can be renovated and costs within 50 million yen, and presents it to the user.

[1013] In this way, users can see their ideal home design in real time at a physical store.

[1014] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1015] Step 1:

[1016] Users use their smartphone or tablet to take pictures of their preferred homes and upload them to the application, then enter information such as family composition, desired address, price range, whether or not the home has been renovated, and whether they want a detached house or an apartment.

[1017] Input: Home image, family composition, desired address, price range, whether it needs to be renovated, desired information such as whether it is a detached house or an apartment, etc.

[1018] Output: Uploaded house images and desired information

[1019] Step 2:

[1020] The server uses an image recognition library (OpenCV) to analyze the uploaded house images and extract their features.

[1021] Input: Uploaded house image

[1022] Output: Extracted image features

[1023] Specific operation: Using an image recognition library, edge detection and color analysis are performed on house images to extract features.

[1024] Step 3:

[1025] The server generates a prompt sentence for the generative AI model (GPT-4) based on the extracted features and the user's desired information.

[1026] Input: extracted image features, desired information

[1027] Output: Generated prompt statement

[1028] Specific operation: The extracted features are combined with the desired information to create a prompt sentence to be input into the generative AI model.

[1029] Step 4:

[1030] The server uses a generative AI model (DALL-E) to generate a house blueprint based on the prompt.

[1031] Input: Generated prompt text

[1032] Output: The generated house blueprint

[1033] Specific operation: A prompt sentence is input into the generative AI model to generate a house blueprint.

[1034] Step 5:

[1035] The server presents the generated blueprints to the user via a large-screen display or VR headset.

[1036] Input: Generated house blueprint

[1037] Output: The design presented to the user

[1038] Specific operation: The generated design is sent to a display or VR headset so that the user can visually check it.

[1039] In this way, users can see their ideal home design in real time at a physical store.

[1040] Example 2

[1041] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1042] Conventional home design systems have had the problem of requiring a great deal of time and effort to reflect the user's preferences and desired information. It was also difficult to efficiently obtain real estate information and automatically generate optimal home design plans based on that information. This made it difficult to quickly provide a home design that satisfied the user.

[1043] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1044] In this invention, the server includes means for acquiring land and building information from a real estate information site, means for storing the acquired information in a data frame and processing the data, means for generating a prompt sentence to be input to a generative AI model based on the processed data, means for automatically generating a house blueprint using the generative AI model, and means for proposing a house based on the generated blueprint, thereby enabling the rapid and efficient provision of a house blueprint that reflects the user's preferences and desired information.

[1045] A "real estate information site" is a website that provides information about land and buildings.

[1046] "Land and building information" refers to detailed data such as the shape of the land, the location of the building, the orientation and size of the windows, and the layout.

[1047] A "data frame" is a two-dimensional data structure consisting of rows and columns, and is used to store and manipulate data.

[1048] "Data processing" is the process of converting acquired data into a form that is easy to analyze and use, and includes filling in missing values ​​and normalizing data.

[1049] A "generative AI model" is a model that uses artificial intelligence to perform a specific task, in this case to automatically generate blueprints for a house.

[1050] A "prompt sentence" is an instruction sentence to be input into the generative AI model, and is generated based on information about the land and building.

[1051] A "house blueprint" is a drawing that shows the floor plan and structure of a house, and serves as the basis for architectural planning.

[1052] A "housing proposal" is a proposal made to the user regarding the design and layout of a house based on the generated blueprint.

[1053] MODE FOR CARRYING OUT THE INVENTION

[1054] This invention relates to a system that acquires land and building information from a real estate information site and automatically generates house blueprints based on this information. A specific embodiment of this system will be described below.

[1055] 1. Program Generation

[1056] The server generates a program to retrieve land and building information from real estate information websites. This program is developed using Python and performs web scraping using libraries such as BeautifulSoup and Selenium.

[1057] 2. Data acquisition and processing

[1058] The server runs the generated program and retrieves land and building information from real estate information websites. Specifically, it collects data such as the shape of the land, the building's location, window orientation, size, and floor plan. The collected data is stored in a data frame using the Pandas library, and any necessary data processing is performed, such as filling in missing values ​​and normalizing the data.

[1059] 3. Prompt generation for the generative AI model

[1060] The server generates prompts to be input into the generative AI model based on the processed data. The prompts include information such as the shape of the land and building, location conditions, window orientation, size, and layout.

[1061] Example prompt sentence:

[1062] Based on the land information for Shibuya Ward, Tokyo, please generate a house blueprint while taking into consideration the following conditions.

[1063] Land shape: Rectangular

[1064] Building location: South facing

[1065] Window orientation: South

[1066] Window size: Large

[1067] Floor plan: 3LDK

[1068] 4. Generate house blueprints

[1069] The server inputs the generated prompt sentence into a generative AI model (e.g., a generative AI model) to generate a house blueprint. The generative AI model then proposes an optimal blueprint based on the prompt sentence.

[1070] 5. Displaying the results

[1071] The server displays the generated house plan on the user's device, where the user can review the proposed plan and request modifications if necessary.

[1072] Specific examples

[1073] If a user wants to generate a house blueprint based on land information for Shibuya Ward, Tokyo, the server inputs the following prompt statement into the generative AI model:

[1074] Example prompt sentence:

[1075] Based on the land information for Shibuya Ward, Tokyo, please generate a house blueprint while taking into consideration the following conditions.

[1076] Land shape: Rectangular

[1077] Building location: South facing

[1078] Window orientation: South

[1079] Window size: Large

[1080] Floor plan: 3LDK

[1081] The generative AI model will then suggest a house blueprint based on the prompt, which will then be displayed on the device for the user to review.

[1082] In this way, the present invention makes it possible to quickly and efficiently provide a house design plan that reflects the user's preferences and desired information.

[1083] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1084] Program processing flow

[1085] Step 1: Obtain property information

[1086] The server retrieves land and building information from real estate information websites using Python and libraries such as BeautifulSoup and Selenium for web scraping.

[1087] Input: URL of real estate information site

[1088] Output: Land and building information (e.g., land shape, building location, window orientation, size, floor plan)

[1089] Specific behavior:

[1090] The server uses Selenium to automatically control the browser and access the specified URL, then parses the HTML using BeautifulSoup to extract the required information.

[1091] Step 2: Data processing

[1092] The server stores the acquired real estate information in a data frame using the Pandas library and performs any necessary data processing, such as filling in missing values ​​and normalizing the data.

[1093] Input: Land and building information

[1094] Output: The processed data frame

[1095] Specific behavior:

[1096] The server converts the retrieved data into a data frame using the Pandas read_html function, then uses the fillna function to impute missing values ​​and the normalize function to normalize the data.

[1097] Step 3: Generate prompts for the generative AI model

[1098] The server generates prompts to be input into the generative AI model based on the processed data. The prompts include information such as the shape of the land and building, location conditions, window orientation, size, and layout.

[1099] Input: The processed data frame

[1100] Output: prompt statement

[1101] Specific behavior:

[1102] The server extracts the necessary information from the data frame and generates a prompt sentence like this:

[1103] Based on the land information for Shibuya Ward, Tokyo, please generate a house blueprint while taking into consideration the following conditions.

[1104] Land shape: Rectangular

[1105] Building location: South facing

[1106] Window orientation: South

[1107] Window size: Large

[1108] Floor plan: 3LDK

[1109] Step 4: Generate the house plan

[1110] The server inputs the generated prompt sentence into a generative AI model (e.g., a generative AI model) to generate a house blueprint. The generative AI model then proposes an optimal blueprint based on the prompt sentence.

[1111] Input: prompt statement

[1112] Output: House blueprint

[1113] Specific behavior:

[1114] The server sends a prompt to the generative AI model's API and receives a blueprint proposal in return. For example, the server sends the prompt using the openai.Completion.create function.

[1115] Step 5: View the results

[1116] The server displays the generated house plan on the user's device, where the user can review the proposed plan and request modifications if necessary.

[1117] Input: House blueprint

[1118] Output: Blueprint displayed on the user's device

[1119] Specific behavior:

[1120] The server formats the generated blueprint in HTML format and sends it to the user's device, where the user can view the blueprint through a browser.

[1121] (Application example 2)

[1122] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1123] Conventional home design systems have difficulty reflecting users' preferences and desired information, and the automatic generation of blueprints based on real estate information is also limited. Furthermore, interior design for physical stores requires specialized knowledge and is not easily performed by ordinary users. For this reason, there is a demand for a system that allows users to easily design homes and stores that meet their desires.

[1124] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for automatically generating an interior design of a physical store based on information acquired from a real estate information provider site, means for creating a prompt sentence for generating the blueprint using a generative AI model, and means for generating the actual blueprint using the generative AI model. This enables users to easily design a house or store that suits their needs.

[1125] "User preference information" is information about the style, function, and design that the user desires in the design of a house or store.

[1126] "Desired information" is information about the specific conditions and requirements that a user desires in the design of a house or store.

[1127] "Real estate information" refers to information relating to the shape, location, area, etc. of land and buildings.

[1128] A "blueprint" is a drawing that shows the floor plan of a house or store, the direction and size of windows, and the interior layout.

[1129] A "real estate information site" is a website that provides information about land and buildings on the Internet.

[1130] "Interior design" refers to planning the layout and design of the interior space of a store or home.

[1131] A "generative AI model" is an algorithm or program that uses artificial intelligence to automatically generate blueprints and designs.

[1132] A "prompt" is an instruction to be input into a generative AI model, and is a sentence that contains the conditions and requirements for generating blueprints and designs.

[1133] A system for implementing the present invention includes a server, a user terminal, and a generative AI model. A specific embodiment of this system will be described below.

[1134] First, the user terminal receives the user's preference information and desired information as input. This information is about the style, function, and design that the user desires in the design of a house or store. The user terminal then transmits this information to the server.

[1135] Next, the server acquires real estate information from a real estate information website. This real estate information includes the shape of the land and building, location conditions, area, etc. The server automatically generates blueprints for homes and stores based on the acquired real estate information.

[1136] The server uses the generative AI model to create a prompt to generate a blueprint. This prompt includes the user's preferences, wishes, and real estate information. For example, the following prompt might be generated:

[1137] "Land shape: Rectangular, Location: Urban area, Window orientation: South facing, Lighting position: Center of ceiling"

[1138] Based on the generated prompt, a generative AI model generates the actual blueprint. For example, OpenAI's GPT-3 is used as a generative AI model. This model takes the prompt as input and outputs a blueprint.

[1139] The generated blueprints are sent from the server to the user's terminal and presented to the user, who can then check the design of the house or store based on the blueprints and make any necessary modifications.

[1140] This system allows users to easily design homes and stores that meet their needs. Specifically, users can easily generate and check blueprints using a smartphone or computer. This allows users to create designs that meet their needs without specialized knowledge.

[1141] The above is a specific embodiment for carrying out the present invention.

[1142] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1143] Step 1:

[1144] The user terminal receives the user's preference information and desired information as input. The user uses a smartphone or PC to input information about the style, functions, and design desired for the design of a home or store. The input information is saved in the user terminal.

[1145] Step 2:

[1146] The user terminal transmits the input preference information and desired information to the server, where the information is stored in a database.

[1147] Step 3:

[1148] The server obtains real estate information from a real estate information provider site. The server uses an API to send a request to the real estate information provider site and obtains information such as the shape of the land and building, location conditions, and area. The obtained real estate information is stored on the server.

[1149] Step 4:

[1150] The server creates a prompt to generate a blueprint based on the acquired real estate information and the user's preferences and wishes. The prompt includes information such as the shape of the land, location conditions, window orientation, and lighting position. For example, a prompt such as "Land shape: rectangular, location conditions: urban area, window orientation: south-facing, lighting position: center of ceiling" may be generated.

[1151] Step 5:

[1152] The server uses a generative AI model to generate a blueprint using the prompt sentence as input. For example, OpenAI's GPT-3 is used as the generative AI model. After receiving the prompt sentence as input, the generative AI model outputs a blueprint. The generated blueprint is saved on the server.

[1153] Step 6:

[1154] The server sends the generated blueprint to the user's device, which then presents the received blueprint to the user, who can then view it on their smartphone or computer screen.

[1155] Step 7:

[1156] The user can check the design of their home or store based on the presented blueprint and make any necessary modifications. The modified information is sent back to the server, and a new blueprint is generated. This allows the user to realize a design that suits their needs.

[1157] Example 3

[1158] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1159] Conventional home design systems have difficulty automatically generating blueprints that reflect the user's preferences and wishes, and are unable to provide optimal design proposals based on real estate information. For this reason, there is a need to efficiently provide home designs that meet the user's needs.

[1160] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1161] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for sending a prompt message and an image to the generating AI model and generating the blueprint, means for acquiring land and building information from a real estate information provider site, means for proposing an optimal design based on the acquired real estate information, and means for displaying the generated blueprint and the proposed content to the user. This makes it possible to automatically generate a house blueprint that reflects the user's preferences and wishes and to propose an optimal design based on the real estate information.

[1162] "User preference information" is information that indicates the user's personal preferences, such as the design, style, and functions desired in the design of a house.

[1163] "Desired information" refers to specific conditions and requirements that a user desires in a home design, such as family composition, budget, location, and the like.

[1164] "Real estate information" refers to detailed data on land and buildings, such as price, area, and surrounding environment.

[1165] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate blueprints based on user input.

[1166] A "prompt sentence" is a text-based input sentence that provides instructions to a generative AI model.

[1167] A "blueprint" is a drawing that shows the structure, layout, and design of a house.

[1168] A "real estate information site" is an online platform that provides information about land and buildings.

[1169] "Optimal design proposal" refers to proposing the most suitable home design based on the user's preferences, wishes, and real estate information.

[1170] The "display means" refers to a method or device for visually presenting the generated design drawings and proposal contents to the user.

[1171] This invention is a system that automatically generates a house design plan based on a user's preference information and desired information, and proposes an optimal design based on real estate information. A specific embodiment of this system will be described below.

[1172] System configuration

[1173] This system consists of three main elements: a server, a terminal, and a user. The server receives input information from the user, generates blueprints using a generative AI model, and makes optimal design proposals based on real estate information. The terminal provides an interface for users to enter information and check the results. Users access the system through their terminal and enter the necessary information.

[1174] Hardware and software used

[1175] Server: A server with high-performance computing power is required. Specifically, use a cloud-based server (e.g., Amazon Web Services or Google Cloud Platform).

[1176] Terminal: The device through which a user enters information. This can be a computer, tablet, smartphone, or other device that can connect to the internet.

[1177] Generative AI models: As generative AI models, we use advanced artificial intelligence models such as OpenAI's GPT-4 and DALL-E.

[1178] Real estate information sites: Use online platforms (e.g., SUUMO or At Home) to obtain real estate information.

[1179] Data processing and calculation

[1180] 1. User information input: The user accesses the form on a web browser using a device, uploads a modern-looking image saved on Instagram, and then enters their family composition (four people), desired area (Tokyo), and budget (50 million yen).

[1181] 2. Prompt generation: The server receives the information entered by the user and generates a prompt to be input to the generative AI model. Specifically, it generates a prompt like this:

[1182] "Automatically generate blueprints for a detached house in Tokyo for a family of four for less than 50 million yen, based on a modern exterior image saved by a user on Instagram."

[1183] 3. Send to the generative AI model: The server sends the generated prompt and the image uploaded by the user to the generative AI model via an API.

[1184] 4. Blueprint Generation: Based on the received prompt and image, the generative AI model generates a blueprint for a modern-looking house in Tokyo. The blueprint includes details such as window orientation, size, and floor plan. The generated blueprint is then sent back to the server.

[1185] 5. Acquisition of real estate information: The server uses the API of a real estate information provider to acquire information on land and buildings in Tokyo. The acquired information includes land prices, building areas, and surrounding environments.

[1186] 6. Optimal design proposal: Based on the acquired real estate information, the server proposes the optimal window orientation, size, floor plan, etc. for the generated blueprint. For example, by proposing a blueprint with many south-facing windows, a sunny living environment can be provided.

[1187] 7. Displaying the results: The server displays the final design and proposals to the user. The user can view this information in a web browser and make corrections or regenerate it as needed. An interactive UI is used for displaying the results, making it easy for the user to operate.

[1188] Specific examples

[1189] If the user enters the following information:

[1190] Modern exterior image saved from Instagram

[1191] family of 4

[1192] Looking for a detached house in Tokyo

[1193] The budget is 50 million yen

[1194] The server generates the following prompt:

[1195] "Automatically generate blueprints for a detached house in Tokyo for a family of four for less than 50 million yen, based on a modern exterior image saved by a user on Instagram."

[1196] The generative AI model generates a design drawing based on the prompt text and images, and the server proposes the optimal window orientation, size, and floor plan based on data acquired from a real estate information website. The flow of the specification process in Example 3 will be described with reference to Figure 15.

[1197] Step 1:

[1198] The user enters the information.

[1199] Users access a form on a web browser using their device, upload a photo of a modern-looking house they saved on Instagram, and then enter their family composition (four people), desired area (Tokyo), and budget (50 million yen). This information is then sent to the server.

[1200] Input: Images saved on Instagram, family composition, desired area, budget

[1201] Output: User preference and wishes

[1202] Step 2:

[1203] The server generates a prompt.

[1204] The server receives the information entered by the user and generates a prompt to be input to the generative AI model. Specifically, it generates the following prompt:

[1205] "Automatically generate blueprints for a detached house in Tokyo for a family of four for less than 50 million yen, based on a modern exterior image saved by a user on Instagram."

[1206] Input: User preferences and wishes

[1207] Output: The prompt to send to the generative AI model

[1208] Step 3:

[1209] The server sends the prompt text and image to the generative AI model.

[1210] The server sends the generated prompt text and the user-uploaded image to the generative AI model via an API.

[1211] Input: prompt text, user uploaded image

[1212] Output: Input data to a generative AI model

[1213] Step 4:

[1214] A generative AI model generates blueprints.

[1215] The generative AI model generates a blueprint of a modern-looking house in Tokyo based on the prompt text and images it receives. The blueprint includes details such as window orientation, size, and floor plan. The generated blueprint is then sent back to the server.

[1216] Input: prompt text, user uploaded image

[1217] Output: Generated blueprint

[1218] Step 5:

[1219] The server retrieves the property information.

[1220] The server uses the API of a real estate information website to obtain information on land and buildings in Tokyo, including land prices, building areas, and surrounding areas.

[1221] Input: API of real estate information provider

[1222] Output: Retrieved property information

[1223] Step 6:

[1224] The server will make optimal design suggestions.

[1225] Based on the acquired real estate information, the server proposes optimal window orientation, size, and floor plan for the generated blueprint. For example, by proposing a blueprint with many south-facing windows, a sunny living environment can be provided.

[1226] Input: Generated blueprints, acquired real estate information

[1227] Output: Optimal design proposal

[1228] Step 7:

[1229] The server displays the results to the user.

[1230] The server displays the final design and proposals to the user, who can then view the information in a web browser and modify or regenerate it as needed. An interactive UI is used for display, allowing users to easily operate the system.

[1231] Input: Final design, proposal details

[1232] Output: The results that are displayed to the user

[1233] (Application example 3)

[1234] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1235] Conventional home design systems have difficulty automatically generating blueprints that reflect the user's preferences and wishes, and are unable to effectively utilize real estate information to propose blueprints. Furthermore, they are unable to utilize images saved by the user or information from social media, making it difficult to provide blueprints that meet the user's specific needs. This has led to the issue of being unable to increase user satisfaction.

[1236] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1237] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for generating a prompt sentence based on an image saved by the user and generating a blueprint using a generative AI model, and means for proposing window orientation, size, floor plan, etc. based on land and building information acquired from a real estate information website. This enables the automatic generation of blueprints according to the user's specific needs and the effective use of real estate information.

[1238] "User preference information" is information about the design and style desired by the user, and is obtained from social media, saved images, etc.

[1239] "Desired information" is information about the conditions and requirements for the home desired by the user, including specific preferences such as family structure, budget, and area.

[1240] A "home blueprint" is a drawing that shows the exterior of a home, the layout, the orientation and size of windows, etc., and is automatically generated based on the user's preferences and wishes.

[1241] "Real estate information" refers to information about land and buildings, and is obtained from real estate information websites and the like.

[1242] A "generative AI model" is a model that uses artificial intelligence to generate blueprints and proposals from specific input information.

[1243] A "prompt sentence" is an instruction sentence to be input into a generative AI model, and is generated based on the user's preferences and desired information.

[1244] A "real estate information site" is a website that provides information about land and buildings, and users can access and obtain the information.

[1245] "Window orientation, size, floor plan, etc." are important elements in home design and are suggested based on the user's wishes and real estate information.

[1246] A system for implementing this invention includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for generating a prompt sentence based on an image saved by the user and generating a blueprint using a generative AI model, and means for proposing window orientation, size, floor plan, etc. based on land and building information obtained from a real estate information provider site.

[1247] System Program

[1248] The server receives preference and desired information entered by the user via a device such as a smartphone or PC. This information includes images obtained from social media such as Instagram, as well as information such as family composition, budget, and desired area. The server then generates a prompt based on this information. This prompt is then input into a generative AI model, which then generates a blueprint for the home.

[1249] Based on the generated prompt, the generative AI model automatically generates a house blueprint. This blueprint reflects the user's preferences and wishes, including specific exterior and floor plans. Furthermore, the server suggests window orientation, size, floor plan, etc. based on land and building information obtained from real estate information websites.

[1250] Hardware and software used

[1251] This system uses the following hardware and software:

[1252] Hardware: Servers, user devices (smartphones, PCs, etc.)

[1253] Software: Generative AI models (e.g., OpenAI's GPT-3), prompt generators, image capture programs (e.g., requests, PIL)

[1254] Specific examples

[1255] For example, if a user enters the following criteria:

[1256] Instagram Image URL: https: / / example.com / instagram_image.jpg

[1257] Family structure: 4 people family

[1258] Preferred area: Tokyo

[1259] Budget: 50 million yen

[1260] The generated prompt text is:

[1261] Based on a modern exterior image saved by a user on Instagram, the user is looking for a detached house in Tokyo for a family of four with a budget of 50 million yen. Generate a blueprint of a detached house with a modern exterior based on this information.

[1262] When this prompt is input into the generative AI model, the model automatically generates a home blueprint that matches the user's preferences. The generated blueprint reflects the user's desired modern exterior and a floor plan that suits the family composition. Specific suggestions are also made, such as window orientation, size, and floor plan, based on land and building information obtained from real estate information websites.

[1263] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1264] Step 1:

[1265] Users input their preferences and desired information from devices such as smartphones or PCs. This includes image URLs obtained from social media such as Instagram, as well as information such as family composition, budget, and desired area. The input information is sent to the server.

[1266] Input: Instagram image URL, family composition, budget, desired area

[1267] Output: User preferences and wishes sent to the server

[1268] Step 2:

[1269] The server receives the preference and desired information sent by the user. Based on the received information, it processes the data to generate a prompt. Specifically, it obtains the image URL and converts information such as family composition, budget, and desired area into text format.

[1270] Input: User preferences and wishes

[1271] Output: Data for generating prompts

[1272] Step 3:

[1273] The server downloads the image based on the image URL and loads it as an image object. This process uses the requests library and the PIL library.

[1274] Input: Image URL

[1275] Output: Image object

[1276] Step 4:

[1277] The server generates a prompt sentence based on the image object and user information in text format. The generated prompt sentence is an instruction sentence to be input to the generative AI model.

[1278] Input: Image object, user information in text format

[1279] Output: prompt statement

[1280] Step 5:

[1281] The server inputs the generated prompt sentences into a generative AI model to automatically generate a house blueprint, using a generative AI model such as OpenAI's GPT-3.

[1282] Input: prompt statement

[1283] Output: Procedurally generated house blueprint

[1284] Step 6:

[1285] The server acquires information about the land and building from a real estate information website, including the orientation and size of windows, floor plan, etc.

[1286] Input: URL of real estate information site

[1287] Output: Land and building information

[1288] Step 7:

[1289] Based on the acquired real estate information, the server makes specific suggestions for the generated house blueprint, such as window orientation, size, and floor plan.

[1290] Input: Land and building information, automatically generated house blueprint

[1291] Output: House blueprint with concrete proposals

[1292] Step 8:

[1293] The server sends the final design to the user's device and makes a proposal to the user, who can then review the proposed design and modify or regenerate it as necessary.

[1294] Input: Home blueprints with specific proposals

[1295] Output: The final design sent to the user's device

[1296] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1297] "Example 1"

[1298] One embodiment of the present invention incorporates an emotion engine that recognizes the user's emotions and adjusts the home's blueprint based on the user's emotions. Specifically, when the user is feeling happy, the emotion engine suggests bright interior colors and an open floor plan. On the other hand, when the user is feeling depressed, the emotion engine suggests calm interior colors and a floor plan that emphasizes privacy.

[1299] "Example 2"

[1300] The emotion engine also adjusts home suggestions based on the user's emotions: when the user is feeling happy, it suggests luxurious homes, while when the user is feeling depressed, it suggests simple, functional homes.

[1301] "Example 3"

[1302] For example, when a user gets a new job and feels happy, the emotion engine recognizes that joy and automatically generates a blueprint for a luxurious home. This blueprint features large windows, a spacious living room, and high-quality interior materials. On the other hand, when a user loses their job and feels depressed, the emotion engine recognizes that depression and automatically generates a blueprint for a simple, functional home. This blueprint has the minimum number of rooms and functions necessary, and is cost-effective.

[1303] The processing flow of each embodiment will be described below.

[1304] "Example 1"

[1305] Step 1: The emotion engine recognizes the user's emotion.

[1306] Step 2: The emotion engine adjusts the home design based on the user's emotions, suggesting lighter colors and open floor plans when the user is feeling happy.

[1307] Step 3: On the other hand, if the user is feeling depressed, we suggest interiors with calming colors and floor plans that prioritize privacy.

[1308] "Example 2"

[1309] Step 1: The emotion engine recognizes the user's emotion.

[1310] Step 2: The emotion engine tailors the home suggestions based on the user's emotions, specifically suggesting luxurious homes when the user is feeling happy.

[1311] Step 3: On the other hand, if the user is feeling down, we suggest a simple and functional home.

[1312] "Example 3"

[1313] Step 1: When a user gets a new job and feels happy, the emotion engine recognizes that happiness.

[1314] Step 2: The emotion engine automatically generates blueprints for a luxurious home, featuring large windows, a spacious living room, and luxurious interior materials.

[1315] Step 3: On the other hand, if the user loses their job and feels depressed, the emotion engine will recognize that feeling.

[1316] Step 4: The emotion engine automatically generates a simple and functional house blueprint, with the minimum number of rooms and features required, while keeping costs down.

[1317] Example 1

[1318] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1319] Conventional home design systems have difficulty automatically generating blueprints that reflect the user's preferences and desired information. Furthermore, because the blueprints are not adjusted to take the user's emotions into account, user satisfaction cannot be increased. Furthermore, there is a lack of means to effectively utilize information from social media and real estate information sites. This has led to the issue of being unable to realize home designs that meet the diverse needs of users.

[1320] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1321] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a home blueprint based on this information, means for receiving real estate information as input and automatically generating a home blueprint based on this information, means for proposing a home based on the generated blueprint, means for recognizing the user's emotions and adjusting the home blueprint based on the emotions, and means for proposing interior and floor plans based on the user's emotions. This enables the automatic generation of home blueprints that reflect the user's preferences and desired information, and also allows the blueprints to be adjusted taking the user's emotions into consideration, thereby increasing user satisfaction. Furthermore, by effectively utilizing information from social media and real estate information sites, home designs that meet the diverse needs of users can be realized.

[1322] "User preference information" refers to images and text information about homes that a user obtains from social media or other sources on the Internet.

[1323] "Desired information" refers to specific requests entered by the user, such as family composition, desired address, price range, whether or not the property has been renovated, whether it is a detached house or an apartment, etc.

[1324] "Real estate information" refers to detailed property information obtained from real estate information websites and other databases.

[1325] "Home blueprints" refer to drawings of the floor plan, interior, and exterior of a home that are automatically generated based on the user's preferences, wishes, and real estate information.

[1326] "Means for recognizing emotions" refers to algorithms or software that analyze emotions from a user's facial expressions or input text and determine their emotional state.

[1327] "Means for adjusting blueprints" refers to algorithms or software that alter or modify the content of home blueprints based on perceived user sentiment.

[1328] "Means for suggesting interior design and floor plan" refers to algorithms and software that suggest optimal interior design and floor plan based on the user's emotions and desired information.

[1329] "Social media" refers to a platform for users to share information on the Internet.

[1330] "Real estate information site" refers to a website or online service that provides detailed information about properties.

[1331] MODE FOR CARRYING OUT THE INVENTION

[1332] This invention is a system that automatically generates house blueprints based on a user's preference information and desired information, and further adjusts the blueprints taking into account the user's feelings. This system is composed of the following elements: a server, a terminal, and a user.

[1333] System configuration

[1334] 1. User operations

[1335] Users save their favorite home images from social media on the Internet and upload them to the system.

[1336] Users input desired information into the system, such as family composition, desired address, price range, whether or not the property needs to be renovated, and whether they want a detached house or an apartment.

[1337] 2. Server Processing

[1338] The server receives house images uploaded by users and extracts image features using image recognition algorithms (e.g., TensorFlow, OpenCV).

[1339] The server analyzes the desired information entered by the user using a natural language processing engine (e.g., GPT-3) and organizes it as structured data.

[1340] The server combines data from image recognition algorithms and natural language processing engines to generate blueprints for the home.

[1341] The server uses an emotion engine to recognize the user's emotions and analyzes the emotions from the user's facial expressions and input text.

[1342] The server adjusts the blueprint based on the user's perceived emotions, suggesting, for example, bright interior colors and an open floor plan if the user is feeling happy.

[1343] The server generates the final adjusted design and provides it to the user.

[1344] Hardware and software used

[1345] Hardware: High-performance server (e.g., server with NVIDIA GPU)

[1346] Software: Image recognition algorithms (e.g., TensorFlow, OpenCV), natural language processing engines (e.g., GPT-3), emotion recognition engines

[1347] Specific examples

[1348] For example, suppose a user uploads an image of a modern-designed home saved from Instagram to the system and enters desired information such as family composition (four-person family), desired address (Tokyo), price range (up to 50 million yen), whether or not it has been renovated (yes), and whether or not it is a detached house or an apartment (detached house).

[1349] The server first uses an image recognition algorithm to extract modern design features from home images, then uses a natural language processing engine to analyze the user's desired information and generate floor plans suitable for a family of four, designs suitable for residential areas in Tokyo, specifications that can be realized within 50 million yen, designs that take renovation into consideration, and plans for detached homes.

[1350] Furthermore, if the emotion engine recognizes the user's emotion as "joy," the server will suggest bright interior colors and an open living room. Finally, the server integrates this information and provides the user with the optimal home design plan.

[1351] Prompt Sentence Examples

[1352] The user entered images of modern-designed homes saved from social media, along with desired information such as family size (four people), desired address (Tokyo), price range (under 50 million yen), whether or not the home has been renovated (yes), and whether or not it is a detached house or condominium (detached house). Based on this information, please generate a blueprint for the home. If the user's emotion is "joy," please suggest a bright interior design and an open floor plan.

[1353] In this way, the system can automatically generate a house blueprint based on the user's preferences and wishes, and further adjust the blueprint to take into account the user's emotions.

[1354] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1355] Step 1:

[1356] The user saves images of their favorite homes and inputs them into the system.

[1357] Specifically, the user downloads a home image of their choice from a social media site on the Internet and uploads the image through the system interface.

[1358] Input: Home images taken from social media

[1359] Output: House images uploaded to the system

[1360] Step 2:

[1361] The user enters desired information into the system.

[1362] Specifically, the user enters desired information such as family composition, desired address, price range, whether the property needs to be renovated, whether it is a detached house or an apartment, etc. through the system interface.

[1363] Input: Family composition, desired address, price range, whether or not it needs to be renovated, whether you want a house or an apartment, and other desired information

[1364] Output: Preferences entered into the system

[1365] Step 3:

[1366] The server analyzes the house image using an image recognition algorithm.

[1367] Specifically, the server receives the uploaded house images and uses image recognition algorithms (e.g., TensorFlow, OpenCV) to extract image features, such as the building's exterior, interior style, and color tone.

[1368] Input: House images uploaded to the system

[1369] Output: Image feature data (building exterior, interior style, color, etc.)

[1370] Step 4:

[1371] The server analyzes the desired information using a natural language processing engine.

[1372] Specifically, the server analyzes the desired information entered by the user using a natural language processing engine (e.g., GPT-3) and organizes it as structured data. For example, it understands information such as family composition, desired address, and price range, and stores it in a database.

[1373] Input: Preferences entered into the system

[1374] Output: Structured preference data

[1375] Step 5:

[1376] The server integrates the analysis results and generates a blueprint for the house.

[1377] Specifically, the server combines data obtained from image recognition algorithms and natural language processing engines to generate blueprints for a home, including floor plans, interiors, and exteriors based on the user's preferences and wishes.

[1378] Input: Image feature data, structured desired information data

[1379] Output: House blueprint

[1380] Step 6:

[1381] The server uses an emotion engine to recognize the user's emotion.

[1382] Specifically, the server uses an emotion engine to recognize the user's emotions, analyzing the text and facial expression data entered by the user into the system to determine the user's current emotional state.

[1383] Input: User text input, facial expression data

[1384] Output: User's emotional state data

[1385] Step 7:

[1386] The server adjusts the blueprint based on the user's emotions.

[1387] Specifically, the server adjusts the blueprint based on the user's emotions. For example, if the user is feeling happy, it will suggest bright interior colors and an open floor plan. On the other hand, if the user is feeling depressed, it will suggest calm interior colors and a floor plan that prioritizes privacy.

[1388] Input: User emotional state data, house blueprints

[1389] Output: Adjusted house blueprint

[1390] Step 8:

[1391] The server provides the final design to the user.

[1392] Specifically, the server generates a final, adjusted design drawing and provides it to the user, who can review the drawing through the system interface and provide feedback as needed.

[1393] Input: Adjusted house blueprint

[1394] Output: The final design provided to the user

[1395] (Application example 1)

[1396] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1397] Conventional home design systems can generate blueprints based on the user's preferences and desired information, but they have the problem of not being able to adjust the blueprints to take the user's emotions into account. Also, when users consult about home design or renovation in a physical store, it is difficult to make suggestions that reflect their emotions in real time. This has led to the issue of not being able to increase user satisfaction.

[1398] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1399] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for recognizing the user's emotions and adjusting the house blueprint based on the emotions, and means for analyzing the user's facial expressions using a smart device and recognizing emotions, thereby enabling the generation and proposal of a house blueprint that reflects the user's emotions in real time.

[1400] "User preference information" refers to images of homes that the user has acquired from social media such as Instagram, and information indicating the user's personal preferences.

[1401] "Desired information" is information indicating the user's specific requests, such as desired family composition, address, price range, whether or not the property has been renovated, whether it is a detached house or an apartment, etc.

[1402] "Real estate information" refers to detailed information such as the location, price, layout, and age of the property, obtained from a real estate information website.

[1403] The "automatic blueprint generation means" refers to a system or algorithm for automatically generating a blueprint for a house based on the user's preference information, desired information, and real estate information.

[1404] The "proposal means" is a system or algorithm for proposing a house to the user based on the generated design drawings.

[1405] An "emotion recognizer" is a system or algorithm that recognizes a user's emotions and adjusts the house blueprint based on those emotions.

[1406] A "smart device" is a device, such as a smartphone or smart glasses, that analyzes a user's facial expressions and recognizes their emotions.

[1407] "Facial expression analysis means" refers to a system or algorithm that uses a smart device to analyze a user's facial expressions and recognize their emotions.

[1408] The system for implementing this invention automatically generates a house blueprint based on a user's preference information, desired information, and real estate information, and adjusts the blueprint by recognizing the user's emotions. Specific embodiments are described below.

[1409] System Configuration

[1410] 1. Hardware:

[1411] Smart devices: Devices such as smartphones and smart glasses that analyze the user's facial expressions and recognize emotions.

[1412] Server: A server for data processing and blueprint generation.

[1413] 2. Software:

[1414] Emotion recognition model: A machine learning model for analyzing a user's facial expressions and recognizing their emotions (e.g., an emotion recognition model using Keras).

[1415] Blueprint generation algorithm: An algorithm that automatically generates house blueprints based on the user's preferences, desires, and real estate information.

[1416] Data Acquisition Module: A module for acquiring necessary information from social media and real estate information sites.

[1417] Processing flow

[1418] 1. Enter your preferences and wishes:

[1419] Users upload images of homes saved from social media such as Instagram to the app and enter information such as family composition, desired address, price range, whether it has been renovated, and whether it is a detached house or an apartment.

[1420] 2. Obtaining real estate information:

[1421] The server obtains detailed information such as the location, price, layout, and age of the property from a real estate information site.

[1422] 3. Emotion recognition:

[1423] The smart device is used to analyze the user's facial expressions and recognize the user's emotions using an emotion recognition model.

[1424] 4. Automatic generation of blueprints:

[1425] The server automatically generates a house blueprint using a blueprint generation algorithm based on the user's preference information, desired information, real estate information, and recognized emotion information.

[1426] 5. Suggestion:

[1427] Based on the generated blueprints, the system makes housing proposals to the user, including proposals for interior design and layout based on the user's emotions.

[1428] Specific examples

[1429] For example, a user can upload an image saved from Instagram to the app and input their desired address and price range. The app then analyzes the user's facial expressions through smart glasses and recognizes their emotions. Based on this information, the server automatically generates blueprints and proposes them to the user.

[1430] Prompt Sentence Examples

[1431] Users upload a photo of a home they have saved from Instagram and enter information such as family composition, desired address, price range, whether it has been renovated, whether it is a detached house or an apartment, etc. The system analyzes facial expressions through smart glasses and recognizes emotions. Based on this information, it automatically generates the optimal home blueprint.

[1432] In this way, a home design assistant system based on the user's emotions and desired information can be realized.

[1433] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1434] Step 1:

[1435] The user uploads an image of a house saved from a social media site such as Instagram to the device.

[1436] Input: Image file of a house

[1437] Output: Uploaded image data

[1438] Specific operation: A user uploads a saved image of a house to the application using a smartphone or smart glasses. The application then sends the image data to the server.

[1439] Step 2:

[1440] The user inputs desired information such as family composition, desired address, price range, whether or not the property has been renovated, and whether or not they want a detached house or an apartment into the terminal.

[1441] Input: Family composition, address, price range, whether renovated, type of home

[1442] Output: User preference data

[1443] Specific operation: The user enters the desired information into the application's input form and presses the submit button. The application then sends the entered data to the server.

[1444] Step 3:

[1445] The server obtains detailed information such as the property's location, price, floor plan, and age from a real estate information site.

[1446] Input: API of real estate information provider

[1447] Output: Real estate information data

[1448] Specific operation: The server calls the API of the real estate information provider site to obtain the required real estate information. The obtained data is stored in an internal database.

[1449] Step 4:

[1450] The terminal analyzes the user's facial expressions using a smart device and recognizes the user's emotions using an emotion recognition model.

[1451] Input: User facial expression image

[1452] Output: User emotion data

[1453] Specific operation: The camera on the smart device captures the user's facial expression and sends the image data to the server. The server then analyzes the facial image using an emotion recognition model and recognizes the user's emotion.

[1454] Step 5:

[1455] The server automatically generates a house blueprint using a blueprint generation algorithm based on the user's preference information, desired information, real estate information, and emotional information.

[1456] Input: User preference information, desired information, real estate information, emotional information

[1457] Output: Procedurally generated house blueprint

[1458] Specific operation: The server integrates all input data and executes the blueprint generation algorithm, which generates blueprints taking into account the interior and floor plan according to the user's emotions.

[1459] Step 6:

[1460] The server proposes a house to the user based on the generated blueprint.

[1461] Input: Procedurally generated house blueprint

[1462] Output: Suggestions to the user

[1463] Specific operation: The server presents the generated blueprint to the user and proposes interior and floor plans according to the user's emotions. The user can confirm the proposals through the application.

[1464] Example 2

[1465] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1466] Conventional home design systems can generate blueprints based on the user's preferences and desired information, but they have the problem of not being able to make proposals that take the user's emotions into account. Furthermore, it is difficult to effectively utilize real estate information when designing a home, making it impossible to make optimal proposals for the user. Furthermore, there is a need to improve user satisfaction by making home proposals that reflect the user's emotions.

[1467] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1468] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, and means for analyzing the user's emotions and adjusting the proposed house based on the analysis results. This makes it possible to propose an optimal house blueprint based not only on the user's preferences and desired information but also on their emotions.

[1469] "User preference information" is information that indicates the user's personal preferences and wishes regarding housing.

[1470] "Desired information" is information that indicates the specific conditions and requests that the user has for a house.

[1471] "Real estate information" refers to information that includes detailed data on the shape, location, price, etc. of land and buildings.

[1472] A "blueprint" is a drawing that shows the layout and structure of a house, as well as the orientation and size of windows.

[1473] A "proposal" is a specific plan for the design and layout of a house that is provided to the user.

[1474] "Analyzing emotions" means identifying and evaluating a user's emotional state from their facial expressions, behavior, input data, etc.

[1475] "Adjusting" means changing and optimizing the proposal based on the analysis results.

[1476] This invention is a system that automatically generates house blueprints and proposes optimal housing by taking into consideration user preference information, desired information, real estate information, and the user's emotions. Specific embodiments of this system are described below.

[1477] System configuration

[1478] 1. Acquisition of real estate information

[1479] The server obtains information about land and buildings from a real estate information website. In this case, the server collects data using a specific API. For example, it uses the API of the real estate information website.

[1480] 2. Data analysis and processing

[1481] The server analyzes the acquired land and building information and extracts data such as shape and location conditions, using a data analysis library.

[1482] 3. Automatic generation of house blueprints

[1483] The server automatically generates a house blueprint based on the analyzed data. Specifically, it takes into account the shape of the land and the location conditions, and suggests window orientation, size, floor plan, etc. This process uses the design software's API.

[1484] 4. Emotional Engine Adjustment

[1485] The device analyzes the user's emotions using an emotion engine, which uses an emotion analysis API. If the user is feeling happy, the device will suggest a luxurious home. On the other hand, if the user is feeling depressed, the device will suggest a simple and functional home.

[1486] Specific examples

[1487] Example 1: Getting real estate information

[1488] The server uses the API of a real estate information site to obtain land information for a specific area. For example, it sends an API request like the following:

[1489] "Take the land information for San Francisco and generate blueprints that suggest luxury homes if the user is happy, or simple homes if the user is depressed."

[1490] Example 2: Data analysis and processing

[1491] The server analyzes the acquired data using a data analysis library, for example to extract information about the shape of the land and its location, and prepares it for use in the next step.

[1492] Example 3: Automatic generation of house blueprints

[1493] The server generates blueprints using the design software's API, proposing things like window orientation, size, and floor plan, taking into account the shape of the land and the location conditions.

[1494] Example 4: Adjustment by Emotion Engine

[1495] The device uses an emotion analysis API to analyze the user's emotions, suggesting, for example, a luxurious home if the user is happy, or a simple home if the user is depressed.

[1496] In this way, it is possible to propose optimal house plans that are based not only on the user's preferences and desired information, but also on their emotions. This system can improve user satisfaction.

[1497] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1498] Step 1:

[1499] The server retrieves land and building information from a real estate information website. Specifically, the server sends an API request and receives JSON data containing land information for the specified area. The input is the API request parameters (e.g., area, property type), and the output is the retrieved real estate information JSON data.

[1500] Step 2:

[1501] The server converts the acquired JSON data into a data frame using a data analysis library. Specifically, the server reads the JSON data using the pandas library and converts it into a data frame. The input is the acquired JSON data, and the output is the real estate information in data frame format.

[1502] Step 3:

[1503] The server extracts the necessary data from the data frame. Specifically, it extracts information such as the shape and location of the land and prepares it for use in the next step. The input is real estate information in data frame format, and the output is the extracted data on the shape and location of the land.

[1504] Step 4:

[1505] The server uses the design software's API to generate a house blueprint. Specifically, it takes into account the shape of the land and the location conditions and proposes window orientation, size, floor plan, etc. The input is the extracted data on the shape of the land and the location conditions, and the output is the generated house blueprint.

[1506] Step 5:

[1507] The device uses an emotion analysis API to analyze the user's emotions. Specifically, it identifies and evaluates the user's emotional state from their facial expressions, behavior, and input data. The input is the user's image and text data, and the output is analyzed emotional data.

[1508] Step 6:

[1509] The device adjusts the housing suggestions based on the analysis results. Specifically, it suggests a luxurious home if the user is happy, and a simple home if the user is depressed. The input is the analyzed emotion data and the generated home blueprint, and the output is the adjusted home suggestion.

[1510] In this way, by clarifying the specific operations and inputs and outputs performed at each processing step, the processing flow of the system program has been explained in detail.

[1511] (Application example 2)

[1512] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1513] Conventional home design systems were able to automatically generate blueprints based on user preferences, desired information, and real estate information, but they were unable to adjust proposals based on the user's emotions or display blueprints using virtual reality. This made it difficult to provide home proposals that were in tune with the user's emotions or a more realistic experience. This led to the issue of being unable to increase user satisfaction.

[1514] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1515] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for receiving user emotion information as input and adjusting the house proposal based on this information, and means for displaying the generated blueprint using a virtual reality display device. This makes it possible to adjust the house proposal based on the user's emotion, and provides a realistic experience using virtual reality.

[1516] "User preference information" is information that indicates the user's personal preferences and wishes regarding housing.

[1517] "Desired information" is information that indicates the specific conditions and requests that the user has for a house.

[1518] "Real estate information" refers to information that includes detailed data about land and buildings.

[1519] A "house blueprint" is a drawing that shows in detail the layout, structure, and facilities of a house.

[1520] "Emotion information" is information that indicates the user's current emotional state.

[1521] A "virtual reality display device" is a device for visually displaying a virtual space.

[1522] "Automatic generation means" refers to a device or program that has the function of automatically creating a design drawing based on input information.

[1523] The "means for adjusting the proposal" refers to a device or program that has the function of changing and optimizing the proposal content based on the user's emotional information.

[1524] The "display means" refers to a device or program that has the function of visually presenting the generated design drawing to the user.

[1525] The system for implementing this invention automatically generates a blueprint of a house based on the user's preference information, desired information, real estate information, and emotional information, and presents it to the user using a virtual reality display device. Specific embodiments are described below.

[1526] System Configuration

[1527] The system consists of the following main components:

[1528] 1. User terminal: A device such as a smartphone or head-mounted display that collects user input information and displays it in virtual reality.

[1529] 2. Server: Receives the user's preference information, desired information, real estate information, and emotional information, and automatically generates a house blueprint.

[1530] 3. Emotion engine: Analyzes the user's emotional information and adjusts housing suggestions.

[1531] 4. Design generation engine: Generates house blueprints based on real estate information and the user's preferences and wishes.

[1532] 5. Virtual reality display device: The generated design drawing is displayed in a virtual reality space.

[1533] Program processing

[1534] The server processes the data in the following steps:

[1535] 1. Data acquisition: Obtain preference information, desired information, and real estate information from the user's device. Obtain user emotion information using the emotion engine.

[1536] 2. Blueprint generation: Using a design generation engine, a blueprint for the house is automatically generated based on the acquired information.

[1537] 3. Proposal adjustment: Using the emotion engine, we adjust the housing proposal based on the user's emotion information.

[1538] 4. Virtual reality display: The generated design drawing is presented to the user using a virtual reality display device.

[1539] Hardware and software used

[1540] Hardware: Smartphones, head-mounted displays, servers

[1541] Software: EmotionEngine, DesignGenerator, VRDisplay

[1542] Specific examples

[1543] For example, if a user experiences home design using a smartphone, a luxurious home will be suggested when the user is happy, and a simple and functional home will be suggested when the user is depressed.The user can wear a head-mounted display and experience the generated blueprints in a realistic virtual reality space.

[1544] Prompt Sentence Examples

[1545] "Generate blueprints that suggest luxury homes when the user is happy."

[1546] "Generate blueprints that suggest simple and functional homes for users when they're feeling down."

[1547] In this way, it is possible to provide a home proposal that responds to the user's emotions and a realistic experience using virtual reality.

[1548] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1549] Step 1:

[1550] The user terminal receives the user's preference information and desired information as input. The user inputs their preferences and specific requests for housing using a smartphone or head-mounted display. This information is then sent to the server.

[1551] Input: User's preference information, desired information

[1552] Output: User preference information and desired information sent to the server

[1553] Step 2:

[1554] The server obtains real estate information from real estate information websites, accessing the websites via API and collecting detailed data on land and buildings.

[1555] Input: URL of real estate information site

[1556] Output: Retrieved property information

[1557] Step 3:

[1558] The user device acquires the user's emotional information using an emotion engine. It analyzes the user's facial expressions and voice to detect their current emotional state. The emotional information is then sent to the server.

[1559] Input: User's facial expression, voice

[1560] Output: Emotion information sent to the server

[1561] Step 4:

[1562] The server uses a design generation engine to automatically generate house blueprints based on the acquired preference information, desired information, and real estate information. The design generation engine analyzes this information and designs the optimal floor plan and structure.

[1563] Input: User preferences, wishes, real estate information

[1564] Output: The generated house blueprint

[1565] Step 5:

[1566] The server uses an emotion engine to tailor the home suggestions based on the user's emotional information, for example, suggesting luxurious homes if the user is happy, and simple and functional homes if the user is depressed.

[1567] Input: Generated house blueprint, emotion information

[1568] Output: Adjusted housing proposals

[1569] Step 6:

[1570] The server uses a virtual reality display device to present the generated blueprint to the user, who can then wear a head-mounted display and experience the blueprint in a realistic virtual reality space.

[1571] Input: Adjusted housing proposals

[1572] Output: House blueprint displayed in virtual reality space

[1573] In this way, it is possible to provide a home proposal that responds to the user's emotions and a realistic experience using virtual reality.

[1574] Example 3

[1575] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1576] Conventional home design systems have had the problem that it is difficult to automatically generate blueprints that reflect the user's preferences and desired information, and generating blueprints that take real estate information into account is also time-consuming. Furthermore, because they are unable to generate blueprints that take the user's emotional state into account, it is not possible to increase the user's psychological satisfaction. There is a need for a system that can solve these problems and automatically generate home blueprints that meet the diverse needs of users.

[1577] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1578] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, and means for recognizing the user's emotional state and adjusting the house blueprint in accordance with the emotional state. This makes it possible to automatically generate a house blueprint that takes into account the user's preference, desired information, real estate information, and even the emotional state.

[1579] "User preference information" is information about the user's preferred designs and styles, and is obtained from social media, etc.

[1580] "Desired information" is information relating to specific requirements such as the location of the house desired by the user, budget, and family composition.

[1581] "Real estate information" refers to information about land and buildings obtained from real estate information websites.

[1582] "Emotional state" is information that indicates the user's current psychological state and is recognized by the emotion engine.

[1583] A "blueprint" is a drawing that shows the structure, floor plan, window orientation and size of a house, etc.

[1584] "Automatic generation" means that the system automatically creates blueprints based on the user's input, real estate information, and emotional state.

[1585] "Proposal" refers to showing the user a specific house design and layout based on the generated blueprint.

[1586] MODE FOR CARRYING OUT THE INVENTION

[1587] This invention is a system that automatically generates and proposes house blueprints to users based on their preferences, desires, real estate information, and emotional state. A specific embodiment of this system is described below.

[1588] Hardware and software used

[1589] Hardware: Server, user terminal (PC, smartphone)

[1590] Software: Generative AI models (e.g., GPT-4), emotion recognition engines, database management systems (e.g., MySQL), real estate listing site APIs

[1591] System Operation Overview

[1592] 1. Enter your user information

[1593] Users use the device to enter information such as images saved on Instagram, family composition, desired home location (within Tokyo), and budget (50 million yen).

[1594] Example: "We are a family of four looking for a modern-looking house in Tokyo with a budget of ¥50 million."

[1595] 2. Data submission and analysis

[1596] The terminal transmits the input information to the server.

[1597] The server analyzes the received information and inputs it as a prompt sentence into the generative AI model.

[1598] Example prompt: "Generate a blueprint based on a photo of a modern exterior that a user saved from Instagram, describing a family of four looking for a detached house in Tokyo with a budget of ¥50 million."

[1599] 3. Generate blueprints

[1600] The server inputs a prompt statement into the generative AI model and generates a blueprint.

[1601] The server suggests window orientation, size, floor plan, etc. based on information about land and buildings in Tokyo obtained from a real estate information website.

[1602] 4. Emotion recognition and blueprint adjustment

[1603] The server uses an emotion engine to recognize the user's emotional state.

[1604] The server adjusts the blueprint based on the results of the emotion engine.

[1605] Example prompt: "The user is excited about their new job. Generate blueprints for a luxurious home with large windows, a spacious living room, and high-quality interior materials."

[1606] 5. Providing blueprints

[1607] The server transmits the generated design drawing to the user terminal.

[1608] The terminal displays the received design drawing to the user.

[1609] Specific examples

[1610] User input: "We are a family of four looking for a modern-looking house in Tokyo with a budget of ¥50 million."

[1611] Prompt: "Generate a blueprint based on a user's saved Instagram image of a modern exterior, a family of four looking for a detached house in Tokyo with a budget of ¥50 million."

[1612] Emotion-aware prompt: "The user is excited about their new job. Generate blueprints for a luxurious home with large windows, a spacious living room, and high-quality interior materials."

[1613] This system enables the automatic generation of house design plans that take into account the user's preferences, desired information, real estate information, and even emotional state. This allows for house designs that meet the diverse needs of users. The flow of the specific processing in Example 3 will be described with reference to FIG. 21.

[1614] Step 1:

[1615] Entering user information

[1616] Users use their device to enter information such as images saved on Instagram, family composition, desired home location (within Tokyo), and budget (50 million yen).

[1617] Input: User preferences and desired information

[1618] Output: The entered information is saved on the device.

[1619] Specific operation: The user enters information into the input form on the terminal and clicks the "Submit" button.

[1620] Step 2:

[1621] Data transmission and analysis

[1622] The terminal transmits the input information to the server.

[1623] Input: Information entered by the user

[1624] Output: User information sent to the server

[1625] Specific operation: The device uses an HTTP request to send input data to the server.

[1626] The server analyzes the received information and inputs it as a prompt sentence into the generative AI model.

[1627] Input: User information sent from the device

[1628] Output: Prompt sentence to be input to the generative AI model

[1629] What it does: The server analyzes the data and generates a prompt like this: "Generate a blueprint based on a photo of a modern exterior that the user saved on Instagram, a family of four looking for a detached house in Tokyo, and a budget of 50 million yen."

[1630] Step 3:

[1631] Blueprint generation

[1632] The server inputs a prompt statement into the generative AI model and generates a blueprint.

[1633] Input: prompt statement

[1634] Output: Generated blueprint data

[1635] Specific operation: The server sends a prompt to a generative AI model (e.g., GPT-4) and receives the blueprint data returned by the model.

[1636] The server suggests window orientation, size, floor plan, etc. based on information about land and buildings in Tokyo obtained from a real estate information website.

[1637] Input: Information obtained from real estate information site

[1638] Output: Proposed window orientation, size, floor plan, etc.

[1639] Specific operation: The server uses the API to obtain real estate information and reflects it in the blueprint.

[1640] Step 4:

[1641] Emotion recognition and blueprint adjustment

[1642] The server uses an emotion engine to recognize the user's emotional state.

[1643] Input: User emotion data

[1644] Output: Perceived emotional state

[1645] Specific operation: The server sends the user's emotional data to the emotion engine and analyzes the emotional state.

[1646] The server adjusts the blueprint based on the results of the emotion engine.

[1647] Input: Perceived emotional state

[1648] Output: Adjusted blueprint

[1649] Specific behavior: The server receives the results of the emotion engine and generates a prompt like the following: "The user is excited about his new job. Please generate blueprints for a luxurious home with large windows, a spacious living room, and high-quality interior materials."

[1650] Step 5:

[1651] Providing blueprints

[1652] The server transmits the generated design drawing to the user terminal.

[1653] Input: Generated blueprint data

[1654] Output: Blueprint sent to user device

[1655] Specific operation: The server sends the blueprint data to the user terminal as an HTTP response.

[1656] The terminal displays the received design drawing to the user.

[1657] Input: Blueprint data sent from the server

[1658] Output: The blueprint displayed to the user

[1659] Specific operation: The terminal analyzes the received blueprint data and displays it on the user interface.

[1660] (Application example 3)

[1661] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1662] Conventional home design systems have difficulty automatically generating blueprints that reflect the user's preferences and desired information, and proposals based on real estate information are also limited. Furthermore, they lack the means to generate blueprints that take the user's emotional state into account, or to visually confirm the generated blueprints as 3D models. This makes it difficult to increase user satisfaction.

[1663] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1664] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for receiving the user's emotional state as input and automatically generating a house blueprint based on this, and means for displaying the generated blueprint as a 3D model. This enables the automatic generation of a house blueprint that reflects the user's preferences, wishes, and emotional state, and visual confirmation of the blueprint.

[1665] "User preference information" is information about the user's preferred designs and styles, and is obtained from social media and image storage services.

[1666] "Desired information" is information about the conditions and specifications of the house desired by the user, including family composition, budget, location, and the like.

[1667] "Real estate information" refers to information about land and buildings obtained from real estate information websites, including details such as price, area, and location.

[1668] "Emotional state" is information that indicates the user's current feelings and mood, and includes emotions such as joy and sadness.

[1669] A "blueprint" is a drawing that shows the structure, layout, and design of a house, and is automatically generated based on the user's preferences, wishes, real estate information, and emotional state.

[1670] A "3D model" is a three-dimensional visual model created based on blueprints, allowing users to see the exterior and interior of a house in three dimensions.

[1671] "Automatic generation" is the process by which the system automatically creates blueprints and 3D models based on user input and acquired data.

[1672] "Proposal" refers to the act of showing the user specific characteristics of the house, such as the orientation and size of windows and the layout, based on the generated blueprint.

[1673] The system for implementing this invention automatically generates a house design plan based on a user's preference information, desired information, real estate information, and emotional state, and displays it as a 3D model. A specific embodiment of this system is described below.

[1674] System Configuration

[1675] The system consists of a user terminal, a server, and a display device. User terminals include smartphones and head-mounted displays (HMDs). The server processes data and automatically generates blueprints using generative AI models. The display device displays the generated blueprints as 3D models.

[1676] Hardware and software used

[1677] Hardware: Smartphone, Head-Mounted Display (HMD), Server

[1678] Software: Python, OpenAI API, 3D modeling libraries

[1679] Data processing and calculation

[1680] 1. Receiving user input:

[1681] The user terminal receives as input the user's preference information (e.g., images obtained from social media), desired information (e.g., family composition, budget, location), and emotional state (e.g., joy or sadness).

[1682] 2. Obtaining real estate information:

[1683] The server retrieves information about land and buildings in Tokyo from real estate information websites, including details such as price, area, and location.

[1684] 3. Automatic generation of blueprints:

[1685] The server uses a generative AI model (e.g., OpenAI's GPT-3) to automatically generate a house blueprint based on the user's input information and the acquired real estate information. An example of a prompt for the generative AI model is as follows:

[1686] User input: {'image': 'modern_house_image.jpg', 'family_size': 4, 'location': 'Tokyo', 'budget': 5000, 'emotion': 'happy'}

[1687] Property Data: {'Land Information': '...', 'Building Information': '...'}

[1688] Generate a blueprint.

[1689] 4. Creating and viewing 3D models:

[1690] The server uses a 3D modeling library to create a 3D model based on the generated design drawings. The created 3D model is then displayed on the display device of the user's device (such as a smartphone or HMD).

[1691] Specific examples

[1692] If a user provides an image of a modern exterior saved on Instagram, requests a detached house in Tokyo for a family of four, and inputs a budget of 50 million yen, the server will automatically generate a blueprint of a modern-looking house in Tokyo based on this information. Similarly, if a user expresses joy at getting a new job, the emotion engine will recognize this joy and automatically generate a blueprint of a luxurious home featuring large windows, a spacious living room, and high-quality interior materials.

[1693] In this way, it becomes possible to automatically generate and visually confirm house plans that reflect the user's preferences, wishes, and emotional state.

[1694] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1695] Step 1:

[1696] Users use a smartphone or a head-mounted display (HMD) to input preference information (e.g., images obtained from social media), desired information (e.g., family composition, budget, location), and emotional state (e.g., joy or sadness).

[1697] Input: User preference information, wishes, emotional state

[1698] Output: User input data

[1699] Specific behavior: The user enters information into an application's input form and presses the submit button.

[1700] Step 2:

[1701] The server obtains information about land and buildings within Tokyo from a real estate information site.

[1702] Input: User's desired information (e.g. location)

[1703] Output: Real estate information data

[1704] Specific operation: The server uses the API to send a request to the real estate information site and obtain the required data.

[1705] Step 3:

[1706] The server uses a generative AI model (e.g., OpenAI's GPT-3) to automatically generate a house blueprint based on user input and acquired real estate information.

[1707] Input: User-entered data, property information data

[1708] Output: House design data

[1709] Specific operation: The server sends a prompt to the generative AI model to generate a blueprint. An example of the prompt is as follows:

[1710] User input: {'image': 'modern_house_image.jpg', 'family_size': 4, 'location': 'Tokyo', 'budget': 5000, 'emotion': 'happy'}

[1711] Property Data: {'Land Information': '...', 'Building Information': '...'}

[1712] Generate a blueprint.

[1713] Step 4:

[1714] The server creates a 3D model using a 3D modeling library based on the generated design drawing.

[1715] Input: House blueprint data

[1716] Output: 3D model data

[1717] Specific operation: The server inputs the design data into the 3D modeling library and generates a 3D model.

[1718] Step 5:

[1719] The server sends the generated 3D model to the user's device, which displays it.

[1720] Input: 3D model data

[1721] Output: 3D model displayed on the user's device

[1722] Specific operation: The server sends the 3D model data to the user's device, which then displays it on a display device (smartphone or HMD).

[1723] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1724] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1725] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[1726] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1727] [Third embodiment]

[1728] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1729] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1730] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1731] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1732] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1733] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1734] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1735] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1736] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1737] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1738] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1739] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1740] "Example 1"

[1741] In one embodiment of the present invention, a user saves an image of a home they like from a social media platform such as Instagram and inputs that image information into the system. The user also inputs desired information into the system, such as their family composition, desired address, price range, whether or not they want to renovate, whether they want a house or an apartment, etc. The system automatically generates a blueprint for the home based on this preference information and desired information.

[1742] "Example 2"

[1743] Furthermore, this system obtains land and building information from real estate information websites and automatically generates house blueprints based on this information. Specifically, it proposes window orientation, size, floor plan, etc., taking into account the shape of the land and building, location conditions, etc.

[1744] "Example 3"

[1745] For example, if a user inputs an image of a modern exterior saved on Instagram and information such as a desire for a detached house in Tokyo for a family of four with a budget of 50 million yen, the system will automatically generate a blueprint for a detached house in Tokyo with a modern exterior based on this information.The system will also suggest window orientation, size, floor plan, etc. based on information on land and buildings in Tokyo obtained from a real estate information website.

[1746] The processing flow of each embodiment will be described below.

[1747] "Example 1"

[1748] Step 1: A user saves an image of a house they like from a social media site such as Instagram.

[1749] Step 2: The user inputs the saved image information into this system.

[1750] Step 3: The user enters desired information into the system, such as their family composition, desired address, price range, whether or not they want to renovate, whether they want a house or an apartment, etc.

[1751] Step 4: The system automatically generates a house blueprint based on this preference and desired information.

[1752] "Example 2"

[1753] Step 1: This system obtains land and building information from a real estate information website.

[1754] Step 2: The system automatically generates a house blueprint based on the acquired land and building information. Specifically, it proposes window orientation, size, floor plan, etc., taking into account the shape of the land and building, location conditions, etc.

[1755] "Example 3"

[1756] Step 1: The user enters an image of a modern exterior they have saved on Instagram, along with information such as a family of four looking for a detached house in Tokyo with a budget of 50 million yen.

[1757] Step 2: Based on this information, the system automatically generates blueprints for a detached house in Tokyo with a modern exterior.

[1758] Step 3: The system proposes window orientation, size, floor plan, etc. based on information about land and buildings in Tokyo obtained from a real estate information website.

[1759] Example 1

[1760] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1761] Conventional home design systems have had difficulty automatically generating blueprints that reflect the user's preferences and wishes. Furthermore, due to a lack of effective means for users to utilize image information acquired from social media, it was not possible to reflect the user's specific preferences in the design. Furthermore, when proposing a home based on the generated blueprints, it was difficult to make proposals that matched the user's wishes.

[1762] The specification process by the specification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving image information saved by the user as input and analyzing this information to identify the user's preferences, means for generating and inputting a prompt sentence to the generative AI model, and means for proposing a house based on the generated blueprint. This makes it possible to automatically generate a house blueprint that reflects the user's specific preferences and wishes, and to propose a house that meets the user's wishes.

[1763] "User preference information" is information about the design and style of a home that the user prefers, and includes images and text data obtained from social media.

[1764] "Desired information" refers to the specific conditions and requirements for the home the user desires, including information such as family composition, desired address, price range, whether or not the home has been renovated, and whether it is a detached house or an apartment.

[1765] "Image Information" refers to image data of a home obtained by a user from social media or other sources and uploaded to the system.

[1766] A "generative AI model" is an artificial intelligence model that automatically generates house blueprints based on a user's preferences and desires, and uses natural language processing and image analysis technology.

[1767] A "prompt sentence" is an instruction sentence input to a generative AI model, and is generated based on the user's preference and desired information.

[1768] A "home blueprint" is a blueprint of a home generated based on the user's preference information and desired information, and includes a specific layout and design.

[1769] A "housing proposal" is a proposal for a house made to a user based on the generated house blueprint, and includes content that matches the user's wishes.

[1770] This invention is based on the premise that users save images of their favorite homes from social media such as Instagram and input the image information into the system. The user also inputs desired information into the system, such as their family composition, desired address, price range, whether or not they want to renovate, whether they want a house or an apartment, etc. Based on this information, the system automatically generates a blueprint for the home.

[1771] Hardware and software used

[1772] The server receives the image information and desired information entered by the user and stores it in a database. Specifically, it uses the following hardware and software:

[1773] Server: High-performance cloud server (e.g., Amazon Web Services, Google Cloud Platform)

[1774] Database: Relational database (e.g. MySQL, PostgreSQL)

[1775] Generative AI models: AI models that use natural language processing and image analysis techniques (e.g., OpenAI's GPT-4, DALL-E)

[1776] Image analysis software: Computer vision technologies (e.g., TensorFlow, PyTorch)

[1777] Data processing and calculation

[1778] The server receives the image file uploaded by the user and the desired information entered, and stores this data in a database. Based on the stored data, it generates and inputs a prompt to the generative AI model. The generative AI model generates a house blueprint based on the prompt and provides it to the user via the server.

[1779] Specific examples

[1780] For example, let's say a user saves an image of a modern home design from Instagram and enters the following preferences:

[1781] Family composition: 4 people (2 adults, 2 children)

[1782] Desired address: Tokyo

[1783] Price range: Under 50 million yen

[1784] Renovation status: Yes

[1785] Detached house or apartment: Detached house

[1786] With this information, the server inputs the following prompt into the generative AI model:

[1787] Based on images of modern-design homes saved by users from Instagram, generate blueprints for homes that match the following desired information:

[1788] Family composition: 4 people (2 adults, 2 children)

[1789] Desired address: Tokyo

[1790] Price range: Under 50 million yen

[1791] Renovation status: Yes

[1792] Detached house or apartment: Detached house

[1793] Based on this prompt, the generative AI model generates a house blueprint that matches the user's wishes and provides it to the user via the server. The user can then review the blueprint received on their device and, if necessary, modify their desired information to generate a new blueprint.

[1794] In this way, it becomes possible to automatically generate house designs that reflect the specific preferences and wishes of the user, and to propose a house that meets the user's wishes.

[1795] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1796] Step 1:

[1797] A user saves an image of a house they like from a social media platform such as Instagram. A user uses a smartphone or computer to find and save an image of a house they like from a social media platform such as Instagram. The input is image data obtained from the social media platform, and the output is an image file saved on the user's device.

[1798] Step 2:

[1799] The user uploads the saved image to the system. The user accesses the system's website or application and uploads the saved image of the house. Specifically, the user clicks the upload button and selects the saved image file. The input is the image file saved on the user's device, and the output is the image data sent to the server.

[1800] Step 3:

[1801] The user inputs desired information such as family composition, desired address, price range, whether or not the property has been renovated, whether it is a detached house or an apartment, etc. The user inputs desired information into the system's input form, such as family composition (e.g., 2 adults, 2 children), desired address (e.g., Tokyo), price range (e.g., under 50 million yen), whether or not the property has been renovated (e.g., renovated), and whether or not it is a detached house or an apartment (e.g., detached house). The input is the desired information entered by the user, and the output is the desired information sent to the server.

[1802] Step 4:

[1803] The server receives image information and desired information from the user and stores it in a database. The server receives image files uploaded by the user and desired information entered, and stores this data in a database. When storing, it associates it with the user ID and manages it. The input is the image information and desired information sent by the user, and the output is the data stored in the database.

[1804] Step 5:

[1805] The server generates and inputs prompt sentences to the generative AI model based on the stored data. The server generates prompt sentences to input to the generative AI model based on the image information and desired information stored in the database. For example, it generates prompt sentences like the following:

[1806] Based on images of modern-design homes saved by users from Instagram, generate blueprints for homes that match the following desired information:

[1807] Family composition: 4 people (2 adults, 2 children)

[1808] Desired address: Tokyo

[1809] Price range: Under 50 million yen

[1810] Renovation status: Yes

[1811] Detached house or apartment: Detached house

[1812] The input is image information stored in the database and desired information, and the output is a prompt sentence that is input into the generative AI model.

[1813] Step 6:

[1814] A generative AI model generates a house blueprint based on a prompt. A generative AI model (e.g., OpenAI's GPT-4 or DALL-E) generates a house blueprint based on a prompt sent from a server. The generative AI model uses image analysis and natural language processing technology to create a blueprint that meets the user's needs. The input is the prompt, and the output is the generated house blueprint.

[1815] Step 7:

[1816] The server sends the generated blueprint to the user's device. The server sends the blueprint received from the generative AI model to the user's device. The user can download or view the blueprint through the system's website or application. The input is the generated house blueprint, and the output is the blueprint sent to the user's device.

[1817] Step 8:

[1818] The user checks the blueprint. The user checks the blueprint received on their terminal. They can check whether the blueprint meets their requirements, and if necessary, they can modify the desired information and generate a new blueprint. The input is the blueprint sent to the user's terminal, and the output is the user's confirmation result.

[1819] (Application example 1)

[1820] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1821] Conventional home design systems have difficulty automatically generating blueprints that reflect a user's preferences and wishes. Especially when a user has a specific image in mind, specialized knowledge is required to reflect that image in the blueprint. Furthermore, when a user checks a home design in a physical store, it is difficult to generate and display blueprints in real time. This leads to problems such as reduced user satisfaction and delayed home purchase decisions.

[1822] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1823] In this invention, the server includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for analyzing a house image taken by the user and extracting its features, means for generating a prompt sentence based on the extracted features and the user's desired information and generating the house blueprint using a generative AI model, and means for presenting the generated blueprint to the user on a display device. This allows a house blueprint that reflects the user's specific image to be generated in real time and can be confirmed in a physical store.

[1824] "User preference information" is information that indicates the user's personal tastes and design preferences for homes.

[1825] "Desired information" is information that indicates the specific requests and conditions that the user has for a home (family composition, desired address, price range, whether or not it has been renovated, whether it is a detached house or an apartment, etc.).

[1826] "Real estate information" refers to information that indicates detailed data about real estate properties (location, price, floor plan, age, etc.).

[1827] A "home blueprint" is a drawing that specifically shows the structure, layout, and design of a home.

[1828] "Means for automatic generation" refers to devices or programs that have the function of automatically creating blueprints using algorithms or AI models based on input information.

[1829] The "means for making a proposal" is a device or program that has the function of making a housing proposal to the user based on the generated design drawings.

[1830] "House images" are photos and image data of houses taken by users.

[1831] The "analyzing means" refers to a device or program that has the function of analyzing input image data and extracting its features.

[1832] A "means for extracting features" is a device or program that has the function of extracting important features from data obtained by image analysis.

[1833] A "prompt sentence" is a text-based input sentence that provides instructions to a generative AI model.

[1834] A "generative AI model" is an artificial intelligence model that generates blueprints and other data based on input prompts.

[1835] A "display device" is a device (such as a display or VR headset) that visually presents the generated design drawing to the user.

[1836] A system for implementing this invention includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for analyzing a house image taken by the user and extracting its features, means for generating a prompt sentence based on the extracted features and the user's desired information and generating a house blueprint using a generative AI model, and means for presenting the generated blueprint to the user via a display device.

[1837] Hardware and software used

[1838] Hardware

[1839] A smartphone or tablet (iOS or Android) that users use to take pictures of their home and enter information.

[1840] Smart glasses (e.g., Google Glass): Used to analyze images taken by the user in real time.

[1841] A large screen display or VR headset (e.g., Oculus Rift): Used to present the generated blueprints to the user.

[1842] software

[1843] Image recognition library (e.g., OpenCV): Used to analyze house images taken by the user and extract their features.

[1844] Generative AI models (e.g., GPT-4, DALL-E): Used to generate house blueprints based on prompts.

[1845] Databases (e.g., Firebase): Used to store and manage user preferences, wishes, and property information.

[1846] A front-end framework (e.g., React Native) is used to build the user interface.

[1847] Processing flow

[1848] 1. User Input

[1849] Users use their smartphone or tablet to take pictures of their preferred homes and upload them to the application, then enter information such as family composition, desired address, price range, whether or not the home has been renovated, and whether they want a detached house or an apartment.

[1850] 2. Image Analysis

[1851] The server uses an image recognition library (OpenCV) to analyze the uploaded house images and extract their features.

[1852] 3. Prompt generation

[1853] The server generates a prompt sentence for the generative AI model (GPT-4) based on the extracted features and the user's desired information.

[1854] Prompt Sentence Examples

[1855] Based on the images and desired information provided by the user, generate a blueprint for a house that meets the following criteria:

[1856] Family composition: 4 people

[1857] Preferred address: Tokyo

[1858] Price range: Under 50 million yen

[1859] Renovation: Yes

[1860] Detached house

[1861] Modern design

[1862] 4. Generate blueprints

[1863] The server uses a generative AI model (DALL-E) to generate a house blueprint based on the prompt.

[1864] 5. Displaying the results

[1865] The generated blueprints are presented to users via a large screen display or VR headset, allowing them to see their ideal home design in real time in a physical store.

[1866] Specific examples

[1867] For example, a user can upload a photo of a modern living room taken with their smartphone and input desired information such as "family size: 4 people, desired address: Tokyo, price range: within 50 million yen, renovation: yes, detached house." Based on this information, the server generates a blueprint of a modern detached house for a family of 4 in Tokyo that can be renovated and costs within 50 million yen, and presents it to the user.

[1868] In this way, users can see their ideal home design in real time at a physical store.

[1869] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1870] Step 1:

[1871] Users use their smartphone or tablet to take pictures of their preferred homes and upload them to the application, then enter information such as family composition, desired address, price range, whether or not the home has been renovated, and whether they want a detached house or an apartment.

[1872] Input: Home image, family composition, desired address, price range, whether it needs to be renovated, desired information such as whether it is a detached house or an apartment, etc.

[1873] Output: Uploaded house images and desired information

[1874] Step 2:

[1875] The server uses an image recognition library (OpenCV) to analyze the uploaded house images and extract their features.

[1876] Input: Uploaded house image

[1877] Output: Extracted image features

[1878] Specific operation: Using an image recognition library, edge detection and color analysis are performed on house images to extract features.

[1879] Step 3:

[1880] The server generates a prompt sentence for the generative AI model (GPT-4) based on the extracted features and the user's desired information.

[1881] Input: extracted image features, desired information

[1882] Output: Generated prompt statement

[1883] Specific operation: The extracted features are combined with the desired information to create a prompt sentence to be input into the generative AI model.

[1884] Step 4:

[1885] The server uses a generative AI model (DALL-E) to generate a house blueprint based on the prompt.

[1886] Input: Generated prompt text

[1887] Output: The generated house blueprint

[1888] Specific operation: A prompt sentence is input into the generative AI model to generate a house blueprint.

[1889] Step 5:

[1890] The server presents the generated blueprints to the user via a large-screen display or VR headset.

[1891] Input: Generated house blueprint

[1892] Output: The design presented to the user

[1893] Specific operation: The generated design is sent to a display or VR headset so that the user can visually check it.

[1894] In this way, users can see their ideal home design in real time at a physical store.

[1895] Example 2

[1896] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1897] Conventional home design systems have had the problem of requiring a great deal of time and effort to reflect the user's preferences and desired information. It was also difficult to efficiently obtain real estate information and automatically generate optimal home design plans based on that information. This made it difficult to quickly provide a home design that satisfied the user.

[1898] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1899] In this invention, the server includes means for acquiring land and building information from a real estate information site, means for storing the acquired information in a data frame and processing the data, means for generating a prompt sentence to be input to a generative AI model based on the processed data, means for automatically generating a house blueprint using the generative AI model, and means for proposing a house based on the generated blueprint, thereby enabling the rapid and efficient provision of a house blueprint that reflects the user's preferences and desired information.

[1900] A "real estate information site" is a website that provides information about land and buildings.

[1901] "Land and building information" refers to detailed data such as the shape of the land, the location of the building, the orientation and size of the windows, and the layout.

[1902] A "data frame" is a two-dimensional data structure consisting of rows and columns, and is used to store and manipulate data.

[1903] "Data processing" is the process of converting acquired data into a form that is easy to analyze and use, and includes filling in missing values ​​and normalizing data.

[1904] A "generative AI model" is a model that uses artificial intelligence to perform a specific task, in this case to automatically generate blueprints for a house.

[1905] A "prompt sentence" is an instruction sentence to be input into the generative AI model, and is generated based on information about the land and building.

[1906] A "house blueprint" is a drawing that shows the floor plan and structure of a house, and serves as the basis for architectural planning.

[1907] A "housing proposal" is a proposal made to the user regarding the design and layout of a house based on the generated blueprint.

[1908] MODE FOR CARRYING OUT THE INVENTION

[1909] This invention relates to a system that acquires land and building information from a real estate information site and automatically generates house blueprints based on this information. A specific embodiment of this system will be described below.

[1910] 1. Program Generation

[1911] The server generates a program to retrieve land and building information from real estate information websites. This program is developed using Python and performs web scraping using libraries such as BeautifulSoup and Selenium.

[1912] 2. Data acquisition and processing

[1913] The server runs the generated program and retrieves land and building information from real estate information websites. Specifically, it collects data such as the shape of the land, the building's location, window orientation, size, and floor plan. The collected data is stored in a data frame using the Pandas library, and any necessary data processing is performed, such as filling in missing values ​​and normalizing the data.

[1914] 3. Prompt generation for the generative AI model

[1915] The server generates prompts to be input into the generative AI model based on the processed data. The prompts include information such as the shape of the land and building, location conditions, window orientation, size, and layout.

[1916] Example prompt sentence:

[1917] Based on the land information for Shibuya Ward, Tokyo, please generate a house blueprint while taking into consideration the following conditions.

[1918] Land shape: Rectangular

[1919] Building location: South facing

[1920] Window orientation: South

[1921] Window size: Large

[1922] Floor plan: 3LDK

[1923] 4. Generate house blueprints

[1924] The server inputs the generated prompt sentence into a generative AI model (e.g., a generative AI model) to generate a house blueprint. The generative AI model then proposes an optimal blueprint based on the prompt sentence.

[1925] 5. Displaying the results

[1926] The server displays the generated house plan on the user's device, where the user can review the proposed plan and request modifications if necessary.

[1927] Specific examples

[1928] If a user wants to generate a house blueprint based on land information for Shibuya Ward, Tokyo, the server inputs the following prompt statement into the generative AI model:

[1929] Example prompt sentence:

[1930] Based on the land information for Shibuya Ward, Tokyo, please generate a house blueprint while taking into consideration the following conditions.

[1931] Land shape: Rectangular

[1932] Building location: South facing

[1933] Window orientation: South

[1934] Window size: Large

[1935] Floor plan: 3LDK

[1936] The generative AI model will then suggest a house blueprint based on the prompt, which will then be displayed on the device for the user to review.

[1937] In this way, the present invention makes it possible to quickly and efficiently provide a house design plan that reflects the user's preferences and desired information.

[1938] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1939] Program processing flow

[1940] Step 1: Obtain property information

[1941] The server retrieves land and building information from real estate information websites. Specifically, it uses Python to perform web scraping using libraries such as BeautifulSoup and Selenium.

[1942] Input: URL of real estate information site

[1943] Output: Land and building information (e.g., land shape, building location, window orientation, size, floor plan)

[1944] Specific behavior:

[1945] The server uses Selenium to automatically control the browser and access the specified URL, then parses the HTML using BeautifulSoup to extract the required information.

[1946] Step 2: Data processing

[1947] The server stores the acquired real estate information in a data frame using the Pandas library and performs any necessary data processing, such as filling in missing values ​​and normalizing the data.

[1948] Input: Land and building information

[1949] Output: The processed data frame

[1950] Specific behavior:

[1951] The server converts the retrieved data into a data frame using the Pandas read_html function, then uses the fillna function to impute missing values ​​and the normalize function to normalize the data.

[1952] Step 3: Generate prompts for the generative AI model

[1953] The server generates prompts to be input into the generative AI model based on the processed data. The prompts include information such as the shape of the land and building, location conditions, window orientation, size, and layout.

[1954] Input: The processed data frame

[1955] Output: prompt statement

[1956] Specific behavior:

[1957] The server extracts the necessary information from the data frame and generates a prompt sentence like this:

[1958] Based on the land information for Shibuya Ward, Tokyo, please generate a house blueprint while taking into consideration the following conditions.

[1959] Land shape: Rectangular

[1960] Building location: South facing

[1961] Window orientation: South

[1962] Window size: Large

[1963] Floor plan: 3LDK

[1964] Step 4: Generate the house plan

[1965] The server inputs the generated prompt sentence into a generative AI model (e.g., a generative AI model) to generate a house blueprint. The generative AI model then proposes an optimal blueprint based on the prompt sentence.

[1966] Input: prompt statement

[1967] Output: House blueprint

[1968] Specific behavior:

[1969] The server sends a prompt to the generative AI model's API and receives a blueprint proposal in return. For example, the server sends the prompt using the openai.Completion.create function.

[1970] Step 5: View the results

[1971] The server displays the generated house plan on the user's device, where the user can review the proposed plan and request modifications if necessary.

[1972] Input: House blueprint

[1973] Output: Blueprint displayed on the user's device

[1974] Specific behavior:

[1975] The server formats the generated blueprint in HTML format and sends it to the user's device, where the user can view the blueprint through a browser.

[1976] (Application example 2)

[1977] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1978] Conventional home design systems have difficulty reflecting users' preferences and desired information, and the automatic generation of blueprints based on real estate information is also limited. Furthermore, interior design for physical stores requires specialized knowledge and is not easily performed by ordinary users. For this reason, there is a demand for a system that allows users to easily design homes and stores that meet their desires.

[1979] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving a user's preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for automatically generating an interior design of a physical store based on information acquired from a real estate information provider site, means for creating a prompt sentence for generating the blueprint using a generative AI model, and means for generating the actual blueprint using the generative AI model. This enables users to easily design a house or store that suits their needs.

[1980] "User preference information" is information about the style, function, and design that the user desires in the design of a house or store.

[1981] "Desired information" is information about the specific conditions and requirements that a user desires in the design of a house or store.

[1982] "Real estate information" refers to information relating to the shape, location, area, etc. of land and buildings.

[1983] A "blueprint" is a drawing that shows the floor plan of a house or store, the direction and size of windows, and the interior layout.

[1984] A "real estate information site" is a website that provides information about land and buildings on the Internet.

[1985] "Interior design" refers to planning the layout and design of the interior space of a store or home.

[1986] A "generative AI model" is an algorithm or program that uses artificial intelligence to automatically generate blueprints and designs.

[1987] A "prompt" is an instruction to be input into a generative AI model, and is a sentence that contains the conditions and requirements for generating blueprints and designs.

[1988] A system for implementing the present invention includes a server, a user terminal, and a generative AI model. A specific embodiment of this system will be described below.

[1989] First, the user terminal receives the user's preference information and desired information as input. This information is about the style, function, and design that the user desires in the design of a house or store. The user terminal then transmits this information to the server.

[1990] Next, the server acquires real estate information from a real estate information website. This real estate information includes the shape of the land and building, location conditions, area, etc. The server automatically generates blueprints for homes and stores based on the acquired real estate information.

[1991] The server uses the generative AI model to create a prompt to generate a blueprint. This prompt includes the user's preferences, wishes, and real estate information. For example, the following prompt might be generated:

[1992] "Land shape: Rectangular, Location: Urban area, Window orientation: South facing, Lighting position: Center of ceiling"

[1993] Based on the generated prompt, a generative AI model generates the actual blueprint. For example, OpenAI's GPT-3 is used as a generative AI model. This model takes the prompt as input and outputs a blueprint.

[1994] The generated blueprints are sent from the server to the user's terminal and presented to the user, who can then check the design of the house or store based on the blueprints and make any necessary modifications.

[1995] This system allows users to easily design homes and stores that meet their needs. Specifically, users can easily generate and check blueprints using a smartphone or computer. This allows users to create designs that meet their needs without specialized knowledge.

[1996] The above is a specific embodiment for carrying out the present invention.

[1997] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1998] Step 1:

[1999] The user terminal receives the user's preference information and desired information as input. The user uses a smartphone or PC to input information about the style, functions, and design desired for the design of a home or store. The input information is saved in the user terminal.

[2000] Step 2:

[2001] The user terminal transmits the input preference information and desired information to the server, where the information is stored in a database.

[2002] Step 3:

[2003] The server obtains real estate information from a real estate information provider site. The server uses an API to send a request to the real estate information provider site and obtains information such as the shape of the land and building, location conditions, and area. The obtained real estate information is stored on the server.

[2004] Step 4:

[2005] The server creates a prompt to generate a blueprint based on the acquired real estate information and the user's preferences and wishes. The prompt includes information such as the shape of the land, location conditions, window orientation, and lighting position. For example, a prompt such as "Land shape: rectangular, location conditions: urban area, window orientation: south-facing, lighting position: center of ceiling" may be generated.

[2006] Step 5:

[2007] The server uses a generative AI model to generate a blueprint using the prompt sentence as input. For example, OpenAI's GPT-3 is used as the generative AI model. After receiving the prompt sentence as input, the generative AI model outputs a blueprint. The generated blueprint is saved on the server.

[2008] Step 6:

[2009] The server sends the generated blueprint to the user's device, which then presents the received blueprint to the user, who can then view it on their smartphone or computer screen.

[2010] Step 7:

[2011] The user can check the design of their home or store based on the presented blueprint and make any necessary modifications. The modified information is sent back to the server, and a new blueprint is generated. This allows the user to realize a design that suits their needs.

[2012] Example 3

[2013] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2014] Conventional home design systems have difficulty automatically generating blueprints that reflect the user's preferences and wishes, and are unable to provide optimal design proposals based on real estate information. For this reason, there is a need to efficiently provide home designs that meet the user's needs.

[2015] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[2016] In this invention, the server includes means for receiving user preference information and desired information as input and automatically generating a house blueprint based on this information, means for receiving real estate information as input and automatically generating a house blueprint based on this information, means for proposing a house based on the generated blueprint, means for sending a prompt message and an image to the generating AI model and generating the blueprint, means for acquiring land and building information from a real estate information provider site, means for proposing an optimal design based on the acquired real estate information, and means for displaying the generated blueprint and the proposed content to the user. This makes it possible to automatically generate a house blueprint that reflects the user's preferences and wishes and to propose an optimal design based on the real estate information.

[2017] "User preference information" is information that indicates the user's personal preferences, such as the design, style, and functions desired in the design of a house.

[2018] "Desired information" refers to specific conditions and requirements that a user desires in a home design, such as family composition, budget, location,...

Claims

1. A generating means for automatically generating a blueprint of the house based on user's house-related information including the design, style and conditions of the house preferred by the user and real estate information by inputting a specific prompt sentence into a generating AI model; A means for proposing the house based on the generated design drawing; an emotion engine that recognizes the emotion of the user; A means for adjusting the interior and layout of the house included in the blueprint based on the emotion; means for displaying the adjusted design drawing using a virtual reality display device; A system including:

2. The system of claim 1 , wherein the generating means obtains the user home-related information from social media.

3. The system according to claim 1 , wherein the generating means acquires the real estate information from a real estate information providing site.

Images