system

Abstract

We provide the system. [Solution] A means by which the user inputs and transmits interior design requirements using a terminal, A server receives the aforementioned interior requirements and generates a detailed interior plan using generative artificial intelligence. A means for analyzing the aforementioned interior plan and converting it into a prompt for image generation artificial intelligence, A means for sending the aforementioned prompt to an image generation artificial intelligence and generating an image of the room's interior, A means for receiving the generated image and processing it into an appropriate format, Means for transmitting the processed image to the user, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a problem that when a user views an image of a room posted on a conventional real estate website, it is difficult to evoke an image of life. There is also a problem that it takes a great deal of cost and time to set up and photograph an actual room. For this reason, it is difficult to attract the interest of users, and the promotion of real estate sales and rentals may be delayed.

Means for Solving the Problems

[0005] To solve the above problems, the present invention provides the following means: A means for a user to input interior design requirements using a terminal and send them to a server. The server generates a detailed interior design plan using generative artificial intelligence based on the received interior design requirements. A means for analyzing this plan and converting it into prompts for image generation artificial intelligence. Based on the prompts, the image generation artificial intelligence generates interior design images of the room, and these images are received by the server. By processing the received images into a format suitable for real estate websites and sending them to the user, the present invention provides a system that reduces setup costs while providing high-quality interior design images that evoke a sense of living in the space.

[0006] A "terminal" is a device used by users to input information and communicate with a server.

[0007] "Interior design requirements" refer to detailed requests from the user regarding the design, layout, and color scheme of the room, which are entered into the terminal and sent to the server.

[0008] A "server" is a central computer system that receives interior requirements sent from a user's terminal and operates generative artificial intelligence and image-generating artificial intelligence.

[0009] "Generative artificial intelligence" refers to artificial intelligence that automatically generates detailed interior design plans based on input information.

[0010] An "interior design plan" is a detailed plan of room layout and design, generated by a generative artificial intelligence system based on the user's interior design requirements.

[0011] A "prompt" is a set of instructions that instructs an image-generating artificial intelligence to generate an image of the room's interior.

[0012] "Image generation artificial intelligence" is an artificial intelligence that automatically generates high-quality images of room interiors based on given prompts.

[0013] "Generated image" refers to an image of the room's interior generated by image generation artificial intelligence.

[0014] "Processing" refers to the process of converting the generated images into a format suitable for real estate websites, and includes adjusting the resolution and converting the file format.

[0015] "User" refers to an individual or legal entity that operates the system to generate interior images of rooms for listing on real estate websites.

[0016] A "real estate website" is a website that publishes property information and related images. [Brief explanation of the drawing]

[0017] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when combined with an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when combined with an emotion engine.

Mode for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc.

[0021] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0022] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0023] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0025] [First Embodiment]

[0026] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0027] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0030] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0037] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0038] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images by linking a generative artificial intelligence and an image-generating artificial intelligence based on the interior requirements entered by the user, and then processing and providing these images.

[0039] Specific Embodiments

[0040] Enter and submit interior design requirements

[0041] The user enters interior design requirements using a terminal. For example, the user might enter requirements such as "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[0042] Generating interior design plans

[0043] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements. The generative AI analyzes the input information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that meet the requirements. For example, it might generate a plan that includes "a brightly colored sofa and table, a large window that lets in plenty of natural light, modern lighting, and houseplants in the living room."

[0044] Generate a view

[0045] The server analyzes the generated interior design plan and converts it into a prompt for image-generating artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior design plan in a format that the image-generating AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0046] Request for image generation

[0047] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[0048] Image processing

[0049] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. By saving the images in a format optimized for real estate websites, high-quality display is achieved.

[0050] Image submission and confirmation

[0051] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, presses the "Save" button to save the image, or presses the "Regenerate" button to request the generation of a new image.

[0052] Posting on the site

[0053] After selecting a satisfactory image, the user proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[0054] According to the above embodiment, the cost and time required to photograph rooms for listing on real estate websites can be reduced, and the image of what it would be like to live in the room that users experience when they actually see it can be enhanced. This is expected to have the effect of promoting the buying, selling, and renting of real estate.

[0055] The following describes the processing flow.

[0056] Step 1:

[0057] The user enters their interior design requirements into the terminal. For example, they might enter a requirement such as, "I want a modern living room with light-colored furniture," and then press the submit button to send the requirement information to the server.

[0058] Step 2:

[0059] The server receives the user's interior design requirements information.

[0060] Step 3:

[0061] The server receives interior design requirements and sends the requirements information to a generative artificial intelligence (AI). The AI ​​analyzes the requirements information and generates a detailed interior design plan. This plan includes color schemes, furniture placement, wall decorations, lighting, and more.

[0062] Step 4:

[0063] The server receives interior design plans generated by generative artificial intelligence, analyzes the plans, and converts them into prompts for image generation artificial intelligence.

[0064] Step 5:

[0065] The server sends the generated prompt to the image generation AI, requesting it to generate an image of the room's interior.

[0066] Step 6:

[0067] The image generation AI generates an image of the room's interior based on the prompt and sends the generated image back to the server.

[0068] Step 7:

[0069] The server receives the generated images and processes them, such as adjusting the resolution and converting the file format. This makes them suitable for real estate websites.

[0070] Step 8:

[0071] The server sends the processed image to the user's device.

[0072] Step 9:

[0073] The user reviews the image sent on their device. If satisfied, they can press the "Save" button to save the image. Furthermore, they can request the generation of a new image by pressing the "Regenerate" button if needed.

[0074] Step 10:

[0075] Users select images they are satisfied with, log in to the real estate website using their device, and upload the generated images to publish them on the website.

[0076] This series of processes allows for the efficient generation of high-quality interior images, which can then be posted on real estate websites.

[0077] (Example 1)

[0078] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0079] In the real estate industry, maintaining high quality and generating interior images of properties quickly is a critical challenge. However, traditional methods involve significant costs and time for photography and image editing, and it is difficult to efficiently propose interior images that satisfy users. In particular, the entire process from users inputting specific interior requirements to generating high-quality interior images that meet those requirements and finally posting them on the real estate website is cumbersome. Therefore, there is a need for a system that improves overall work efficiency and provides users with satisfactory interior images quickly.

[0080] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0081] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence; means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence; means for transmitting the prompts to the image generation artificial intelligence to generate an image of the room's interior; means for receiving the generated image and processing it into an appropriate format; means for transmitting the processed image to the user; and means for the user to view the image on their terminal and choose to regenerate or save it. This makes it possible to quickly and efficiently generate high-quality interior design images that correspond to the user's input of specific interior design requirements and ultimately post them on a real estate website.

[0082] A "user" refers to an individual or legal entity that uses the system to input interior design requirements.

[0083] A "terminal" is an electronic device used by a user for operation, and includes personal computers, tablets, smartphones, and other similar devices.

[0084] "Interior design requirements" refer to the specific conditions and demands regarding the interior design of a room that the user enters.

[0085] "Means of transmission" refers to the functions and operations used by a user to send interior design requirements entered via a terminal to a server.

[0086] A "server" refers to a central processing unit or computer system that analyzes interior design requirements received from users and generates and processes images using generative artificial intelligence and image generation artificial intelligence.

[0087] "Generative artificial intelligence" refers to artificial intelligence technologies and algorithms used to generate detailed interior design plans based on interior design requirements.

[0088] An "interior design plan" refers to a plan that includes details such as the layout, color scheme, and furniture of the interior, generated by generative artificial intelligence.

[0089] A "prompt" refers to the instruction or input text necessary to pass the interior design plan to the image-generating artificial intelligence.

[0090] "Image generation artificial intelligence" refers to artificial intelligence technologies and algorithms used to generate high-quality interior images based on prompts.

[0091] "Appropriate format" refers to a format that meets the requirements for image resolution, file format, size adjustment, and other specifications necessary for posting images on a real estate website.

[0092] "Processing methods" refer to processes such as adjusting the resolution and converting the file format of the generated image in order to make it suitable for a real estate website.

[0093] "Regeneration" refers to the act of a user requesting the creation of a new image if they are not satisfied with the previously generated image.

[0094] "Saving" refers to the act of a user being satisfied with a generated image and saving that image to their device.

[0095] A "real estate website" refers to a website used to showcase real estate properties.

[0096] "Methods of uploading" refers to the operations and functions that allow users to upload generated images for posting on real estate websites.

[0097] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images by linking a generative artificial intelligence and an image-generating artificial intelligence based on the interior requirements entered by the user, and then processing and providing these images.

[0098] Enter and submit interior design requirements

[0099] The user uses their own device (such as a PC or tablet) to open the interior design requirements input page on the real estate website. The requirements the user enters might be something like, "I want a modern living room with light-colored furniture." After completing the input, pressing the submit button converts the input data into JSON format using JavaScript (registered trademark) and sends it to the server.

[0100] Generating interior design plans

[0101] The server analyzes the received interior design requirements using a programming language such as Python. It then inputs the data into a generative artificial intelligence (e.g., GPT-4®) and performs natural language processing to generate a detailed interior design plan. The generated plan might include details such as, "The living room should include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0102] Generate a view

[0103] The server converts the generated interior plan into a prompt for image-generating artificial intelligence. The prompt is a concise instruction that extracts and summarizes the key elements of the interior plan, in a format that image-generating AI can understand. For example, if the interior plan is "The living room should include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants," the prompt would be:

[0104] "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0105] Request for image generation

[0106] The server sends the generated prompt to an image-generating artificial intelligence (such as DALL-E or Stable Diffusion) to generate high-quality images of the room's interior. This AI generates images based on the prompts and sends the generated images back to the server.

[0107] Image processing

[0108] The server uses image processing software such as Adobe Photoshop API and OpenCV to process received images into a format suitable for real estate websites. Image processing includes adjusting resolution, converting file formats, and cropping images.

[0109] Image submission and confirmation

[0110] The processed image is sent from the server to the user's device. The user checks the image through a web browser on their device, and if satisfied, they can either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[0111] Posting on the site

[0112] To post the generated images on the real estate website, the user logs in to the website using their device and uploads the image files. Along with the uploaded images, they also enter a description of the room and complete the posting.

[0113] This entire process allows users to efficiently generate high-quality interior images and post them on real estate websites. Furthermore, this system significantly reduces the cost and time required for shooting and editing interior images.

[0114] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0115] Step 1:

[0116] The user enters their interior design requirements using a terminal. For example, they might enter, "I want a modern living room with light-colored furniture." The input data includes the desired room type, color scheme, and furniture type. They then press the submit button to convert this data to JSON format and send it.

[0117] Input: User's interior design requirements (e.g., "I want a modern living room with light-colored furniture.")

[0118] Output: Interior design requirements data converted to JSON format

[0119] Step 2:

[0120] The server receives interior design requirements in JSON format from the user. It parses the received data and runs a Python script to extract the necessary information. This information is then passed to a generative artificial intelligence, which generates a detailed interior design plan through natural language processing. The generated interior design plan might include details such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0121] Input: Interior design requirements data in JSON format

[0122] Data processing: Analysis using Python scripts

[0123] Output: Detailed interior plan

[0124] Step 3:

[0125] The server further analyzes the generated interior plan and generates a prompt for the image generation artificial intelligence. This prompt is a concise instruction that extracts the main elements of the interior plan. This conversion process is performed using a text generation algorithm based on the information in the interior plan. For example, the prompt might read, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0126] Input: Detailed interior plan

[0127] Data processing: Prompt text generation using text generation algorithms

[0128] Output: Prompt message for image generation artificial intelligence

[0129] Step 4:

[0130] The server sends the generated prompt text to an image generation artificial intelligence (such as DALL-E or Stable Diffusion). This AI generates a high-quality interior image based on the prompt text and sends that image back to the server. The server also receives the URL of the generated image stored in cloud storage.

[0131] Input: Prompt for image generation artificial intelligence

[0132] Data processing: Image generation using artificial intelligence

[0133] Output: Generated interior image (and its URL)

[0134] Step 5:

[0135] The server receives the generated interior images and processes them into a format suitable for real estate websites. Specifically, this involves adjusting the resolution, converting file formats, and cropping the images. Adobe Photoshop API and OpenCV are used to perform these image processing tasks.

[0136] Input: Generated interior image

[0137] Data processing: Resolution adjustment, file format conversion, cropping

[0138] Output: Processed interior image

[0139] Step 6:

[0140] The server sends the processed image to the user's device. The user checks the image through a web browser on their device, and if satisfied, they can either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[0141] Input: Processed interior image

[0142] Data processing: Image transmission

[0143] Output: User confirmation result (choice to save or regenerate)

[0144] Step 7:

[0145] To post the generated images on the real estate website, the user logs in to the website using their device and uploads the image files. Along with the uploaded images, they also enter a description of the room and complete the posting.

[0146] Input: Saved image file, room description

[0147] Data processing: Image upload, description entry

[0148] Output: Image posting on real estate websites

[0149] The above outlines the specific processing flow within this system. Through the detailed data processing and calculations performed at each step, users can efficiently generate high-quality interior images and post them on real estate websites.

[0150] (Application Example 1)

[0151] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0152] Traditional real estate websites have faced significant costs and time constraints in generating interior images, and have struggled to provide interior images that accurately reflect users' specific requests. Furthermore, the lack of real-time visibility into desired interior and furniture customizations hindered purchase and selection decisions. Therefore, there is a need to efficiently generate high-quality room interior images and provide realistic interior images that meet user needs.

[0153] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0154] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence; means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence; means for transmitting the prompts to the image generation artificial intelligence to generate an image of the room's interior; means for receiving the generated image and processing it into an appropriate format; means for transmitting the processed image to the user; means for the user to customize furniture and interior design using a terminal and regenerate new conditions; and means for the user to view the room's interior design image on a virtual store interface and perform regeneration or set new conditions. This allows the user to view and regenerate their desired interior design image in real time, improving the efficiency of interior design decisions.

[0155] A "user" refers to the final user who uses the system to input interior design requirements and to view and customize images of the room's interior.

[0156] "Terminal" refers to a general term for electronic devices used by users to input interior design requirements and to view and manipulate the generated interior design images.

[0157] "Interior design requirements" refer to the specific conditions and requests regarding the interior design of a room that the user desires.

[0158] A "server" is a remote computing system that receives interior design requirements from users and uses generative artificial intelligence and image-generating artificial intelligence to create interior design plans, generate images, and process images.

[0159] "Generative artificial intelligence" refers to an artificial intelligence algorithm that generates detailed interior design plans based on the interior design requirements entered by the user.

[0160] An "interior design plan" refers to a design proposal for the arrangement of furniture, color scheme, and decorations within a room, generated by a generative artificial intelligence system based on the user's interior design requirements.

[0161] A "prompt" is a set of instructions based on the interior design plan, converted into a format that the image-generating artificial intelligence can understand.

[0162] "Image generation artificial intelligence" is an artificial intelligence algorithm that generates high-quality images of room interiors based on prompts.

[0163] "Processing" refers to the process of adjusting the resolution and converting file formats of generated interior images to adapt them to the requirements of real estate websites and virtual stores.

[0164] A "virtual store" is a digital platform where users can customize furniture and interior design online and view real-time generated images of the interior.

[0165] This invention is a system that efficiently generates high-quality interior images of rooms and provides realistic interior images that meet the user's needs. Specific embodiments of this system are described below.

[0166] Hardware and software configuration

[0167] The server has the following functions:

[0168] 1. Use a generative artificial intelligence system (e.g., GPT-4) to generate a detailed interior design plan based on the interior design requirements received from the user.

[0169] 2. Analyze the interior design plan and convert it into prompts that can be understood by image generation artificial intelligence (e.g., DALL-E or Stable Diffusion).

[0170] 3. The generated prompt is sent to the image generation artificial intelligence to generate an interior image.

[0171] 4. Process the generated interior images into a format suitable for real estate websites and virtual stores.

[0172] The device has the following features:

[0173] 1. A function that allows users to input interior design requirements through the user interface.

[0174] 2. A function to display the interior design plan and generated interior images sent to the server.

[0175] 3. A function that allows users to receive processed interior images and review and customize them.

[0176] The user will use the system in the following steps:

[0177] System operation

[0178] 1. Inputting interior design requirements:

[0179] The user uses the terminal interface to enter their desired room interior design requirements. For example, they might enter specific requirements such as, "I want a modern living room with light-colored furniture."

[0180] 2. Generating the interior design plan:

[0181] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements. The generated interior plan includes specific layouts, color schemes, and types of furniture. For example, it might say, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0182] 3. Generating the prompt:

[0183] The system analyzes the interior design plan and converts it into prompt sentences for image generation artificial intelligence. These prompt sentences are concise instructions that summarize the elements of the interior design plan. For example, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0184] 4. Generating interior images:

[0185] The server sends the generated prompt text to the image generation AI, which generates an image of the room's interior. The image generation AI generates a high-quality interior image based on the prompt text and sends it back to the server.

[0186] 5. Image processing:

[0187] The server receives the generated images and processes them into a format suitable for real estate websites and virtual stores. This processing includes adjusting the resolution, converting file formats, and cropping the images.

[0188] 6. Sending and confirming images to the user:

[0189] The processed image is sent to the user's device, and the user can review the generated interior image. If necessary, they can request regeneration or set new conditions to create the image again.

[0190] This allows users to view high-quality interior images tailored to their specific needs in real time. Furthermore, it assists them in making purchasing and selection decisions through online furniture and interior customization.

[0191] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0192] Step 1:

[0193] User input and submission of interior design requirements

[0194] The user enters interior design requirements in text format using the terminal interface. For example, they might enter the requirement "I want a modern living room with light-colored furniture" and press the submit button. This input data is then sent to the server in JSON format.

[0195] Input: User's interior design requirements (text)

[0196] Output: Interior design requirements sent to the server (in JSON format)

[0197] Step 2:

[0198] Generating interior design plans

[0199] The server uses generative artificial intelligence (GPT-4) to generate a detailed interior plan based on the received interior requirements. The generative AI analyzes the input information and outputs a detailed plan of the interior layout, color scheme, furniture, etc., that corresponds to the requirements.

[0200] Input: User's interior design requirements (JSON format)

[0201] Output: Interior design plan (text)

[0202] Step 3:

[0203] Prompt statement generation

[0204] The server analyzes the generated interior plan and converts it into a prompt that can be understood by image generation artificial intelligence (such as DALL-E or Stable Diffusion). For example, if the interior plan is "The living room includes a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0205] Input: Interior design plan (text)

[0206] Output: Prompt message (text)

[0207] Step 4:

[0208] Generating interior images

[0209] The server sends the generated prompt text to the image generation AI, which generates an image of the room's interior. The image generation AI generates a high-quality image of the room's interior based on the prompt text and sends it back to the server.

[0210] Input: Prompt message (text)

[0211] Output: Generated interior image (image data)

[0212] Step 5:

[0213] Image processing

[0214] The server receives the generated interior images and processes them into a format optimized for real estate websites and virtual stores. This processing includes adjusting the resolution, converting file formats, and cropping the images. For example, it might convert them to 1280x720 pixel JPEG images.

[0215] Input: Generated interior image (image data)

[0216] Output: Processed interior image (image data in an appropriate format)

[0217] Step 6:

[0218] Sending and confirming images to the user

[0219] The server sends the processed image to the user's device, where the user can view the generated interior image. If the user is satisfied, they can press the "Save" button to save the image. Alternatively, they can press the "Regenerate" button, enter new interior requirements, and request a regeneration.

[0220] Input: Processed interior images (image data in an appropriate format)

[0221] Output: Interior images (image data) sent to the user.

[0222] By performing this step, users can view and customize their desired interior design in real time and obtain high-quality interior images.

[0223] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0224] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images based on user-inputted interior requirements by linking generative artificial intelligence and image-generating artificial intelligence, and then processing and providing these images. Furthermore, by incorporating an emotion engine that recognizes the user's emotions and reflects them in the interior plan, it is possible to generate an optimal interior plan for the user.

[0225] Specific Embodiments

[0226] Enter and submit interior design requirements

[0227] The user enters interior design requirements using a terminal. For example, the user might enter the requirement "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[0228] Recognition and analysis of emotions

[0229] During this process, the emotion engine installed in the device recognizes and analyzes the user's emotions. This emotion engine, for example, uses the camera and microphone to analyze the user's facial expressions and tone of voice to understand the user's emotional state.

[0230] Generating interior design plans

[0231] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements and the user's emotional information. The generative AI analyzes the input information and emotional information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that correspond to the requirements. For example, it might generate a plan such as, "The living room will include a sofa and table in bright colors, a large window that lets in plenty of natural light, modern lighting, and houseplants."

[0232] Plan revision

[0233] If the generated interior plan does not reflect the user's emotional state, the server will modify the plan based on the output of the emotion engine. For example, if the user is feeling stressed, the server will make modifications such as adding relaxing elements.

[0234] Generate a view

[0235] The server analyzes the revised interior plan and converts it into a prompt for image-generating artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior plan in a format that the image-generating AI can understand. For example, if the interior plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0236] Request for image generation

[0237] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[0238] Image processing

[0239] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. By saving the images in a format optimized for real estate websites, high-quality display is achieved.

[0240] Image submission and confirmation

[0241] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, presses the "Save" button to save the image, or presses the "Regenerate" button to request the generation of a new image.

[0242] Posting on the site

[0243] After selecting a satisfactory image, the user proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[0244] According to the above embodiment, the cost and time required to photograph rooms for listing on real estate websites can be reduced, and the image of living in the room that users feel when they actually see it can be enhanced. Furthermore, by providing designs that reflect the user's emotions, it becomes possible to generate more personalized and satisfying images. As a result, it is expected that the buying, selling, and renting of real estate will be promoted.

[0245] The following describes the processing flow.

[0246] Step 1:

[0247] The user enters their interior design requirements into the terminal. For example, they might enter a requirement such as, "I want a modern living room with light-colored furniture," and then press the submit button to send the requirement information to the server.

[0248] Step 2:

[0249] The device's built-in emotion engine recognizes the user's emotions. It uses the camera and microphone to analyze the user's facial expressions and voice tone to understand their emotional state.

[0250] Step 3:

[0251] The terminal sends recognized emotion information and interior design requirement information to the server.

[0252] Step 4:

[0253] The server receives the user's interior design requirements and emotional information.

[0254] Step 5:

[0255] The server receives interior design requirements and emotional information, and then sends the requirements information to a generative artificial intelligence (AI). The AI ​​analyzes the requirements and emotional information and generates a detailed interior design plan. For example, it might generate a plan such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0256] Step 6:

[0257] The server receives interior design plans generated by a generative artificial intelligence system, and if the plans do not reflect the user's emotional information, it modifies them based on the output of the emotion engine. For example, if the user is feeling stressed, relaxing elements will be added.

[0258] Step 7:

[0259] The server analyzes the revised interior design plan and converts it into prompts for image generation artificial intelligence. For example, it converts it into instructions such as, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0260] Step 8:

[0261] The server sends the generated prompt to the image generation AI, requesting it to generate an image of the room's interior.

[0262] Step 9:

[0263] The image generation AI generates an image of the room's interior based on the prompt and sends it back to the server.

[0264] Step 10:

[0265] The server receives the generated images, processes them by adjusting the resolution and converting the file format, and then converts them to an image format suitable for real estate websites.

[0266] Step 11:

[0267] The server sends the processed image to the user's terminal.

[0268] Step 12:

[0269] The user reviews the image sent on their device and, if satisfied, presses the "Save" button to save the image. If necessary, they can press the "Regenerate" button to request the generation of a new image.

[0270] Step 13:

[0271] Users select images they are satisfied with, log in to the real estate website using their device, and upload the generated images to publish them on the website.

[0272] This entire process allows for the efficient generation of high-quality interior images that take user emotions into consideration, and enables their publication on real estate websites.

[0273] (Example 2)

[0274] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0275] Traditional real estate websites did not generate interior images that reflected the specific requirements and feelings of users, making it difficult to flexibly respond to the needs of individual users. Furthermore, the process from generating interior plans to creating images was cumbersome, costly, and time-consuming. This made it difficult for users to visualize themselves actually living in the room, hindering the sale and rental of properties.

[0276] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0277] In this invention, the server includes means for the user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and recognize and analyze the user's emotional state using an emotion engine; means for the server to generate a detailed interior design plan using generative artificial intelligence based on the interior design requirements and emotional information; means for the server to modify the plan based on the output of the emotion engine if the generated interior design plan does not reflect the user's emotional state; means for analyzing the interior design plan and converting it into prompt text for image generation artificial intelligence; means for transmitting the prompt text to the image generation artificial intelligence to generate an interior design image of the room; means for receiving the generated image and processing it into an appropriate format; and means for transmitting the processed image to the user. This makes it possible to quickly and efficiently provide high-quality interior design images of rooms that reflect the user's specific requirements and emotions.

[0278] An "emotion engine" refers to software or hardware that analyzes a user's facial expressions and tone of voice to recognize their emotional state.

[0279] "Generative artificial intelligence" refers to an artificial intelligence model that generates detailed interior design plans based on user input and emotional information.

[0280] "Image generation artificial intelligence" refers to an artificial intelligence model that generates high-quality images of room interiors based on generated prompt text.

[0281] A "prompt message" refers to a set of instructions that concisely summarizes the elements of an interior design plan and is in a format that can be understood by an image-generating artificial intelligence.

[0282] "Interior design requirements" refer to the specific requests and conditions that the user has regarding the interior design of a room.

[0283] The "interior plan" refers to a design plan that includes details such as the layout, color scheme, and furniture of the interior, generated based on the user's interior requirements and emotional information.

[0284] The present invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides means for generating images by coordinating a generation-based artificial intelligence and an image generation artificial intelligence based on the interior requirements input by the user, and processing and providing them. Also, by incorporating an emotion engine that recognizes the user's emotions and reflects them in the interior plan, an optimal interior plan for the user can be generated.

[0285] Input and transmission of interior requirements

[0286] The user inputs interior requirements using a terminal. For example, the user inputs requirements such as "want to use bright-colored furniture in a modern living room" into the terminal. When the input is completed, press the send button to send the requirement information to the server.

[0287] Recognition and analysis of emotions

[0288] At that time, the emotion engine installed on the terminal recognizes and analyzes the user's emotions. This emotion engine analyzes the user's facial expressions and voice tones using, for example, a camera or a microphone to grasp the user's emotional state. Information such as whether the user is relaxed or feeling stressed is obtained.

[0289] Generation of interior plan

[0290] The server generates a detailed interior plan by utilizing a generation-based artificial intelligence based on the received interior requirements and the user's emotional information. The generation-based artificial intelligence analyzes the input information and emotional information, and outputs an interior plan that includes details such as the layout, color scheme, and furniture of the interior corresponding to the requirements. For example, a plan such as "the living room includes a bright-colored sofa and table, a large window with plenty of natural light, modern lighting, and foliage plants" is generated.

[0291] Plan revision

[0292] If the generated interior plan does not reflect the user's emotional information, the server modifies the plan based on the output of the emotion engine. For example, if the user is feeling stressed, it will make modifications such as adding relaxing elements. The modified plan is then finalized again by the generative artificial intelligence.

[0293] Generate a view

[0294] The server analyzes the finalized interior design plan and converts it into a prompt for image generation artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior design plan in a format that the image generation AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt will be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0295] Request for image generation

[0296] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[0297] Image processing

[0298] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. Saving the images in the optimal format for real estate websites ensures high-quality display.

[0299] Image submission and confirmation

[0300] The server sends the processed image to the user's terminal. The user checks the image of the room generated on the terminal. If satisfied, the user presses the "Save" button to save the image or presses the "Regenerate" button to request the generation of a new image.

[0301] Publication on the website

[0302] The user selects a satisfactory image and performs procedures for posting it on the real estate website. Specifically, the user uses the interface of the terminal to log in to the real estate website and uploads the generated image. Through this series of processes, it becomes possible to quickly and efficiently provide an image of a room that evokes a high-quality living image.

[0303] The flow of the specific process in Example 2 will be described using FIG. 13.

[0304] Step 1: Input and transmission of interior requirements

[0305] The user uses the terminal to input the requirements for the interior. For example, the user inputs the requirement of "wanting a modern living room with brightly colored furniture". The input requirement information becomes the input data. The user presses the send button, and the terminal sends the requirement information to the server. Here, the input data is the interior requirement, and the output data is the requirement information sent to the server.

[0306] Step 2: Recognition and analysis of emotions

[0307] The emotion engine installed on the terminal recognizes and analyzes the user's emotions at the time of input. Specifically, the camera captures the facial expression, and the microphone records the tone of the voice. The emotion engine analyzes this raw data to recognize the user's emotional state. The input data is the raw data obtained from the camera and microphone, and the output data is the analyzed emotion information. The emotion information and the interior requirements are sent to the server.

[0308] Step 3: Generating the interior design plan

[0309] The server receives interior design requirements and emotional information from the user. Generative artificial intelligence takes this information as input data and generates a detailed interior design plan. Specifically, it outputs detailed plans such as the layout, color scheme, and furniture as output data. For example, it might generate a plan such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0310] Step 4: Modify the plan

[0311] If the generated interior plan does not reflect the user's emotional information, the server modifies the plan based on the output of the emotion engine. Specifically, it re-analyzes the emotional information and makes modifications such as adding relaxing elements. The modified plan is then finalized again by the generative artificial intelligence. The input data is the original interior plan and additional emotional information, and the output data is the modified interior plan.

[0312] Step 5: Generate a prompt

[0313] The server analyzes the finalized interior design plan and generates prompts for image generation artificial intelligence. These prompts concisely summarize the elements of the interior design plan and convert them into instructional sentences. The input data is the interior design plan, and the output data is the prompt sentences. For example, a prompt sentence in the format "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." is generated.

[0314] Step 6: Request image generation

[0315] The server sends the generated prompt text to the image generation AI, requesting it to generate specific interior images. The image generation AI receives the prompt text as input data, generates high-quality images of room interiors, and sends them back to the server. The input data is the prompt text, and the output data is the generated interior images.

[0316] Step 7: Image Processing

[0317] The server receives the generated image and processes it into a format suitable for a real estate website. Specific operations include adjusting the resolution, converting file formats, and cropping the image. The input data is the generated image, and the output data is the processed image.

[0318] Step 8: Image submission and confirmation

[0319] The server sends the processed image to the user's device. The user checks the image on their device and, if satisfied, presses the "Save" button to save the image, or if not satisfied, presses the "Regenerate" button to request the generation of a new image. The input data is the processed image, and the output data is feedback based on the user's satisfaction level.

[0320] Step 9: Posting to the website

[0321] The user selects a satisfactory image and proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. The input data is the saved image, and the output data is the image posted on the real estate website.

[0322] (Application Example 2)

[0323] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0324] The problem that this invention aims to solve is to provide users with an optimal interior design plan that reflects their emotions in real time when designing interiors in a virtual store, thereby realizing a more personalized and satisfying experience. It also aims to enable users to easily generate high-quality interior images and use those images to support their purchasing decisions.

[0325] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0326] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal, means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence, and means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence. This enables the generation of an optimal interior design plan based on the user's requirements and emotional information, and the generation of high-quality images based on that interior design plan.

[0327] A "user" is the end user who uses the system to input interior design requirements and then reviews the generated interior design plans and images.

[0328] A "terminal" is a device used by a user to input and submit interior design requirements, and specific examples include smartphones and tablets.

[0329] "Interior design requirements" refer to information that specifies the desired room style, color scheme, furniture, and other details from the user.

[0330] A "server" is a computer system that receives interior design requirements from users and generates detailed interior design plans using generative artificial intelligence.

[0331] "Generative artificial intelligence" refers to an artificial intelligence system that generates interior design plans based on the user's interior design requirements and emotional information.

[0332] An "interior design plan" is a detailed blueprint of the room layout and design, created by a generative artificial intelligence system based on the user's requirements.

[0333] A "prompt" is a set of instructions that concisely summarizes the elements of an interior design plan and is in a format that can be understood by an image-generating artificial intelligence.

[0334] "Image generation artificial intelligence" is an artificial intelligence system that generates images of room interiors based on prompts.

[0335] The "emotion engine" is an analytical system that recognizes the user's emotional state and reflects it in the interior design plan.

[0336] "Image processing" refers to the process of editing generated interior images into an appropriate format by adjusting the resolution, converting file formats, and so on.

[0337] A "virtual store" is an online platform where users can select interior items and design their interiors via the internet.

[0338] This invention relates to a system that allows users to select interior items and design interiors within a virtual store using a terminal. Specific embodiments for carrying out this invention are described below.

[0339] System Configuration

[0340] terminal

[0341] Users input interior design requirements using devices such as smartphones and tablets. These requirements include information such as the room style, color scheme, desired furniture, and decorative items. For example, a user might input a requirement such as, "I want a modern living room with light-colored furniture."

[0342] server

[0343] The server receives interior design requirements submitted by the user. The server is equipped with multiple artificial intelligence engines, including generative AI and image generation AI.

[0344] 1. Generative Artificial Intelligence

[0345] The server generates a detailed interior plan based on the interior requirements. The generative artificial intelligence outputs an interior plan that includes details such as the arrangement of interiors, color schemes, and furniture that meet the requirements.

[0346] 2. Emotional Engine

[0347] The emotion engine installed on the server recognizes and analyzes the user's emotions. The emotion engine uses the camera and microphone installed on the device to analyze the user's facial expressions and tone of voice to understand the user's emotional state. For example, if the user is feeling stressed, the engine will make adjustments such as adding elements that help them relax.

[0348] 3. Prompt generation

[0349] The server analyzes the interior design plan and converts it into prompts for image-generating artificial intelligence. These prompts are concise instructions summarizing the elements of the generated interior design plan, in a format that the image-generating AI can understand.

[0350] For example, for a plan that states, "The living room includes a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." is generated.

[0351] 4. Image generation artificial intelligence

[0352] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[0353] 5. Image processing

[0354] The server receives the generated images and processes them into a format suitable for the virtual store. This processing includes adjusting the resolution, converting file formats, and cropping the images.

[0355] User operation

[0356] Users can view the generated interior images of the room on their device. If they are satisfied, they can press the "Save" button to save the image, or press the "Regenerate" button to request the generation of a new image.

[0357] This system allows users to view optimal interior design plans in real time based on their own feelings and requirements, enabling them to create interior designs that are highly satisfying. It also makes it easy to generate high-quality interior images to support purchasing decisions.

[0358] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0359] Step 1:

[0360] The user uses a terminal to input and submit interior design requirements. Specifically, the user enters detailed information such as the desired room style, color scheme, and furniture into the terminal's input screen and sends it to the server by pressing the submit button. The input data at this time may include, for example, "I want a modern living room with light-colored furniture." The output of the terminal is the interior design requirements data.

[0361] Step 2:

[0362] The server receives the aforementioned interior requirements and uses generative artificial intelligence to generate a detailed interior plan. First, the server receives the interior requirements data sent from the terminal and passes it to the generative artificial intelligence. Based on this data, the generative artificial intelligence generates a detailed interior plan including the layout, color scheme, furniture, etc. In this process, the generative artificial intelligence utilizes existing design databases and algorithms. The generated interior plan is the server's output.

[0363] Step 3:

[0364] The server uses an emotion engine to recognize the user's emotional state and reflect it in the interior design plan. The server uses the terminal's camera and microphone to analyze the user's facial expressions and tone of voice to understand their emotional state. For example, if the user is stressed, the server modifies the interior design plan to include elements that promote relaxation. The input data includes the user's emotional information, and the output data is the modified interior design plan.

[0365] Step 4:

[0366] The server analyzes the interior design plan and converts it into a prompt for image-generating artificial intelligence. Specifically, it concisely summarizes each element of the generated interior design plan and creates an instruction in a format that the image-generating AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." The input data is the interior design plan, and the output data is the prompt.

[0367] Step 5:

[0368] The server sends a prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The server passes the generated prompt to the AI ​​and sends a request to generate the interior image. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the image data back to the server. The prompt text is the input data, and the interior image is the output data.

[0369] Step 6:

[0370] The server receives the generated images and processes them into a format suitable for the virtual store. Specifically, it adjusts the image resolution, converts the file format, and crops the images as needed. After performing these processing steps, the server creates the final image data. The input data is the generated raw interior image, and the output data is the processed image.

[0371] Step 7:

[0372] The server sends the processed image to the user's device. The user checks the generated room interior image on their device and, if satisfied, presses the "Save" button to save the image. They can also request the generation of a new image by pressing the "Regenerate" button. The processed image is the input data, and the user's confirmation and manipulation are the output.

[0373] Through this series of steps, users can view optimal interior plans based on their own feelings and requirements in real time, enabling them to create interior designs that are highly satisfying. Furthermore, it's possible to easily generate high-quality interior images to support purchasing decisions.

[0374] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0375] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0376] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0377] [Second Embodiment]

[0378] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0379] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0380] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0381] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0382] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0383] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0384] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0385] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0386] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0387] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0388] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0389] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0390] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images by linking a generative artificial intelligence and an image-generating artificial intelligence based on the interior requirements entered by the user, and then processing and providing these images.

[0391] Specific Embodiments

[0392] Enter and submit interior design requirements

[0393] The user enters interior design requirements using a terminal. For example, the user might enter requirements such as "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[0394] Generating interior design plans

[0395] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements. The generative AI analyzes the input information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that meet the requirements. For example, it might generate a plan that includes "a brightly colored sofa and table, a large window that lets in plenty of natural light, modern lighting, and houseplants in the living room."

[0396] Generate a view

[0397] The server analyzes the generated interior design plan and converts it into a prompt for image-generating artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior design plan in a format that the image-generating AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0398] Request for image generation

[0399] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[0400] Image processing

[0401] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. By saving the images in a format optimized for real estate websites, high-quality display is achieved.

[0402] Image submission and confirmation

[0403] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, presses the "Save" button to save the image, or presses the "Regenerate" button to request the generation of a new image.

[0404] Posting on the site

[0405] After selecting a satisfactory image, the user proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[0406] According to the above embodiment, the cost and time required to photograph rooms for listing on real estate websites can be reduced, and the image of what it would be like to live in the room that users experience when they actually see it can be enhanced. This is expected to have the effect of promoting the buying, selling, and renting of real estate.

[0407] The following describes the processing flow.

[0408] Step 1:

[0409] The user enters their interior design requirements into the terminal. For example, they might enter a requirement such as, "I want a modern living room with light-colored furniture," and then press the submit button to send the requirement information to the server.

[0410] Step 2:

[0411] The server receives the user's interior design requirements information.

[0412] Step 3:

[0413] The server receives interior design requirements and sends the requirements information to a generative artificial intelligence (AI). The AI ​​analyzes the requirements information and generates a detailed interior design plan. This plan includes color schemes, furniture placement, wall decorations, lighting, and more.

[0414] Step 4:

[0415] The server receives interior design plans generated by generative artificial intelligence, analyzes the plans, and converts them into prompts for image generation artificial intelligence.

[0416] Step 5:

[0417] The server sends the generated prompt to the image generation AI, requesting it to generate an image of the room's interior.

[0418] Step 6:

[0419] The image generation AI generates an image of the room's interior based on the prompt and sends the generated image back to the server.

[0420] Step 7:

[0421] The server receives the generated images and processes them, such as adjusting the resolution and converting the file format. This makes them suitable for real estate websites.

[0422] Step 8:

[0423] The server sends the processed image to the user's device.

[0424] Step 9:

[0425] The user reviews the image sent on their device. If satisfied, they can press the "Save" button to save the image. Furthermore, they can request the generation of a new image by pressing the "Regenerate" button if needed.

[0426] Step 10:

[0427] Users select images they are satisfied with, log in to the real estate website using their device, and upload the generated images to publish them on the website.

[0428] This series of processes allows for the efficient generation of high-quality interior images, which can then be posted on real estate websites.

[0429] (Example 1)

[0430] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0431] In the real estate industry, maintaining high quality and generating interior images of properties quickly is a critical challenge. However, traditional methods involve significant costs and time for photography and image editing, and it is difficult to efficiently propose interior images that satisfy users. In particular, the entire process from users inputting specific interior requirements to generating high-quality interior images that meet those requirements and finally posting them on the real estate website is cumbersome. Therefore, there is a need for a system that improves overall work efficiency and provides users with satisfactory interior images quickly.

[0432] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0433] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence; means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence; means for transmitting the prompts to the image generation artificial intelligence to generate an image of the room's interior; means for receiving the generated image and processing it into an appropriate format; means for transmitting the processed image to the user; and means for the user to view the image on their terminal and choose to regenerate or save it. This makes it possible to quickly and efficiently generate high-quality interior design images that correspond to the user's input of specific interior design requirements and ultimately post them on a real estate website.

[0434] A "user" refers to an individual or legal entity that uses the system to input interior design requirements.

[0435] A "terminal" is an electronic device used by a user for operation, and includes personal computers, tablets, smartphones, and other similar devices.

[0436] "Interior design requirements" refer to the specific conditions and demands regarding the interior design of a room that the user enters.

[0437] "Means of transmission" refers to the functions and operations used by a user to send interior design requirements entered via a terminal to a server.

[0438] A "server" refers to a central processing unit or computer system that analyzes interior design requirements received from users and generates and processes images using generative artificial intelligence and image generation artificial intelligence.

[0439] "Generative artificial intelligence" refers to artificial intelligence technologies and algorithms used to generate detailed interior design plans based on interior design requirements.

[0440] An "interior design plan" refers to a plan that includes details such as the layout, color scheme, and furniture of the interior, generated by generative artificial intelligence.

[0441] A "prompt" refers to the instruction or input text necessary to pass the interior design plan to the image-generating artificial intelligence.

[0442] "Image generation artificial intelligence" refers to artificial intelligence technologies and algorithms used to generate high-quality interior images based on prompts.

[0443] "Appropriate format" refers to a format that meets the requirements for image resolution, file format, size adjustment, and other specifications necessary for posting images on a real estate website.

[0444] "Processing methods" refer to processes such as adjusting the resolution and converting the file format of the generated image in order to make it suitable for a real estate website.

[0445] "Regeneration" refers to the act of a user requesting the creation of a new image if they are not satisfied with the previously generated image.

[0446] "Saving" refers to the act of a user being satisfied with a generated image and saving that image to their device.

[0447] A "real estate website" refers to a website used to showcase real estate properties.

[0448] "Methods of uploading" refers to the operations and functions that allow users to upload generated images for posting on real estate websites.

[0449] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images by linking a generative artificial intelligence and an image-generating artificial intelligence based on the interior requirements entered by the user, and then processing and providing these images.

[0450] Enter and submit interior design requirements

[0451] The user uses their own device (such as a PC or tablet) to open the interior design requirements input page on the real estate website. The requirements the user enters might be something like, "I want a modern living room with light-colored furniture." After completing the input, pressing the submit button converts the input data into JSON format using JavaScript and sends it to the server.

[0452] Generating interior design plans

[0453] The server analyzes the received interior design requirements using a programming language such as Python. It then inputs the data into a generative artificial intelligence (e.g., GPT-4), which performs natural language processing to generate a detailed interior design plan. The generated plan might include details such as, "The living room should include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0454] Generate a view

[0455] The server converts the generated interior plan into a prompt for image-generating artificial intelligence. The prompt is a concise instruction that extracts and summarizes the key elements of the interior plan, in a format that image-generating AI can understand. For example, if the interior plan is "The living room should include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants," the prompt would be:

[0456] "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0457] Request for image generation

[0458] The server sends the generated prompt to an image-generating artificial intelligence (such as DALL-E or Stable Diffusion) to generate high-quality images of the room's interior. This AI generates images based on the prompts and sends the generated images back to the server.

[0459] Image processing

[0460] The server uses image processing software such as Adobe Photoshop API and OpenCV to process received images into a format suitable for real estate websites. Image processing includes adjusting resolution, converting file formats, and cropping images.

[0461] Image submission and confirmation

[0462] The processed image is sent from the server to the user's device. The user checks the image through a web browser on their device, and if satisfied, they can either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[0463] Posting on the site

[0464] To post the generated images on the real estate website, the user logs in to the website using their device and uploads the image files. Along with the uploaded images, they also enter a description of the room and complete the posting.

[0465] This entire process allows users to efficiently generate high-quality interior images and post them on real estate websites. Furthermore, this system significantly reduces the cost and time required for shooting and editing interior images.

[0466] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0467] Step 1:

[0468] The user enters their interior design requirements using a terminal. For example, they might enter, "I want a modern living room with light-colored furniture." The input data includes the desired room type, color scheme, and furniture type. They then press the submit button to convert this data to JSON format and send it.

[0469] Input: User's interior design requirements (e.g., "I want a modern living room with light-colored furniture.")

[0470] Output: Interior design requirements data converted to JSON format

[0471] Step 2:

[0472] The server receives interior design requirements in JSON format from the user. It parses the received data and runs a Python script to extract the necessary information. This information is then passed to a generative artificial intelligence, which generates a detailed interior design plan through natural language processing. The generated interior design plan might include details such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0473] Input: Interior design requirements data in JSON format

[0474] Data processing: Analysis using Python scripts

[0475] Output: Detailed interior plan

[0476] Step 3:

[0477] The server further analyzes the generated interior plan and generates a prompt for the image generation artificial intelligence. This prompt is a concise instruction that extracts the main elements of the interior plan. This conversion process is performed using a text generation algorithm based on the information in the interior plan. For example, the prompt might read, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0478] Input: Detailed interior plan

[0479] Data processing: Prompt text generation using text generation algorithms

[0480] Output: Prompt message for image generation artificial intelligence

[0481] Step 4:

[0482] The server sends the generated prompt text to an image generation artificial intelligence (such as DALL-E or Stable Diffusion). This AI generates a high-quality interior image based on the prompt text and sends that image back to the server. The server also receives the URL of the generated image stored in cloud storage.

[0483] Input: Prompt for image generation artificial intelligence

[0484] Data processing: Image generation using artificial intelligence

[0485] Output: Generated interior image (and its URL)

[0486] Step 5:

[0487] The server receives the generated interior images and processes them into a format suitable for real estate websites. Specifically, this involves adjusting the resolution, converting file formats, and cropping the images. Adobe Photoshop API and OpenCV are used to perform these image processing tasks.

[0488] Input: Generated interior image

[0489] Data processing: Resolution adjustment, file format conversion, cropping

[0490] Output: Processed interior image

[0491] Step 6:

[0492] The server sends the processed image to the user's device. The user checks the image through a web browser on their device, and if satisfied, they can either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[0493] Input: Processed interior image

[0494] Data processing: Image transmission

[0495] Output: User confirmation result (choice to save or regenerate)

[0496] Step 7:

[0497] To post the generated images on the real estate website, the user logs in to the website using their device and uploads the image files. Along with the uploaded images, they also enter a description of the room and complete the posting.

[0498] Input: Saved image file, room description

[0499] Data processing: Image upload, description entry

[0500] Output: Image posting on real estate websites

[0501] The above outlines the specific processing flow within this system. Through the detailed data processing and calculations performed at each step, users can efficiently generate high-quality interior images and post them on real estate websites.

[0502] (Application Example 1)

[0503] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0504] Traditional real estate websites have faced significant costs and time constraints in generating interior images, and have struggled to provide interior images that accurately reflect users' specific requests. Furthermore, the lack of real-time visibility into desired interior and furniture customizations hindered purchase and selection decisions. Therefore, there is a need to efficiently generate high-quality room interior images and provide realistic interior images that meet user needs.

[0505] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0506] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence; means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence; means for transmitting the prompts to the image generation artificial intelligence to generate an image of the room's interior; means for receiving the generated image and processing it into an appropriate format; means for transmitting the processed image to the user; means for the user to customize furniture and interior design using a terminal and regenerate new conditions; and means for the user to view the room's interior design image on a virtual store interface and perform regeneration or set new conditions. This allows the user to view and regenerate their desired interior design image in real time, improving the efficiency of interior design decisions.

[0507] A "user" refers to the final user who uses the system to input interior design requirements and to view and customize images of the room's interior.

[0508] "Terminal" refers to a general term for electronic devices used by users to input interior design requirements and to view and manipulate the generated interior design images.

[0509] "Interior design requirements" refer to the specific conditions and requests regarding the interior design of a room that the user desires.

[0510] A "server" is a remote computing system that receives interior design requirements from users and uses generative artificial intelligence and image-generating artificial intelligence to create interior design plans, generate images, and process images.

[0511] "Generative artificial intelligence" refers to an artificial intelligence algorithm that generates detailed interior design plans based on the interior design requirements entered by the user.

[0512] An "interior design plan" refers to a design proposal for the arrangement of furniture, color scheme, and decorations within a room, generated by a generative artificial intelligence system based on the user's interior design requirements.

[0513] A "prompt" is a set of instructions based on the interior design plan, converted into a format that the image-generating artificial intelligence can understand.

[0514] "Image generation artificial intelligence" is an artificial intelligence algorithm that generates high-quality images of room interiors based on prompts.

[0515] "Processing" refers to the process of adjusting the resolution and converting file formats of generated interior images to adapt them to the requirements of real estate websites and virtual stores.

[0516] A "virtual store" is a digital platform where users can customize furniture and interior design online and view real-time generated images of the interior.

[0517] This invention is a system that efficiently generates high-quality interior images of rooms and provides realistic interior images that meet the user's needs. Specific embodiments of this system are described below.

[0518] Hardware and software configuration

[0519] The server has the following functions:

[0520] 1. Use a generative artificial intelligence system (e.g., GPT-4) to generate a detailed interior design plan based on the interior design requirements received from the user.

[0521] 2. Analyze the interior design plan and convert it into prompts that can be understood by image generation artificial intelligence (e.g., DALL-E or Stable Diffusion).

[0522] 3. The generated prompt is sent to the image generation artificial intelligence to generate an interior image.

[0523] 4. Process the generated interior images into a format suitable for real estate websites and virtual stores.

[0524] The device has the following features:

[0525] 1. A function that allows users to input interior design requirements through the user interface.

[0526] 2. A function to display the interior design plan and generated interior images sent to the server.

[0527] 3. A function that allows users to receive processed interior images and review and customize them.

[0528] The user will use the system in the following steps:

[0529] System operation

[0530] 1. Inputting interior design requirements:

[0531] The user uses the terminal interface to enter their desired room interior design requirements. For example, they might enter specific requirements such as, "I want a modern living room with light-colored furniture."

[0532] 2. Generating the interior design plan:

[0533] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements. The generated interior plan includes specific layouts, color schemes, and types of furniture. For example, it might say, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0534] 3. Generating the prompt:

[0535] The system analyzes the interior design plan and converts it into prompt sentences for image generation artificial intelligence. These prompt sentences are concise instructions that summarize the elements of the interior design plan. For example, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0536] 4. Generating interior images:

[0537] The server sends the generated prompt text to the image generation AI, which generates an image of the room's interior. The image generation AI generates a high-quality interior image based on the prompt text and sends it back to the server.

[0538] 5. Image processing:

[0539] The server receives the generated images and processes them into a format suitable for real estate websites and virtual stores. This processing includes adjusting the resolution, converting file formats, and cropping the images.

[0540] 6. Sending and confirming images to the user:

[0541] The processed image is sent to the user's device, and the user can review the generated interior image. If necessary, they can request regeneration or set new conditions to create the image again.

[0542] This allows users to view high-quality interior images tailored to their specific needs in real time. Furthermore, it assists them in making purchasing and selection decisions through online furniture and interior customization.

[0543] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0544] Step 1:

[0545] User input and submission of interior design requirements

[0546] The user enters interior design requirements in text format using the terminal interface. For example, they might enter the requirement "I want a modern living room with light-colored furniture" and press the submit button. This input data is then sent to the server in JSON format.

[0547] Input: User's interior design requirements (text)

[0548] Output: Interior design requirements sent to the server (in JSON format)

[0549] Step 2:

[0550] Generating interior design plans

[0551] The server uses generative artificial intelligence (GPT-4) to generate a detailed interior plan based on the received interior requirements. The generative AI analyzes the input information and outputs a detailed plan of the interior layout, color scheme, furniture, etc., that corresponds to the requirements.

[0552] Input: User's interior design requirements (JSON format)

[0553] Output: Interior design plan (text)

[0554] Step 3:

[0555] Prompt statement generation

[0556] The server analyzes the generated interior plan and converts it into a prompt that can be understood by image generation artificial intelligence (such as DALL-E or Stable Diffusion). For example, if the interior plan is "The living room includes a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0557] Input: Interior design plan (text)

[0558] Output: Prompt message (text)

[0559] Step 4:

[0560] Generating interior images

[0561] The server sends the generated prompt text to the image generation AI, which generates an image of the room's interior. The image generation AI generates a high-quality image of the room's interior based on the prompt text and sends it back to the server.

[0562] Input: Prompt message (text)

[0563] Output: Generated interior image (image data)

[0564] Step 5:

[0565] Image processing

[0566] The server receives the generated interior images and processes them into a format optimized for real estate websites and virtual stores. This processing includes adjusting the resolution, converting file formats, and cropping the images. For example, it might convert them to 1280x720 pixel JPEG images.

[0567] Input: Generated interior image (image data)

[0568] Output: Processed interior image (image data in an appropriate format)

[0569] Step 6:

[0570] Sending and confirming images to the user

[0571] The server sends the processed image to the user's device, where the user can view the generated interior image. If the user is satisfied, they can press the "Save" button to save the image. Alternatively, they can press the "Regenerate" button, enter new interior requirements, and request a regeneration.

[0572] Input: Processed interior images (image data in an appropriate format)

[0573] Output: Interior images (image data) sent to the user.

[0574] By performing this step, users can view and customize their desired interior design in real time and obtain high-quality interior images.

[0575] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0576] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images based on user-inputted interior requirements by linking generative artificial intelligence and image-generating artificial intelligence, and then processing and providing these images. Furthermore, by incorporating an emotion engine that recognizes the user's emotions and reflects them in the interior plan, it is possible to generate an optimal interior plan for the user.

[0577] Specific Embodiments

[0578] Enter and submit interior design requirements

[0579] The user enters interior design requirements using a terminal. For example, the user might enter the requirement "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[0580] Recognition and analysis of emotions

[0581] During this process, the emotion engine installed in the device recognizes and analyzes the user's emotions. This emotion engine, for example, uses the camera and microphone to analyze the user's facial expressions and tone of voice to understand the user's emotional state.

[0582] Generating interior design plans

[0583] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements and the user's emotional information. The generative AI analyzes the input information and emotional information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that correspond to the requirements. For example, it might generate a plan such as, "The living room will include a sofa and table in bright colors, a large window that lets in plenty of natural light, modern lighting, and houseplants."

[0584] Plan revision

[0585] If the generated interior plan does not reflect the user's emotional state, the server will modify the plan based on the output of the emotion engine. For example, if the user is feeling stressed, the server will make modifications such as adding relaxing elements.

[0586] Generate a view

[0587] The server analyzes the revised interior plan and converts it into a prompt for image-generating artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior plan in a format that the image-generating AI can understand. For example, if the interior plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0588] Request for image generation

[0589] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[0590] Image processing

[0591] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. By saving the images in a format optimized for real estate websites, high-quality display is achieved.

[0592] Image submission and confirmation

[0593] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, presses the "Save" button to save the image, or presses the "Regenerate" button to request the generation of a new image.

[0594] Posting on the site

[0595] After selecting a satisfactory image, the user proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[0596] According to the above embodiment, the cost and time required to photograph rooms for listing on real estate websites can be reduced, and the image of living in the room that users feel when they actually see it can be enhanced. Furthermore, by providing designs that reflect the user's emotions, it becomes possible to generate more personalized and satisfying images. As a result, it is expected that the buying, selling, and renting of real estate will be promoted.

[0597] The following describes the processing flow.

[0598] Step 1:

[0599] The user enters their interior design requirements into the terminal. For example, they might enter a requirement such as, "I want a modern living room with light-colored furniture," and then press the submit button to send the requirement information to the server.

[0600] Step 2:

[0601] The device's built-in emotion engine recognizes the user's emotions. It uses the camera and microphone to analyze the user's facial expressions and voice tone to understand their emotional state.

[0602] Step 3:

[0603] The terminal sends recognized emotion information and interior design requirement information to the server.

[0604] Step 4:

[0605] The server receives the user's interior design requirements and emotional information.

[0606] Step 5:

[0607] The server receives interior design requirements and emotional information, and then sends the requirements information to a generative artificial intelligence (AI). The AI ​​analyzes the requirements and emotional information and generates a detailed interior design plan. For example, it might generate a plan such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0608] Step 6:

[0609] The server receives interior design plans generated by a generative artificial intelligence system, and if the plans do not reflect the user's emotional information, it modifies them based on the output of the emotion engine. For example, if the user is feeling stressed, relaxing elements will be added.

[0610] Step 7:

[0611] The server analyzes the revised interior design plan and converts it into prompts for image generation artificial intelligence. For example, it converts it into instructions such as, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0612] Step 8:

[0613] The server sends the generated prompt to the image generation AI, requesting it to generate an image of the room's interior.

[0614] Step 9:

[0615] The image generation AI generates an image of the room's interior based on the prompt and sends it back to the server.

[0616] Step 10:

[0617] The server receives the generated images, processes them by adjusting the resolution and converting the file format, and then converts them to an image format suitable for real estate websites.

[0618] Step 11:

[0619] The server sends the processed image to the user's terminal.

[0620] Step 12:

[0621] The user reviews the image sent on their device and, if satisfied, presses the "Save" button to save the image. If necessary, they can press the "Regenerate" button to request the generation of a new image.

[0622] Step 13:

[0623] Users select images they are satisfied with, log in to the real estate website using their device, and upload the generated images to publish them on the website.

[0624] This entire process allows for the efficient generation of high-quality interior images that take user emotions into consideration, and enables their publication on real estate websites.

[0625] (Example 2)

[0626] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0627] Traditional real estate websites did not generate interior images that reflected the specific requirements and feelings of users, making it difficult to flexibly respond to the needs of individual users. Furthermore, the process from generating interior plans to creating images was cumbersome, costly, and time-consuming. This made it difficult for users to visualize themselves actually living in the room, hindering the sale and rental of properties.

[0628] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0629] In this invention, the server includes means for the user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and recognize and analyze the user's emotional state using an emotion engine; means for the server to generate a detailed interior design plan using generative artificial intelligence based on the interior design requirements and emotional information; means for the server to modify the plan based on the output of the emotion engine if the generated interior design plan does not reflect the user's emotional state; means for analyzing the interior design plan and converting it into prompt text for image generation artificial intelligence; means for transmitting the prompt text to the image generation artificial intelligence to generate an interior design image of the room; means for receiving the generated image and processing it into an appropriate format; and means for transmitting the processed image to the user. This makes it possible to quickly and efficiently provide high-quality interior design images of rooms that reflect the user's specific requirements and emotions.

[0630] An "emotion engine" refers to software or hardware that analyzes a user's facial expressions and tone of voice to recognize their emotional state.

[0631] "Generative artificial intelligence" refers to an artificial intelligence model that generates detailed interior design plans based on user input and emotional information.

[0632] "Image generation artificial intelligence" refers to an artificial intelligence model that generates high-quality images of room interiors based on generated prompt text.

[0633] A "prompt message" refers to a set of instructions that concisely summarizes the elements of an interior design plan and is in a format that can be understood by an image-generating artificial intelligence.

[0634] "Interior design requirements" refer to the specific requests and conditions that the user has regarding the interior design of a room.

[0635] An "interior design plan" refers to a design proposal that includes details such as the layout, color scheme, and furniture of the interior, generated based on the user's interior design requirements and emotional information.

[0636] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images based on user-inputted interior requirements by linking generative artificial intelligence and image-generating artificial intelligence, and then processing and providing these images. Furthermore, by incorporating an emotion engine that recognizes user emotions and reflects them in the interior plan, the system can generate an optimal interior plan for the user.

[0637] Enter and submit interior design requirements

[0638] The user enters interior design requirements using a terminal. For example, the user might enter the requirement "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[0639] Recognition and analysis of emotions

[0640] During this process, the emotion engine installed in the device recognizes and analyzes the user's emotions. This emotion engine uses, for example, the camera and microphone to analyze the user's facial expressions and tone of voice, and understands the user's emotional state. It obtains information such as whether the user is relaxed or stressed.

[0641] Generating interior design plans

[0642] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements and the user's emotional information. The generative AI analyzes the input information and emotional information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that correspond to the requirements. For example, it might generate a plan such as, "The living room will include a sofa and table in bright colors, a large window that lets in plenty of natural light, modern lighting, and houseplants."

[0643] Plan revision

[0644] If the generated interior plan does not reflect the user's emotional information, the server modifies the plan based on the output of the emotion engine. For example, if the user is feeling stressed, it will make modifications such as adding relaxing elements. The modified plan is then finalized again by the generative artificial intelligence.

[0645] Generate a view

[0646] The server analyzes the finalized interior design plan and converts it into a prompt for image generation artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior design plan in a format that the image generation AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt will be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0647] Request for image generation

[0648] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[0649] Image processing

[0650] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. Saving the images in the optimal format for real estate websites ensures high-quality display.

[0651] Image submission and confirmation

[0652] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[0653] Posting on the site

[0654] Users select images they are satisfied with and then proceed with the process of posting them on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated images. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[0655] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0656] Step 1: Enter and submit interior design requirements.

[0657] The user uses a terminal to input interior design requirements. For example, the user might input the requirement, "I want a modern living room with light-colored furniture." The entered requirement information becomes the input data. The user presses the submit button, and the terminal sends the requirement information to the server. Here, the input data is the interior design requirements, and the output data is the requirement information sent to the server.

[0658] Step 2: Recognition and Analysis of Emotions

[0659] The emotion engine built into the device recognizes and analyzes the user's emotions during input. Specifically, it captures facial expressions with a camera and records voice tone with a microphone. The emotion engine analyzes this raw data to recognize the user's emotional state. The input data is raw data obtained from the camera and microphone, and the output data is the analyzed emotion information. The emotion information and interior design requirements are sent to the server.

[0660] Step 3: Generating the interior design plan

[0661] The server receives interior design requirements and emotional information from the user. Generative artificial intelligence takes this information as input data and generates a detailed interior design plan. Specifically, it outputs detailed plans such as the layout, color scheme, and furniture as output data. For example, it might generate a plan such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0662] Step 4: Modify the plan

[0663] If the generated interior plan does not reflect the user's emotional information, the server modifies the plan based on the output of the emotion engine. Specifically, it re-analyzes the emotional information and makes modifications such as adding relaxing elements. The modified plan is then finalized again by the generative artificial intelligence. The input data is the original interior plan and additional emotional information, and the output data is the modified interior plan.

[0664] Step 5: Generate a prompt

[0665] The server analyzes the finalized interior design plan and generates prompts for image generation artificial intelligence. These prompts concisely summarize the elements of the interior design plan and convert them into instructional sentences. The input data is the interior design plan, and the output data is the prompt sentences. For example, a prompt sentence in the format "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." is generated.

[0666] Step 6: Request image generation

[0667] The server sends the generated prompt text to the image generation AI, requesting it to generate specific interior images. The image generation AI receives the prompt text as input data, generates high-quality images of room interiors, and sends them back to the server. The input data is the prompt text, and the output data is the generated interior images.

[0668] Step 7: Image Processing

[0669] The server receives the generated image and processes it into a format suitable for a real estate website. Specific operations include adjusting the resolution, converting file formats, and cropping the image. The input data is the generated image, and the output data is the processed image.

[0670] Step 8: Image submission and confirmation

[0671] The server sends the processed image to the user's device. The user checks the image on their device and, if satisfied, presses the "Save" button to save the image, or if not satisfied, presses the "Regenerate" button to request the generation of a new image. The input data is the processed image, and the output data is feedback based on the user's satisfaction level.

[0672] Step 9: Posting to the website

[0673] The user selects a satisfactory image and proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. The input data is the saved image, and the output data is the image posted on the real estate website.

[0674] (Application Example 2)

[0675] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0676] The problem that this invention aims to solve is to provide users with an optimal interior design plan that reflects their emotions in real time when designing interiors in a virtual store, thereby realizing a more personalized and satisfying experience. It also aims to enable users to easily generate high-quality interior images and use those images to support their purchasing decisions.

[0677] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0678] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal, means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence, and means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence. This enables the generation of an optimal interior design plan based on the user's requirements and emotional information, and the generation of high-quality images based on that interior design plan.

[0679] A "user" is the end user who uses the system to input interior design requirements and then reviews the generated interior design plans and images.

[0680] A "terminal" is a device used by a user to input and submit interior design requirements, and specific examples include smartphones and tablets.

[0681] "Interior design requirements" refer to information that specifies the desired room style, color scheme, furniture, and other details from the user.

[0682] A "server" is a computer system that receives interior design requirements from users and generates detailed interior design plans using generative artificial intelligence.

[0683] "Generative artificial intelligence" refers to an artificial intelligence system that generates interior design plans based on the user's interior design requirements and emotional information.

[0684] An "interior design plan" is a detailed blueprint of the room layout and design, created by a generative artificial intelligence system based on the user's requirements.

[0685] A "prompt" is a set of instructions that concisely summarizes the elements of an interior design plan and is in a format that can be understood by an image-generating artificial intelligence.

[0686] "Image generation artificial intelligence" is an artificial intelligence system that generates images of room interiors based on prompts.

[0687] The "emotion engine" is an analytical system that recognizes the user's emotional state and reflects it in the interior design plan.

[0688] "Image processing" refers to the process of editing generated interior images into an appropriate format by adjusting the resolution, converting file formats, and so on.

[0689] A "virtual store" is an online platform where users can select interior items and design their interiors via the internet.

[0690] This invention relates to a system that allows users to select interior items and design interiors within a virtual store using a terminal. Specific embodiments for carrying out this invention are described below.

[0691] System Configuration

[0692] terminal

[0693] Users input interior design requirements using devices such as smartphones and tablets. These requirements include information such as the room style, color scheme, desired furniture, and decorative items. For example, a user might input a requirement such as, "I want a modern living room with light-colored furniture."

[0694] server

[0695] The server receives interior design requirements submitted by the user. The server is equipped with multiple artificial intelligence engines, including generative AI and image generation AI.

[0696] 1. Generative Artificial Intelligence

[0697] The server generates a detailed interior plan based on the interior requirements. The generative artificial intelligence outputs an interior plan that includes details such as the arrangement of interiors, color schemes, and furniture that meet the requirements.

[0698] 2. Emotional Engine

[0699] The emotion engine installed on the server recognizes and analyzes the user's emotions. The emotion engine uses the camera and microphone installed on the device to analyze the user's facial expressions and tone of voice to understand the user's emotional state. For example, if the user is feeling stressed, the engine will make adjustments such as adding elements that help them relax.

[0700] 3. Prompt generation

[0701] The server analyzes the interior design plan and converts it into prompts for image-generating artificial intelligence. These prompts are concise instructions summarizing the elements of the generated interior design plan, in a format that the image-generating AI can understand.

[0702] For example, for a plan that states, "The living room includes a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." is generated.

[0703] 4. Image generation artificial intelligence

[0704] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[0705] 5. Image processing

[0706] The server receives the generated images and processes them into a format suitable for the virtual store. This processing includes adjusting the resolution, converting file formats, and cropping the images.

[0707] User operation

[0708] Users can view the generated interior images of the room on their device. If they are satisfied, they can press the "Save" button to save the image, or press the "Regenerate" button to request the generation of a new image.

[0709] This system allows users to view optimal interior design plans in real time based on their own feelings and requirements, enabling them to create interior designs that are highly satisfying. It also makes it easy to generate high-quality interior images to support purchasing decisions.

[0710] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0711] Step 1:

[0712] The user uses a terminal to input and submit interior design requirements. Specifically, the user enters detailed information such as the desired room style, color scheme, and furniture into the terminal's input screen and sends it to the server by pressing the submit button. The input data at this time may include, for example, "I want a modern living room with light-colored furniture." The output of the terminal is the interior design requirements data.

[0713] Step 2:

[0714] The server receives the aforementioned interior requirements and uses generative artificial intelligence to generate a detailed interior plan. First, the server receives the interior requirements data sent from the terminal and passes it to the generative artificial intelligence. Based on this data, the generative artificial intelligence generates a detailed interior plan including the layout, color scheme, furniture, etc. In this process, the generative artificial intelligence utilizes existing design databases and algorithms. The generated interior plan is the server's output.

[0715] Step 3:

[0716] The server uses an emotion engine to recognize the user's emotional state and reflect it in the interior design plan. The server uses the terminal's camera and microphone to analyze the user's facial expressions and tone of voice to understand their emotional state. For example, if the user is stressed, the server modifies the interior design plan to include elements that promote relaxation. The input data includes the user's emotional information, and the output data is the modified interior design plan.

[0717] Step 4:

[0718] The server analyzes the interior design plan and converts it into a prompt for image-generating artificial intelligence. Specifically, it concisely summarizes each element of the generated interior design plan and creates an instruction in a format that the image-generating AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." The input data is the interior design plan, and the output data is the prompt.

[0719] Step 5:

[0720] The server sends a prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The server passes the generated prompt to the AI ​​and sends a request to generate the interior image. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the image data back to the server. The prompt text is the input data, and the interior image is the output data.

[0721] Step 6:

[0722] The server receives the generated images and processes them into a format suitable for the virtual store. Specifically, it adjusts the image resolution, converts the file format, and crops the images as needed. After performing these processing steps, the server creates the final image data. The input data is the generated raw interior image, and the output data is the processed image.

[0723] Step 7:

[0724] The server sends the processed image to the user's device. The user checks the generated room interior image on their device and, if satisfied, presses the "Save" button to save the image. They can also request the generation of a new image by pressing the "Regenerate" button. The processed image is the input data, and the user's confirmation and manipulation are the output.

[0725] Through this series of steps, users can view optimal interior plans based on their own feelings and requirements in real time, enabling them to create interior designs that are highly satisfying. Furthermore, it's possible to easily generate high-quality interior images to support purchasing decisions.

[0726] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0727] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0728] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0729] [Third Embodiment]

[0730] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0731] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0732] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0733] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0734] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0735] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0736] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0737] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0738] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0739] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0740] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0741] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0742] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images by linking a generative artificial intelligence and an image-generating artificial intelligence based on the interior requirements entered by the user, and then processing and providing these images.

[0743] Specific Embodiments

[0744] Enter and submit interior design requirements

[0745] The user enters interior design requirements using a terminal. For example, the user might enter requirements such as "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[0746] Generating interior design plans

[0747] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements. The generative AI analyzes the input information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that meet the requirements. For example, it might generate a plan that includes "a brightly colored sofa and table, a large window that lets in plenty of natural light, modern lighting, and houseplants in the living room."

[0748] Generate a view

[0749] The server analyzes the generated interior design plan and converts it into a prompt for image-generating artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior design plan in a format that the image-generating AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0750] Request for image generation

[0751] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[0752] Image processing

[0753] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. By saving the images in a format optimized for real estate websites, high-quality display is achieved.

[0754] Image submission and confirmation

[0755] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, presses the "Save" button to save the image, or presses the "Regenerate" button to request the generation of a new image.

[0756] Posting on the site

[0757] After selecting a satisfactory image, the user proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[0758] According to the above embodiment, the cost and time required to photograph rooms for listing on real estate websites can be reduced, and the image of what it would be like to live in the room that users experience when they actually see it can be enhanced. This is expected to have the effect of promoting the buying, selling, and renting of real estate.

[0759] The following describes the processing flow.

[0760] Step 1:

[0761] The user enters their interior design requirements into the terminal. For example, they might enter a requirement such as, "I want a modern living room with light-colored furniture," and then press the submit button to send the requirement information to the server.

[0762] Step 2:

[0763] The server receives the user's interior design requirements information.

[0764] Step 3:

[0765] The server receives interior design requirements and sends the requirements information to a generative artificial intelligence (AI). The AI ​​analyzes the requirements information and generates a detailed interior design plan. This plan includes color schemes, furniture placement, wall decorations, lighting, and more.

[0766] Step 4:

[0767] The server receives interior design plans generated by generative artificial intelligence, analyzes the plans, and converts them into prompts for image generation artificial intelligence.

[0768] Step 5:

[0769] The server sends the generated prompt to the image generation AI, requesting it to generate an image of the room's interior.

[0770] Step 6:

[0771] The image generation AI generates an image of the room's interior based on the prompt and sends the generated image back to the server.

[0772] Step 7:

[0773] The server receives the generated images and processes them, such as adjusting the resolution and converting the file format. This makes them suitable for real estate websites.

[0774] Step 8:

[0775] The server sends the processed image to the user's device.

[0776] Step 9:

[0777] The user reviews the image sent on their device. If satisfied, they can press the "Save" button to save the image. Furthermore, they can request the generation of a new image by pressing the "Regenerate" button if needed.

[0778] Step 10:

[0779] Users select images they are satisfied with, log in to the real estate website using their device, and upload the generated images to publish them on the website.

[0780] This series of processes allows for the efficient generation of high-quality interior images, which can then be posted on real estate websites.

[0781] (Example 1)

[0782] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0783] In the real estate industry, maintaining high quality and generating interior images of properties quickly is a critical challenge. However, traditional methods involve significant costs and time for photography and image editing, and it is difficult to efficiently propose interior images that satisfy users. In particular, the entire process from users inputting specific interior requirements to generating high-quality interior images that meet those requirements and finally posting them on the real estate website is cumbersome. Therefore, there is a need for a system that improves overall work efficiency and provides users with satisfactory interior images quickly.

[0784] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0785] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence; means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence; means for transmitting the prompts to the image generation artificial intelligence to generate an image of the room's interior; means for receiving the generated image and processing it into an appropriate format; means for transmitting the processed image to the user; and means for the user to view the image on their terminal and choose to regenerate or save it. This makes it possible to quickly and efficiently generate high-quality interior design images that correspond to the user's input of specific interior design requirements and ultimately post them on a real estate website.

[0786] A "user" refers to an individual or legal entity that uses the system to input interior design requirements.

[0787] A "terminal" is an electronic device used by a user for operation, and includes personal computers, tablets, smartphones, and other similar devices.

[0788] "Interior design requirements" refer to the specific conditions and demands regarding the interior design of a room that the user enters.

[0789] "Means of transmission" refers to the functions and operations used by a user to send interior design requirements entered via a terminal to a server.

[0790] A "server" refers to a central processing unit or computer system that analyzes interior design requirements received from users and generates and processes images using generative artificial intelligence and image generation artificial intelligence.

[0791] "Generative artificial intelligence" refers to artificial intelligence technologies and algorithms used to generate detailed interior design plans based on interior design requirements.

[0792] An "interior design plan" refers to a plan that includes details such as the layout, color scheme, and furniture of the interior, generated by generative artificial intelligence.

[0793] A "prompt" refers to the instruction or input text necessary to pass the interior design plan to the image-generating artificial intelligence.

[0794] "Image generation artificial intelligence" refers to artificial intelligence technologies and algorithms used to generate high-quality interior images based on prompts.

[0795] "Appropriate format" refers to a format that meets the requirements for image resolution, file format, size adjustment, and other specifications necessary for posting images on a real estate website.

[0796] "Processing methods" refer to processes such as adjusting the resolution and converting the file format of the generated image in order to make it suitable for a real estate website.

[0797] "Regeneration" refers to the act of a user requesting the creation of a new image if they are not satisfied with the previously generated image.

[0798] "Saving" refers to the act of a user being satisfied with a generated image and saving that image to their device.

[0799] A "real estate website" refers to a website used to showcase real estate properties.

[0800] "Methods of uploading" refers to the operations and functions that allow users to upload generated images for posting on real estate websites.

[0801] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images by linking a generative artificial intelligence and an image-generating artificial intelligence based on the interior requirements entered by the user, and then processing and providing these images.

[0802] Enter and submit interior design requirements

[0803] The user uses their own device (such as a PC or tablet) to open the interior design requirements input page on the real estate website. The requirements the user enters might be something like, "I want a modern living room with light-colored furniture." After completing the input, pressing the submit button converts the input data into JSON format using JavaScript and sends it to the server.

[0804] Generating interior design plans

[0805] The server analyzes the received interior design requirements using a programming language such as Python. It then inputs the data into a generative artificial intelligence (e.g., GPT-4), which performs natural language processing to generate a detailed interior design plan. The generated plan might include details such as, "The living room should include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0806] Generate a view

[0807] The server converts the generated interior plan into a prompt for image-generating artificial intelligence. The prompt is a concise instruction that extracts and summarizes the key elements of the interior plan, in a format that image-generating AI can understand. For example, if the interior plan is "The living room should include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants," the prompt would be:

[0808] "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0809] Request for image generation

[0810] The server sends the generated prompt to an image-generating artificial intelligence (such as DALL-E or Stable Diffusion) to generate high-quality images of the room's interior. This AI generates images based on the prompts and sends the generated images back to the server.

[0811] Image processing

[0812] The server uses image processing software such as Adobe Photoshop API and OpenCV to process received images into a format suitable for real estate websites. Image processing includes adjusting resolution, converting file formats, and cropping images.

[0813] Image submission and confirmation

[0814] The processed image is sent from the server to the user's device. The user checks the image through a web browser on their device, and if satisfied, they can either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[0815] Posting on the site

[0816] To post the generated images on the real estate website, the user logs in to the website using their device and uploads the image files. Along with the uploaded images, they also enter a description of the room and complete the posting.

[0817] This entire process allows users to efficiently generate high-quality interior images and post them on real estate websites. Furthermore, this system significantly reduces the cost and time required for shooting and editing interior images.

[0818] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0819] Step 1:

[0820] The user enters their interior design requirements using a terminal. For example, they might enter, "I want a modern living room with light-colored furniture." The input data includes the desired room type, color scheme, and furniture type. They then press the submit button to convert this data to JSON format and send it.

[0821] Input: User's interior design requirements (e.g., "I want a modern living room with light-colored furniture.")

[0822] Output: Interior design requirements data converted to JSON format

[0823] Step 2:

[0824] The server receives interior design requirements in JSON format from the user. It parses the received data and runs a Python script to extract the necessary information. This information is then passed to a generative artificial intelligence, which generates a detailed interior design plan through natural language processing. The generated interior design plan might include details such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0825] Input: Interior design requirements data in JSON format

[0826] Data processing: Analysis using Python scripts

[0827] Output: Detailed interior plan

[0828] Step 3:

[0829] The server further analyzes the generated interior plan and generates a prompt for the image generation artificial intelligence. This prompt is a concise instruction that extracts the main elements of the interior plan. This conversion process is performed using a text generation algorithm based on the information in the interior plan. For example, the prompt might read, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0830] Input: Detailed interior plan

[0831] Data processing: Prompt text generation using text generation algorithms

[0832] Output: Prompt message for image generation artificial intelligence

[0833] Step 4:

[0834] The server sends the generated prompt text to an image generation artificial intelligence (such as DALL-E or Stable Diffusion). This AI generates a high-quality interior image based on the prompt text and sends that image back to the server. The server also receives the URL of the generated image stored in cloud storage.

[0835] Input: Prompt for image generation artificial intelligence

[0836] Data processing: Image generation using artificial intelligence

[0837] Output: Generated interior image (and its URL)

[0838] Step 5:

[0839] The server receives the generated interior images and processes them into a format suitable for real estate websites. Specifically, this involves adjusting the resolution, converting file formats, and cropping the images. Adobe Photoshop API and OpenCV are used to perform these image processing tasks.

[0840] Input: Generated interior image

[0841] Data processing: Resolution adjustment, file format conversion, cropping

[0842] Output: Processed interior image

[0843] Step 6:

[0844] The server sends the processed image to the user's device. The user checks the image through a web browser on their device, and if satisfied, they can either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[0845] Input: Processed interior image

[0846] Data processing: Image transmission

[0847] Output: User confirmation result (choice to save or regenerate)

[0848] Step 7:

[0849] To post the generated images on the real estate website, the user logs in to the website using their device and uploads the image files. Along with the uploaded images, they also enter a description of the room and complete the posting.

[0850] Input: Saved image file, room description

[0851] Data processing: Image upload, description entry

[0852] Output: Image posting on real estate websites

[0853] The above outlines the specific processing flow within this system. Through the detailed data processing and calculations performed at each step, users can efficiently generate high-quality interior images and post them on real estate websites.

[0854] (Application Example 1)

[0855] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0856] Traditional real estate websites have faced significant costs and time constraints in generating interior images, and have struggled to provide interior images that accurately reflect users' specific requests. Furthermore, the lack of real-time visibility into desired interior and furniture customizations hindered purchase and selection decisions. Therefore, there is a need to efficiently generate high-quality room interior images and provide realistic interior images that meet user needs.

[0857] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0858] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence; means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence; means for transmitting the prompts to the image generation artificial intelligence to generate an image of the room's interior; means for receiving the generated image and processing it into an appropriate format; means for transmitting the processed image to the user; means for the user to customize furniture and interior design using a terminal and regenerate new conditions; and means for the user to view the room's interior design image on a virtual store interface and perform regeneration or set new conditions. This allows the user to view and regenerate their desired interior design image in real time, improving the efficiency of interior design decisions.

[0859] A "user" refers to the final user who uses the system to input interior design requirements and to view and customize images of the room's interior.

[0860] "Terminal" refers to a general term for electronic devices used by users to input interior design requirements and to view and manipulate the generated interior design images.

[0861] "Interior design requirements" refer to the specific conditions and requests regarding the interior design of a room that the user desires.

[0862] A "server" is a remote computing system that receives interior design requirements from users and uses generative artificial intelligence and image-generating artificial intelligence to create interior design plans, generate images, and process images.

[0863] "Generative artificial intelligence" refers to an artificial intelligence algorithm that generates detailed interior design plans based on the interior design requirements entered by the user.

[0864] An "interior design plan" refers to a design proposal for the arrangement of furniture, color scheme, and decorations within a room, generated by a generative artificial intelligence system based on the user's interior design requirements.

[0865] A "prompt" is a set of instructions based on the interior design plan, converted into a format that the image-generating artificial intelligence can understand.

[0866] "Image generation artificial intelligence" is an artificial intelligence algorithm that generates high-quality images of room interiors based on prompts.

[0867] "Processing" refers to the process of adjusting the resolution and converting file formats of generated interior images to adapt them to the requirements of real estate websites and virtual stores.

[0868] A "virtual store" is a digital platform where users can customize furniture and interior design online and view real-time generated images of the interior.

[0869] This invention is a system that efficiently generates high-quality interior images of rooms and provides realistic interior images that meet the user's needs. Specific embodiments of this system are described below.

[0870] Hardware and software configuration

[0871] The server has the following functions:

[0872] 1. Use a generative artificial intelligence system (e.g., GPT-4) to generate a detailed interior design plan based on the interior design requirements received from the user.

[0873] 2. Analyze the interior design plan and convert it into prompts that can be understood by image generation artificial intelligence (e.g., DALL-E or Stable Diffusion).

[0874] 3. The generated prompt is sent to the image generation artificial intelligence to generate an interior image.

[0875] 4. Process the generated interior images into a format suitable for real estate websites and virtual stores.

[0876] The device has the following features:

[0877] 1. A function that allows users to input interior design requirements through the user interface.

[0878] 2. A function to display the interior design plan and generated interior images sent to the server.

[0879] 3. A function that allows users to receive processed interior images and review and customize them.

[0880] The user will use the system in the following steps:

[0881] System operation

[0882] 1. Inputting interior design requirements:

[0883] The user uses the terminal interface to enter their desired room interior design requirements. For example, they might enter specific requirements such as, "I want a modern living room with light-colored furniture."

[0884] 2. Generating the interior design plan:

[0885] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements. The generated interior plan includes specific layouts, color schemes, and types of furniture. For example, it might say, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0886] 3. Generating the prompt:

[0887] The system analyzes the interior design plan and converts it into prompt sentences for image generation artificial intelligence. These prompt sentences are concise instructions that summarize the elements of the interior design plan. For example, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0888] 4. Generating interior images:

[0889] The server sends the generated prompt text to the image generation AI, which generates an image of the room's interior. The image generation AI generates a high-quality interior image based on the prompt text and sends it back to the server.

[0890] 5. Image processing:

[0891] The server receives the generated images and processes them into a format suitable for real estate websites and virtual stores. This processing includes adjusting the resolution, converting file formats, and cropping the images.

[0892] 6. Sending and confirming images to the user:

[0893] The processed image is sent to the user's device, and the user can review the generated interior image. If necessary, they can request regeneration or set new conditions to create the image again.

[0894] This allows users to view high-quality interior images tailored to their specific needs in real time. Furthermore, it assists them in making purchasing and selection decisions through online furniture and interior customization.

[0895] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0896] Step 1:

[0897] User input and submission of interior design requirements

[0898] The user enters interior design requirements in text format using the terminal interface. For example, they might enter the requirement "I want a modern living room with light-colored furniture" and press the submit button. This input data is then sent to the server in JSON format.

[0899] Input: User's interior design requirements (text)

[0900] Output: Interior design requirements sent to the server (in JSON format)

[0901] Step 2:

[0902] Generating interior design plans

[0903] The server uses generative artificial intelligence (GPT-4) to generate a detailed interior plan based on the received interior requirements. The generative AI analyzes the input information and outputs a detailed plan of the interior layout, color scheme, furniture, etc., that corresponds to the requirements.

[0904] Input: User's interior design requirements (JSON format)

[0905] Output: Interior design plan (text)

[0906] Step 3:

[0907] Prompt statement generation

[0908] The server analyzes the generated interior plan and converts it into a prompt that can be understood by image generation artificial intelligence (such as DALL-E or Stable Diffusion). For example, if the interior plan is "The living room includes a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0909] Input: Interior design plan (text)

[0910] Output: Prompt message (text)

[0911] Step 4:

[0912] Generating interior images

[0913] The server sends the generated prompt text to the image generation AI, which generates an image of the room's interior. The image generation AI generates a high-quality image of the room's interior based on the prompt text and sends it back to the server.

[0914] Input: Prompt message (text)

[0915] Output: Generated interior image (image data)

[0916] Step 5:

[0917] Image processing

[0918] The server receives the generated interior images and processes them into a format optimized for real estate websites and virtual stores. This processing includes adjusting the resolution, converting file formats, and cropping the images. For example, it might convert them to 1280x720 pixel JPEG images.

[0919] Input: Generated interior image (image data)

[0920] Output: Processed interior image (image data in an appropriate format)

[0921] Step 6:

[0922] Sending and confirming images to the user

[0923] The server sends the processed image to the user's device, where the user can view the generated interior image. If the user is satisfied, they can press the "Save" button to save the image. Alternatively, they can press the "Regenerate" button, enter new interior requirements, and request a regeneration.

[0924] Input: Processed interior images (image data in an appropriate format)

[0925] Output: Interior images (image data) sent to the user.

[0926] By performing this step, users can view and customize their desired interior design in real time and obtain high-quality interior images.

[0927] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0928] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images based on user-inputted interior requirements by linking generative artificial intelligence and image-generating artificial intelligence, and then processing and providing these images. Furthermore, by incorporating an emotion engine that recognizes the user's emotions and reflects them in the interior plan, it is possible to generate an optimal interior plan for the user.

[0929] Specific Embodiments

[0930] Enter and submit interior design requirements

[0931] The user enters interior design requirements using a terminal. For example, the user might enter the requirement "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[0932] Recognition and analysis of emotions

[0933] During this process, the emotion engine installed in the device recognizes and analyzes the user's emotions. This emotion engine, for example, uses the camera and microphone to analyze the user's facial expressions and tone of voice to understand the user's emotional state.

[0934] Generating interior design plans

[0935] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements and the user's emotional information. The generative AI analyzes the input information and emotional information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that correspond to the requirements. For example, it might generate a plan such as, "The living room will include a sofa and table in bright colors, a large window that lets in plenty of natural light, modern lighting, and houseplants."

[0936] Plan revision

[0937] If the generated interior plan does not reflect the user's emotional state, the server will modify the plan based on the output of the emotion engine. For example, if the user is feeling stressed, the server will make modifications such as adding relaxing elements.

[0938] Generate a view

[0939] The server analyzes the revised interior plan and converts it into a prompt for image-generating artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior plan in a format that the image-generating AI can understand. For example, if the interior plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0940] Request for image generation

[0941] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[0942] Image processing

[0943] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. By saving the images in a format optimized for real estate websites, high-quality display is achieved.

[0944] Image submission and confirmation

[0945] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, presses the "Save" button to save the image, or presses the "Regenerate" button to request the generation of a new image.

[0946] Posting on the site

[0947] After selecting a satisfactory image, the user proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[0948] According to the above embodiment, the cost and time required to photograph rooms for listing on real estate websites can be reduced, and the image of living in the room that users feel when they actually see it can be enhanced. Furthermore, by providing designs that reflect the user's emotions, it becomes possible to generate more personalized and satisfying images. As a result, it is expected that the buying, selling, and renting of real estate will be promoted.

[0949] The following describes the processing flow.

[0950] Step 1:

[0951] The user enters their interior design requirements into the terminal. For example, they might enter a requirement such as, "I want a modern living room with light-colored furniture," and then press the submit button to send the requirement information to the server.

[0952] Step 2:

[0953] The device's built-in emotion engine recognizes the user's emotions. It uses the camera and microphone to analyze the user's facial expressions and voice tone to understand their emotional state.

[0954] Step 3:

[0955] The terminal sends recognized emotion information and interior design requirement information to the server.

[0956] Step 4:

[0957] The server receives the user's interior design requirements and emotional information.

[0958] Step 5:

[0959] The server receives interior design requirements and emotional information, and then sends the requirements information to a generative artificial intelligence (AI). The AI ​​analyzes the requirements and emotional information and generates a detailed interior design plan. For example, it might generate a plan such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[0960] Step 6:

[0961] The server receives interior design plans generated by a generative artificial intelligence system, and if the plans do not reflect the user's emotional information, it modifies them based on the output of the emotion engine. For example, if the user is feeling stressed, relaxing elements will be added.

[0962] Step 7:

[0963] The server analyzes the revised interior design plan and converts it into prompts for image generation artificial intelligence. For example, it converts it into instructions such as, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0964] Step 8:

[0965] The server sends the generated prompt to the image generation AI, requesting it to generate an image of the room's interior.

[0966] Step 9:

[0967] The image generation AI generates an image of the room's interior based on the prompt and sends it back to the server.

[0968] Step 10:

[0969] The server receives the generated images, processes them by adjusting the resolution and converting the file format, and then converts them to an image format suitable for real estate websites.

[0970] Step 11:

[0971] The server sends the processed image to the user's terminal.

[0972] Step 12:

[0973] The user reviews the image sent on their device and, if satisfied, presses the "Save" button to save the image. If necessary, they can press the "Regenerate" button to request the generation of a new image.

[0974] Step 13:

[0975] Users select images they are satisfied with, log in to the real estate website using their device, and upload the generated images to publish them on the website.

[0976] This entire process allows for the efficient generation of high-quality interior images that take user emotions into consideration, and enables their publication on real estate websites.

[0977] (Example 2)

[0978] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0979] Traditional real estate websites did not generate interior images that reflected the specific requirements and feelings of users, making it difficult to flexibly respond to the needs of individual users. Furthermore, the process from generating interior plans to creating images was cumbersome, costly, and time-consuming. This made it difficult for users to visualize themselves actually living in the room, hindering the sale and rental of properties.

[0980] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0981] In this invention, the server includes means for the user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and recognize and analyze the user's emotional state using an emotion engine; means for the server to generate a detailed interior design plan using generative artificial intelligence based on the interior design requirements and emotional information; means for the server to modify the plan based on the output of the emotion engine if the generated interior design plan does not reflect the user's emotional state; means for analyzing the interior design plan and converting it into prompt text for image generation artificial intelligence; means for transmitting the prompt text to the image generation artificial intelligence to generate an interior design image of the room; means for receiving the generated image and processing it into an appropriate format; and means for transmitting the processed image to the user. This makes it possible to quickly and efficiently provide high-quality interior design images of rooms that reflect the user's specific requirements and emotions.

[0982] An "emotion engine" refers to software or hardware that analyzes a user's facial expressions and tone of voice to recognize their emotional state.

[0983] "Generative artificial intelligence" refers to an artificial intelligence model that generates detailed interior design plans based on user input and emotional information.

[0984] "Image generation artificial intelligence" refers to an artificial intelligence model that generates high-quality images of room interiors based on generated prompt text.

[0985] A "prompt message" refers to a set of instructions that concisely summarizes the elements of an interior design plan and is in a format that can be understood by an image-generating artificial intelligence.

[0986] "Interior design requirements" refer to the specific requests and conditions that the user has regarding the interior design of a room.

[0987] An "interior design plan" refers to a design proposal that includes details such as the layout, color scheme, and furniture of the interior, generated based on the user's interior design requirements and emotional information.

[0988] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images based on user-inputted interior requirements by linking generative artificial intelligence and image-generating artificial intelligence, and then processing and providing these images. Furthermore, by incorporating an emotion engine that recognizes user emotions and reflects them in the interior plan, the system can generate an optimal interior plan for the user.

[0989] Enter and submit interior design requirements

[0990] The user enters interior design requirements using a terminal. For example, the user might enter the requirement "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[0991] Recognition and analysis of emotions

[0992] During this process, the emotion engine installed in the device recognizes and analyzes the user's emotions. This emotion engine uses, for example, the camera and microphone to analyze the user's facial expressions and tone of voice, and understands the user's emotional state. It obtains information such as whether the user is relaxed or stressed.

[0993] Generating interior design plans

[0994] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements and the user's emotional information. The generative AI analyzes the input information and emotional information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that correspond to the requirements. For example, it might generate a plan such as, "The living room will include a sofa and table in bright colors, a large window that lets in plenty of natural light, modern lighting, and houseplants."

[0995] Plan revision

[0996] If the generated interior plan does not reflect the user's emotional information, the server modifies the plan based on the output of the emotion engine. For example, if the user is feeling stressed, it will make modifications such as adding relaxing elements. The modified plan is then finalized again by the generative artificial intelligence.

[0997] Generate a view

[0998] The server analyzes the finalized interior design plan and converts it into a prompt for image generation artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior design plan in a format that the image generation AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt will be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[0999] Request for image generation

[1000] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[1001] Image processing

[1002] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. Saving the images in the optimal format for real estate websites ensures high-quality display.

[1003] Image submission and confirmation

[1004] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[1005] Posting on the site

[1006] Users select images they are satisfied with and then proceed with the process of posting them on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated images. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[1007] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1008] Step 1: Enter and submit interior design requirements.

[1009] The user uses a terminal to input interior design requirements. For example, the user might input the requirement, "I want a modern living room with light-colored furniture." The entered requirement information becomes the input data. The user presses the submit button, and the terminal sends the requirement information to the server. Here, the input data is the interior design requirements, and the output data is the requirement information sent to the server.

[1010] Step 2: Recognition and Analysis of Emotions

[1011] The emotion engine built into the device recognizes and analyzes the user's emotions during input. Specifically, it captures facial expressions with a camera and records voice tone with a microphone. The emotion engine analyzes this raw data to recognize the user's emotional state. The input data is raw data obtained from the camera and microphone, and the output data is the analyzed emotion information. The emotion information and interior design requirements are sent to the server.

[1012] Step 3: Generating the interior design plan

[1013] The server receives interior design requirements and emotional information from the user. Generative artificial intelligence takes this information as input data and generates a detailed interior design plan. Specifically, it outputs detailed plans such as the layout, color scheme, and furniture as output data. For example, it might generate a plan such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[1014] Step 4: Modify the plan

[1015] If the generated interior plan does not reflect the user's emotional information, the server modifies the plan based on the output of the emotion engine. Specifically, it re-analyzes the emotional information and makes modifications such as adding relaxing elements. The modified plan is then finalized again by the generative artificial intelligence. The input data is the original interior plan and additional emotional information, and the output data is the modified interior plan.

[1016] Step 5: Generate a prompt

[1017] The server analyzes the finalized interior design plan and generates prompts for image generation artificial intelligence. These prompts concisely summarize the elements of the interior design plan and convert them into instructional sentences. The input data is the interior design plan, and the output data is the prompt sentences. For example, a prompt sentence in the format "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." is generated.

[1018] Step 6: Request image generation

[1019] The server sends the generated prompt text to the image generation AI, requesting it to generate specific interior images. The image generation AI receives the prompt text as input data, generates high-quality images of room interiors, and sends them back to the server. The input data is the prompt text, and the output data is the generated interior images.

[1020] Step 7: Image Processing

[1021] The server receives the generated image and processes it into a format suitable for a real estate website. Specific operations include adjusting the resolution, converting file formats, and cropping the image. The input data is the generated image, and the output data is the processed image.

[1022] Step 8: Image submission and confirmation

[1023] The server sends the processed image to the user's device. The user checks the image on their device and, if satisfied, presses the "Save" button to save the image, or if not satisfied, presses the "Regenerate" button to request the generation of a new image. The input data is the processed image, and the output data is feedback based on the user's satisfaction level.

[1024] Step 9: Posting to the website

[1025] The user selects a satisfactory image and proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. The input data is the saved image, and the output data is the image posted on the real estate website.

[1026] (Application Example 2)

[1027] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1028] The problem that this invention aims to solve is to provide users with an optimal interior design plan that reflects their emotions in real time when designing interiors in a virtual store, thereby realizing a more personalized and satisfying experience. It also aims to enable users to easily generate high-quality interior images and use those images to support their purchasing decisions.

[1029] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1030] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal, means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence, and means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence. This enables the generation of an optimal interior design plan based on the user's requirements and emotional information, and the generation of high-quality images based on that interior design plan.

[1031] A "user" is the end user who uses the system to input interior design requirements and then reviews the generated interior design plans and images.

[1032] A "terminal" is a device used by a user to input and submit interior design requirements, and specific examples include smartphones and tablets.

[1033] "Interior design requirements" refer to information that specifies the desired room style, color scheme, furniture, and other details from the user.

[1034] A "server" is a computer system that receives interior design requirements from users and generates detailed interior design plans using generative artificial intelligence.

[1035] "Generative artificial intelligence" refers to an artificial intelligence system that generates interior design plans based on the user's interior design requirements and emotional information.

[1036] An "interior design plan" is a detailed blueprint of the room layout and design, created by a generative artificial intelligence system based on the user's requirements.

[1037] A "prompt" is a set of instructions that concisely summarizes the elements of an interior design plan and is in a format that can be understood by an image-generating artificial intelligence.

[1038] "Image generation artificial intelligence" is an artificial intelligence system that generates images of room interiors based on prompts.

[1039] The "emotion engine" is an analytical system that recognizes the user's emotional state and reflects it in the interior design plan.

[1040] "Image processing" refers to the process of editing generated interior images into an appropriate format by adjusting the resolution, converting file formats, and so on.

[1041] A "virtual store" is an online platform where users can select interior items and design their interiors via the internet.

[1042] This invention relates to a system that allows users to select interior items and design interiors within a virtual store using a terminal. Specific embodiments for carrying out this invention are described below.

[1043] System Configuration

[1044] terminal

[1045] Users input interior design requirements using devices such as smartphones and tablets. These requirements include information such as the room style, color scheme, desired furniture, and decorative items. For example, a user might input a requirement such as, "I want a modern living room with light-colored furniture."

[1046] server

[1047] The server receives interior design requirements submitted by the user. The server is equipped with multiple artificial intelligence engines, including generative AI and image generation AI.

[1048] 1. Generative Artificial Intelligence

[1049] The server generates a detailed interior plan based on the interior requirements. The generative artificial intelligence outputs an interior plan that includes details such as the arrangement of interiors, color schemes, and furniture that meet the requirements.

[1050] 2. Emotional Engine

[1051] The emotion engine installed on the server recognizes and analyzes the user's emotions. The emotion engine uses the camera and microphone installed on the device to analyze the user's facial expressions and tone of voice to understand the user's emotional state. For example, if the user is feeling stressed, the engine will make adjustments such as adding elements that help them relax.

[1052] 3. Prompt generation

[1053] The server analyzes the interior design plan and converts it into prompts for image-generating artificial intelligence. These prompts are concise instructions summarizing the elements of the generated interior design plan, in a format that the image-generating AI can understand.

[1054] For example, for a plan that states, "The living room includes a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." is generated.

[1055] 4. Image generation artificial intelligence

[1056] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[1057] 5. Image processing

[1058] The server receives the generated images and processes them into a format suitable for the virtual store. This processing includes adjusting the resolution, converting file formats, and cropping the images.

[1059] User operation

[1060] Users can view the generated interior images of the room on their device. If they are satisfied, they can press the "Save" button to save the image, or press the "Regenerate" button to request the generation of a new image.

[1061] This system allows users to view optimal interior design plans in real time based on their own feelings and requirements, enabling them to create interior designs that are highly satisfying. It also makes it easy to generate high-quality interior images to support purchasing decisions.

[1062] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1063] Step 1:

[1064] The user uses a terminal to input and submit interior design requirements. Specifically, the user enters detailed information such as the desired room style, color scheme, and furniture into the terminal's input screen and sends it to the server by pressing the submit button. The input data at this time may include, for example, "I want a modern living room with light-colored furniture." The output of the terminal is the interior design requirements data.

[1065] Step 2:

[1066] The server receives the aforementioned interior requirements and uses generative artificial intelligence to generate a detailed interior plan. First, the server receives the interior requirements data sent from the terminal and passes it to the generative artificial intelligence. Based on this data, the generative artificial intelligence generates a detailed interior plan including the layout, color scheme, furniture, etc. In this process, the generative artificial intelligence utilizes existing design databases and algorithms. The generated interior plan is the server's output.

[1067] Step 3:

[1068] The server uses an emotion engine to recognize the user's emotional state and reflect it in the interior design plan. The server uses the terminal's camera and microphone to analyze the user's facial expressions and tone of voice to understand their emotional state. For example, if the user is stressed, the server modifies the interior design plan to include elements that promote relaxation. The input data includes the user's emotional information, and the output data is the modified interior design plan.

[1069] Step 4:

[1070] The server analyzes the interior design plan and converts it into a prompt for image-generating artificial intelligence. Specifically, it concisely summarizes each element of the generated interior design plan and creates an instruction in a format that the image-generating AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." The input data is the interior design plan, and the output data is the prompt.

[1071] Step 5:

[1072] The server sends a prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The server passes the generated prompt to the AI ​​and sends a request to generate the interior image. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the image data back to the server. The prompt text is the input data, and the interior image is the output data.

[1073] Step 6:

[1074] The server receives the generated images and processes them into a format suitable for the virtual store. Specifically, it adjusts the image resolution, converts the file format, and crops the images as needed. After performing these processing steps, the server creates the final image data. The input data is the generated raw interior image, and the output data is the processed image.

[1075] Step 7:

[1076] The server sends the processed image to the user's device. The user checks the generated room interior image on their device and, if satisfied, presses the "Save" button to save the image. They can also request the generation of a new image by pressing the "Regenerate" button. The processed image is the input data, and the user's confirmation and manipulation are the output.

[1077] Through this series of steps, users can view optimal interior plans based on their own feelings and requirements in real time, enabling them to create interior designs that are highly satisfying. Furthermore, it's possible to easily generate high-quality interior images to support purchasing decisions.

[1078] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1079] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1080] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1081] [Fourth Embodiment]

[1082] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1083] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1084] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1085] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1086] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1087] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1088] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1089] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1090] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1091] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1092] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1093] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1094] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1095] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images by linking a generative artificial intelligence and an image-generating artificial intelligence based on the interior requirements entered by the user, and then processing and providing these images.

[1096] Specific Embodiments

[1097] Enter and submit interior design requirements

[1098] The user enters interior design requirements using a terminal. For example, the user might enter requirements such as "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[1099] Generating interior design plans

[1100] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements. The generative AI analyzes the input information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that meet the requirements. For example, it might generate a plan that includes "a brightly colored sofa and table, a large window that lets in plenty of natural light, modern lighting, and houseplants in the living room."

[1101] Generate a view

[1102] The server analyzes the generated interior design plan and converts it into a prompt for image-generating artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior design plan in a format that the image-generating AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[1103] Request for image generation

[1104] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[1105] Image processing

[1106] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. By saving the images in a format optimized for real estate websites, high-quality display is achieved.

[1107] Image submission and confirmation

[1108] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, presses the "Save" button to save the image, or presses the "Regenerate" button to request the generation of a new image.

[1109] Posting on the site

[1110] After selecting a satisfactory image, the user proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[1111] According to the above embodiment, the cost and time required to photograph rooms for listing on real estate websites can be reduced, and the image of what it would be like to live in the room that users experience when they actually see it can be enhanced. This is expected to have the effect of promoting the buying, selling, and renting of real estate.

[1112] The following describes the processing flow.

[1113] Step 1:

[1114] The user enters their interior design requirements into the terminal. For example, they might enter a requirement such as, "I want a modern living room with light-colored furniture," and then press the submit button to send the requirement information to the server.

[1115] Step 2:

[1116] The server receives the user's interior design requirements information.

[1117] Step 3:

[1118] The server receives interior design requirements and sends the requirements information to a generative artificial intelligence (AI). The AI ​​analyzes the requirements information and generates a detailed interior design plan. This plan includes color schemes, furniture placement, wall decorations, lighting, and more.

[1119] Step 4:

[1120] The server receives interior design plans generated by generative artificial intelligence, analyzes the plans, and converts them into prompts for image generation artificial intelligence.

[1121] Step 5:

[1122] The server sends the generated prompt to the image generation AI, requesting it to generate an image of the room's interior.

[1123] Step 6:

[1124] The image generation AI generates an image of the room's interior based on the prompt and sends the generated image back to the server.

[1125] Step 7:

[1126] The server receives the generated images and processes them, such as adjusting the resolution and converting the file format. This makes them suitable for real estate websites.

[1127] Step 8:

[1128] The server sends the processed image to the user's device.

[1129] Step 9:

[1130] The user reviews the image sent on their device. If satisfied, they can press the "Save" button to save the image. Furthermore, they can request the generation of a new image by pressing the "Regenerate" button if needed.

[1131] Step 10:

[1132] Users select images they are satisfied with, log in to the real estate website using their device, and upload the generated images to publish them on the website.

[1133] This series of processes allows for the efficient generation of high-quality interior images, which can then be posted on real estate websites.

[1134] (Example 1)

[1135] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1136] In the real estate industry, maintaining high quality and generating interior images of properties quickly is a critical challenge. However, traditional methods involve significant costs and time for photography and image editing, and it is difficult to efficiently propose interior images that satisfy users. In particular, the entire process from users inputting specific interior requirements to generating high-quality interior images that meet those requirements and finally posting them on the real estate website is cumbersome. Therefore, there is a need for a system that improves overall work efficiency and provides users with satisfactory interior images quickly.

[1137] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1138] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence; means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence; means for transmitting the prompts to the image generation artificial intelligence to generate an image of the room's interior; means for receiving the generated image and processing it into an appropriate format; means for transmitting the processed image to the user; and means for the user to view the image on their terminal and choose to regenerate or save it. This makes it possible to quickly and efficiently generate high-quality interior design images that correspond to the user's input of specific interior design requirements and ultimately post them on a real estate website.

[1139] A "user" refers to an individual or legal entity that uses the system to input interior design requirements.

[1140] A "terminal" is an electronic device used by a user for operation, and includes personal computers, tablets, smartphones, and other similar devices.

[1141] "Interior design requirements" refer to the specific conditions and demands regarding the interior design of a room that the user enters.

[1142] "Means of transmission" refers to the functions and operations used by a user to send interior design requirements entered via a terminal to a server.

[1143] A "server" refers to a central processing unit or computer system that analyzes interior design requirements received from users and generates and processes images using generative artificial intelligence and image generation artificial intelligence.

[1144] "Generative artificial intelligence" refers to artificial intelligence technologies and algorithms used to generate detailed interior design plans based on interior design requirements.

[1145] An "interior design plan" refers to a plan that includes details such as the layout, color scheme, and furniture of the interior, generated by generative artificial intelligence.

[1146] A "prompt" refers to the instruction or input text necessary to pass the interior design plan to the image-generating artificial intelligence.

[1147] "Image generation artificial intelligence" refers to artificial intelligence technologies and algorithms used to generate high-quality interior images based on prompts.

[1148] "Appropriate format" refers to a format that meets the requirements for image resolution, file format, size adjustment, and other specifications necessary for posting images on a real estate website.

[1149] "Processing methods" refer to processes such as adjusting the resolution and converting the file format of the generated image in order to make it suitable for a real estate website.

[1150] "Regeneration" refers to the act of a user requesting the creation of a new image if they are not satisfied with the previously generated image.

[1151] "Saving" refers to the act of a user being satisfied with a generated image and saving that image to their device.

[1152] A "real estate website" refers to a website used to showcase real estate properties.

[1153] "Methods of uploading" refers to the operations and functions that allow users to upload generated images for posting on real estate websites.

[1154] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images by linking a generative artificial intelligence and an image-generating artificial intelligence based on the interior requirements entered by the user, and then processing and providing these images.

[1155] Enter and submit interior design requirements

[1156] The user uses their own device (such as a PC or tablet) to open the interior design requirements input page on the real estate website. The requirements the user enters might be something like, "I want a modern living room with light-colored furniture." After completing the input, pressing the submit button converts the input data into JSON format using JavaScript and sends it to the server.

[1157] Generating interior design plans

[1158] The server analyzes the received interior design requirements using a programming language such as Python. It then inputs the data into a generative artificial intelligence (e.g., GPT-4), which performs natural language processing to generate a detailed interior design plan. The generated plan might include details such as, "The living room should include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[1159] Generate a view

[1160] The server converts the generated interior plan into a prompt for image-generating artificial intelligence. The prompt is a concise instruction that extracts and summarizes the key elements of the interior plan, in a format that image-generating AI can understand. For example, if the interior plan is "The living room should include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants," the prompt would be:

[1161] "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[1162] Request for image generation

[1163] The server sends the generated prompt to an image-generating artificial intelligence (such as DALL-E or Stable Diffusion) to generate high-quality images of the room's interior. This AI generates images based on the prompts and sends the generated images back to the server.

[1164] Image processing

[1165] The server uses image processing software such as Adobe Photoshop API and OpenCV to process received images into a format suitable for real estate websites. Image processing includes adjusting resolution, converting file formats, and cropping images.

[1166] Image submission and confirmation

[1167] The processed image is sent from the server to the user's device. The user checks the image through a web browser on their device, and if satisfied, they can either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[1168] Posting on the site

[1169] To post the generated images on the real estate website, the user logs in to the website using their device and uploads the image files. Along with the uploaded images, they also enter a description of the room and complete the posting.

[1170] This entire process allows users to efficiently generate high-quality interior images and post them on real estate websites. Furthermore, this system significantly reduces the cost and time required for shooting and editing interior images.

[1171] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1172] Step 1:

[1173] The user enters their interior design requirements using a terminal. For example, they might enter, "I want a modern living room with light-colored furniture." The input data includes the desired room type, color scheme, and furniture type. They then press the submit button to convert this data to JSON format and send it.

[1174] Input: User's interior design requirements (e.g., "I want a modern living room with light-colored furniture.")

[1175] Output: Interior design requirements data converted to JSON format

[1176] Step 2:

[1177] The server receives interior design requirements in JSON format from the user. It parses the received data and runs a Python script to extract the necessary information. This information is then passed to a generative artificial intelligence, which generates a detailed interior design plan through natural language processing. The generated interior design plan might include details such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[1178] Input: Interior design requirements data in JSON format

[1179] Data processing: Analysis using Python scripts

[1180] Output: Detailed interior plan

[1181] Step 3:

[1182] The server further analyzes the generated interior plan and generates a prompt for the image generation artificial intelligence. This prompt is a concise instruction that extracts the main elements of the interior plan. This conversion process is performed using a text generation algorithm based on the information in the interior plan. For example, the prompt might read, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[1183] Input: Detailed interior plan

[1184] Data processing: Prompt text generation using text generation algorithms

[1185] Output: Prompt message for image generation artificial intelligence

[1186] Step 4:

[1187] The server sends the generated prompt text to an image generation artificial intelligence (such as DALL-E or Stable Diffusion). This AI generates a high-quality interior image based on the prompt text and sends that image back to the server. The server also receives the URL of the generated image stored in cloud storage.

[1188] Input: Prompt for image generation artificial intelligence

[1189] Data processing: Image generation using artificial intelligence

[1190] Output: Generated interior image (and its URL)

[1191] Step 5:

[1192] The server receives the generated interior images and processes them into a format suitable for real estate websites. Specifically, this involves adjusting the resolution, converting file formats, and cropping the images. Adobe Photoshop API and OpenCV are used to perform these image processing tasks.

[1193] Input: Generated interior image

[1194] Data processing: Resolution adjustment, file format conversion, cropping

[1195] Output: Processed interior image

[1196] Step 6:

[1197] The server sends the processed image to the user's device. The user checks the image through a web browser on their device, and if satisfied, they can either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[1198] Input: Processed interior image

[1199] Data processing: Image transmission

[1200] Output: User confirmation result (choice to save or regenerate)

[1201] Step 7:

[1202] To post the generated images on the real estate website, the user logs in to the website using their device and uploads the image files. Along with the uploaded images, they also enter a description of the room and complete the posting.

[1203] Input: Saved image file, room description

[1204] Data processing: Image upload, description entry

[1205] Output: Image posting on real estate websites

[1206] The above outlines the specific processing flow within this system. Through the detailed data processing and calculations performed at each step, users can efficiently generate high-quality interior images and post them on real estate websites.

[1207] (Application Example 1)

[1208] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1209] Traditional real estate websites have faced significant costs and time constraints in generating interior images, and have struggled to provide interior images that accurately reflect users' specific requests. Furthermore, the lack of real-time visibility into desired interior and furniture customizations hindered purchase and selection decisions. Therefore, there is a need to efficiently generate high-quality room interior images and provide realistic interior images that meet user needs.

[1210] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1211] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence; means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence; means for transmitting the prompts to the image generation artificial intelligence to generate an image of the room's interior; means for receiving the generated image and processing it into an appropriate format; means for transmitting the processed image to the user; means for the user to customize furniture and interior design using a terminal and regenerate new conditions; and means for the user to view the room's interior design image on a virtual store interface and perform regeneration or set new conditions. This allows the user to view and regenerate their desired interior design image in real time, improving the efficiency of interior design decisions.

[1212] A "user" refers to the final user who uses the system to input interior design requirements and to view and customize images of the room's interior.

[1213] "Terminal" refers to a general term for electronic devices used by users to input interior design requirements and to view and manipulate the generated interior design images.

[1214] "Interior design requirements" refer to the specific conditions and requests regarding the interior design of a room that the user desires.

[1215] A "server" is a remote computing system that receives interior design requirements from users and uses generative artificial intelligence and image-generating artificial intelligence to create interior design plans, generate images, and process images.

[1216] "Generative artificial intelligence" refers to an artificial intelligence algorithm that generates detailed interior design plans based on the interior design requirements entered by the user.

[1217] An "interior design plan" refers to a design proposal for the arrangement of furniture, color scheme, and decorations within a room, generated by a generative artificial intelligence system based on the user's interior design requirements.

[1218] A "prompt" is a set of instructions based on the interior design plan, converted into a format that the image-generating artificial intelligence can understand.

[1219] "Image generation artificial intelligence" is an artificial intelligence algorithm that generates high-quality images of room interiors based on prompts.

[1220] "Processing" refers to the process of adjusting the resolution and converting file formats of generated interior images to adapt them to the requirements of real estate websites and virtual stores.

[1221] A "virtual store" is a digital platform where users can customize furniture and interior design online and view real-time generated images of the interior.

[1222] This invention is a system that efficiently generates high-quality interior images of rooms and provides realistic interior images that meet the user's needs. Specific embodiments of this system are described below.

[1223] Hardware and software configuration

[1224] The server has the following functions:

[1225] 1. Use a generative artificial intelligence system (e.g., GPT-4) to generate a detailed interior design plan based on the interior design requirements received from the user.

[1226] 2. Analyze the interior design plan and convert it into prompts that can be understood by image generation artificial intelligence (e.g., DALL-E or Stable Diffusion).

[1227] 3. The generated prompt is sent to the image generation artificial intelligence to generate an interior image.

[1228] 4. Process the generated interior images into a format suitable for real estate websites and virtual stores.

[1229] The device has the following features:

[1230] 1. A function that allows users to input interior design requirements through the user interface.

[1231] 2. A function to display the interior design plan and generated interior images sent to the server.

[1232] 3. A function that allows users to receive processed interior images and review and customize them.

[1233] The user will use the system in the following steps:

[1234] System operation

[1235] 1. Inputting interior design requirements:

[1236] The user uses the terminal interface to enter their desired room interior design requirements. For example, they might enter specific requirements such as, "I want a modern living room with light-colored furniture."

[1237] 2. Generating the interior design plan:

[1238] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements. The generated interior plan includes specific layouts, color schemes, and types of furniture. For example, it might say, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[1239] 3. Generating the prompt:

[1240] The system analyzes the interior design plan and converts it into prompt sentences for image generation artificial intelligence. These prompt sentences are concise instructions that summarize the elements of the interior design plan. For example, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[1241] 4. Generating interior images:

[1242] The server sends the generated prompt text to the image generation AI, which generates an image of the room's interior. The image generation AI generates a high-quality interior image based on the prompt text and sends it back to the server.

[1243] 5. Image processing:

[1244] The server receives the generated images and processes them into a format suitable for real estate websites and virtual stores. This processing includes adjusting the resolution, converting file formats, and cropping the images.

[1245] 6. Sending and confirming images to the user:

[1246] The processed image is sent to the user's device, and the user can review the generated interior image. If necessary, they can request regeneration or set new conditions to create the image again.

[1247] This allows users to view high-quality interior images tailored to their specific needs in real time. Furthermore, it assists them in making purchasing and selection decisions through online furniture and interior customization.

[1248] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1249] Step 1:

[1250] User input and submission of interior design requirements

[1251] The user enters interior design requirements in text format using the terminal interface. For example, they might enter the requirement "I want a modern living room with light-colored furniture" and press the submit button. This input data is then sent to the server in JSON format.

[1252] Input: User's interior design requirements (text)

[1253] Output: Interior design requirements sent to the server (in JSON format)

[1254] Step 2:

[1255] Generating interior design plans

[1256] The server uses generative artificial intelligence (GPT-4) to generate a detailed interior plan based on the received interior requirements. The generative AI analyzes the input information and outputs a detailed plan of the interior layout, color scheme, furniture, etc., that corresponds to the requirements.

[1257] Input: User's interior design requirements (JSON format)

[1258] Output: Interior design plan (text)

[1259] Step 3:

[1260] Prompt statement generation

[1261] The server analyzes the generated interior plan and converts it into a prompt that can be understood by image generation artificial intelligence (such as DALL-E or Stable Diffusion). For example, if the interior plan is "The living room includes a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[1262] Input: Interior design plan (text)

[1263] Output: Prompt message (text)

[1264] Step 4:

[1265] Generating interior images

[1266] The server sends the generated prompt text to the image generation AI, which generates an image of the room's interior. The image generation AI generates a high-quality image of the room's interior based on the prompt text and sends it back to the server.

[1267] Input: Prompt message (text)

[1268] Output: Generated interior image (image data)

[1269] Step 5:

[1270] Image processing

[1271] The server receives the generated interior images and processes them into a format optimized for real estate websites and virtual stores. This processing includes adjusting the resolution, converting file formats, and cropping the images. For example, it might convert them to 1280x720 pixel JPEG images.

[1272] Input: Generated interior image (image data)

[1273] Output: Processed interior image (image data in an appropriate format)

[1274] Step 6:

[1275] Sending and confirming images to the user

[1276] The server sends the processed image to the user's device, where the user can view the generated interior image. If the user is satisfied, they can press the "Save" button to save the image. Alternatively, they can press the "Regenerate" button, enter new interior requirements, and request a regeneration.

[1277] Input: Processed interior images (image data in an appropriate format)

[1278] Output: Interior images (image data) sent to the user.

[1279] By performing this step, users can view and customize their desired interior design in real time and obtain high-quality interior images.

[1280] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1281] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images based on user-inputted interior requirements by linking generative artificial intelligence and image-generating artificial intelligence, and then processing and providing these images. Furthermore, by incorporating an emotion engine that recognizes the user's emotions and reflects them in the interior plan, it is possible to generate an optimal interior plan for the user.

[1282] Specific Embodiments

[1283] Enter and submit interior design requirements

[1284] The user enters interior design requirements using a terminal. For example, the user might enter the requirement "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[1285] Recognition and analysis of emotions

[1286] During this process, the emotion engine installed in the device recognizes and analyzes the user's emotions. This emotion engine, for example, uses the camera and microphone to analyze the user's facial expressions and tone of voice to understand the user's emotional state.

[1287] Generating interior design plans

[1288] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements and the user's emotional information. The generative AI analyzes the input information and emotional information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that correspond to the requirements. For example, it might generate a plan such as, "The living room will include a sofa and table in bright colors, a large window that lets in plenty of natural light, modern lighting, and houseplants."

[1289] Plan revision

[1290] If the generated interior plan does not reflect the user's emotional state, the server will modify the plan based on the output of the emotion engine. For example, if the user is feeling stressed, the server will make modifications such as adding relaxing elements.

[1291] Generate a view

[1292] The server analyzes the revised interior plan and converts it into a prompt for image-generating artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior plan in a format that the image-generating AI can understand. For example, if the interior plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[1293] Request for image generation

[1294] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[1295] Image processing

[1296] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. By saving the images in a format optimized for real estate websites, high-quality display is achieved.

[1297] Image submission and confirmation

[1298] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, presses the "Save" button to save the image, or presses the "Regenerate" button to request the generation of a new image.

[1299] Posting on the site

[1300] After selecting a satisfactory image, the user proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[1301] According to the above embodiment, the cost and time required to photograph rooms for listing on real estate websites can be reduced, and the image of living in the room that users feel when they actually see it can be enhanced. Furthermore, by providing designs that reflect the user's emotions, it becomes possible to generate more personalized and satisfying images. As a result, it is expected that the buying, selling, and renting of real estate will be promoted.

[1302] The following describes the processing flow.

[1303] Step 1:

[1304] The user enters their interior design requirements into the terminal. For example, they might enter a requirement such as, "I want a modern living room with light-colored furniture," and then press the submit button to send the requirement information to the server.

[1305] Step 2:

[1306] The device's built-in emotion engine recognizes the user's emotions. It uses the camera and microphone to analyze the user's facial expressions and voice tone to understand their emotional state.

[1307] Step 3:

[1308] The terminal sends recognized emotion information and interior design requirement information to the server.

[1309] Step 4:

[1310] The server receives the user's interior design requirements and emotional information.

[1311] Step 5:

[1312] The server receives interior design requirements and emotional information, and then sends the requirements information to a generative artificial intelligence (AI). The AI ​​analyzes the requirements and emotional information and generates a detailed interior design plan. For example, it might generate a plan such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[1313] Step 6:

[1314] The server receives interior design plans generated by a generative artificial intelligence system, and if the plans do not reflect the user's emotional information, it modifies them based on the output of the emotion engine. For example, if the user is feeling stressed, relaxing elements will be added.

[1315] Step 7:

[1316] The server analyzes the revised interior design plan and converts it into prompts for image generation artificial intelligence. For example, it converts it into instructions such as, "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[1317] Step 8:

[1318] The server sends the generated prompt to the image generation AI, requesting it to generate an image of the room's interior.

[1319] Step 9:

[1320] The image generation AI generates an image of the room's interior based on the prompt and sends it back to the server.

[1321] Step 10:

[1322] The server receives the generated images, processes them by adjusting the resolution and converting the file format, and then converts them to an image format suitable for real estate websites.

[1323] Step 11:

[1324] The server sends the processed image to the user's terminal.

[1325] Step 12:

[1326] The user reviews the image sent on their device and, if satisfied, presses the "Save" button to save the image. If necessary, they can press the "Regenerate" button to request the generation of a new image.

[1327] Step 13:

[1328] Users select images they are satisfied with, log in to the real estate website using their device, and upload the generated images to publish them on the website.

[1329] This entire process allows for the efficient generation of high-quality interior images that take user emotions into consideration, and enables their publication on real estate websites.

[1330] (Example 2)

[1331] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1332] Traditional real estate websites did not generate interior images that reflected the specific requirements and feelings of users, making it difficult to flexibly respond to the needs of individual users. Furthermore, the process from generating interior plans to creating images was cumbersome, costly, and time-consuming. This made it difficult for users to visualize themselves actually living in the room, hindering the sale and rental of properties.

[1333] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1334] In this invention, the server includes means for the user to input and transmit interior design requirements using a terminal; means for the server to receive the interior design requirements and recognize and analyze the user's emotional state using an emotion engine; means for the server to generate a detailed interior design plan using generative artificial intelligence based on the interior design requirements and emotional information; means for the server to modify the plan based on the output of the emotion engine if the generated interior design plan does not reflect the user's emotional state; means for analyzing the interior design plan and converting it into prompt text for image generation artificial intelligence; means for transmitting the prompt text to the image generation artificial intelligence to generate an interior design image of the room; means for receiving the generated image and processing it into an appropriate format; and means for transmitting the processed image to the user. This makes it possible to quickly and efficiently provide high-quality interior design images of rooms that reflect the user's specific requirements and emotions.

[1335] An "emotion engine" refers to software or hardware that analyzes a user's facial expressions and tone of voice to recognize their emotional state.

[1336] "Generative artificial intelligence" refers to an artificial intelligence model that generates detailed interior design plans based on user input and emotional information.

[1337] "Image generation artificial intelligence" refers to an artificial intelligence model that generates high-quality images of room interiors based on generated prompt text.

[1338] A "prompt message" refers to a set of instructions that concisely summarizes the elements of an interior design plan and is in a format that can be understood by an image-generating artificial intelligence.

[1339] "Interior design requirements" refer to the specific requests and conditions that the user has regarding the interior design of a room.

[1340] An "interior design plan" refers to a design proposal that includes details such as the layout, color scheme, and furniture of the interior, generated based on the user's interior design requirements and emotional information.

[1341] This invention relates to a system for efficiently generating high-quality interior images of rooms for posting on real estate websites. It provides a means for generating images based on user-inputted interior requirements by linking generative artificial intelligence and image-generating artificial intelligence, and then processing and providing these images. Furthermore, by incorporating an emotion engine that recognizes user emotions and reflects them in the interior plan, the system can generate an optimal interior plan for the user.

[1342] Enter and submit interior design requirements

[1343] The user enters interior design requirements using a terminal. For example, the user might enter the requirement "I want a modern living room with light-colored furniture." Once the user has finished entering the requirements, they press the submit button to send the requirements information to the server.

[1344] Recognition and analysis of emotions

[1345] During this process, the emotion engine installed in the device recognizes and analyzes the user's emotions. This emotion engine uses, for example, the camera and microphone to analyze the user's facial expressions and tone of voice, and understands the user's emotional state. It obtains information such as whether the user is relaxed or stressed.

[1346] Generating interior design plans

[1347] The server uses generative artificial intelligence to generate a detailed interior plan based on the received interior requirements and the user's emotional information. The generative AI analyzes the input information and emotional information and outputs an interior plan that includes details such as the layout, color scheme, and furniture that correspond to the requirements. For example, it might generate a plan such as, "The living room will include a sofa and table in bright colors, a large window that lets in plenty of natural light, modern lighting, and houseplants."

[1348] Plan revision

[1349] If the generated interior plan does not reflect the user's emotional information, the server modifies the plan based on the output of the emotion engine. For example, if the user is feeling stressed, it will make modifications such as adding relaxing elements. The modified plan is then finalized again by the generative artificial intelligence.

[1350] Generate a view

[1351] The server analyzes the finalized interior design plan and converts it into a prompt for image generation artificial intelligence. This prompt is a concise instruction that summarizes the elements of the generated interior design plan in a format that the image generation AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt will be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants."

[1352] Request for image generation

[1353] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[1354] Image processing

[1355] The server receives the generated images and processes them into a format suitable for real estate websites. This processing includes adjusting the resolution, converting file formats, and cropping the images. Saving the images in the optimal format for real estate websites ensures high-quality display.

[1356] Image submission and confirmation

[1357] The server sends the processed image to the user's device. The user checks the generated room image on their device and, if satisfied, either press the "Save" button to save the image or press the "Regenerate" button to request the generation of a new image.

[1358] Posting on the site

[1359] Users select images they are satisfied with and then proceed with the process of posting them on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated images. This entire process makes it possible to quickly and efficiently provide high-quality images of rooms that evoke a sense of living in them.

[1360] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1361] Step 1: Enter and submit interior design requirements.

[1362] The user uses a terminal to input interior design requirements. For example, the user might input the requirement, "I want a modern living room with light-colored furniture." The entered requirement information becomes the input data. The user presses the submit button, and the terminal sends the requirement information to the server. Here, the input data is the interior design requirements, and the output data is the requirement information sent to the server.

[1363] Step 2: Recognition and Analysis of Emotions

[1364] The emotion engine built into the device recognizes and analyzes the user's emotions during input. Specifically, it captures facial expressions with a camera and records voice tone with a microphone. The emotion engine analyzes this raw data to recognize the user's emotional state. The input data is raw data obtained from the camera and microphone, and the output data is the analyzed emotion information. The emotion information and interior design requirements are sent to the server.

[1365] Step 3: Generating the interior design plan

[1366] The server receives interior design requirements and emotional information from the user. Generative artificial intelligence takes this information as input data and generates a detailed interior design plan. Specifically, it outputs detailed plans such as the layout, color scheme, and furniture as output data. For example, it might generate a plan such as, "The living room will include a sofa and table in light colors, large windows that let in plenty of natural light, modern lighting, and houseplants."

[1367] Step 4: Modify the plan

[1368] If the generated interior plan does not reflect the user's emotional information, the server modifies the plan based on the output of the emotion engine. Specifically, it re-analyzes the emotional information and makes modifications such as adding relaxing elements. The modified plan is then finalized again by the generative artificial intelligence. The input data is the original interior plan and additional emotional information, and the output data is the modified interior plan.

[1369] Step 5: Generate a prompt

[1370] The server analyzes the finalized interior design plan and generates prompts for image generation artificial intelligence. These prompts concisely summarize the elements of the interior design plan and convert them into instructional sentences. The input data is the interior design plan, and the output data is the prompt sentences. For example, a prompt sentence in the format "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." is generated.

[1371] Step 6: Request image generation

[1372] The server sends the generated prompt text to the image generation AI, requesting it to generate specific interior images. The image generation AI receives the prompt text as input data, generates high-quality images of room interiors, and sends them back to the server. The input data is the prompt text, and the output data is the generated interior images.

[1373] Step 7: Image Processing

[1374] The server receives the generated image and processes it into a format suitable for a real estate website. Specific operations include adjusting the resolution, converting file formats, and cropping the image. The input data is the generated image, and the output data is the processed image.

[1375] Step 8: Image submission and confirmation

[1376] The server sends the processed image to the user's device. The user checks the image on their device and, if satisfied, presses the "Save" button to save the image, or if not satisfied, presses the "Regenerate" button to request the generation of a new image. The input data is the processed image, and the output data is feedback based on the user's satisfaction level.

[1377] Step 9: Posting to the website

[1378] The user selects a satisfactory image and proceeds with the process of posting it on the real estate website. Specifically, they log in to the real estate website using the terminal's interface and upload the generated image. The input data is the saved image, and the output data is the image posted on the real estate website.

[1379] (Application Example 2)

[1380] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1381] The problem that this invention aims to solve is to provide users with an optimal interior design plan that reflects their emotions in real time when designing interiors in a virtual store, thereby realizing a more personalized and satisfying experience. It also aims to enable users to easily generate high-quality interior images and use those images to support their purchasing decisions.

[1382] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1383] In this invention, the server includes means for a user to input and transmit interior design requirements using a terminal, means for the server to receive the interior design requirements and generate a detailed interior design plan using generative artificial intelligence, and means for analyzing the interior design plan and converting it into prompts for image generation artificial intelligence. This enables the generation of an optimal interior design plan based on the user's requirements and emotional information, and the generation of high-quality images based on that interior design plan.

[1384] A "user" is the end user who uses the system to input interior design requirements and then reviews the generated interior design plans and images.

[1385] A "terminal" is a device used by a user to input and submit interior design requirements, and specific examples include smartphones and tablets.

[1386] "Interior design requirements" refer to information that specifies the desired room style, color scheme, furniture, and other details from the user.

[1387] A "server" is a computer system that receives interior design requirements from users and generates detailed interior design plans using generative artificial intelligence.

[1388] "Generative artificial intelligence" refers to an artificial intelligence system that generates interior design plans based on the user's interior design requirements and emotional information.

[1389] An "interior design plan" is a detailed blueprint of the room layout and design, created by a generative artificial intelligence system based on the user's requirements.

[1390] A "prompt" is a set of instructions that concisely summarizes the elements of an interior design plan and is in a format that can be understood by an image-generating artificial intelligence.

[1391] "Image generation artificial intelligence" is an artificial intelligence system that generates images of room interiors based on prompts.

[1392] The "emotion engine" is an analytical system that recognizes the user's emotional state and reflects it in the interior design plan.

[1393] "Image processing" refers to the process of editing generated interior images into an appropriate format by adjusting the resolution, converting file formats, and so on.

[1394] A "virtual store" is an online platform where users can select interior items and design their interiors via the internet.

[1395] This invention relates to a system that allows users to select interior items and design interiors within a virtual store using a terminal. Specific embodiments for carrying out this invention are described below.

[1396] System Configuration

[1397] terminal

[1398] Users input interior design requirements using devices such as smartphones and tablets. These requirements include information such as the room style, color scheme, desired furniture, and decorative items. For example, a user might input a requirement such as, "I want a modern living room with light-colored furniture."

[1399] server

[1400] The server receives interior design requirements submitted by the user. The server is equipped with multiple artificial intelligence engines, including generative AI and image generation AI.

[1401] 1. Generative Artificial Intelligence

[1402] The server generates a detailed interior plan based on the interior requirements. The generative artificial intelligence outputs an interior plan that includes details such as the arrangement of interiors, color schemes, and furniture that meet the requirements.

[1403] 2. Emotional Engine

[1404] The emotion engine installed on the server recognizes and analyzes the user's emotions. The emotion engine uses the camera and microphone installed on the device to analyze the user's facial expressions and tone of voice to understand the user's emotional state. For example, if the user is feeling stressed, the engine will make adjustments such as adding elements that help them relax.

[1405] 3. Prompt generation

[1406] The server analyzes the interior design plan and converts it into prompts for image-generating artificial intelligence. These prompts are concise instructions summarizing the elements of the generated interior design plan, in a format that the image-generating AI can understand.

[1407] For example, for a plan that states, "The living room includes a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." is generated.

[1408] 4. Image generation artificial intelligence

[1409] The server sends the generated prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the generated image back to the server.

[1410] 5. Image processing

[1411] The server receives the generated images and processes them into a format suitable for the virtual store. This processing includes adjusting the resolution, converting file formats, and cropping the images.

[1412] User operation

[1413] Users can view the generated interior images of the room on their device. If they are satisfied, they can press the "Save" button to save the image, or press the "Regenerate" button to request the generation of a new image.

[1414] This system allows users to view optimal interior design plans in real time based on their own feelings and requirements, enabling them to create interior designs that are highly satisfying. It also makes it easy to generate high-quality interior images to support purchasing decisions.

[1415] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1416] Step 1:

[1417] The user uses a terminal to input and submit interior design requirements. Specifically, the user enters detailed information such as the desired room style, color scheme, and furniture into the terminal's input screen and sends it to the server by pressing the submit button. The input data at this time may include, for example, "I want a modern living room with light-colored furniture." The output of the terminal is the interior design requirements data.

[1418] Step 2:

[1419] The server receives the aforementioned interior requirements and uses generative artificial intelligence to generate a detailed interior plan. First, the server receives the interior requirements data sent from the terminal and passes it to the generative artificial intelligence. Based on this data, the generative artificial intelligence generates a detailed interior plan including the layout, color scheme, furniture, etc. In this process, the generative artificial intelligence utilizes existing design databases and algorithms. The generated interior plan is the server's output.

[1420] Step 3:

[1421] The server uses an emotion engine to recognize the user's emotional state and reflect it in the interior design plan. The server uses the terminal's camera and microphone to analyze the user's facial expressions and tone of voice to understand their emotional state. For example, if the user is stressed, the server modifies the interior design plan to include elements that promote relaxation. The input data includes the user's emotional information, and the output data is the modified interior design plan.

[1422] Step 4:

[1423] The server analyzes the interior design plan and converts it into a prompt for image-generating artificial intelligence. Specifically, it concisely summarizes each element of the generated interior design plan and creates an instruction in a format that the image-generating AI can understand. For example, if the interior design plan is "The living room will include a brightly colored sofa and table, large windows that let in lots of natural light, modern lighting, and indoor plants," the prompt would be "A modern living room with bright-colored furniture, large windows that allow a lot of natural light, modern lighting, and indoor plants." The input data is the interior design plan, and the output data is the prompt.

[1424] Step 5:

[1425] The server sends a prompt to the image-generating artificial intelligence (AI), which then generates an image of the room's interior. The server passes the generated prompt to the AI ​​and sends a request to generate the interior image. The AI ​​generates a high-quality image of the room's interior based on the prompt and sends the image data back to the server. The prompt text is the input data, and the interior image is the output data.

[1426] Step 6:

[1427] The server receives the generated images and processes them into a format suitable for the virtual store. Specifically, it adjusts the image resolution, converts the file format, and crops the images as needed. After performing these processing steps, the server creates the final image data. The input data is the generated raw interior image, and the output data is the processed image.

[1428] Step 7:

[1429] The server sends the processed image to the user's device. The user checks the generated room interior image on their device and, if satisfied, presses the "Save" button to save the image. They can also request the generation of a new image by pressing the "Regenerate" button. The processed image is the input data, and the user's confirmation and manipulation are the output.

[1430] Through this series of steps, users can view optimal interior plans based on their own feelings and requirements in real time, enabling them to create interior designs that are highly satisfying. Furthermore, it's possible to easily generate high-quality interior images to support purchasing decisions.

[1431] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1432] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1433] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1434] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1435] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1436] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1437] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1438] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1439] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1440] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1441] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1442] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1443] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1444] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1445] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1446] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1447] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1448] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1449] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1450] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1451] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[1452] The following is further disclosed regarding the embodiments described above.

[1453] (Claim 1)

[1454] A means for the user to input and submit interior design requirements using a terminal,

[1455] A server receives the aforementioned interior requirements and generates a detailed interior plan using generative artificial intelligence.

[1456] A means for analyzing the aforementioned interior plan and converting it into a prompt for image generation artificial intelligence,

[1457] A means for sending the aforementioned prompt to an image generation artificial intelligence and generating an image of the room's interior,

[1458] A means for receiving the generated image and processing it into an appropriate format,

[1459] Means for transmitting the processed image to the user,

[1460] A system that includes this.

[1461] (Claim 2)

[1462] The system according to claim 1, further comprising means for the user to confirm and select the generated interior plan.

[1463] (Claim 3)

[1464] The system according to claim 1, which includes means for a server to convert the processed image into a format suitable for a real estate website.

[1465] "Example 1"

[1466] (Claim 1)

[1467] A means for the user to input and submit interior design requirements using a terminal,

[1468] A server receives the aforementioned interior requirements and generates a detailed interior plan using generative artificial intelligence.

[1469] A means for analyzing the aforementioned interior plan and converting it into a prompt for image generation artificial intelligence,

[1470] A means for sending the aforementioned prompt to an image generation artificial intelligence and generating an image of the room's interior,

[1471] A means for receiving the generated image and processing it into an appropriate format,

[1472] Means for transmitting the processed image to the user,

[1473] A means by which the user can view the aforementioned image on their own device and choose to regenerate or save it,

[1474] A system that includes this.

[1475] (Claim 2)

[1476] The system according to claim 1, further comprising means for the user to confirm and select the generated interior plan.

[1477] (Claim 3)

[1478] The server provides means for converting the processed image into a format suitable for a real estate website,

[1479] The system according to claim 1, which includes means for a user to upload the aforementioned image to a real estate website.

[1480] "Application Example 1"

[1481] (Claim 1)

[1482] A means for the user to input and submit interior design requirements using a terminal,

[1483] A server receives the aforementioned interior requirements and generates a detailed interior plan using generative artificial intelligence.

[1484] A means for analyzing the aforementioned interior plan and converting it into a prompt for image generation artificial intelligence,

[1485] A means for sending the aforementioned prompt to an image generation artificial intelligence and generating an image of the room's interior,

[1486] A means for receiving the generated image and processing it into an appropriate format,

[1487] Means for transmitting the processed image to the user,

[1488] A means for users to customize furniture and interiors using a device and regenerate new conditions,

[1489] A means for users to view interior images of rooms on a virtual store interface and to regenerate or set new conditions,

[1490] A system that includes this.

[1491] (Claim 2)

[1492] The system according to claim 1, further comprising means for the user to confirm and select the generated interior plan.

[1493] (Claim 3)

[1494] The system according to claim 1, which includes means for a server to convert the processed image into a format suitable for a real estate website.

[1495] "Example 2 of combining an emotion engine"

[1496] (Claim 1)

[1497] A means for the user to input and submit interior design requirements using a terminal,

[1498] The server receives the aforementioned interior requirements and uses an emotion engine to recognize and analyze the user's emotional state,

[1499] A server is provided with means for generating a detailed interior plan using generative artificial intelligence based on the aforementioned interior requirements and emotional information.

[1500] If the generated interior plan does not reflect the user's emotional state, the server has a means to modify the plan based on the output of the emotion engine.

[1501] A means for analyzing the aforementioned interior plan and converting it into a prompt sentence for image generation artificial intelligence,

[1502] A means for sending the aforementioned prompt message to an image generation artificial intelligence to generate an image of the room's interior,

[1503] A means for receiving the generated image and processing it into an appropriate format,

[1504] Means for transmitting the processed image to the user,

[1505] A system that includes this.

[1506] (Claim 2)

[1507] The system according to claim 1, further comprising means for the user to confirm and select the generated interior plan.

[1508] (Claim 3)

[1509] The system according to claim 1, which includes means for a server to convert the processed image into a format suitable for a real estate website.

[1510] "Application example 2 when combining with an emotional engine"

[1511] (Claim 1)

[1512] A means for the user to input and submit interior design requirements using a terminal,

[1513] A server receives the aforementioned interior requirements and generates a detailed interior plan using generative artificial intelligence.

[1514] A means for analyzing the aforementioned interior plan and converting it into a prompt for image generation artificial intelligence,

[1515] A means for sending the aforementioned prompt to an image generation artificial intelligence and generating an image of the room's interior,

[1516] A means for receiving the generated image and processing it into an appropriate format,

[1517] Means for transmitting the processed image to the user,

[1518] A system equipped with an emotional engine that recognizes emotional states and reflects them in interior design plans,

[1519] A system that includes this.

[1520] (Claim 2)

[1521] The system according to claim 1, further comprising means for the user to confirm and select the generated interior plan.

[1522] (Claim 3)

[1523] The system according to claim 1, which includes means for a server to convert the processed image into a format suitable for a real estate website. [Explanation of Symbols]

[1524] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for the user to input and submit interior design requirements using a terminal, A server receives the aforementioned interior requirements and generates a detailed interior plan using generative artificial intelligence. A means for analyzing the aforementioned interior plan and converting it into a prompt for image generation artificial intelligence, A means for sending the aforementioned prompt to an image generation artificial intelligence and generating an image of the room's interior, A means for receiving the generated image and processing it into an appropriate format, Means for transmitting the processed image to the user, A system that includes this.

2. The system according to claim 1, further comprising means for the user to confirm and select the generated interior design plan.

3. The system according to claim 1, which includes means for a server to convert the processed image into a format suitable for a real estate website.

Images