system

Abstract

We provide the system. [Solution] A means of receiving information from users about their lifestyle, family structure, hobbies, and future life plans, Based on the aforementioned information, a means for automatically generating a design plan using artificial intelligence, A means for modeling and visualizing the aforementioned design plan in a virtual space using three-dimensional modeling means, A means by which the user experiences a three-dimensional model in the virtual space and provides a list of selected products and requests for desired changes regarding the interior design, Based on the aforementioned change requests, a means of using artificial intelligence to execute product suggestions and design changes in real time, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, the method including: receiving a user utterance; adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character; encoding the prompt; and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In conventional housing design, it is difficult for ordinary customers without professional knowledge to specifically reflect their own lifestyles and wishes in the design, and there are also problems that the design process takes a long time and is costly. Therefore, there are significant barriers in designing the ideal housing for customers.

Means for Solving the Problems

[0005] This invention provides a system that automatically generates an optimal housing design plan using artificial intelligence based on lifestyle and family structure information obtained from the user. This system works in conjunction with a 3D modeling system to construct a 3D model in a virtual space, allowing the user to virtually experience the model. Furthermore, it significantly reduces time and costs by automatically readjusting the design based on user feedback and enabling another virtual experience. Moreover, this 3D model is adaptable to building codes, environmental conditions, and market trends.

[0006] A "user" refers to an individual or group that uses the system to input their lifestyle and housing-related requests.

[0007] "Lifestyle" refers to a person's way of life, including their daily habits, personal preferences, and routine behaviors.

[0008] "Artificial intelligence" refers to the technology that enables computers to mimic human intellectual activity, analyze data, and make decisions.

[0009] A "residential design plan" refers to a plan that specifies in detail the layout and design of living spaces based on the user's needs and wishes.

[0010] "Three-dimensional modeling means" refers to software or technology used to visualize objects in three-dimensional space on a computer.

[0011] A "virtual space" refers to a three-dimensional simulation environment created by a computer, a space in which users can have an immersive experience through digital devices.

[0012] "Feedback" refers to the act of users communicating their opinions and reactions to a system regarding their experience and areas for improvement.

[0013] "Redesign" refers to the process of reviewing, improving, or changing an existing design based on user feedback.

[0014] "Building standards" refer to the legally mandated norms regarding the design and construction of buildings, including requirements related to safety and performance.

[0015] "Environmental conditions" refer to the climate, geography, and other natural factors of the area where the building is located.

[0016] "Market trends" refer to consumer preferences and industry trends at a specific time, and include popular trends and patterns that influence design and product development. [Brief explanation of the drawing]

[0017] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0019] First, the language used in the following description will be explained.

[0020] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0021] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0022] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0023] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0025] [First Embodiment]

[0026] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0027] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0030] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0037] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0038] This invention is a system for providing housing designs tailored to the user's lifestyle and needs, and in order to achieve this, each component works in conjunction with the others.

[0039] First, the user uses their device to input information such as their lifestyle, family structure, hobbies, and future life plans into a dedicated interface. The device compiles this information and sends the data to the server via a secure connection.

[0040] In the next stage, the server provides the received user data to an artificial intelligence agent for analysis. This AI agent considers accumulated design patterns and market trends to generate a house design plan that meets the user's needs. For example, if the user wants to "let in lots of natural light," the server's AI agent will generate a design plan that includes a living room with large windows.

[0041] Next, the server reflects the generated house design plan into a virtual space through a three-dimensional modeling system, constructing a 3D model. This model is adjusted to meet building codes and environmental conditions, and energy efficiency and durability are also taken into consideration.

[0042] Users wear a VR headset on their device and can experience a 3D model in a virtual space as a virtual tour. At this stage, users can visualize the design from all angles and check whether the room layout and design are reflected as intended.

[0043] Furthermore, feedback provided by users during the experience is sent from the device to the server and quickly analyzed by an artificial intelligence agent. Based on the feedback, the server readjusts the design plan, generates a new design, and presents it again in the virtual space. For example, if a user requests that the kitchen be a little larger, the artificial intelligence agent will enlarge the kitchen area and recalculate the space allocation for the other rooms.

[0044] This allows users to adjust their ideal home design as many times as needed until they are satisfied, enabling them to achieve a highly polished design without spending a lot of time and money.

[0045] The following describes the processing flow.

[0046] Step 1:

[0047] Users use a dedicated interface on the device to input information about their lifestyle, family structure, hobbies, and future life plans. The device compiles this information and sends it to the server in an appropriate format.

[0048] Step 2:

[0049] The server receives user information from the terminal and provides it to the artificial intelligence agent. The artificial intelligence agent analyzes the input information and performs data analysis to generate a housing design plan that matches the user's preferences.

[0050] Step 3:

[0051] The server receives the house design plan generated by the artificial intelligence agent and sends it to the 3D modeling engine. This engine generates a 3D model based on the design plan and constructs a model to simulate the actual building in a virtual space.

[0052] Step 4:

[0053] Users wear a VR headset via a device and experience 3D models provided by the server in a virtual space. Users can freely move around the model and examine every detail of the design.

[0054] Step 5:

[0055] Users input suggestions for improvements and design changes they find during a virtual tour into a terminal. The terminal continuously sends this feedback to the server.

[0056] Step 6:

[0057] The server receives feedback from the user, and an artificial intelligence agent analyzes it. Based on the analysis results, the housing design plan is readjusted, and a new 3D model is generated.

[0058] Step 7:

[0059] The server sends a redesigned 3D model to the terminal, and the user reviews the new design again in VR. This allows the user to iterate on the design until it approaches their ideal.

[0060] (Example 1)

[0061] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0062] Traditional residential design processes have faced challenges in accurately reflecting user needs, requiring significant time and cost. In particular, the process of repeatedly revising physical models is inefficient and labor-intensive. Because of these problems, there is a need for a simple and rapid method for users to design their ideal homes.

[0063] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0064] In this invention, the server includes means for receiving lifestyle information from the user, means for automatically generating a spatial design plan using data processing technology, and means for modeling it using a three-dimensional structural method and visualizing it in a digital space. This makes it possible for the user to easily and repeatedly check and modify a housing design based on their own needs in a virtual environment.

[0065] "Lifestyle information" is a general term for information related to an individual user's lifestyle, such as their lifestyle, family structure, hobbies, and future plans.

[0066] "Data processing technology" refers to the technology used to analyze input information using computers and convert it into a format that is effective for a specific purpose.

[0067] A "space design plan" is a design proposal that concretizes the layout and design of a living space based on the user's requirements.

[0068] "Three-dimensional structural method" refers to the process of generating a three-dimensional model from a two-dimensional drawing using computer-aided design (CAD) technology.

[0069] "Digital space" refers to a space where three-dimensional models visualized within a virtual computer-generated environment can be viewed.

[0070] "Opinions" refer to the thoughts and requests regarding the design that users provide as feedback during their virtual tour experience.

[0071] "Revising the plan" is a procedure for reviewing and modifying existing design proposals based on user feedback.

[0072] A description of the embodiment for carrying out the invention will be provided.

[0073] At system startup, users access a dedicated interface using a terminal and input information about their lifestyle, family structure, hobbies, and future life plans. The terminal converts this information into a structured data format and sends it to the server via a secure connection. Common formats such as JSON and XML are used for this purpose.

[0074] The server uses a generative AI model to analyze the received information. This model incorporates a system based on a deep learning framework. Specifically, TENSORFLOW® and PyTorch may be used. Based on the server's data analysis results, it generates a spatial design plan best suited to the user's needs. In this process, it references an accumulated design pattern database and information on market trends.

[0075] The generated design plan is transferred from the server to 3D modeling software. Here, the design plan is recreated in three dimensions using tools such as Blender or Autodesk Revit. The 3D model is then visualized in a digital space, making it easily accessible to the user.

[0076] Next, the user uses their device to put on a VR headset and virtually tour the three-dimensional structure within the virtual space. This allows them to check the room layout and design details in real time. Based on this experience in the virtual space, the user provides feedback using their opinions. This feedback is sent from the device to the server as voice input or text message.

[0077] The server reuses the generated AI model based on feedback and automatically readjusts the design proposal. This regenerated design plan is then reflected again in the digital space and reviewed by the user. Specific examples of prompts include "Please generate a house design plan based on my lifestyle" and "I want a larger kitchen, so please adjust the design plan."

[0078] Through the above process, users can quickly and effectively design their ideal home.

[0079] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0080] Step 1:

[0081] Users access a dedicated interface through their device and input information such as their lifestyle, family structure, hobbies, and future life plans. This information is converted by the device into a structured data format (e.g., JSON or XML). The entered data is then sent to the server via a secure connection.

[0082] Step 2:

[0083] The server verifies the received user data and begins data analysis. At this stage, the server uses a generative AI model to automatically generate a spatial design plan based on the user's input. The AI ​​model references database design patterns and market trends to create appropriate design proposals. As a result of the analysis, specific design suggestions are output.

[0084] Step 3:

[0085] The server passes the generated spatial design plan to 3D modeling software. Here, the software uses CAD data format to construct the design plan as a 3D model. The software used is generally known as 3D design software. The output 3D model is provided in a format that can be visualized in digital space.

[0086] Step 4:

[0087] Users wear a VR headset on their device and take a virtual tour of the property in a digital space. Here, users can view a three-dimensional model from various perspectives and experience the layout and design of the living space. Specifically, they can visually consider the location of rooms and the placement of furniture.

[0088] Step 5:

[0089] Users send feedback obtained through virtual tours from their terminals to the server. Feedback is typically provided via voice or text input. Based on this feedback, the server uses a generated AI model to further refine the design plan. As a result of the feedback analysis, a newly adjusted design plan is output and reflected again in the virtual space.

[0090] Step 6:

[0091] This readjustment process is repeated until the user is completely satisfied with the design. The design process is complete when the user is finally satisfied with the intended design. This continuous feedback loop establishes efficient and effective residential design.

[0092] (Application Example 1)

[0093] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0094] Traditionally, users have found it difficult to select interior design products that suit their preferences and lifestyles, and to confirm their placement and design in a virtual environment. In particular, there is a lack of means to virtually check the product's appearance before actually purchasing it. Furthermore, the absence of a system that allows users to incorporate their requests regarding product placement and design in real time makes it difficult to make satisfactory product choices.

[0095] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0096] In this invention, the server includes means for receiving information from the user regarding their lifestyle, family structure, hobbies, and future life plans; means for automatically generating a design plan using artificial intelligence; and means for modeling and visualizing the design plan in a virtual space using three-dimensional modeling means. This allows the user to easily incorporate desired changes while experiencing the placement and design of interior products in real time in the virtual space.

[0097] A "lifestyle" is the sum total of the behavioral patterns and values ​​that an individual or family engages in on a daily basis.

[0098] "Family structure" refers to the relationships and number of residents in the same household.

[0099] A "hobby" is an activity or interest that an individual enjoys on their own initiative.

[0100] "Future life plans" refer to the goals and activities you intend to achieve in your future life.

[0101] "Artificial intelligence" is computer technology that imitates human intelligence to analyze information and make decisions.

[0102] A "design plan" is a detailed plan of a living space created based on the user's needs and wishes.

[0103] "Three-dimensional modeling techniques" refer to technologies that use computers to visualize objects in three dimensions.

[0104] A "virtual space" is an artificial digital environment created by a computer.

[0105] "User feedback" refers to opinions and impressions provided by users based on their experiences.

[0106] A "change request" is a user's request for modifications or additions to the current design or layout.

[0107] "Product recommendations" refer to recommendations for products and services that meet the user's needs.

[0108] A "means of execution in real time" refers to a technology that can respond immediately the moment a user request arises.

[0109] The system that realizes this invention provides a detailed design plan based on the user's lifestyle and needs, and a mechanism that allows the user to experience that design in a virtual space.

[0110] Users input information about their lifestyle, family structure, hobbies, and future life plans through their devices. The devices collect this information and transmit it to the server via a secure connection.

[0111] Based on the received data, the server generates a design plan using an AI model. This AI model considers past design patterns and market trends to propose interior products and designs that meet the user's needs.

[0112] The server then uses Unity to perform 3D modeling and reflects the design plan in the virtual space. Users can then wear a VR headset and interactively experience this 3D model.

[0113] Users visualize products in a virtual space and submit change requests, such as "I want to change the color of the sofa." Based on this, the server uses TensorFlow to quickly analyze user feedback and adjust the design plan in real time.

[0114] As a concrete example, a user can experience a virtual room by placing an orange sofa in a virtual store and provide feedback such as, "I want a sofa in a brighter color," at which point the AI ​​will automatically suggest an alternative color sofa. An example of this prompt would be, "Based on the user's feedback, please suggest the best furniture arrangement and design style for the room."

[0115] This process allows users to improve the accuracy of their product selection while reducing time and costs, ultimately enabling them to achieve their ideal interior design.

[0116] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0117] Step 1:

[0118] Users input information about their lifestyle, family structure, hobbies, and future life plans using a terminal. This input consists of user selections and text input into data fields corresponding to each item, and the output is a structured user information dataset.

[0119] Step 2:

[0120] The terminal transmits this user information data to the server via a secure connection. This action provides the server with detailed information about the user's needs, preparing it for analysis.

[0121] Step 3:

[0122] The server generates a design plan using a generative AI model based on the received user information data. The input is user information data, and the output is an interior design plan optimized for the user. Here, the AI ​​performs data calculations based on past design patterns and market trends.

[0123] Step 4:

[0124] The server uses Unity to perform 3D modeling and reflects this design plan in a virtual space. The input is the design plan, and the output is 3D modeled virtual space data. This prepares a digital environment that users can experience.

[0125] Step 5:

[0126] The user wears a VR headset and enters a three-dimensional model of a virtual space via a terminal. The input here is login information for the VR system, and the output is the interactive virtual environment that the user visually experiences.

[0127] Step 6:

[0128] Users provide feedback on product placement and design within a virtual space. This feedback consists of evaluations and requests based on the visual experience in the virtual environment, and is transmitted to the server via the user's device.

[0129] Step 7:

[0130] The server uses TensorFlow to analyze user feedback. The input is feedback data, and the output is new product suggestions or design changes based on that feedback. Specific data processing includes sentiment analysis and trend matching of the feedback.

[0131] Step 8:

[0132] The server redesigns the model based on the processing results and provides the updated 3D model to the user. The new design is reflected in the virtual space in real time, updating the user experience.

[0133] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0134] This invention is a system for users to design homes based on their lifestyle and personal needs, and it enhances the user experience by combining it with an emotional engine. Embodiments of this invention are described below.

[0135] First, the user uses a device to input information about their lifestyle, family structure, hobbies, and future life plans into the interface. The device then aggregates this input data and transmits it to a server using a secure communication method.

[0136] The server receives the transmitted information and provides it to the artificial intelligence agent. The AI ​​agent analyzes the input information and automatically generates a house design plan optimized for the user's needs. This design plan includes room layout, space usage, and design style.

[0137] Next, the server uses 3D modeling technology to create a virtual model of the designed house plan and visualizes it for the user in a virtual space. The user can then freely move around in the virtual space using a VR headset and view the created 3D model.

[0138] Furthermore, this system integrates an emotion engine. When a user takes a virtual tour, the terminal uses sensors such as cameras and microphones to capture the user's facial expressions and voice in real time, which the emotion engine then analyzes. The emotion engine infers the user's emotional state from the acquired data and evaluates which aspects the user is satisfied with and which aspects they are dissatisfied with.

[0139] Subsequently, the server redesigns itself by integrating this sentiment data with user feedback. For example, if a user has a positive reaction to the brightness of the design, it will maintain that characteristic while improving other aspects. Conversely, if the user's sentiment is negative, the server will identify the cause, propose changes to improve the design, and remodel it.

[0140] This process is repeated until the user is satisfied with their ideal home design, enabling the system to consistently deliver high-quality designs. By combining it with an emotional engine, it becomes possible to quickly create designs that more accurately reflect the user's latent desires.

[0141] The following describes the processing flow.

[0142] Step 1:

[0143] Users input information about their lifestyle, family structure, hobbies, and future life plans through the terminal's interface. The terminal aggregates this input data and transmits it to the server in a secure manner.

[0144] Step 2:

[0145] The server receives user information from the terminal and provides the data to the artificial intelligence agent. The AI ​​agent analyzes the input information and automatically generates a house design plan that matches the user's needs. At this stage, the room layout and design style are specifically determined.

[0146] Step 3:

[0147] The server visualizes the generated house design plans in a virtual space using 3D modeling technology. The 3D models are constructed so that users can experience them realistically in the virtual space.

[0148] Step 4:

[0149] Users wear a VR headset on their device and experience a three-dimensional model of a virtual space provided by the server. Users can move around within the space and examine the designed interior and room layout in detail.

[0150] Step 5:

[0151] During the user's experience, the device uses its built-in camera and microphone to capture the user's facial expressions and voice in real time. An emotion engine analyzes this data to determine the user's emotional state.

[0152] Step 6:

[0153] The emotion engine evaluates how the user feels about the model based on the analysis results and identifies positive or negative emotions. For example, if the user is satisfied with the spacious living room, a positive emotion will be detected.

[0154] Step 7:

[0155] After the user experiences the product and enters feedback into their device, the server combines this feedback with the analysis results from the emotion engine to readjust the design plan. A new design plan is generated, and the 3D model is rebuilt.

[0156] Step 8:

[0157] The server sends the redesigned 3D model to the user's terminal, and the user reviews the model again through a VR experience. This process is repeated until the user is satisfied. This iterative process ensures that the house design best meets the user's emotions and needs.

[0158] (Example 2)

[0159] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0160] To create homes that adapt to diverse modern lifestyles and personal needs, customizable plans that accurately reflect the elements users desire are essential. However, traditional design methods have difficulty taking into account users' emotional states and detailed feedback, making them insufficient to meet users' latent desires. Furthermore, the means of verifying the effectiveness of designs through real-time experiences in virtual environments are limited, posing challenges to rapid modification and improvement.

[0161] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0162] In this invention, the server includes a device for receiving information on lifestyle, family structure, hobbies, and future life plans; a device for automatically generating living space design plans using computer intelligence; and a device for performing emotional analysis based on opinions and proposing redesigns. This enables customizable housing designs that accurately reflect the user's specific needs and emotions.

[0163] The term "device" refers to a machine or system designed to perform a specific function.

[0164] "Computer intelligence" refers to the technology by which computer systems mimic intelligent activity, with the aim of analyzing data and solving problems.

[0165] A "living space design plan" refers to a design proposal for creating a living space based on the user's lifestyle and needs.

[0166] "Three-dimensional modeling technology" refers to the technology used to generate and visualize three-dimensional shapes on a computer.

[0167] A "virtual environment" refers to a digital space that is simulated by a computer and can be experienced by a user.

[0168] "Opinions" refer to feedback and reactions from users, including evaluations and suggestions regarding design and functionality.

[0169] "Sentiment analysis" refers to the process of analyzing data in order to evaluate and understand emotional states.

[0170] "Redesign" refers to the process of modifying or improving an existing design to generate a new design proposal.

[0171] This invention is a comprehensive system for designing customizable living spaces tailored to the individual lifestyles and needs of users. This system includes a server, terminals, and a user interface.

[0172] Users input detailed information about their lifestyle, family structure, hobbies, and future life plans into the interface using their devices. This information is entered using hardware such as laptops or tablets. This information is collected once and then transmitted to a server via a secure communication method.

[0173] The server analyzes this received data using computer intelligence, specifically a generative AI model. The data analysis utilizes algorithms designed to automate the creation of living space design plans based on user needs. For example, by leveraging deep learning technology, design plans that efficiently reflect user needs are generated.

[0174] The generated design plans are visualized in a virtual environment using 3D modeling technology by the server. Specific software used includes tools such as Blender and AutoCAD. Users can experience the generated 3D structures in the virtual environment using a VR headset.

[0175] Furthermore, sensors such as cameras and microphones are utilized on the device to analyze the user's facial expressions and voice in real time. This information is used for emotion analysis, and user feedback is immediately generated. The server then proposes a redesign, incorporating these emotion results and user feedback, and presents it again within the virtual environment.

[0176] As a concrete example, if a user wants a new living room design, the following prompt message is input into the AI ​​model:

[0177] "Please design a living room where I can relax with friends. I prefer a modern yet warm style with plenty of natural light."

[0178] This system allows users to easily design their ideal living space, taking their own emotions and feedback into consideration.

[0179] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0180] Step 1:

[0181] Users input information using a terminal. This input includes lifestyle, family structure, hobbies, and future life plans. This information is collected by the interface and compiled into a single integrated dataset. As output, this dataset is structured in JSON format.

[0182] Step 2:

[0183] The terminal sends the aggregated dataset to the server using a secure protocol (e.g., HTTPS). For enhanced security, the data is encrypted. The transmitted data is stored in the server's database.

[0184] Step 3:

[0185] The server retrieves data from the database and performs analysis using a generated AI model. During this process, the AI ​​model automatically generates a living space design plan tailored to the user's needs. The input consists of various user information, and the output is an optimized design plan.

[0186] Step 4:

[0187] The server models the generated design plan using 3D modeling technology. Software such as Blender is used for modeling. As output, 3D data for use in the virtual environment is generated.

[0188] Step 5:

[0189] The server integrates 3D data into the virtual environment system and performs rendering in real time. The user wears a VR headset to experience the virtual environment and verify the designed space. The output is a virtual space that the user can experience.

[0190] Step 6:

[0191] The device uses its camera and microphone to capture the user's facial expressions and voice in real time. The acquired data is processed by the device and passed to the emotion engine. The input is the user's biometric data, and the output is the evaluation result of their emotional state.

[0192] Step 7:

[0193] The server receives the results from the emotion engine and redesigns based on the feedback. The system uses a generative AI model to generate prompts and proposes an improved design. The output is updated 3D design data.

[0194] Step 8:

[0195] The server renders the redesigned 3D data again within the virtual environment and presents it to the user. This process is repeated until the user is satisfied. The final output is the ideal design that reflects the user's requirements.

[0196] (Application Example 2)

[0197] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0198] Currently, it is difficult to quickly and efficiently design individual homes that fully reflect the user's emotions and latent needs. Furthermore, there is a lack of means to directly utilize user feedback based on emotions to improve the design, and improvements are needed to enhance user satisfaction.

[0199] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0200] In this invention, the server includes means for receiving information from the user regarding lifestyle, family structure, hobbies, and future life plans; means for automatically generating a housing design plan using artificial intelligence based on the information; means for modeling the housing design plan using three-dimensional modeling means and visualizing it in a virtual space; means for the user to experience the three-dimensional model in the virtual space and provide feedback; means for analyzing the feedback, inferring the user's emotional state using an emotion engine, and improving the design plan; and means for redesigning based on the improvements and generating an optimized design plan. This enables rapid design improvements that more accurately reflect the user's potential needs.

[0201] "Lifestyle" is a general term for the way of life and habits of an individual or group, and includes daily activities, values, hobbies, and preferences.

[0202] "Family structure" refers to information indicating the number of family members and their relationships within a household, and is used to understand the form of that household.

[0203] A "hobby" refers to an activity or area of ​​interest that an individual pursues in their free time, and it influences their personality and lifestyle.

[0204] "Future life plans" refer to goals, objectives, and plans that an individual wants to achieve in their future life, and include things like housing and family plans.

[0205] "Artificial intelligence" is a technology in which computer systems imitate human intelligence and perform learning, reasoning, and problem-solving.

[0206] A "residential design plan" is a detailed plan that outlines the structure, layout, and design style of a house, with the aim of making optimal use of living space.

[0207] "Three-dimensional modeling" is a technique that allows for the three-dimensional representation of objects and spaces on a computer, enabling visual confirmation and analysis.

[0208] A "virtual space" refers to a digital environment created using computer technology, within which users can engage in activities and work.

[0209] "Feedback" refers to the opinions and reactions received from others as a result of a process or activity, and serves as fundamental information for making improvements.

[0210] An "emotion engine" refers to a system that analyzes data acquired from sensors, estimates an individual's emotional state, and then provides responses or suggestions appropriate to that emotion.

[0211] "Optimization" is a method of improving plans and processes and eliminating waste in order to obtain the most desirable results under specific conditions.

[0212] To implement this invention, the user first uses a terminal to input information about their lifestyle, family structure, hobbies, and future life plans. The terminal aggregates this input data and transmits it to a server using a secure communication method. The server receives the transmitted information and provides it to an artificial intelligence agent. The artificial intelligence agent analyzes the user's input information and automatically generates an optimized housing design plan based on it. This design plan includes room layout, space utilization, and design style.

[0213] The server uses 3D modeling technology to create a virtual model of the designed house plan and visualizes it in a virtual space. Users can move around in the virtual space using devices such as VR headsets and view the 3D model.

[0214] Furthermore, the system integrates an emotion engine. This emotion engine acquires the user's facial expressions and voice in real time through sensors such as cameras and microphones, and uses this information to infer their emotional state. While the user is taking a virtual tour, the emotion engine analyzes the acquired data and evaluates which aspects they are satisfied with and which aspects they are dissatisfied with.

[0215] The server redesigns the design based on this emotional data and user feedback. For example, if a user has a positive reaction to the living room design, it will improve other areas while maintaining those characteristics. On the other hand, if a negative reaction is detected, it will identify the cause, suggest changes to improve the design, and remodel it. An example of a prompt message would be, "Based on the user's facial expressions and voice data, analyze their emotional state towards this living room design and generate improvement suggestions." This process allows the user to refine the design with the system until they are satisfied with their ideal home design.

[0216] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0217] Step 1:

[0218] The user uses a device to input information about their lifestyle, family structure, hobbies, and future life plans into the interface. This information becomes the input data for the device. The device then aggregates this information and prepares it to be sent to the server.

[0219] Step 2:

[0220] The server receives the information sent from the terminal. The server converts this information into an appropriate format for input to the artificial intelligence agent and provides the data. This allows the artificial intelligence agent to analyze the user's input information.

[0221] Step 3:

[0222] The artificial intelligence agent analyzes information received from the server. Based on the input lifestyle, family structure, hobbies, and future life plans, it generates an optimized housing design plan. By using data analysis and algorithmic generative models, it can produce a concrete design plan as output.

[0223] Step 4:

[0224] The server inputs the generated house design plan into 3D modeling software and creates a virtual model. Through modeling, the house design plan is transformed into a state that can be visualized in three-dimensional space. This model is then output in a state that can be visually confirmed within the virtual space.

[0225] Step 5:

[0226] Users access a virtual space on a server using a VR headset installed on their device and experience a three-dimensional model. They can move around within the virtual space and examine each room and design. User feedback and opinions are input into the system.

[0227] Step 6:

[0228] The device uses its camera and microphone to capture the user's facial expressions and voice data in real time while the user explores the virtual space. This data is input into an emotion engine to infer the user's emotional state. This process analyzes what emotions the user feels towards which parts of the virtual space.

[0229] Step 7:

[0230] The server integrates analysis results from the emotion engine with user feedback to carry out a redesign process. While retaining design elements where positive emotions were detected, it adjusts elements associated with negative emotions based on specific improvement algorithms and outputs a new design plan.

[0231] Step 8:

[0232] The redesigned plan is again 3D modeled and provided from the server to the terminal for visual confirmation in the virtual space. The prompt message, "Based on the user's facial expressions and voice data, analyze their emotional state towards this living room design and generate improvement suggestions," assists in the implementation of the generated AI model. This process is repeated until the user is satisfied.

[0233] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0234] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0235] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0236] [Second Embodiment]

[0237] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0238] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0239] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0240] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0241] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0242] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0243] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0244] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0245] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0246] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0247] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0248] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0249] This invention is a system for providing housing designs tailored to the user's lifestyle and needs, and in order to achieve this, each component works in conjunction with the others.

[0250] First, the user uses their device to input information such as their lifestyle, family structure, hobbies, and future life plans into a dedicated interface. The device compiles this information and sends the data to the server via a secure connection.

[0251] In the next stage, the server provides the received user data to an artificial intelligence agent for analysis. This AI agent considers accumulated design patterns and market trends to generate a house design plan that meets the user's needs. For example, if the user wants to "let in lots of natural light," the server's AI agent will generate a design plan that includes a living room with large windows.

[0252] Next, the server reflects the generated house design plan into a virtual space through a three-dimensional modeling system, constructing a 3D model. This model is adjusted to meet building codes and environmental conditions, and energy efficiency and durability are also taken into consideration.

[0253] Users wear a VR headset on their device and can experience a 3D model in a virtual space as a virtual tour. At this stage, users can visualize the design from all angles and check whether the room layout and design are reflected as intended.

[0254] Furthermore, feedback provided by users during the experience is sent from the device to the server and quickly analyzed by an artificial intelligence agent. Based on the feedback, the server readjusts the design plan, generates a new design, and presents it again in the virtual space. For example, if a user requests that the kitchen be a little larger, the artificial intelligence agent will enlarge the kitchen area and recalculate the space allocation for the other rooms.

[0255] This allows users to adjust their ideal home design as many times as needed until they are satisfied, enabling them to achieve a highly polished design without spending a lot of time and money.

[0256] The following describes the processing flow.

[0257] Step 1:

[0258] Users use a dedicated interface on the device to input information about their lifestyle, family structure, hobbies, and future life plans. The device compiles this information and sends it to the server in an appropriate format.

[0259] Step 2:

[0260] The server receives user information from the terminal and provides it to the artificial intelligence agent. The artificial intelligence agent analyzes the input information and performs data analysis to generate a housing design plan that matches the user's preferences.

[0261] Step 3:

[0262] The server receives the house design plan generated by the artificial intelligence agent and sends it to the 3D modeling engine. This engine generates a 3D model based on the design plan and constructs a model to simulate the actual building in a virtual space.

[0263] Step 4:

[0264] Users wear a VR headset via a device and experience 3D models provided by the server in a virtual space. Users can freely move around the model and examine every detail of the design.

[0265] Step 5:

[0266] Users input suggestions for improvements and design changes they find during a virtual tour into a terminal. The terminal continuously sends this feedback to the server.

[0267] Step 6:

[0268] The server receives feedback from the user, and an artificial intelligence agent analyzes it. Based on the analysis results, the housing design plan is readjusted, and a new 3D model is generated.

[0269] Step 7:

[0270] The server sends a redesigned 3D model to the terminal, and the user reviews the new design again in VR. This allows the user to iterate on the design until it approaches their ideal.

[0271] (Example 1)

[0272] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0273] Traditional residential design processes have faced challenges in accurately reflecting user needs, requiring significant time and cost. In particular, the process of repeatedly revising physical models is inefficient and labor-intensive. Because of these problems, there is a need for a simple and rapid method for users to design their ideal homes.

[0274] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0275] In this invention, the server includes means for receiving lifestyle information from the user, means for automatically generating a spatial design plan using data processing technology, and means for modeling it using a three-dimensional structural method and visualizing it in a digital space. This makes it possible for the user to easily and repeatedly check and modify a housing design based on their own needs in a virtual environment.

[0276] "Lifestyle information" is a general term for information related to an individual user's lifestyle, such as their lifestyle, family structure, hobbies, and future plans.

[0277] "Data processing technology" refers to the technology used to analyze input information using computers and convert it into a format that is effective for a specific purpose.

[0278] The "Spatial Design Plan" is a design proposal that embodies the layout and design of the living space based on the user's requirements.

[0279] The "3D Structure Method" is the process of generating a three-dimensional model from two-dimensional drawings using computer-aided design (CAD) technology.

[0280] The "Digital Space" is a space where a three-dimensional model visualized within a virtual computer-generated environment can be viewed.

[0281] "Opinions" are the ideas and demands regarding the design provided by the user as feedback during the virtual viewing experience.

[0282] "Modifying the plan" is the procedure of reexamining and modifying the existing design proposal based on the user's feedback.

[0283] The mode of implementing the invention will be described.

[0284] At the start of the system, the user uses the terminal to access a dedicated interface and inputs information regarding their lifestyle, family composition, hobbies, and future life plans. The terminal converts this information into a structured data format and transmits it to the server via a secure connection. Commonly used formats such as JSON and XML are used for this.

[0285] When analyzing the received information, the server uses a generated AI model. As the model, a system based on a deep learning framework is incorporated. Specifically, TensorFlow or PyTorch may be used. From the analysis results of the data by the server, a spatial design plan most suitable for the user's needs is generated. In this process, the accumulated design pattern database and information regarding market trends are referred to.

[0286] The generated design plan is passed by the server to three-dimensional modeling software. Here, tools such as Blender or Autodesk Revit are used to reproduce the design plan three-dimensionally. The three-dimensional model is visualized in the digital space so that the user can easily experience it.

[0287] Next, the user uses the terminal, wears a VR headset, and views the three-dimensional structure in the virtual space. This allows the user to check the room layout and design details in real time. Based on the experience in this virtual space, the user provides feedback using their opinions. The feedback is sent from the terminal to the server as voice input or a text message.

[0288] The server reuses the generative AI model based on the feedback and automatically readjusts the design plan. This regenerated design plan is reflected again in the digital space and confirmed by the user. Specific examples of prompt sentences include "Please generate a housing design plan based on the lifestyle" and "Please adjust the design plan because I want a larger kitchen".

[0289] Through the above process, the user can quickly and effectively design an ideal house.

[0290] The flow of the specific process in Example 1 will be described using FIG. 11.

[0291] Step 1:

[0292] The user accesses a dedicated interface through the terminal and inputs information such as their lifestyle, family composition, hobbies, and future life plans. This information is converted by the terminal into a structured data format (e.g., JSON or XML). The input data is sent to the server via a secure connection.

[0293] Step 2:

[0294] The server verifies the received user data and begins data analysis. At this stage, the server uses a generative AI model to automatically generate a spatial design plan based on the user's input. The AI ​​model references database design patterns and market trends to create appropriate design proposals. As a result of the analysis, specific design suggestions are output.

[0295] Step 3:

[0296] The server passes the generated spatial design plan to 3D modeling software. Here, the software uses CAD data format to construct the design plan as a 3D model. The software used is generally known as 3D design software. The output 3D model is provided in a format that can be visualized in digital space.

[0297] Step 4:

[0298] Users wear a VR headset on their device and take a virtual tour of the property in a digital space. Here, users can view a three-dimensional model from various perspectives and experience the layout and design of the living space. Specifically, they can visually consider the location of rooms and the placement of furniture.

[0299] Step 5:

[0300] Users send feedback obtained through virtual tours from their terminals to the server. Feedback is typically provided via voice or text input. Based on this feedback, the server uses a generated AI model to further refine the design plan. As a result of the feedback analysis, a newly adjusted design plan is output and reflected again in the virtual space.

[0301] Step 6:

[0302] This readjustment process is repeated until the user is completely satisfied with the design. When the user is finally satisfied with the intended design, the design process is completed. This continuous feedback loop establishes an efficient and effective housing design.

[0303] (Application Example 1)

[0304] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart glasses 214 are referred to as a "terminal".

[0305] Conventionally, it has been difficult for users to select interior goods that suit their preferences and lifestyle and to confirm the room layout and design. In particular, there has been a lack of means to confirm the state in a virtual space before actually purchasing. Also, since there is no mechanism for reflecting the user's requests regarding the arrangement and design of the goods in real time, there is a problem that it is difficult to make a satisfactory selection of goods.

[0306] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following respective means.

[0307] In this invention, the server includes means for receiving information regarding lifestyle, family composition, hobbies, and future life plans from the user, means for automatically generating a design plan using artificial intelligence, and means for modeling and visualizing the design plan in a virtual space by three-dimensional modeling means. Thereby, the user can easily reflect desired change requests while experiencing the arrangement and design of interior goods in real time on the virtual space.

[0308] "Lifestyle" is the overall pattern of behaviors and values that an individual or family performs daily.

[0309] "Family composition" is the relationship and number of residents in the same household.

[0310] "Hobbies" are activities and objects of interest that an individual enjoys voluntarily.

[0311] "Future life plans" refer to the goals and activities you intend to achieve in your future life.

[0312] "Artificial intelligence" is computer technology that imitates human intelligence to analyze information and make decisions.

[0313] A "design plan" is a detailed plan of a living space created based on the user's needs and wishes.

[0314] "Three-dimensional modeling techniques" refer to technologies that use computers to visualize objects in three dimensions.

[0315] A "virtual space" is an artificial digital environment created by a computer.

[0316] "User feedback" refers to opinions and impressions provided by users based on their experiences.

[0317] A "change request" is a user's request for modifications or additions to the current design or layout.

[0318] "Product recommendations" refer to recommendations for products and services that meet the user's needs.

[0319] A "means of execution in real time" refers to a technology that can respond immediately the moment a user request arises.

[0320] The system that realizes this invention provides a detailed design plan based on the user's lifestyle and needs, and a mechanism that allows the user to experience that design in a virtual space.

[0321] Users input information about their lifestyle, family structure, hobbies, and future life plans through their devices. The devices collect this information and transmit it to the server via a secure connection.

[0322] Based on the received data, the server generates a design plan using an AI model. This AI model considers past design patterns and market trends to propose interior products and designs that meet the user's needs.

[0323] The server then uses Unity to perform 3D modeling and reflects the design plan in the virtual space. Users can then wear a VR headset and interactively experience this 3D model.

[0324] Users visualize products in a virtual space and submit change requests, such as "I want to change the color of the sofa." Based on this, the server uses TensorFlow to quickly analyze user feedback and adjust the design plan in real time.

[0325] As a concrete example, a user can experience a virtual room by placing an orange sofa in a virtual store and provide feedback such as, "I want a sofa in a brighter color," at which point the AI ​​will automatically suggest an alternative color sofa. An example of this prompt would be, "Based on the user's feedback, please suggest the best furniture arrangement and design style for the room."

[0326] This process allows users to improve the accuracy of their product selection while reducing time and costs, ultimately enabling them to achieve their ideal interior design.

[0327] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0328] Step 1:

[0329] Users input information about their lifestyle, family structure, hobbies, and future life plans using a terminal. This input consists of user selections and text input into data fields corresponding to each item, and the output is a structured user information dataset.

[0330] Step 2:

[0331] The terminal transmits this user information data to the server via a secure connection. This action provides the server with detailed information about the user's needs, preparing it for analysis.

[0332] Step 3:

[0333] The server generates a design plan using a generative AI model based on the received user information data. The input is user information data, and the output is an interior design plan optimized for the user. Here, the AI ​​performs data calculations based on past design patterns and market trends.

[0334] Step 4:

[0335] The server uses Unity to perform 3D modeling and reflects this design plan in a virtual space. The input is the design plan, and the output is 3D modeled virtual space data. This prepares a digital environment that users can experience.

[0336] Step 5:

[0337] The user wears a VR headset and enters a three-dimensional model of a virtual space via a terminal. The input here is login information for the VR system, and the output is the interactive virtual environment that the user visually experiences.

[0338] Step 6:

[0339] Users provide feedback on product placement and design within a virtual space. This feedback consists of evaluations and requests based on the visual experience in the virtual environment, and is transmitted to the server via the user's device.

[0340] Step 7:

[0341] The server uses TensorFlow to analyze user feedback. The input is feedback data, and the output is new product suggestions or design changes based on that feedback. Specific data processing includes sentiment analysis and trend matching of the feedback.

[0342] Step 8:

[0343] The server redesigns the model based on the processing results and provides the updated 3D model to the user. The new design is reflected in the virtual space in real time, updating the user experience.

[0344] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0345] This invention is a system for users to design homes based on their lifestyle and personal needs, and it enhances the user experience by combining it with an emotional engine. Embodiments of this invention are described below.

[0346] First, the user uses a device to input information about their lifestyle, family structure, hobbies, and future life plans into the interface. The device then aggregates this input data and transmits it to a server using a secure communication method.

[0347] The server receives the transmitted information and provides it to the artificial intelligence agent. The AI ​​agent analyzes the input information and automatically generates a house design plan optimized for the user's needs. This design plan includes room layout, space usage, and design style.

[0348] Next, the server uses 3D modeling technology to create a virtual model of the designed house plan and visualizes it for the user in a virtual space. The user can then freely move around in the virtual space using a VR headset and view the created 3D model.

[0349] Furthermore, this system integrates an emotion engine. When a user takes a virtual tour, the terminal uses sensors such as cameras and microphones to capture the user's facial expressions and voice in real time, which the emotion engine then analyzes. The emotion engine infers the user's emotional state from the acquired data and evaluates which aspects the user is satisfied with and which aspects they are dissatisfied with.

[0350] Subsequently, the server redesigns itself by integrating this sentiment data with user feedback. For example, if a user has a positive reaction to the brightness of the design, it will maintain that characteristic while improving other aspects. Conversely, if the user's sentiment is negative, the server will identify the cause, propose changes to improve the design, and remodel it.

[0351] This process is repeated until the user is satisfied with their ideal home design, enabling the system to consistently deliver high-quality designs. By combining it with an emotional engine, it becomes possible to quickly create designs that more accurately reflect the user's latent desires.

[0352] The following describes the processing flow.

[0353] Step 1:

[0354] Users input information about their lifestyle, family structure, hobbies, and future life plans through the terminal's interface. The terminal aggregates this input data and transmits it to the server in a secure manner.

[0355] Step 2:

[0356] The server receives user information from the terminal and provides the data to the artificial intelligence agent. The AI ​​agent analyzes the input information and automatically generates a house design plan that matches the user's needs. At this stage, the room layout and design style are specifically determined.

[0357] Step 3:

[0358] The server visualizes the generated house design plans in a virtual space using 3D modeling technology. The 3D models are constructed so that users can experience them realistically in the virtual space.

[0359] Step 4:

[0360] Users wear a VR headset on their device and experience a three-dimensional model of a virtual space provided by the server. Users can move around within the space and examine the designed interior and room layout in detail.

[0361] Step 5:

[0362] During the user's experience, the device uses its built-in camera and microphone to capture the user's facial expressions and voice in real time. An emotion engine analyzes this data to determine the user's emotional state.

[0363] Step 6:

[0364] The emotion engine evaluates how the user feels about the model based on the analysis results and identifies positive or negative emotions. For example, if the user is satisfied with the spacious living room, a positive emotion will be detected.

[0365] Step 7:

[0366] After the user experiences the product and enters feedback into their device, the server combines this feedback with the analysis results from the emotion engine to readjust the design plan. A new design plan is generated, and the 3D model is rebuilt.

[0367] Step 8:

[0368] The server sends the redesigned 3D model to the user's terminal, and the user reviews the model again through a VR experience. This process is repeated until the user is satisfied. This iterative process ensures that the house design best meets the user's emotions and needs.

[0369] (Example 2)

[0370] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0371] To create homes that adapt to diverse modern lifestyles and personal needs, customizable plans that accurately reflect the elements users desire are essential. However, traditional design methods have difficulty taking into account users' emotional states and detailed feedback, making them insufficient to meet users' latent desires. Furthermore, the means of verifying the effectiveness of designs through real-time experiences in virtual environments are limited, posing challenges to rapid modification and improvement.

[0372] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0373] In this invention, the server includes a device for receiving information on lifestyle, family structure, hobbies, and future life plans; a device for automatically generating living space design plans using computer intelligence; and a device for performing emotional analysis based on opinions and proposing redesigns. This enables customizable housing designs that accurately reflect the user's specific needs and emotions.

[0374] The term "device" refers to a machine or system designed to perform a specific function.

[0375] "Computer intelligence" refers to the technology by which computer systems mimic intelligent activity, with the aim of analyzing data and solving problems.

[0376] A "living space design plan" refers to a design proposal for creating a living space based on the user's lifestyle and needs.

[0377] "Three-dimensional modeling technology" refers to the technology used to generate and visualize three-dimensional shapes on a computer.

[0378] A "virtual environment" refers to a digital space that is simulated by a computer and can be experienced by a user.

[0379] "Opinions" refer to feedback and reactions from users, including evaluations and suggestions regarding design and functionality.

[0380] "Sentiment analysis" refers to the process of analyzing data in order to evaluate and understand emotional states.

[0381] "Redesign" refers to the process of modifying or improving an existing design to generate a new design proposal.

[0382] This invention is a comprehensive system for designing customizable living spaces tailored to the individual lifestyles and needs of users. This system includes a server, terminals, and a user interface.

[0383] Users input detailed information about their lifestyle, family structure, hobbies, and future life plans into the interface using their devices. This information is entered using hardware such as laptops or tablets. This information is collected once and then transmitted to a server via a secure communication method.

[0384] The server analyzes this received data using computer intelligence, specifically a generative AI model. The data analysis utilizes algorithms designed to automate the creation of living space design plans based on user needs. For example, by leveraging deep learning technology, design plans that efficiently reflect user needs are generated.

[0385] The generated design plans are visualized in a virtual environment using 3D modeling technology by the server. Specific software used includes tools such as Blender and AutoCAD. Users can experience the generated 3D structures in the virtual environment using a VR headset.

[0386] Furthermore, sensors such as cameras and microphones are utilized on the device to analyze the user's facial expressions and voice in real time. This information is used for emotion analysis, and user feedback is immediately generated. The server then proposes a redesign, incorporating these emotion results and user feedback, and presents it again within the virtual environment.

[0387] As a concrete example, if a user wants a new living room design, the following prompt message is input into the AI ​​model:

[0388] "Please design a living room where I can relax with friends. I prefer a modern yet warm style with plenty of natural light."

[0389] This system allows users to easily design their ideal living space, taking their own emotions and feedback into consideration.

[0390] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0391] Step 1:

[0392] Users input information using a terminal. This input includes lifestyle, family structure, hobbies, and future life plans. This information is collected by the interface and compiled into a single integrated dataset. As output, this dataset is structured in JSON format.

[0393] Step 2:

[0394] The terminal sends the aggregated dataset to the server using a secure protocol (e.g., HTTPS). For enhanced security, the data is encrypted. The transmitted data is stored in the server's database.

[0395] Step 3:

[0396] The server retrieves data from the database and performs analysis using a generated AI model. During this process, the AI ​​model automatically generates a living space design plan tailored to the user's needs. The input consists of various user information, and the output is an optimized design plan.

[0397] Step 4:

[0398] The server models the generated design plan using 3D modeling technology. Software such as Blender is used for modeling. As output, 3D data for use in the virtual environment is generated.

[0399] Step 5:

[0400] The server integrates 3D data into the virtual environment system and performs rendering in real time. The user wears a VR headset to experience the virtual environment and verify the designed space. The output is a virtual space that the user can experience.

[0401] Step 6:

[0402] The device uses its camera and microphone to capture the user's facial expressions and voice in real time. The acquired data is processed by the device and passed to the emotion engine. The input is the user's biometric data, and the output is the evaluation result of their emotional state.

[0403] Step 7:

[0404] The server receives the results from the emotion engine and redesigns based on the feedback. The system uses a generative AI model to generate prompts and proposes an improved design. The output is updated 3D design data.

[0405] Step 8:

[0406] The server renders the redesigned 3D data again within the virtual environment and presents it to the user. This process is repeated until the user is satisfied. The final output is the ideal design that reflects the user's requirements.

[0407] (Application Example 2)

[0408] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart glasses 214 as the "terminal".

[0409] Currently, it is difficult to quickly and efficiently design individual homes that fully reflect the user's emotions and latent needs. Furthermore, there is a lack of means to directly utilize user feedback based on emotions to improve the design, and improvements are needed to enhance user satisfaction.

[0410] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0411] In this invention, the server includes means for receiving information from the user regarding lifestyle, family structure, hobbies, and future life plans; means for automatically generating a housing design plan using artificial intelligence based on the information; means for modeling the housing design plan using three-dimensional modeling means and visualizing it in a virtual space; means for the user to experience the three-dimensional model in the virtual space and provide feedback; means for analyzing the feedback, inferring the user's emotional state using an emotion engine, and improving the design plan; and means for redesigning based on the improvements and generating an optimized design plan. This enables rapid design improvements that more accurately reflect the user's potential needs.

[0412] "Lifestyle" is a general term for the way of life and habits of an individual or group, and includes daily activities, values, hobbies, and preferences.

[0413] "Family structure" refers to information indicating the number of family members and their relationships within a household, and is used to understand the form of that household.

[0414] A "hobby" refers to an activity or area of ​​interest that an individual pursues in their free time, and it influences their personality and lifestyle.

[0415] "Future life plans" refer to goals, objectives, and plans that an individual wants to achieve in their future life, and include things like housing and family plans.

[0416] "Artificial intelligence" is a technology in which computer systems imitate human intelligence and perform learning, reasoning, and problem-solving.

[0417] A "residential design plan" is a detailed plan that outlines the structure, layout, and design style of a house, with the aim of making optimal use of living space.

[0418] "Three-dimensional modeling" is a technique that allows for the three-dimensional representation of objects and spaces on a computer, enabling visual confirmation and analysis.

[0419] A "virtual space" refers to a digital environment created using computer technology, within which users can engage in activities and work.

[0420] "Feedback" refers to the opinions and reactions received from others as a result of a process or activity, and serves as fundamental information for making improvements.

[0421] An "emotion engine" refers to a system that analyzes data acquired from sensors, estimates an individual's emotional state, and then provides responses or suggestions appropriate to that emotion.

[0422] "Optimization" is a method of improving plans and processes and eliminating waste in order to obtain the most desirable results under specific conditions.

[0423] To implement this invention, the user first uses a terminal to input information about their lifestyle, family structure, hobbies, and future life plans. The terminal aggregates this input data and transmits it to a server using a secure communication method. The server receives the transmitted information and provides it to an artificial intelligence agent. The artificial intelligence agent analyzes the user's input information and automatically generates an optimized housing design plan based on it. This design plan includes room layout, space utilization, and design style.

[0424] The server uses 3D modeling technology to create a virtual model of the designed house plan and visualizes it in a virtual space. Users can move around in the virtual space using devices such as VR headsets and view the 3D model.

[0425] Furthermore, the system integrates an emotion engine. This emotion engine acquires the user's facial expressions and voice in real time through sensors such as cameras and microphones, and uses this information to infer their emotional state. While the user is taking a virtual tour, the emotion engine analyzes the acquired data and evaluates which aspects they are satisfied with and which aspects they are dissatisfied with.

[0426] The server redesigns the design based on this emotional data and user feedback. For example, if a user has a positive reaction to the living room design, it will improve other areas while maintaining those characteristics. On the other hand, if a negative reaction is detected, it will identify the cause, suggest changes to improve the design, and remodel it. An example of a prompt message would be, "Based on the user's facial expressions and voice data, analyze their emotional state towards this living room design and generate improvement suggestions." This process allows the user to refine the design with the system until they are satisfied with their ideal home design.

[0427] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0428] Step 1:

[0429] The user uses a device to input information about their lifestyle, family structure, hobbies, and future life plans into the interface. This information becomes the input data for the device. The device then aggregates this information and prepares it to be sent to the server.

[0430] Step 2:

[0431] The server receives the information sent from the terminal. The server converts this information into an appropriate format for input to the artificial intelligence agent and provides the data. This allows the artificial intelligence agent to analyze the user's input information.

[0432] Step 3:

[0433] The artificial intelligence agent analyzes information received from the server. Based on the input lifestyle, family structure, hobbies, and future life plans, it generates an optimized housing design plan. By using data analysis and algorithmic generative models, it can produce a concrete design plan as output.

[0434] Step 4:

[0435] The server inputs the generated house design plan into 3D modeling software and creates a virtual model. Through modeling, the house design plan is transformed into a state that can be visualized in three-dimensional space. This model is then output in a state that can be visually confirmed within the virtual space.

[0436] Step 5:

[0437] Users access a virtual space on a server using a VR headset installed on their device and experience a three-dimensional model. They can move around within the virtual space and examine each room and design. User feedback and opinions are input into the system.

[0438] Step 6:

[0439] The device uses its camera and microphone to capture the user's facial expressions and voice data in real time while the user explores the virtual space. This data is input into an emotion engine to infer the user's emotional state. This process analyzes what emotions the user feels towards which parts of the virtual space.

[0440] Step 7:

[0441] The server integrates analysis results from the emotion engine with user feedback to carry out a redesign process. While retaining design elements where positive emotions were detected, it adjusts elements associated with negative emotions based on specific improvement algorithms and outputs a new design plan.

[0442] Step 8:

[0443] The redesigned plan is again 3D modeled and provided from the server to the terminal for visual confirmation in the virtual space. The prompt message, "Based on the user's facial expressions and voice data, analyze their emotional state towards this living room design and generate improvement suggestions," assists in the implementation of the generated AI model. This process is repeated until the user is satisfied.

[0444] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0445] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0446] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0447] [Third Embodiment]

[0448] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0449] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0450] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0451] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0452] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0453] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0454] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0455] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0456] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0457] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0458] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0459] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0460] This invention is a system for providing housing designs tailored to the user's lifestyle and needs, and in order to achieve this, each component works in conjunction with the others.

[0461] First, the user uses their device to input information such as their lifestyle, family structure, hobbies, and future life plans into a dedicated interface. The device compiles this information and sends the data to the server via a secure connection.

[0462] In the next stage, the server provides the received user data to an artificial intelligence agent for analysis. This AI agent considers accumulated design patterns and market trends to generate a house design plan that meets the user's needs. For example, if the user wants to "let in lots of natural light," the server's AI agent will generate a design plan that includes a living room with large windows.

[0463] Next, the server reflects the generated house design plan into a virtual space through a three-dimensional modeling system, constructing a 3D model. This model is adjusted to meet building codes and environmental conditions, and energy efficiency and durability are also taken into consideration.

[0464] Users wear a VR headset on their device and can experience a 3D model in a virtual space as a virtual tour. At this stage, users can visualize the design from all angles and check whether the room layout and design are reflected as intended.

[0465] Furthermore, feedback provided by users during the experience is sent from the device to the server and quickly analyzed by an artificial intelligence agent. Based on the feedback, the server readjusts the design plan, generates a new design, and presents it again in the virtual space. For example, if a user requests that the kitchen be a little larger, the artificial intelligence agent will enlarge the kitchen area and recalculate the space allocation for the other rooms.

[0466] This allows users to adjust their ideal home design as many times as needed until they are satisfied, enabling them to achieve a highly polished design without spending a lot of time and money.

[0467] The following describes the processing flow.

[0468] Step 1:

[0469] Users use a dedicated interface on the device to input information about their lifestyle, family structure, hobbies, and future life plans. The device compiles this information and sends it to the server in an appropriate format.

[0470] Step 2:

[0471] The server receives user information from the terminal and provides it to the artificial intelligence agent. The artificial intelligence agent analyzes the input information and performs data analysis to generate a housing design plan that matches the user's preferences.

[0472] Step 3:

[0473] The server receives the house design plan generated by the artificial intelligence agent and sends it to the 3D modeling engine. This engine generates a 3D model based on the design plan and constructs a model to simulate the actual building in a virtual space.

[0474] Step 4:

[0475] Users wear a VR headset via a device and experience 3D models provided by the server in a virtual space. Users can freely move around the model and examine every detail of the design.

[0476] Step 5:

[0477] Users input suggestions for improvements and design changes they find during a virtual tour into a terminal. The terminal continuously sends this feedback to the server.

[0478] Step 6:

[0479] The server receives feedback from the user, and an artificial intelligence agent analyzes it. Based on the analysis results, the housing design plan is readjusted, and a new 3D model is generated.

[0480] Step 7:

[0481] The server sends a redesigned 3D model to the terminal, and the user reviews the new design again in VR. This allows the user to iterate on the design until it approaches their ideal.

[0482] (Example 1)

[0483] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0484] Traditional residential design processes have faced challenges in accurately reflecting user needs, requiring significant time and cost. In particular, the process of repeatedly revising physical models is inefficient and labor-intensive. Because of these problems, there is a need for a simple and rapid method for users to design their ideal homes.

[0485] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0486] In this invention, the server includes means for receiving lifestyle information from the user, means for automatically generating a spatial design plan using data processing technology, and means for modeling it using a three-dimensional structural method and visualizing it in a digital space. This makes it possible for the user to easily and repeatedly check and modify a housing design based on their own needs in a virtual environment.

[0487] "Lifestyle information" is a general term for information related to an individual user's lifestyle, such as their lifestyle, family structure, hobbies, and future plans.

[0488] "Data processing technology" refers to the technology used to analyze input information using computers and convert it into a format that is effective for a specific purpose.

[0489] A "space design plan" is a design proposal that concretizes the layout and design of a living space based on the user's requirements.

[0490] "Three-dimensional structural method" refers to the process of generating a three-dimensional model from a two-dimensional drawing using computer-aided design (CAD) technology.

[0491] "Digital space" refers to a space where three-dimensional models visualized within a virtual computer-generated environment can be viewed.

[0492] "Opinions" refer to the thoughts and requests regarding the design that users provide as feedback during their virtual tour experience.

[0493] "Revising the plan" is a procedure for reviewing and modifying existing design proposals based on user feedback.

[0494] A description of the embodiment for carrying out the invention will be provided.

[0495] At system startup, users access a dedicated interface using a terminal and input information about their lifestyle, family structure, hobbies, and future life plans. The terminal converts this information into a structured data format and sends it to the server via a secure connection. Common formats such as JSON and XML are used for this purpose.

[0496] The server uses a generative AI model to analyze the received information. This model incorporates a system based on a deep learning framework, specifically TensorFlow or PyTorch. Based on the server's data analysis results, it generates a spatial design plan best suited to the user's needs. In this process, it references an accumulated database of design patterns and information on market trends.

[0497] The generated design plan is transferred from the server to 3D modeling software. Here, the design plan is recreated in three dimensions using tools such as Blender or Autodesk Revit. The 3D model is then visualized in a digital space, making it easily accessible to the user.

[0498] Next, the user uses their device to put on a VR headset and virtually tour the three-dimensional structure within the virtual space. This allows them to check the room layout and design details in real time. Based on this experience in the virtual space, the user provides feedback using their opinions. This feedback is sent from the device to the server as voice input or text message.

[0499] The server reuses the generated AI model based on feedback and automatically readjusts the design proposal. This regenerated design plan is then reflected again in the digital space and reviewed by the user. Specific examples of prompts include "Please generate a house design plan based on my lifestyle" and "I want a larger kitchen, so please adjust the design plan."

[0500] Through the above process, users can quickly and effectively design their ideal home.

[0501] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0502] Step 1:

[0503] Users access a dedicated interface through their device and input information such as their lifestyle, family structure, hobbies, and future life plans. This information is converted by the device into a structured data format (e.g., JSON or XML). The entered data is then sent to the server via a secure connection.

[0504] Step 2:

[0505] The server verifies the received user data and begins data analysis. At this stage, the server uses a generative AI model to automatically generate a spatial design plan based on the user's input. The AI ​​model references database design patterns and market trends to create appropriate design proposals. As a result of the analysis, specific design suggestions are output.

[0506] Step 3:

[0507] The server passes the generated spatial design plan to 3D modeling software. Here, the software uses CAD data format to construct the design plan as a 3D model. The software used is generally known as 3D design software. The output 3D model is provided in a format that can be visualized in digital space.

[0508] Step 4:

[0509] Users wear a VR headset on their device and take a virtual tour of the property in a digital space. Here, users can view a three-dimensional model from various perspectives and experience the layout and design of the living space. Specifically, they can visually consider the location of rooms and the placement of furniture.

[0510] Step 5:

[0511] Users send feedback obtained through virtual tours from their terminals to the server. Feedback is typically provided via voice or text input. Based on this feedback, the server uses a generated AI model to further refine the design plan. As a result of the feedback analysis, a newly adjusted design plan is output and reflected again in the virtual space.

[0512] Step 6:

[0513] This readjustment process is repeated until the user is completely satisfied with the design. The design process is complete when the user is finally satisfied with the intended design. This continuous feedback loop establishes efficient and effective residential design.

[0514] (Application Example 1)

[0515] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0516] Traditionally, users have found it difficult to select interior design products that suit their preferences and lifestyles, and to confirm their placement and design in a virtual environment. In particular, there is a lack of means to virtually check the product's appearance before actually purchasing it. Furthermore, the absence of a system that allows users to incorporate their requests regarding product placement and design in real time makes it difficult to make satisfactory product choices.

[0517] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0518] In this invention, the server includes means for receiving information from the user regarding their lifestyle, family structure, hobbies, and future life plans; means for automatically generating a design plan using artificial intelligence; and means for modeling and visualizing the design plan in a virtual space using three-dimensional modeling means. This allows the user to easily incorporate desired changes while experiencing the placement and design of interior products in real time in the virtual space.

[0519] A "lifestyle" is the sum total of the behavioral patterns and values ​​that an individual or family engages in on a daily basis.

[0520] "Family structure" refers to the relationships and number of residents in the same household.

[0521] A "hobby" is an activity or interest that an individual enjoys on their own initiative.

[0522] "Future life plans" refer to the goals and activities you intend to achieve in your future life.

[0523] "Artificial intelligence" is computer technology that imitates human intelligence to analyze information and make decisions.

[0524] A "design plan" is a detailed plan of a living space created based on the user's needs and wishes.

[0525] "Three-dimensional modeling techniques" refer to technologies that use computers to visualize objects in three dimensions.

[0526] A "virtual space" is an artificial digital environment created by a computer.

[0527] "User feedback" refers to opinions and impressions provided by users based on their experiences.

[0528] A "change request" is a user's request for modifications or additions to the current design or layout.

[0529] "Product recommendations" refer to recommendations for products and services that meet the user's needs.

[0530] A "means of execution in real time" refers to a technology that can respond immediately the moment a user request arises.

[0531] The system that realizes this invention provides a detailed design plan based on the user's lifestyle and needs, and a mechanism that allows the user to experience that design in a virtual space.

[0532] Users input information about their lifestyle, family structure, hobbies, and future life plans through their devices. The devices collect this information and transmit it to the server via a secure connection.

[0533] Based on the received data, the server generates a design plan using an AI model. This AI model considers past design patterns and market trends to propose interior products and designs that meet the user's needs.

[0534] The server then uses Unity to perform 3D modeling and reflects the design plan in the virtual space. Users can then wear a VR headset and interactively experience this 3D model.

[0535] Users visualize products in a virtual space and submit change requests, such as "I want to change the color of the sofa." Based on this, the server uses TensorFlow to quickly analyze user feedback and adjust the design plan in real time.

[0536] As a concrete example, a user can experience a virtual room by placing an orange sofa in a virtual store and provide feedback such as, "I want a sofa in a brighter color," at which point the AI ​​will automatically suggest an alternative color sofa. An example of this prompt would be, "Based on the user's feedback, please suggest the best furniture arrangement and design style for the room."

[0537] This process allows users to improve the accuracy of their product selection while reducing time and costs, ultimately enabling them to achieve their ideal interior design.

[0538] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0539] Step 1:

[0540] Users input information about their lifestyle, family structure, hobbies, and future life plans using a terminal. This input consists of user selections and text input into data fields corresponding to each item, and the output is a structured user information dataset.

[0541] Step 2:

[0542] The terminal transmits this user information data to the server via a secure connection. This action provides the server with detailed information about the user's needs, preparing it for analysis.

[0543] Step 3:

[0544] The server generates a design plan using a generative AI model based on the received user information data. The input is user information data, and the output is an interior design plan optimized for the user. Here, the AI ​​performs data calculations based on past design patterns and market trends.

[0545] Step 4:

[0546] The server uses Unity to perform 3D modeling and reflects this design plan in a virtual space. The input is the design plan, and the output is 3D modeled virtual space data. This prepares a digital environment that users can experience.

[0547] Step 5:

[0548] The user wears a VR headset and enters a three-dimensional model of a virtual space via a terminal. The input here is login information for the VR system, and the output is the interactive virtual environment that the user visually experiences.

[0549] Step 6:

[0550] Users provide feedback on product placement and design within a virtual space. This feedback consists of evaluations and requests based on the visual experience in the virtual environment, and is transmitted to the server via the user's device.

[0551] Step 7:

[0552] The server uses TensorFlow to analyze user feedback. The input is feedback data, and the output is new product suggestions or design changes based on that feedback. Specific data processing includes sentiment analysis and trend matching of the feedback.

[0553] Step 8:

[0554] The server redesigns the model based on the processing results and provides the updated 3D model to the user. The new design is reflected in the virtual space in real time, updating the user experience.

[0555] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0556] This invention is a system for users to design homes based on their lifestyle and personal needs, and it enhances the user experience by combining it with an emotional engine. Embodiments of this invention are described below.

[0557] First, the user uses a device to input information about their lifestyle, family structure, hobbies, and future life plans into the interface. The device then aggregates this input data and transmits it to a server using a secure communication method.

[0558] The server receives the transmitted information and provides it to the artificial intelligence agent. The AI ​​agent analyzes the input information and automatically generates a house design plan optimized for the user's needs. This design plan includes room layout, space usage, and design style.

[0559] Next, the server uses 3D modeling technology to create a virtual model of the designed house plan and visualizes it for the user in a virtual space. The user can then freely move around in the virtual space using a VR headset and view the created 3D model.

[0560] Furthermore, this system integrates an emotion engine. When a user takes a virtual tour, the terminal uses sensors such as cameras and microphones to capture the user's facial expressions and voice in real time, which the emotion engine then analyzes. The emotion engine infers the user's emotional state from the acquired data and evaluates which aspects the user is satisfied with and which aspects they are dissatisfied with.

[0561] Subsequently, the server redesigns itself by integrating this sentiment data with user feedback. For example, if a user has a positive reaction to the brightness of the design, it will maintain that characteristic while improving other aspects. Conversely, if the user's sentiment is negative, the server will identify the cause, propose changes to improve the design, and remodel it.

[0562] This process is repeated until the user is satisfied with their ideal home design, enabling the system to consistently deliver high-quality designs. By combining it with an emotional engine, it becomes possible to quickly create designs that more accurately reflect the user's latent desires.

[0563] The following describes the processing flow.

[0564] Step 1:

[0565] Users input information about their lifestyle, family structure, hobbies, and future life plans through the terminal's interface. The terminal aggregates this input data and transmits it to the server in a secure manner.

[0566] Step 2:

[0567] The server receives user information from the terminal and provides the data to the artificial intelligence agent. The AI ​​agent analyzes the input information and automatically generates a house design plan that matches the user's needs. At this stage, the room layout and design style are specifically determined.

[0568] Step 3:

[0569] The server visualizes the generated house design plans in a virtual space using 3D modeling technology. The 3D models are constructed so that users can experience them realistically in the virtual space.

[0570] Step 4:

[0571] Users wear a VR headset on their device and experience a three-dimensional model of a virtual space provided by the server. Users can move around within the space and examine the designed interior and room layout in detail.

[0572] Step 5:

[0573] During the user's experience, the device uses its built-in camera and microphone to capture the user's facial expressions and voice in real time. An emotion engine analyzes this data to determine the user's emotional state.

[0574] Step 6:

[0575] The emotion engine evaluates how the user feels about the model based on the analysis results and identifies positive or negative emotions. For example, if the user is satisfied with the spacious living room, a positive emotion will be detected.

[0576] Step 7:

[0577] After the user experiences the product and enters feedback into their device, the server combines this feedback with the analysis results from the emotion engine to readjust the design plan. A new design plan is generated, and the 3D model is rebuilt.

[0578] Step 8:

[0579] The server sends the redesigned 3D model to the user's terminal, and the user reviews the model again through a VR experience. This process is repeated until the user is satisfied. This iterative process ensures that the house design best meets the user's emotions and needs.

[0580] (Example 2)

[0581] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0582] To create homes that adapt to diverse modern lifestyles and personal needs, customizable plans that accurately reflect the elements users desire are essential. However, traditional design methods have difficulty taking into account users' emotional states and detailed feedback, making them insufficient to meet users' latent desires. Furthermore, the means of verifying the effectiveness of designs through real-time experiences in virtual environments are limited, posing challenges to rapid modification and improvement.

[0583] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0584] In this invention, the server includes a device for receiving information on lifestyle, family structure, hobbies, and future life plans; a device for automatically generating living space design plans using computer intelligence; and a device for performing emotional analysis based on opinions and proposing redesigns. This enables customizable housing designs that accurately reflect the user's specific needs and emotions.

[0585] The term "device" refers to a machine or system designed to perform a specific function.

[0586] "Computer intelligence" refers to the technology by which computer systems mimic intelligent activity, with the aim of analyzing data and solving problems.

[0587] A "living space design plan" refers to a design proposal for creating a living space based on the user's lifestyle and needs.

[0588] "Three-dimensional modeling technology" refers to the technology used to generate and visualize three-dimensional shapes on a computer.

[0589] A "virtual environment" refers to a digital space that is simulated by a computer and can be experienced by a user.

[0590] "Opinions" refer to feedback and reactions from users, including evaluations and suggestions regarding design and functionality.

[0591] "Sentiment analysis" refers to the process of analyzing data in order to evaluate and understand emotional states.

[0592] "Redesign" refers to the process of modifying or improving an existing design to generate a new design proposal.

[0593] This invention is a comprehensive system for designing customizable living spaces tailored to the individual lifestyles and needs of users. This system includes a server, terminals, and a user interface.

[0594] Users input detailed information about their lifestyle, family structure, hobbies, and future life plans into the interface using their devices. This information is entered using hardware such as laptops or tablets. This information is collected once and then transmitted to a server via a secure communication method.

[0595] The server analyzes this received data using computer intelligence, specifically a generative AI model. The data analysis utilizes algorithms designed to automate the creation of living space design plans based on user needs. For example, by leveraging deep learning technology, design plans that efficiently reflect user needs are generated.

[0596] The generated design plans are visualized in a virtual environment using 3D modeling technology by the server. Specific software used includes tools such as Blender and AutoCAD. Users can experience the generated 3D structures in the virtual environment using a VR headset.

[0597] Furthermore, sensors such as cameras and microphones are utilized on the device to analyze the user's facial expressions and voice in real time. This information is used for emotion analysis, and user feedback is immediately generated. The server then proposes a redesign, incorporating these emotion results and user feedback, and presents it again within the virtual environment.

[0598] As a concrete example, if a user wants a new living room design, the following prompt message is input into the AI ​​model:

[0599] "Please design a living room where I can relax with friends. I prefer a modern yet warm style with plenty of natural light."

[0600] This system allows users to easily design their ideal living space, taking their own emotions and feedback into consideration.

[0601] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0602] Step 1:

[0603] Users input information using a terminal. This input includes lifestyle, family structure, hobbies, and future life plans. This information is collected by the interface and compiled into a single integrated dataset. As output, this dataset is structured in JSON format.

[0604] Step 2:

[0605] The terminal sends the aggregated dataset to the server using a secure protocol (e.g., HTTPS). For enhanced security, the data is encrypted. The transmitted data is stored in the server's database.

[0606] Step 3:

[0607] The server retrieves data from the database and performs analysis using a generated AI model. During this process, the AI ​​model automatically generates a living space design plan tailored to the user's needs. The input consists of various user information, and the output is an optimized design plan.

[0608] Step 4:

[0609] The server models the generated design plan using 3D modeling technology. Software such as Blender is used for modeling. As output, 3D data for use in the virtual environment is generated.

[0610] Step 5:

[0611] The server integrates 3D data into the virtual environment system and performs rendering in real time. The user wears a VR headset to experience the virtual environment and verify the designed space. The output is a virtual space that the user can experience.

[0612] Step 6:

[0613] The device uses its camera and microphone to capture the user's facial expressions and voice in real time. The acquired data is processed by the device and passed to the emotion engine. The input is the user's biometric data, and the output is the evaluation result of their emotional state.

[0614] Step 7:

[0615] The server receives the results from the emotion engine and redesigns based on the feedback. The system uses a generative AI model to generate prompts and proposes an improved design. The output is updated 3D design data.

[0616] Step 8:

[0617] The server renders the redesigned 3D data again within the virtual environment and presents it to the user. This process is repeated until the user is satisfied. The final output is the ideal design that reflects the user's requirements.

[0618] (Application Example 2)

[0619] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0620] Currently, it is difficult to quickly and efficiently design individual homes that fully reflect the user's emotions and latent needs. Furthermore, there is a lack of means to directly utilize user feedback based on emotions to improve the design, and improvements are needed to enhance user satisfaction.

[0621] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0622] In this invention, the server includes means for receiving information from the user regarding lifestyle, family structure, hobbies, and future life plans; means for automatically generating a housing design plan using artificial intelligence based on the information; means for modeling the housing design plan using three-dimensional modeling means and visualizing it in a virtual space; means for the user to experience the three-dimensional model in the virtual space and provide feedback; means for analyzing the feedback, inferring the user's emotional state using an emotion engine, and improving the design plan; and means for redesigning based on the improvements and generating an optimized design plan. This enables rapid design improvements that more accurately reflect the user's potential needs.

[0623] "Lifestyle" is a general term for the way of life and habits of an individual or group, and includes daily activities, values, hobbies, and preferences.

[0624] "Family structure" refers to information indicating the number of family members and their relationships within a household, and is used to understand the form of that household.

[0625] A "hobby" refers to an activity or area of ​​interest that an individual pursues in their free time, and it influences their personality and lifestyle.

[0626] "Future life plans" refer to goals, objectives, and plans that an individual wants to achieve in their future life, and include things like housing and family plans.

[0627] "Artificial intelligence" is a technology in which computer systems imitate human intelligence and perform learning, reasoning, and problem-solving.

[0628] A "residential design plan" is a detailed plan that outlines the structure, layout, and design style of a house, with the aim of making optimal use of living space.

[0629] "Three-dimensional modeling" is a technique that allows for the three-dimensional representation of objects and spaces on a computer, enabling visual confirmation and analysis.

[0630] A "virtual space" refers to a digital environment created using computer technology, within which users can engage in activities and work.

[0631] "Feedback" refers to the opinions and reactions received from others as a result of a process or activity, and serves as fundamental information for making improvements.

[0632] An "emotion engine" refers to a system that analyzes data acquired from sensors, estimates an individual's emotional state, and then provides responses or suggestions appropriate to that emotion.

[0633] "Optimization" is a method of improving plans and processes and eliminating waste in order to obtain the most desirable results under specific conditions.

[0634] To implement this invention, the user first uses a terminal to input information about their lifestyle, family structure, hobbies, and future life plans. The terminal aggregates this input data and transmits it to a server using a secure communication method. The server receives the transmitted information and provides it to an artificial intelligence agent. The artificial intelligence agent analyzes the user's input information and automatically generates an optimized housing design plan based on it. This design plan includes room layout, space utilization, and design style.

[0635] The server uses 3D modeling technology to create a virtual model of the designed house plan and visualizes it in a virtual space. Users can move around in the virtual space using devices such as VR headsets and view the 3D model.

[0636] Furthermore, the system integrates an emotion engine. This emotion engine acquires the user's facial expressions and voice in real time through sensors such as cameras and microphones, and uses this information to infer their emotional state. While the user is taking a virtual tour, the emotion engine analyzes the acquired data and evaluates which aspects they are satisfied with and which aspects they are dissatisfied with.

[0637] The server redesigns the design based on this emotional data and user feedback. For example, if a user has a positive reaction to the living room design, it will improve other areas while maintaining those characteristics. On the other hand, if a negative reaction is detected, it will identify the cause, suggest changes to improve the design, and remodel it. An example of a prompt message would be, "Based on the user's facial expressions and voice data, analyze their emotional state towards this living room design and generate improvement suggestions." This process allows the user to refine the design with the system until they are satisfied with their ideal home design.

[0638] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0639] Step 1:

[0640] The user uses a device to input information about their lifestyle, family structure, hobbies, and future life plans into the interface. This information becomes the input data for the device. The device then aggregates this information and prepares it to be sent to the server.

[0641] Step 2:

[0642] The server receives the information sent from the terminal. The server converts this information into an appropriate format for input to the artificial intelligence agent and provides the data. This allows the artificial intelligence agent to analyze the user's input information.

[0643] Step 3:

[0644] The artificial intelligence agent analyzes information received from the server. Based on the input lifestyle, family structure, hobbies, and future life plans, it generates an optimized housing design plan. By using data analysis and algorithmic generative models, it can produce a concrete design plan as output.

[0645] Step 4:

[0646] The server inputs the generated house design plan into 3D modeling software and creates a virtual model. Through modeling, the house design plan is transformed into a state that can be visualized in three-dimensional space. This model is then output in a state that can be visually confirmed within the virtual space.

[0647] Step 5:

[0648] Users access a virtual space on a server using a VR headset installed on their device and experience a three-dimensional model. They can move around within the virtual space and examine each room and design. User feedback and opinions are input into the system.

[0649] Step 6:

[0650] The device uses its camera and microphone to capture the user's facial expressions and voice data in real time while the user explores the virtual space. This data is input into an emotion engine to infer the user's emotional state. This process analyzes what emotions the user feels towards which parts of the virtual space.

[0651] Step 7:

[0652] The server integrates analysis results from the emotion engine with user feedback to carry out a redesign process. While retaining design elements where positive emotions were detected, it adjusts elements associated with negative emotions based on specific improvement algorithms and outputs a new design plan.

[0653] Step 8:

[0654] The redesigned plan is again 3D modeled and provided from the server to the terminal for visual confirmation in the virtual space. The prompt message, "Based on the user's facial expressions and voice data, analyze their emotional state towards this living room design and generate improvement suggestions," assists in the implementation of the generated AI model. This process is repeated until the user is satisfied.

[0655] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0656] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0657] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0658] [Fourth Embodiment]

[0659] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0660] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0661] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0662] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0663] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0664] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0665] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0666] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0667] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0668] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0669] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0670] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0671] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0672] This invention is a system for providing housing designs tailored to the user's lifestyle and needs, and in order to achieve this, each component works in conjunction with the others.

[0673] First, the user uses their device to input information such as their lifestyle, family structure, hobbies, and future life plans into a dedicated interface. The device compiles this information and sends the data to the server via a secure connection.

[0674] In the next stage, the server provides the received user data to an artificial intelligence agent for analysis. This AI agent considers accumulated design patterns and market trends to generate a house design plan that meets the user's needs. For example, if the user wants to "let in lots of natural light," the server's AI agent will generate a design plan that includes a living room with large windows.

[0675] Next, the server reflects the generated house design plan into a virtual space through a three-dimensional modeling system, constructing a 3D model. This model is adjusted to meet building codes and environmental conditions, and energy efficiency and durability are also taken into consideration.

[0676] Users wear a VR headset on their device and can experience a 3D model in a virtual space as a virtual tour. At this stage, users can visualize the design from all angles and check whether the room layout and design are reflected as intended.

[0677] Furthermore, feedback provided by users during the experience is sent from the device to the server and quickly analyzed by an artificial intelligence agent. Based on the feedback, the server readjusts the design plan, generates a new design, and presents it again in the virtual space. For example, if a user requests that the kitchen be a little larger, the artificial intelligence agent will enlarge the kitchen area and recalculate the space allocation for the other rooms.

[0678] This allows users to adjust their ideal home design as many times as needed until they are satisfied, enabling them to achieve a highly polished design without spending a lot of time and money.

[0679] The following describes the processing flow.

[0680] Step 1:

[0681] Users use a dedicated interface on the device to input information about their lifestyle, family structure, hobbies, and future life plans. The device compiles this information and sends it to the server in an appropriate format.

[0682] Step 2:

[0683] The server receives user information from the terminal and provides it to the artificial intelligence agent. The artificial intelligence agent analyzes the input information and performs data analysis to generate a housing design plan that matches the user's preferences.

[0684] Step 3:

[0685] The server receives the house design plan generated by the artificial intelligence agent and sends it to the 3D modeling engine. This engine generates a 3D model based on the design plan and constructs a model to simulate the actual building in a virtual space.

[0686] Step 4:

[0687] Users wear a VR headset via a device and experience 3D models provided by the server in a virtual space. Users can freely move around the model and examine every detail of the design.

[0688] Step 5:

[0689] Users input suggestions for improvements and design changes they find during a virtual tour into a terminal. The terminal continuously sends this feedback to the server.

[0690] Step 6:

[0691] The server receives feedback from the user, and an artificial intelligence agent analyzes it. Based on the analysis results, the housing design plan is readjusted, and a new 3D model is generated.

[0692] Step 7:

[0693] The server sends a redesigned 3D model to the terminal, and the user reviews the new design again in VR. This allows the user to iterate on the design until it approaches their ideal.

[0694] (Example 1)

[0695] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0696] Traditional residential design processes have faced challenges in accurately reflecting user needs, requiring significant time and cost. In particular, the process of repeatedly revising physical models is inefficient and labor-intensive. Because of these problems, there is a need for a simple and rapid method for users to design their ideal homes.

[0697] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0698] In this invention, the server includes means for receiving lifestyle information from the user, means for automatically generating a spatial design plan using data processing technology, and means for modeling it using a three-dimensional structural method and visualizing it in a digital space. This makes it possible for the user to easily and repeatedly check and modify a housing design based on their own needs in a virtual environment.

[0699] "Lifestyle information" is a general term for information related to an individual user's lifestyle, such as their lifestyle, family structure, hobbies, and future plans.

[0700] "Data processing technology" refers to the technology used to analyze input information using computers and convert it into a format that is effective for a specific purpose.

[0701] A "space design plan" is a design proposal that concretizes the layout and design of a living space based on the user's requirements.

[0702] "Three-dimensional structural method" refers to the process of generating a three-dimensional model from a two-dimensional drawing using computer-aided design (CAD) technology.

[0703] "Digital space" refers to a space where three-dimensional models visualized within a virtual computer-generated environment can be viewed.

[0704] "Opinions" refer to the thoughts and requests regarding the design that users provide as feedback during their virtual tour experience.

[0705] "Revising the plan" is a procedure for reviewing and modifying existing design proposals based on user feedback.

[0706] A description of the embodiment for carrying out the invention will be provided.

[0707] At system startup, users access a dedicated interface using a terminal and input information about their lifestyle, family structure, hobbies, and future life plans. The terminal converts this information into a structured data format and sends it to the server via a secure connection. Common formats such as JSON and XML are used for this purpose.

[0708] The server uses a generative AI model to analyze the received information. This model incorporates a system based on a deep learning framework, specifically TensorFlow or PyTorch. Based on the server's data analysis results, it generates a spatial design plan best suited to the user's needs. In this process, it references an accumulated database of design patterns and information on market trends.

[0709] The generated design plan is transferred from the server to 3D modeling software. Here, the design plan is recreated in three dimensions using tools such as Blender or Autodesk Revit. The 3D model is then visualized in a digital space, making it easily accessible to the user.

[0710] Next, the user uses their device to put on a VR headset and virtually tour the three-dimensional structure within the virtual space. This allows them to check the room layout and design details in real time. Based on this experience in the virtual space, the user provides feedback using their opinions. This feedback is sent from the device to the server as voice input or text message.

[0711] The server reuses the generated AI model based on feedback and automatically readjusts the design proposal. This regenerated design plan is then reflected again in the digital space and reviewed by the user. Specific examples of prompts include "Please generate a house design plan based on my lifestyle" and "I want a larger kitchen, so please adjust the design plan."

[0712] Through the above process, users can quickly and effectively design their ideal home.

[0713] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0714] Step 1:

[0715] Users access a dedicated interface through their device and input information such as their lifestyle, family structure, hobbies, and future life plans. This information is converted by the device into a structured data format (e.g., JSON or XML). The entered data is then sent to the server via a secure connection.

[0716] Step 2:

[0717] The server verifies the received user data and begins data analysis. At this stage, the server uses a generative AI model to automatically generate a spatial design plan based on the user's input. The AI ​​model references database design patterns and market trends to create appropriate design proposals. As a result of the analysis, specific design suggestions are output.

[0718] Step 3:

[0719] The server passes the generated spatial design plan to 3D modeling software. Here, the software uses CAD data format to construct the design plan as a 3D model. The software used is generally known as 3D design software. The output 3D model is provided in a format that can be visualized in digital space.

[0720] Step 4:

[0721] Users wear a VR headset on their device and take a virtual tour of the property in a digital space. Here, users can view a three-dimensional model from various perspectives and experience the layout and design of the living space. Specifically, they can visually consider the location of rooms and the placement of furniture.

[0722] Step 5:

[0723] Users send feedback obtained through virtual tours from their terminals to the server. Feedback is typically provided via voice or text input. Based on this feedback, the server uses a generated AI model to further refine the design plan. As a result of the feedback analysis, a newly adjusted design plan is output and reflected again in the virtual space.

[0724] Step 6:

[0725] This readjustment process is repeated until the user is completely satisfied with the design. The design process is complete when the user is finally satisfied with the intended design. This continuous feedback loop establishes efficient and effective residential design.

[0726] (Application Example 1)

[0727] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0728] Traditionally, users have found it difficult to select interior design products that suit their preferences and lifestyles, and to confirm their placement and design in a virtual environment. In particular, there is a lack of means to virtually check the product's appearance before actually purchasing it. Furthermore, the absence of a system that allows users to incorporate their requests regarding product placement and design in real time makes it difficult to make satisfactory product choices.

[0729] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0730] In this invention, the server includes means for receiving information from the user regarding their lifestyle, family structure, hobbies, and future life plans; means for automatically generating a design plan using artificial intelligence; and means for modeling and visualizing the design plan in a virtual space using three-dimensional modeling means. This allows the user to easily incorporate desired changes while experiencing the placement and design of interior products in real time in the virtual space.

[0731] A "lifestyle" is the sum total of the behavioral patterns and values ​​that an individual or family engages in on a daily basis.

[0732] "Family structure" refers to the relationships and number of residents in the same household.

[0733] A "hobby" is an activity or interest that an individual enjoys on their own initiative.

[0734] "Future life plans" refer to the goals and activities you intend to achieve in your future life.

[0735] "Artificial intelligence" is computer technology that imitates human intelligence to analyze information and make decisions.

[0736] A "design plan" is a detailed plan of a living space created based on the user's needs and wishes.

[0737] "Three-dimensional modeling techniques" refer to technologies that use computers to visualize objects in three dimensions.

[0738] A "virtual space" is an artificial digital environment created by a computer.

[0739] "User feedback" refers to opinions and impressions provided by users based on their experiences.

[0740] A "change request" is a user's request for modifications or additions to the current design or layout.

[0741] "Product recommendations" refer to recommendations for products and services that meet the user's needs.

[0742] A "means of execution in real time" refers to a technology that can respond immediately the moment a user request arises.

[0743] The system that realizes this invention provides a detailed design plan based on the user's lifestyle and needs, and a mechanism that allows the user to experience that design in a virtual space.

[0744] Users input information about their lifestyle, family structure, hobbies, and future life plans through their devices. The devices collect this information and transmit it to the server via a secure connection.

[0745] Based on the received data, the server generates a design plan using an AI model. This AI model considers past design patterns and market trends to propose interior products and designs that meet the user's needs.

[0746] The server then uses Unity to perform 3D modeling and reflects the design plan in the virtual space. Users can then wear a VR headset and interactively experience this 3D model.

[0747] Users visualize products in a virtual space and submit change requests, such as "I want to change the color of the sofa." Based on this, the server uses TensorFlow to quickly analyze user feedback and adjust the design plan in real time.

[0748] As a concrete example, a user can experience a virtual room by placing an orange sofa in a virtual store and provide feedback such as, "I want a sofa in a brighter color," at which point the AI ​​will automatically suggest an alternative color sofa. An example of this prompt would be, "Based on the user's feedback, please suggest the best furniture arrangement and design style for the room."

[0749] This process allows users to improve the accuracy of their product selection while reducing time and costs, ultimately enabling them to achieve their ideal interior design.

[0750] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0751] Step 1:

[0752] Users input information about their lifestyle, family structure, hobbies, and future life plans using a terminal. This input consists of user selections and text input into data fields corresponding to each item, and the output is a structured user information dataset.

[0753] Step 2:

[0754] The terminal transmits this user information data to the server via a secure connection. This action provides the server with detailed information about the user's needs, preparing it for analysis.

[0755] Step 3:

[0756] The server generates a design plan using a generative AI model based on the received user information data. The input is user information data, and the output is an interior design plan optimized for the user. Here, the AI ​​performs data calculations based on past design patterns and market trends.

[0757] Step 4:

[0758] The server uses Unity to perform 3D modeling and reflects this design plan in a virtual space. The input is the design plan, and the output is 3D modeled virtual space data. This prepares a digital environment that users can experience.

[0759] Step 5:

[0760] The user wears a VR headset and enters a three-dimensional model of a virtual space via a terminal. The input here is login information for the VR system, and the output is the interactive virtual environment that the user visually experiences.

[0761] Step 6:

[0762] Users provide feedback on product placement and design within a virtual space. This feedback consists of evaluations and requests based on the visual experience in the virtual environment, and is transmitted to the server via the user's device.

[0763] Step 7:

[0764] The server uses TensorFlow to analyze user feedback. The input is feedback data, and the output is new product suggestions or design changes based on that feedback. Specific data processing includes sentiment analysis and trend matching of the feedback.

[0765] Step 8:

[0766] The server redesigns the model based on the processing results and provides the updated 3D model to the user. The new design is reflected in the virtual space in real time, updating the user experience.

[0767] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0768] This invention is a system for users to design homes based on their lifestyle and personal needs, and it enhances the user experience by combining it with an emotional engine. Embodiments of this invention are described below.

[0769] First, the user uses a device to input information about their lifestyle, family structure, hobbies, and future life plans into the interface. The device then aggregates this input data and transmits it to a server using a secure communication method.

[0770] The server receives the transmitted information and provides it to the artificial intelligence agent. The AI ​​agent analyzes the input information and automatically generates a house design plan optimized for the user's needs. This design plan includes room layout, space usage, and design style.

[0771] Next, the server uses 3D modeling technology to create a virtual model of the designed house plan and visualizes it for the user in a virtual space. The user can then freely move around in the virtual space using a VR headset and view the created 3D model.

[0772] Furthermore, this system integrates an emotion engine. When a user takes a virtual tour, the terminal uses sensors such as cameras and microphones to capture the user's facial expressions and voice in real time, which the emotion engine then analyzes. The emotion engine infers the user's emotional state from the acquired data and evaluates which aspects the user is satisfied with and which aspects they are dissatisfied with.

[0773] Subsequently, the server redesigns itself by integrating this sentiment data with user feedback. For example, if a user has a positive reaction to the brightness of the design, it will maintain that characteristic while improving other aspects. Conversely, if the user's sentiment is negative, the server will identify the cause, propose changes to improve the design, and remodel it.

[0774] This process is repeated until the user is satisfied with their ideal home design, enabling the system to consistently deliver high-quality designs. By combining it with an emotional engine, it becomes possible to quickly create designs that more accurately reflect the user's latent desires.

[0775] The following describes the processing flow.

[0776] Step 1:

[0777] Users input information about their lifestyle, family structure, hobbies, and future life plans through the terminal's interface. The terminal aggregates this input data and transmits it to the server in a secure manner.

[0778] Step 2:

[0779] The server receives user information from the terminal and provides the data to the artificial intelligence agent. The AI ​​agent analyzes the input information and automatically generates a house design plan that matches the user's needs. At this stage, the room layout and design style are specifically determined.

[0780] Step 3:

[0781] The server visualizes the generated house design plans in a virtual space using 3D modeling technology. The 3D models are constructed so that users can experience them realistically in the virtual space.

[0782] Step 4:

[0783] Users wear a VR headset on their device and experience a three-dimensional model of a virtual space provided by the server. Users can move around within the space and examine the designed interior and room layout in detail.

[0784] Step 5:

[0785] During the user's experience, the device uses its built-in camera and microphone to capture the user's facial expressions and voice in real time. An emotion engine analyzes this data to determine the user's emotional state.

[0786] Step 6:

[0787] The emotion engine evaluates how the user feels about the model based on the analysis results and identifies positive or negative emotions. For example, if the user is satisfied with the spacious living room, a positive emotion will be detected.

[0788] Step 7:

[0789] After the user experiences the product and enters feedback into their device, the server combines this feedback with the analysis results from the emotion engine to readjust the design plan. A new design plan is generated, and the 3D model is rebuilt.

[0790] Step 8:

[0791] The server sends the redesigned 3D model to the user's terminal, and the user reviews the model again through a VR experience. This process is repeated until the user is satisfied. This iterative process ensures that the house design best meets the user's emotions and needs.

[0792] (Example 2)

[0793] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0794] To create homes that adapt to diverse modern lifestyles and personal needs, customizable plans that accurately reflect the elements users desire are essential. However, traditional design methods have difficulty taking into account users' emotional states and detailed feedback, making them insufficient to meet users' latent desires. Furthermore, the means of verifying the effectiveness of designs through real-time experiences in virtual environments are limited, posing challenges to rapid modification and improvement.

[0795] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0796] In this invention, the server includes a device for receiving information on lifestyle, family structure, hobbies, and future life plans; a device for automatically generating living space design plans using computer intelligence; and a device for performing emotional analysis based on opinions and proposing redesigns. This enables customizable housing designs that accurately reflect the user's specific needs and emotions.

[0797] The term "device" refers to a machine or system designed to perform a specific function.

[0798] "Computer intelligence" refers to the technology by which computer systems mimic intelligent activity, with the aim of analyzing data and solving problems.

[0799] A "living space design plan" refers to a design proposal for creating a living space based on the user's lifestyle and needs.

[0800] "Three-dimensional modeling technology" refers to the technology used to generate and visualize three-dimensional shapes on a computer.

[0801] A "virtual environment" refers to a digital space that is simulated by a computer and can be experienced by a user.

[0802] "Opinions" refer to feedback and reactions from users, including evaluations and suggestions regarding design and functionality.

[0803] "Sentiment analysis" refers to the process of analyzing data in order to evaluate and understand emotional states.

[0804] "Redesign" refers to the process of modifying or improving an existing design to generate a new design proposal.

[0805] This invention is a comprehensive system for designing customizable living spaces tailored to the individual lifestyles and needs of users. This system includes a server, terminals, and a user interface.

[0806] Users input detailed information about their lifestyle, family structure, hobbies, and future life plans into the interface using their devices. This information is entered using hardware such as laptops or tablets. This information is collected once and then transmitted to a server via a secure communication method.

[0807] The server analyzes this received data using computer intelligence, specifically a generative AI model. The data analysis utilizes algorithms designed to automate the creation of living space design plans based on user needs. For example, by leveraging deep learning technology, design plans that efficiently reflect user needs are generated.

[0808] The generated design plans are visualized in a virtual environment using 3D modeling technology by the server. Specific software used includes tools such as Blender and AutoCAD. Users can experience the generated 3D structures in the virtual environment using a VR headset.

[0809] Furthermore, sensors such as cameras and microphones are utilized on the device to analyze the user's facial expressions and voice in real time. This information is used for emotion analysis, and user feedback is immediately generated. The server then proposes a redesign, incorporating these emotion results and user feedback, and presents it again within the virtual environment.

[0810] As a concrete example, if a user wants a new living room design, the following prompt message is input into the AI ​​model:

[0811] "Please design a living room where I can relax with friends. I prefer a modern yet warm style with plenty of natural light."

[0812] This system allows users to easily design their ideal living space, taking their own emotions and feedback into consideration.

[0813] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0814] Step 1:

[0815] Users input information using a terminal. This input includes lifestyle, family structure, hobbies, and future life plans. This information is collected by the interface and compiled into a single integrated dataset. As output, this dataset is structured in JSON format.

[0816] Step 2:

[0817] The terminal sends the aggregated dataset to the server using a secure protocol (e.g., HTTPS). For enhanced security, the data is encrypted. The transmitted data is stored in the server's database.

[0818] Step 3:

[0819] The server retrieves data from the database and performs analysis using a generated AI model. During this process, the AI ​​model automatically generates a living space design plan tailored to the user's needs. The input consists of various user information, and the output is an optimized design plan.

[0820] Step 4:

[0821] The server models the generated design plan using 3D modeling technology. Software such as Blender is used for modeling. As output, 3D data for use in the virtual environment is generated.

[0822] Step 5:

[0823] The server integrates 3D data into the virtual environment system and performs rendering in real time. The user wears a VR headset to experience the virtual environment and verify the designed space. The output is a virtual space that the user can experience.

[0824] Step 6:

[0825] The device uses its camera and microphone to capture the user's facial expressions and voice in real time. The acquired data is processed by the device and passed to the emotion engine. The input is the user's biometric data, and the output is the evaluation result of their emotional state.

[0826] Step 7:

[0827] The server receives the results from the emotion engine and redesigns based on the feedback. The system uses a generative AI model to generate prompts and proposes an improved design. The output is updated 3D design data.

[0828] Step 8:

[0829] The server renders the redesigned 3D data again within the virtual environment and presents it to the user. This process is repeated until the user is satisfied. The final output is the ideal design that reflects the user's requirements.

[0830] (Application Example 2)

[0831] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0832] Currently, it is difficult to quickly and efficiently design individual homes that fully reflect the user's emotions and latent needs. Furthermore, there is a lack of means to directly utilize user feedback based on emotions to improve the design, and improvements are needed to enhance user satisfaction.

[0833] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0834] In this invention, the server includes means for receiving information from the user regarding lifestyle, family structure, hobbies, and future life plans; means for automatically generating a housing design plan using artificial intelligence based on the information; means for modeling the housing design plan using three-dimensional modeling means and visualizing it in a virtual space; means for the user to experience the three-dimensional model in the virtual space and provide feedback; means for analyzing the feedback, inferring the user's emotional state using an emotion engine, and improving the design plan; and means for redesigning based on the improvements and generating an optimized design plan. This enables rapid design improvements that more accurately reflect the user's potential needs.

[0835] "Lifestyle" is a general term for the way of life and habits of an individual or group, and includes daily activities, values, hobbies, and preferences.

[0836] "Family structure" refers to information indicating the number of family members and their relationships within a household, and is used to understand the form of that household.

[0837] A "hobby" refers to an activity or area of ​​interest that an individual pursues in their free time, and it influences their personality and lifestyle.

[0838] "Future life plans" refer to goals, objectives, and plans that an individual wants to achieve in their future life, and include things like housing and family plans.

[0839] "Artificial intelligence" is a technology in which computer systems imitate human intelligence and perform learning, reasoning, and problem-solving.

[0840] A "residential design plan" is a detailed plan that outlines the structure, layout, and design style of a house, with the aim of making optimal use of living space.

[0841] "Three-dimensional modeling" is a technique that allows for the three-dimensional representation of objects and spaces on a computer, enabling visual confirmation and analysis.

[0842] A "virtual space" refers to a digital environment created using computer technology, within which users can engage in activities and work.

[0843] "Feedback" refers to the opinions and reactions received from others as a result of a process or activity, and serves as fundamental information for making improvements.

[0844] An "emotion engine" refers to a system that analyzes data acquired from sensors, estimates an individual's emotional state, and then provides responses or suggestions appropriate to that emotion.

[0845] "Optimization" is a method of improving plans and processes and eliminating waste in order to obtain the most desirable results under specific conditions.

[0846] To implement this invention, the user first uses a terminal to input information about their lifestyle, family structure, hobbies, and future life plans. The terminal aggregates this input data and transmits it to a server using a secure communication method. The server receives the transmitted information and provides it to an artificial intelligence agent. The artificial intelligence agent analyzes the user's input information and automatically generates an optimized housing design plan based on it. This design plan includes room layout, space utilization, and design style.

[0847] The server uses 3D modeling technology to create a virtual model of the designed house plan and visualizes it in a virtual space. Users can move around in the virtual space using devices such as VR headsets and view the 3D model.

[0848] Furthermore, the system integrates an emotion engine. This emotion engine acquires the user's facial expressions and voice in real time through sensors such as cameras and microphones, and uses this information to infer their emotional state. While the user is taking a virtual tour, the emotion engine analyzes the acquired data and evaluates which aspects they are satisfied with and which aspects they are dissatisfied with.

[0849] The server redesigns the design based on this emotional data and user feedback. For example, if a user has a positive reaction to the living room design, it will improve other areas while maintaining those characteristics. On the other hand, if a negative reaction is detected, it will identify the cause, suggest changes to improve the design, and remodel it. An example of a prompt message would be, "Based on the user's facial expressions and voice data, analyze their emotional state towards this living room design and generate improvement suggestions." This process allows the user to refine the design with the system until they are satisfied with their ideal home design.

[0850] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0851] Step 1:

[0852] The user uses a device to input information about their lifestyle, family structure, hobbies, and future life plans into the interface. This information becomes the input data for the device. The device then aggregates this information and prepares it to be sent to the server.

[0853] Step 2:

[0854] The server receives the information sent from the terminal. The server converts this information into an appropriate format for input to the artificial intelligence agent and provides the data. This allows the artificial intelligence agent to analyze the user's input information.

[0855] Step 3:

[0856] The artificial intelligence agent analyzes information received from the server. Based on the input lifestyle, family structure, hobbies, and future life plans, it generates an optimized housing design plan. By using data analysis and algorithmic generative models, it can produce a concrete design plan as output.

[0857] Step 4:

[0858] The server inputs the generated house design plan into 3D modeling software and creates a virtual model. Through modeling, the house design plan is transformed into a state that can be visualized in three-dimensional space. This model is then output in a state that can be visually confirmed within the virtual space.

[0859] Step 5:

[0860] Users access a virtual space on a server using a VR headset installed on their device and experience a three-dimensional model. They can move around within the virtual space and examine each room and design. User feedback and opinions are input into the system.

[0861] Step 6:

[0862] The device uses its camera and microphone to capture the user's facial expressions and voice data in real time while the user explores the virtual space. This data is input into an emotion engine to infer the user's emotional state. This process analyzes what emotions the user feels towards which parts of the virtual space.

[0863] Step 7:

[0864] The server integrates analysis results from the emotion engine with user feedback to carry out a redesign process. While retaining design elements where positive emotions were detected, it adjusts elements associated with negative emotions based on specific improvement algorithms and outputs a new design plan.

[0865] Step 8:

[0866] The redesigned plan is again 3D modeled and provided from the server to the terminal for visual confirmation in the virtual space. The prompt message, "Based on the user's facial expressions and voice data, analyze their emotional state towards this living room design and generate improvement suggestions," assists in the implementation of the generated AI model. This process is repeated until the user is satisfied.

[0867] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0868] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0869] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0870] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0871] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. In the upper and lower directions of the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. Also, the upper side of the concentric circles is where "pleasant" emotions are located, and the lower side is where "unpleasant" emotions are located. In this way, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0872] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0873] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0874] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0875] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0876] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0877] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0878] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0879] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0880] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0881] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0882] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0883] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0884] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0885] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0886] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0887] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0888] The following is further disclosed regarding the embodiments described above.

[0889] (Claim 1)

[0890] A means of receiving information from users about their lifestyle, family structure, hobbies, and future life plans,

[0891] Based on the aforementioned information, a means for automatically generating a housing design plan using artificial intelligence,

[0892] A means for modeling the aforementioned residential design plan using three-dimensional modeling and visualizing it in a virtual space,

[0893] A means by which a user experiences a three-dimensional model in the aforementioned virtual space and provides feedback,

[0894] A means for redesigning based on the aforementioned feedback,

[0895] A system that includes this.

[0896] (Claim 2)

[0897] The system according to claim 1, wherein the redesign is performed automatically, and the three-dimensional model after the redesign is repeatedly provided in a virtual space.

[0898] (Claim 3)

[0899] The system according to claim 1, wherein the three-dimensional model is adaptable to building codes, environmental conditions, and market trends.

[0900] "Example 1"

[0901] (Claim 1)

[0902] Means of receiving lifestyle information from users,

[0903] A means for automatically generating a spatial design plan using data processing technology based on the aforementioned information,

[0904] A means for modeling the aforementioned spatial design plan using a three-dimensional structural method and visualizing it in a digital space,

[0905] A means for users to experience a three-dimensional structure in the aforementioned digital space and provide feedback,

[0906] Based on the above opinion, means of revising the plan,

[0907] A system that includes this.

[0908] (Claim 2)

[0909] The system according to claim 1, wherein the aforementioned modifications are performed automatically, and the modified three-dimensional structure is repeatedly provided in digital space.

[0910] (Claim 3)

[0911] The system according to claim 1, wherein the three-dimensional structure is adaptable to standard conditions, environmental conditions, and market trends.

[0912] "Application Example 1"

[0913] (Claim 1)

[0914] A means of receiving information from users about their lifestyle, family structure, hobbies, and future life plans,

[0915] Based on the aforementioned information, a means for automatically generating a design plan using artificial intelligence,

[0916] A means for modeling and visualizing the aforementioned design plan in a virtual space using three-dimensional modeling means,

[0917] A means by which the user experiences a three-dimensional model in the virtual space and provides a list of selected products and requests for desired changes regarding the interior design,

[0918] Based on the aforementioned change requests, a means of using artificial intelligence to execute product suggestions and design changes in real time,

[0919] A system that includes this.

[0920] (Claim 2)

[0921] The system according to claim 1, wherein a design is automatically performed based on the aforementioned change request, and the resulting three-dimensional model is repeatedly provided in a virtual space.

[0922] (Claim 3)

[0923] The system according to claim 1, wherein the three-dimensional model is adaptable to standards, environmental conditions, and market trends.

[0924] "Example 2 of combining an emotion engine"

[0925] (Claim 1)

[0926] A device that receives information from users about their lifestyle, family structure, hobbies, and future life plans,

[0927] Based on the aforementioned information, a device that automatically generates a living space design plan using computer intelligence,

[0928] A device that models the aforementioned living space design plan using three-dimensional modeling technology and visualizes it in a virtual environment,

[0929] A device that allows users to experience a three-dimensional structure in the virtual environment and provide feedback,

[0930] Based on the aforementioned opinions, a device is provided that performs emotional analysis and proposes a redesign.

[0931] A device that presents a redesigned three-dimensional structure again in a virtual environment,

[0932] A system that includes this.

[0933] (Claim 2)

[0934] The system according to claim 1, wherein the redesign is performed automatically, and the three-dimensional structure after the redesign is repeatedly presented in a virtual environment.

[0935] (Claim 3)

[0936] The system according to claim 1, wherein the three-dimensional structure is adaptable to construction standards, environmental conditions, and market trends.

[0937] "Application example 2 when combining with an emotional engine"

[0938] (Claim 1)

[0939] A means of receiving information from users about their lifestyle, family structure, hobbies, and future life plans,

[0940] Based on the aforementioned information, a means for automatically generating a housing design plan using artificial intelligence,

[0941] A means for modeling the aforementioned residential design plan using three-dimensional modeling and visualizing it in a virtual space,

[0942] A means by which a user experiences a three-dimensional model in the aforementioned virtual space and provides feedback,

[0943] A means for analyzing the aforementioned feedback, using an emotion engine to infer the user's emotional state, and improving the design plan,

[0944] A means for redesigning and generating an optimized design plan based on the aforementioned improvements,

[0945] A system that includes this.

[0946] (Claim 2)

[0947] The system according to claim 1, wherein the redesign is performed automatically, and the three-dimensional model after the redesign is repeatedly provided in a virtual space.

[0948] (Claim 3)

[0949] The system according to claim 1, wherein the three-dimensional model is adaptable to building codes, environmental conditions, and market trends, and is further optimized to reflect the emotional state of the user. [Explanation of symbols]

[0950] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of receiving information from users about their lifestyle, family structure, hobbies, and future life plans, Based on the aforementioned information, a means for automatically generating a design plan using artificial intelligence, A means for modeling and visualizing the aforementioned design plan in a virtual space using three-dimensional modeling means, A means by which the user experiences a three-dimensional model in the virtual space and provides a list of selected products and requests for desired changes regarding the interior design, Based on the aforementioned change requests, a means of using artificial intelligence to execute product suggestions and design changes in real time, A system that includes this.

2. The system according to claim 1, wherein a design is automatically performed based on the aforementioned change request, and the resulting three-dimensional model is repeatedly provided in a virtual space.

3. The system according to claim 1, wherein the three-dimensional model is adaptable to standards, environmental conditions, and market trends.

Images