System

The system addresses the inefficiencies of traditional construction by using AI-generated blueprints and 3D printing to quickly and cost-effectively build structures that meet user specifications with real-time progress tracking.

JP2026028747APending Publication Date: 2026-02-20SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024131363
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-07
Publication Date
2026-02-20

AI Technical Summary

Technical Problem

Traditional construction methods are expensive, time-consuming, and difficult to adapt to diverse user needs, with challenges in reflecting user requests during architectural design and centrally monitoring progress.

Method used

A system that allows users to input architectural wishes and specifications, uses a specialized AI to generate blueprints, incorporates legal and technical checks, and employs a 3D printer to construct buildings while providing real-time progress updates.

Benefits of technology

Enables quick, low-cost construction that meets individual user needs with real-time progress monitoring, reducing time and cost from design to completion.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026028747000001_ABST
    Figure 2026028747000001_ABST
Patent Text Reader

Abstract

A system is provided.SOLUTION: The system of claim 1, further comprising: means for transmitting the generated blueprint to an architect to check and correct the blueprint from a legal and technical point of view; means for allowing the user to confirm the checked and corrected blueprint; means for forming an architectural structure using a 3D printer based on the blueprint; and means for providing the user with a progress status of the architectural structure in real time. AI.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Traditional construction methods are expensive and time-consuming, making it difficult to quickly respond to diverse user needs. It is also difficult to reflect user requests in detail during the architectural design stage. Furthermore, because multiple processes are involved, it is difficult to centrally monitor the progress of construction. This creates the challenge of making it difficult to realize fast, low-cost construction based on individual user requests. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means: A means for allowing users to input their architectural wishes and specifications is provided, and a means for collecting the input data and saving it in a database is provided. A means for a specialized architectural generation AI to automatically generate blueprints based on the saved data is provided, and a means for sending the generated blueprints to an architect for legal and technical checks and corrections is also provided. Next, a means for allowing the user to review the blueprints after checking and corrections have been completed is provided. Furthermore, a system is constructed that utilizes a means for using a 3D printer to create a building based on the blueprints, and includes a means for providing the user with real-time updates on the progress of construction. This makes it possible to respond quickly to user requests and provide high-quality buildings at low cost.

[0006] A "user" is an individual or legal entity that logs into the system and inputs their building wishes and specifications.

[0007] An "architect" is a qualified professional who checks and corrects the generated blueprints from legal and technical perspectives.

[0008] "Architecture-specialized generative AI" is an artificial intelligence that automatically generates architectural blueprints based on user requirements data.

[0009] A "database" is a digital record system for storing information such as architectural preferences and specifications collected from users.

[0010] A "blueprint" is a drawing created by a generative AI, checked and corrected by an architect, and showing in detail the specific structure of a building.

[0011] A 3D printer is a machine that forms buildings by discharging and layering special mortar while moving a nozzle horizontally based on a blueprint.

[0012] A "building" is a structure generated by a 3D printer based on the user's wishes and blueprints.

[0013] "Progress" is status information that indicates how much of the building has been completed by the 3D printer.

[0014] "Real time" refers to a situation in which information is transmitted almost simultaneously with little time delay.

[0015] The "system" refers to a structure that integrates a series of means to generate blueprints based on user requirements, create buildings using a 3D printer, and provide real-time progress updates. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. The invention combines building-specific generation AI and 3D printing technology to efficiently generate buildings.

[0038] System Overview

[0039] 1. Obtaining user information and gathering requirements

[0040] User: Logs into the system and enters the necessary information for construction through the interface, including the desired number of rooms, design style, budget, and construction site information.

[0041] Server: Takes user input and stores it in a database, formatting it and converting it into a format that can be easily used for further processing.

[0042] 2. Automatic generation of blueprints

[0043] Server: Retrieves user requirements data from the database and passes it to the building-specific generation AI.

[0044] Generative AI: Automatically generates optimal design drawings based on user requirements. This process involves creating plans while referencing certain design standards and past design data.

[0045] Server: Temporarily stores the generated blueprints and later sends them to the architect.

[0046] 3. Check and correct the design drawings

[0047] Server: Sends the generated blueprints to the architect's device.

[0048] Terminal (Architect): Checks the blueprints from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprints to the server.

[0049] Server: Re-saves the modified blueprint and sends it to the user for confirmation.

[0050] 4. Final Review and Approval

[0051] User: Checks the design and gives final approval, which is sent to the server.

[0052] Server: Officially sends the user-approved design to the 3D printing system.

[0053] 5. 3D Printed Architecture

[0054] 3D printer: Based on blueprint data, a special mortar is continuously dispensed by moving the nozzle horizontally, forming layers to form buildings. The printer adjusts the layering pattern and amount of material used, progressing the construction according to the plan.

[0055] 6. Share your progress

[0056] 3D printer: Uses sensors and logs data to record construction progress.

[0057] Server: Collects progress data in real time and provides it to the user's device, allowing the user to check the progress of the construction at any time.

[0058] Specific examples

[0059] 1. Example of user information entry

[0060] User: Enters into the system, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen."

[0061] 2. Automatic generation and checking of blueprints

[0062] Server: Requests a design plan from the generative AI based on the user's data.

[0063] Generative AI: Generates a plan step by step, automatically creating a blueprint with a living room, kitchen, and bathroom on the first floor, and three bedrooms and a balcony on the second floor.

[0064] Terminal (Architect): Checks blueprints and confirms and modifies building standards and safety. For example, modifies the number of columns based on earthquake resistance standards.

[0065] 3. Final Review and Approval

[0066] User: Checks the revised design drawings and gives final approval, saying, "Please proceed with this design."

[0067] 4. 3D Printed Architecture

[0068] 3D printer: Based on the approved blueprint, construction proceeds from the ground up. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day.

[0069] 5. Share your progress

[0070] Server: Notifies the user in real time, "The foundation for the first floor has been completed. Construction of the second floor is currently underway."

[0071] This is the implementation form of this system. Designs that meet the user's needs are provided quickly and efficiently, and the construction progress can be checked in real time, which enables significant cost and time savings.

[0072] The processing flow will be explained below.

[0073] Step 1:

[0074] User: Logs in to the system and enters their architectural wishes and specifications, such as the number of rooms required, design style, budget, and construction site information.

[0075] Step 2:

[0076] Server: Collects input data from users and saves it in a database. Each input item is stored in the database in the specified format.

[0077] Step 3:

[0078] Server: Retrieves user requirements data from the database and passes it to the architecture-specific generation AI. It extracts the user requirements and converts them into a format that the AI ​​can understand.

[0079] Step 4:

[0080] Generation AI (on the server): Automatically generates blueprints based on the user's requirements. During generation, it references a database of past data, design standards, and regional characteristics to create the optimal plan.

[0081] Step 5:

[0082] Server: Temporarily stores the generated blueprints and sends them to the architect for review. The blueprint data and related information are sent as a package.

[0083] Step 6:

[0084] Terminal (Architect): Review blueprints and perform legal and technical checks. View blueprints and perform checks using checklists based on structural stability and building codes.

[0085] Step 7:

[0086] Terminal (Architect): After checking, if any corrections are necessary, make the necessary changes to the blueprint. Send the corrected blueprint to the server.

[0087] Step 8:

[0088] Server: Receives the modified blueprint and sends it to the user for confirmation.

[0089] Step 9:

[0090] User: Review and approve the blueprint. Review the blueprint and add comments if necessary.

[0091] Step 10:

[0092] Server: Sends the design, which has received the user's final approval, to the 3D printing system. It analyzes the design data and converts it into a format that can be sent to the printer.

[0093] Step 11:

[0094] 3D printer: Based on a blueprint, a nozzle moves horizontally to dispense a special mortar, layering it up to form a building. The printer determines the order in which each layer is formed and calculates the amount of mortar to be used.

[0095] Step 12:

[0096] 3D printer: The construction progress is collected based on sensors and log data, and the progress is recorded sequentially, allowing the printer to move on to the next step.

[0097] Step 13:

[0098] Server: Periodically collects progress data and provides it to the user's device in real time. It records the progress of each building part in detail and provides it to the user in text and graphic format.

[0099] Step 14:

[0100] User: See progress in real time on their device, track progress and send feedback to the server if necessary.

[0101] Example 1

[0102] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0103] A major issue with traditional construction projects is the significant time and cost required from the start of design to the actual completion of construction. In particular, it is difficult to quickly respond to diverse user requests and specifications, making the design and revision process cumbersome and inefficient. Another problem is that progress management is time-consuming, making it difficult for users to grasp the status in real time.

[0104] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0105] In this invention, the server includes: a means for inputting user requests and specifications for a building; a means for collecting the input data and saving it in an information database; a means for a building-specific generation AI to automatically generate blueprints based on the saved data; a means for sending prompts to the generation AI and generating blueprints; a means for sending the generated blueprints to an architect for legal and technical review and correction; a means for saving the corrected blueprints and allowing the user to review them; a means for creating a building using a 3D printer based on the blueprints; and a means for providing the user with real-time construction progress updates. This allows for quick and efficient response to user requests and specifications, significantly reducing the time and cost from design to construction. Furthermore, real-time progress management allows users to constantly monitor the progress of construction.

[0106] "User" refers to the user of the system who inputs architectural wishes and specifications.

[0107] "Server" refers to a central system that collects, stores, and processes user information over the Internet.

[0108] "Desires and specifications" refers to the specific requirements for the building the user desires (number of rooms, design style, budget, construction site information, etc.).

[0109] "Information Database" refers to a digital storage system for storing collected user information and data related to the design process.

[0110] "Architecture-specialized generative AI" is an artificial intelligence program specialized in the field of architecture, and has the ability to automatically generate blueprints based on the user's wishes and specifications.

[0111] A "prompt sentence" refers to the input sentence when requesting a construction-specialized generation AI to generate a blueprint.

[0112] "Blueprints" refers to drawings or plans that show the design and structure of a building.

[0113] An "architect" is a specialist who checks the generated blueprints from a legal and technical perspective and makes any necessary corrections.

[0114] "Modification" refers to the process of making changes or revisions to the generated design drawings from legal and technical perspectives.

[0115] A "3D printer" is a device that creates actual buildings by layering materials such as mortar based on digital blueprints.

[0116] "Progress" refers to the progress of each stage of a construction project.

[0117] "Real-time" refers to the near-instantaneous reflection and display of ongoing activities and conditions.

[0118] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. The invention combines building-specific generation AI and 3D printing technology to efficiently generate buildings.

[0119] The system is implemented using the following hardware and software:

[0120] 1. Server:

[0121] The server plays a central role in receiving input from users, storing it in a database, and generating prompts for the generative AI.

[0122] 2. Terminal:

[0123] A device used by architects to check and correct blueprints, specifically a PC or tablet with CAD software installed.

[0124] 3. User Device:

[0125] The device that users use to access the system and enter their preferences and specifications. This can include smartphones, tablets, and PCs.

[0126] 4. Architecture-specific generative AI:

[0127] The AI ​​model automatically generates blueprints based on prompts sent from the server, and references past architectural design data and certain design standards.

[0128] 5. 3D Printer:

[0129] This refers to hardware that uses special mortar to form buildings based on submitted blueprints.

[0130] Implementation details

[0131] Obtaining user information and gathering requirements

[0132] Users log in to the system and enter the necessary information for construction through the interface, including the desired number of rooms, design style, budget, and construction site information.

[0133] Example: "I want to build a modern, two-story house with four rooms within a budget of 50 million yen."

[0134] The server receives user input and stores the data in an information database, where it is formatted and converted into a form that can be easily used for further processing.

[0135] Automatic generation of blueprints

[0136] The server retrieves the user's requirements data from the database and passes it to the building-specialized generation AI.

[0137] Example prompt: "The user's desired building is a two-story house with four rooms and a modern design. The budget is within 50 million yen."

[0138] The generative AI automatically generates optimal design drawings based on the user's requirements, and in this process creates plans while referencing certain design standards and past design data.

[0139] For example, the first floor will have a living room, kitchen and bathroom, while the second floor will have three bedrooms and a balcony.

[0140] The server temporarily stores the generated blueprints and later sends them to the architect.

[0141] Check and correct blueprints

[0142] The server transmits the generated design drawings to the architect's terminal.

[0143] The terminal (architect) checks the blueprint from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprint to the server.

[0144] Example: Modifying the number of columns based on seismic standards.

[0145] The server re-stores the modified blueprint and sends it to the user for confirmation.

[0146] Final review and approval

[0147] The user checks the design and gives final approval, which is then sent to the server.

[0148] For example: "Please proceed with this design."

[0149] The server officially sends the user-approved design to the 3D printing system.

[0150] 3D printed architecture

[0151] Based on blueprint data, the 3D printer forms a building by continuously ejecting and layering special mortar while moving the nozzle horizontally.

[0152] Example: Complete the foundation of the first floor in one day and build the second floor the next day.

[0153] Share your progress

[0154] The 3D printer uses sensors and logs data to record the construction progress.

[0155] The server collects progress data in real time and provides it to the user's terminal.

[0156] Example: "The foundations for the first floor are complete. Construction of the second floor is currently underway."

[0157] This system allows us to respond quickly and efficiently to the diverse needs and specifications of our users, significantly reducing the time and cost required from design to construction. Furthermore, it allows for real-time management of progress, allowing users to constantly monitor the progress of construction.

[0158] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0159] Step 1:

[0160] The user uses the interface to input their architectural preferences and specifications (number of rooms, design style, budget, construction site information, etc.). Specifically, the user logs in with their account, fills in the required information in the input form, and clicks the submit button. This input data is used for the next process.

[0161] Input: Your wishes and specifications

[0162] Output: Send data to the server

[0163] Step 2:

[0164] The server receives the user's input data and stores it in an information database, formatting the data and converting it into a format that is easy to handle for subsequent processing. Specifically, the server receives an HTTP request and executes a query to insert the data into the database.

[0165] Input: Data submitted by the user

[0166] Output: Formatted data stored in a database

[0167] Step 3:

[0168] The server retrieves the user's requirements data from the database and passes the data to the architecture-specific generation AI. Specifically, the server executes periodic queries, loads the necessary data into a cache, and sends prompts to the generation AI's API.

[0169] Input: Formatted data stored in the database

[0170] Output: The prompt sent to the generation AI

[0171] Step 4:

[0172] The AI ​​automatically generates optimal blueprints based on the prompts. During this process, the AI ​​creates plans while referencing certain design standards and past design data. Specifically, the AI ​​uses its internal algorithms to generate blueprints and sends them back to the server in digital format.

[0173] Input: Prompt text sent from the server

[0174] Output: Generated blueprint

[0175] Step 5:

[0176] The server temporarily stores the generated blueprints and later sends them to the architect. Specifically, the server stores the blueprint data in temporary storage and prepares an HTTP request to the architect's terminal for the next step.

[0177] Input: Blueprint sent from the generation AI

[0178] Output: Temporarily saved blueprint data

[0179] Step 6:

[0180] The server sends the generated design data to the architect's terminal. Specifically, the server encodes the data and executes an HTTP request to the architect's terminal.

[0181] Input: Temporarily saved blueprint data

[0182] Output: Blueprint data sent to the architect's terminal

[0183] Step 7:

[0184] The terminal (architect) checks the blueprint from legal and technical perspectives and makes any necessary corrections. Specifically, the architect opens the blueprint using CAD software and makes any necessary corrections. Once the corrections are complete, the corrected blueprint data is uploaded to the server.

[0185] Input: Blueprint data sent from the server

[0186] Output: Modified blueprint data

[0187] Step 8:

[0188] The server stores the modified blueprint data again and sends it to the user for confirmation. Specifically, the server stores the modified data in the database and then sends a notification to the user's terminal.

[0189] Input: Modified blueprint data

[0190] Output: The revised design is sent to the user's device.

[0191] Step 9:

[0192] The user checks the revised design and gives final approval. The approval information is sent to the server. Specifically, the user previews the design on the interface and clicks the "Approve" button. This action is sent as data to the server.

[0193] Input: Modified design notified to user

[0194] Output: Authorization information sent to the server

[0195] Step 10:

[0196] The server officially sends the user-approved design to the 3D printing system. Specifically, the server encodes the design data and sends an HTTP request to the 3D printer's control system.

[0197] Input: Authorization information sent by the user

[0198] Output: Design data sent to the 3D printing system

[0199] Step 11:

[0200] The 3D printer creates buildings by continuously discharging special mortar while moving the nozzle horizontally based on the blueprint data, and layering it up. Specifically, the printer operates according to the blueprint data to form each layer.

[0201] Input: Blueprint data sent from the server

[0202] Output: Physical building constructed

[0203] Step 12:

[0204] The 3D printer uses sensors and log data to record the progress of the construction. Specifically, the 3D printer uses built-in sensors to collect data in real time and sends the log to a server.

[0205] Input: Sensor data collected during the building process

[0206] Output: Progress data sent to the server

[0207] Step 13:

[0208] The server collects progress data in real time and provides it to the user's terminal, and specifically, the server processes the collected data and displays it on the user's interface in real time.

[0209] Input: Progress data sent from the 3D printer

[0210] Output: Progress notification displayed on the user's terminal

[0211] The above are the details of the specific processing steps in this system. Each step is closely linked to realize a fast and efficient construction process based on the user's wishes.

[0212] (Application example 1)

[0213] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0214] In conventional construction processes, designing and constructing a building based on a user's wishes and specifications requires a great deal of time and money. Furthermore, making design changes and checking progress is time-consuming and burdensome for users. The purpose of this invention is to solve these problems and provide a system that allows users to easily customize building designs and check progress in real time.

[0215] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0216] In this invention, the server includes means for inputting building requests and specifications from users, means for collecting the input data and saving it in a database, means for a building-specialized generation AI to automatically generate blueprints based on the saved data, means for sending the generated blueprints to an architect for legal and technical checks and corrections, means for the user to review the blueprints after checking and corrections have been completed, means for forming a building using a 3D printer based on the blueprints, means for providing the user with real-time construction progress information, and means for the user to input requirements and check the construction progress via a smartphone, thereby enabling users to quickly and efficiently design and construct buildings.

[0217] "User" refers to a general user who inputs their wishes and specifications regarding the design and construction of a building and checks its progress.

[0218] "Architectural wishes and specifications" are specific requirements and conditions such as the number of rooms, design style, budget, and information about the construction site of the building desired by the user.

[0219] The "database" is an information management system for managing and storing architectural wishes and specifications entered by users.

[0220] "Architecture-specialized generative AI" is an artificial intelligence technology that automatically generates optimal blueprints based on the architectural wishes and specifications entered by the user.

[0221] "Blueprints" are detailed drawings used when designing a building, automatically generated by architecturally specialized generation AI and used by architects to check and correct.

[0222] An "architect" is a specialist who checks the generated blueprints from legal and technical perspectives and makes any necessary corrections.

[0223] A 3D printer is a device that forms buildings by continuously discharging and layering special mortar while moving a nozzle horizontally based on blueprint data.

[0224] "Progress" is information that indicates the current stage of the design and construction of a building, and is provided to the user in real time.

[0225] A "smartphone" is a portable information terminal device that allows users to input their wishes and specifications regarding construction and check the progress of construction.

[0226] The system for implementing this invention allows users to input their wishes and specifications via smartphone, and then a specialized architectural generation AI automatically generates blueprints based on that information, providing a process for actually creating the building using a 3D printer. This system is composed of multiple pieces of hardware and software, including a server, a user terminal, an architect terminal, and a 3D printer.

[0227] The server collects architectural specifications (such as the number of rooms, design style, budget, and construction site information) entered by the user via smartphone and stores them in a database. Next, a specialized architectural generation AI automatically generates blueprints based on this data. This AI generates a plan that best suits the user's requirements, referencing certain design standards and past design data.

[0228] The generated blueprints are sent to the architect's terminal and checked from legal and technical perspectives. During this process, it is confirmed whether the design complies with regulations and satisfies safety standards such as earthquake resistance. After the architect has completed the revisions, the blueprints are sent to the user via the server for confirmation.

[0229] The user can review the generated and revised blueprints via their smartphone and provide final approval. This approval information is then sent to the server, which then sends the blueprints to the 3D printing system. The 3D printer then moves the nozzle horizontally, continuously discharging a special mortar to layer the structure to create a building based on the blueprint.

[0230] The 3D printer also uses sensors and log data to record the progress of construction, and the server collects this data in real time and provides it to the user's smartphone, allowing the user to check the progress of construction at any time.

[0231] Specific examples

[0232] For example, a user might enter on their smartphone, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This information is collected and stored on the server, and a specialized architectural generation AI automatically generates a blueprint with a living room, kitchen, and bathroom on the first floor, and three bedrooms and a balcony on the second floor. The blueprint is then sent to an architect, who makes any necessary revisions after legal and technical checks, and the revised blueprint is then reviewed by the user again. Once the user has finally approved the blueprint, the 3D printer begins construction, and the user is notified of the progress in real time.

[0233] Prompt Sentence Examples

[0234] "User's desired building requirements:

[0235] Number of rooms: 4

[0236] Design Style: Modern

[0237] Budget: Under 50 million yen

[0238] Location: Tokyo

[0239] Generate the optimal design plan based on this.

[0240] In this way, by using this system, users can design and construct buildings quickly and efficiently, and can check the progress in real time, thereby reducing costs and time.

[0241] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0242] Step 1:

[0243] Users use their smartphones to input their wishes and specifications regarding the building. Specifically, the user enters requirements information such as "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen" into an input form on their smartphone. This input data is sent from the user to the server.

[0244] Step 2:

[0245] The server receives the data of the user's wishes and specifications and stores it in a database. During the storage process, the data is formatted and converted into the required format, making it easier to handle in subsequent processing.

[0246] Step 3:

[0247] The server retrieves the user's requirements data from the database and passes that data to the architecture-specialized generation AI. Specifically, requirements such as "number of rooms: 4, design style: modern, budget: within 50 million yen, location: Tokyo" are entered into the generation AI. The generation AI then automatically generates blueprints based on this data.

[0248] Step 4:

[0249] The generative AI model generates optimal design drawings based on the user's requirements data. In doing so, it automatically creates plans while referencing past design data and certain design standards. Once the design drawing data is generated, it is sent to a server and temporarily stored.

[0250] Step 5:

[0251] The server then sends the generated blueprint data to the architect's terminal. The architect then checks the blueprints received on the terminal from legal and technical perspectives and makes any necessary modifications. For example, the architect may increase the number of columns to comply with earthquake resistance standards or check legal regulations. The modified blueprints are then sent back to the server.

[0252] Step 6:

[0253] The server receives the revised blueprints sent by the architect and sends them to the user for confirmation. The user then checks the blueprints via their smartphone and performs final approval. If the user approves the blueprints, the information is sent back to the server.

[0254] Step 7:

[0255] The server then sends the approved design data to the 3D printing system. The 3D printer then moves the nozzle horizontally based on the design data, continuously discharging a special mortar and layering it to form the building. Specifically, it builds the foundation for the first floor, then stacks the second floor.

[0256] Step 8:

[0257] The 3D printer records the construction progress using sensors and log data. As the construction progresses, it sends the current progress status to the server, which collects this progress data in real time and provides it to the user.

[0258] Step 9:

[0259] Users can check the construction progress in real time via their smartphones. Specifically, they will receive updates on the construction status, such as "The foundations for the first floor have been completed. Construction of the second floor is currently underway."

[0260] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0261] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. In particular, it provides a system that enables architectural designs that are more in line with the preferences of individual users by combining it with an emotion engine that recognizes the user's emotions.

[0262] System Overview

[0263] 1. Acquiring user information and recognizing emotions

[0264] User: Logs in to the system and inputs their wishes and specifications, including the number of rooms required, design style, budget, and construction site information.

[0265] Emotion engine (on the server): Analyzes the user's input information and recognizes the user's emotions. Emotions are acquired using, for example, text analysis and facial expression recognition technology.

[0266] Server: Stores the emotion data collected by the emotion engine in a database along with the user's preferences and specifications.

[0267] 2. Automatic generation of blueprints

[0268] Server: Based on the user's wishes, specifications, and emotional data, it passes this to a specialized construction generation AI.

[0269] Generative AI: Automatically generates blueprints that better suit the user's preferences based on user requirements and sentiment data. This process references a database of past data, design standards, and local characteristics to create the optimal plan.

[0270] Server: Temporarily stores the generated blueprints and associated emotion data, then transmits them to the architect.

[0271] 3. Check and correct the design drawings

[0272] Server: Sends the generated blueprints to the architect's device.

[0273] Terminal (Architect): Checks the blueprints from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprints to the server.

[0274] Server: Save the modified blueprint again and send it to the user for confirmation.

[0275] 4. Final Review and Approval

[0276] User: Review the revised design and give final approval, for example by entering approval information and any additional comments.

[0277] Server: Officially sends the user-approved design to the 3D printing system.

[0278] 5. 3D Printed Architecture

[0279] 3D printer: Based on blueprint data, the nozzle moves horizontally to continuously dispense special mortar, layering it to form a building. The order in which each layer is formed and the amount of material used are automatically adjusted.

[0280] 6. Share your progress

[0281] 3D printer: Construction progress is collected based on sensors and log data.

[0282] Server: Collects progress data periodically and provides it to users in real time, allowing users to check the progress of their construction at any time.

[0283] Specific examples

[0284] 1. Example of user information entry

[0285] User: "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." At the same time, the emotion engine detects "feelings of anticipation and excitement" from the user's sentence.

[0286] 2. Automatic generation and checking of blueprints

[0287] Server: Requests a design plan from the generative AI based on user data and emotional data.

[0288] Generative AI: Reflects the user's positive emotions and automatically generates blueprints including a bright and spacious living room.

[0289] Terminal (Architect): Checks the blueprints and confirms and modifies building standards and safety. For example, modifies the number of columns based on earthquake resistance standards.

[0290] 3. Final Review and Approval

[0291] User: Checks the revised design drawings and gives final approval, saying, "Please proceed with this design."

[0292] 4. 3D Printed Architecture

[0293] 3D printer: Based on the approved blueprint, construction proceeds from the ground up. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day.

[0294] 5. Share your progress

[0295] Server: Notifies the user in real time, "The foundation for the first floor has been completed. Construction of the second floor is currently underway."

[0296] In this way, by combining the emotion engine, it becomes possible to design and build structures that better reflect the user's emotions and preferences, and to provide buildings that provide greater satisfaction. In addition, the progress of construction can be checked in real time, which increases the user's sense of security.

[0297] The processing flow will be explained below.

[0298] Step 1:

[0299] User: Logs into the system and enters their architectural wishes and specifications, such as the number of rooms required, design style, budget, and construction location.

[0300] Step 2:

[0301] Emotion engine (on the server): Analyzes user input information in real time and recognizes the user's emotions. For example, it performs text analysis and facial expression recognition to identify emotions such as "expectation" and "excitement."

[0302] Step 3:

[0303] Server: Collects user inputs such as preferences and specifications, as well as recognized emotional data, formats them, and stores them in a database.

[0304] Step 4:

[0305] Server: Obtains user preferences, specifications, and emotional data from the database and passes them to the specialized architectural generation AI.

[0306] Step 5:

[0307] Generative AI (on the server): Automatically generates blueprints based on the user's wishes and emotional data. For example, if a user requests a "bright living room" and the emotional engine detects the emotion of "expectation and excitement," it will create a blueprint that includes a living room with spacious windows and bright colors.

[0308] Step 6:

[0309] Server: Temporarily stores the generated blueprints and then sends them to the architect.

[0310] Step 7:

[0311] Terminal (architect): Receives blueprints and checks them from legal and technical perspectives. For example, checks whether they comply with the Building Standards Act and whether earthquake resistance is appropriate based on a checklist.

[0312] Step 8:

[0313] Terminal (architect): After checking, make any necessary modifications to the blueprint. For example, change the size of a window to improve safety. Once the modifications are complete, send the modified blueprint back to the server.

[0314] Step 9:

[0315] Server: Receives the modified blueprint and sends it to the user for confirmation.

[0316] Step 10:

[0317] User: Checks the design and gives final approval. For example, if the user views the design and is satisfied with the overall design, they submit a comment such as "Please proceed with this design" and their approval.

[0318] Step 11:

[0319] Server: After receiving the user's final approval, the design is officially sent to the 3D printing system.

[0320] Step 12:

[0321] 3D printer: Based on a blueprint, a nozzle moves horizontally to dispense special mortar, layering it up to form a building. For example, starting with the foundation, the first floor walls are constructed, followed by the second floor walls.

[0322] Step 13:

[0323] 3D printer: The progress of construction is collected based on sensors and log data. For example, when the first floor walls are completed, that information is collected and the next step is started.

[0324] Step 14:

[0325] Server: Periodically collects progress data and provides it to the user's device in real time. For example, it sends a notification such as, "The foundation of the first floor has been completed. Construction of the second floor is currently underway."

[0326] Step 15:

[0327] Users: View the construction progress in real time on their devices, for example, via a smartphone app or web interface, and provide comments and feedback as needed.

[0328] Example 2

[0329] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0330] Conventional architectural design systems often struggle to fully reflect the user's feelings and preferences, even when users input their wishes and specifications, resulting in low user satisfaction. Furthermore, there are limited ways to check the construction progress in real time, often resulting in a lack of security for users. Another issue is the time-consuming and cumbersome process of checking and correcting blueprints.

[0331] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for inputting the user's wishes and specifications regarding construction and the user's emotional data, a means for collecting the input data and emotional data and storing them in a database, and a means for the construction-specific generation AI to automatically generate blueprints based on the stored data and emotional data. This enables the automatic generation of blueprints that reflect the user's emotions and preferences, thereby improving user satisfaction. Furthermore, the system has a function for checking the construction progress in real time, which increases the user's sense of security. Furthermore, the overall time can be reduced by streamlining the process of checking and correcting blueprints by construction professionals.

[0332] A "user" is someone who uses the system to input information about a desired building, generate blueprints, and check the progress of construction.

[0333] "Emotion data" is data that indicates the user's emotions and preferences, analyzed from information entered by the user and facial expressions.

[0334] "Architecture-specialized generative AI" is an artificial intelligence model that automatically generates blueprints for buildings based on the user's wishes, specifications, and emotional data.

[0335] A "database" is an electronic storage device for storing user input information, emotional data, generated blueprints, and so on.

[0336] "Architectural professionals" are experts who check and correct the generated blueprints from legal and technical perspectives.

[0337] An "architectural professional terminal" is a computer or device used by an architectural professional to review and modify blueprints.

[0338] A "3D printer" is a device that continuously constructs buildings using layered materials based on blueprints.

[0339] "Laminated materials" are building materials used in 3D printers that are continuously ejected through a nozzle.

[0340] "Means of providing information in real time" refers to a system that collects information on the progress of construction as it occurs and notifies users immediately.

[0341] This invention relates to a system that provides buildings quickly and at low cost based on user wishes and specifications. In particular, it provides a system that enables architectural design according to individual user preferences by combining it with an emotion engine that recognizes user emotions. Specific embodiments of this invention are described below.

[0342] 1. Acquiring user information and recognizing emotions

[0343] User

[0344] A user logs into the system and inputs information about the building they want. For example, they might input, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This allows the system to obtain the user's specific wishes and specifications.

[0345] server

[0346] The server sends the information entered by the user to the emotion engine. The emotion engine uses natural language processing APIs, such as IBM Watson or Microsoft Azure Cognitive Services, to analyze the user's input text and facial expression data and recognize the user's emotions. For example, it detects "feelings of anticipation and excitement." Based on this, the server stores the user's wishes, specifications, and emotional data in a database.

[0347] 2. Automatic generation of blueprints

[0348] server

[0349] The server passes the user's wishes, specifications, and emotional data to a generative AI model specialized for architecture (e.g., OpenAI GPT-4) and requests a design plan. The generative AI then references this data, as well as past design data and regional characteristic data, to generate a design plan tailored to the user's preferences.

[0350] Generation AI

[0351] The generative AI automatically generates blueprints, including a bright and spacious living room, reflecting the user's positive emotions. This process utilizes a database of past data, design standards, and local characteristics. The generated blueprints and emotion data are temporarily stored on a server and then sent to the architect's device.

[0352] 3. Check and correct the design drawings

[0353] server

[0354] The server transmits the generated design drawings to the terminal of the construction professional.

[0355] Terminal (Architectural Professional)

[0356] The architect's terminal checks the blueprints from legal and technical standpoints and makes any necessary modifications, such as increasing the number of columns to comply with earthquake resistance standards. Once the modifications are complete, the blueprints are sent back to the server.

[0357] 4. Final Review and Approval

[0358] User

[0359] The user checks the revised design drawing and gives final approval by saying, "Please proceed with this design." The server receives the user's approval information and sends the approved design drawing data to the 3D printing system.

[0360] 5. 3D Printed Architecture

[0361] 3D printer

[0362] The 3D printer builds the building in order, starting from the base, based on the blueprint data. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day. The horizontal movement of the nozzle and the amount of material used are automatically adjusted. The server periodically records the 3D printer's operation log and progress.

[0363] 6. Share your progress

[0364] server

[0365] The server collects the construction progress status in real time based on the sensor and log data collected by the 3D printer. This allows the server to notify the user of the construction progress in real time. For example, the server may inform the user that "The foundation of the first floor has been completed. Construction of the second floor is currently underway." This allows the user to check the construction progress at any time, giving them peace of mind.

[0366] Specific examples

[0367] In response to the prompt, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen," the AI ​​automatically generates a blueprint that includes a bright and spacious living room. The blueprint is then revised by an architectural professional based on earthquake resistance standards, and once the user has approved it, construction begins using a 3D printer.

[0368] In this way, a system incorporating an emotion engine enables highly accurate architectural designs that reflect the user's emotions and preferences, and construction progress is shared in real time, greatly improving user satisfaction.

[0369] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0370] Step 1:

[0371] A user logs into the system and inputs their wishes and specifications for the building. For example, they might input, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This is sent as the initial input data. The server receives the wishes and specifications entered by the user and sends them to the emotion engine. The emotion engine performs text analysis and facial expression recognition to recognize the user's emotions. For example, "feelings of anticipation and excitement" are detected based on the text analysis. The server then stores the user's wishes, specifications, and emotion data in a database.

[0372] Input: User's wishes and specifications (e.g., "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen.")

[0373] Output: Desires, specifications, and emotional data are saved in a database

[0374] Step 2:

[0375] The server passes the user's wishes, specifications, and emotional data stored in the database to an architecture-specific generative AI model and requests a design plan. The generative AI model analyzes the input data and references past design data and regional characteristic data to automatically generate a blueprint tailored to the user's preferences. For example, the generative AI reflects positive emotions and generates a blueprint that includes a bright and spacious living room. The server temporarily stores the generated blueprint and emotional data, and then sends it to the architecture professional's device.

[0376] Input: User's wishes, specifications, and emotional data

[0377] Output: Automatically generated blueprints by generative AI

[0378] Step 3:

[0379] The server sends the generated blueprint to the architectural professional's terminal. The architectural professional reviews the blueprint from legal and technical perspectives and makes any necessary modifications, such as increasing the number of columns based on earthquake resistance standards. Once the modifications are complete, the blueprint is sent back to the server. The server stores the modified blueprint in a database and sends it to the user for confirmation.

[0380] Input: Auto-generated blueprint

[0381] Output: Blueprints revised by the architectural profession

[0382] Step 4:

[0383] The user checks the revised design drawing and gives final approval by saying, "Please proceed with this design." The server receives the user's approval information and sends the approved design drawing data to the 3D printing system.

[0384] Input: Modified blueprint

[0385] Output: User approval information and approved design data sent to the 3D printing system

[0386] Step 5:

[0387] The 3D printer builds the building from the ground up based on the blueprint data. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day. The horizontal movement of the nozzle and the amount of material used are automatically adjusted. The server regularly records the 3D printer's operation log and progress.

[0388] Input: Approved design data

[0389] Output: Physical construction, progress log data

[0390] Step 6:

[0391] The 3D printer collects construction progress information based on sensor and log data. The server collects progress data in real time and notifies the user. For example, the server may inform the user that "The foundations for the first floor have been completed. Construction of the second floor is currently underway." This allows the user to check the construction progress at any time.

[0392] Input: Progress log data

[0393] Output: Real-time notification to the user

[0394] (Application example 2)

[0395] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0396] In the traditional building design and construction process, while it was possible to reflect the user's wishes and specifications, it was difficult to propose designs that took the user's emotions into consideration. Furthermore, there was no user experience utilizing virtual space, and users lacked a means to visually confirm the contents of the blueprints. This created a high possibility that the final building would not meet the user's expectations, resulting in a decrease in satisfaction.

[0397] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0398] In this invention, the server includes a means for recognizing a user's emotions, a means for an architecture-specific generation AI to automatically generate blueprints based on the recognized emotion data and stored data, and a means for the user to visualize and experience the generated blueprints in a virtual space. This makes it possible to propose designs that reflect the user's emotions, and the user can visually check the blueprints in a virtual space, making it possible to provide buildings that are highly satisfying.

[0399] A "user" is an entity that uses the system to input the building's wishes and specifications.

[0400] "Specifications" refers to the specific conditions and requirements for the building desired by the user.

[0401] "Emotion" refers to the psychological state or state of mind that the user expresses when entering input, and is recognized by the system.

[0402] "Emotion recognition" refers to the technology of analyzing and understanding a user's psychological state from facial expressions, voice, etc.

[0403] "Architecture-specialized generative AI" refers to artificial intelligence technology specialized for automatically generating blueprints for buildings.

[0404] A "blueprint" is a drawing that shows the specific shape, structure, and layout of a building.

[0405] An "architect" is a specialist who checks the blueprints of buildings from legal and technical perspectives and makes corrections as necessary.

[0406] A "3D printer" is a machine that layers materials to create three-dimensional buildings and structures.

[0407] "Virtual space" refers to a space that is virtually constructed using computer graphics, etc.

[0408] "Real-time" refers to events being processed simultaneously with little delay after they occur.

[0409] "Visualization" is the conversion of data or information into a visible form such as graphics or images.

[0410] "User experience" refers to the experience and satisfaction that users gain from using a system.

[0411] This invention is a system that proposes and constructs buildings based on the user's wishes and specifications. In particular, it aims to increase user satisfaction by recognizing emotions and allowing users to visualize and experience blueprints in a virtual space. Specific embodiments are shown below.

[0412] System Configuration

[0413] This system mainly uses the following hardware and software:

[0414] Hardware: Smartphones, smart glasses, head-mounted displays, 3D printers

[0415] Software: Camera API, voice recognition API, emotion recognition AI tools (e.g., Microsoft Azure Emotion API, Google Cloud Vision), generative AI specialized for architecture (e.g., GPT-4, DALL-E), virtual space display software (e.g., Unity, Unreal Engine)

[0416] Acquiring user information and recognizing emotions

[0417] Users log in to the system using a smartphone or smart glasses and enter their preferences and specifications. When entering information, the device's camera captures the user's facial expressions, and the microphone accepts voice input. This data is acquired by the camera API and voice recognition API and sent to the emotion recognition AI tool. The emotion recognition AI tool analyzes the user's emotions in real time and stores them as emotion data on the server.

[0418] Automatic generation of blueprints

[0419] The server then passes the collected emotional data and the user's wishes and specifications to a generative AI specialized for architecture. The generative AI model (e.g., GPT-4, DALL-E) references past data and building standards to automatically generate blueprints that reflect the user's emotions. These blueprints are then stored on the server and sent to the architect.

[0420] Check and correct blueprints

[0421] The architect uses the terminal to check the submitted blueprints from legal and technical standpoints and make any necessary corrections. The corrected blueprints are then sent back to the server and provided to the user for review.

[0422] Final confirmation and virtual experience

[0423] Users visualize and experience the blueprint in a virtual space using a head-mounted display. They can visually review the design and request changes. The server receives this feedback and passes the data back to the generative AI model to generate revisions.

[0424] 3D printed architecture

[0425] Finally, the 3D printer creates the building based on the user-approved design. The 3D printer moves the nozzle horizontally, continuously discharging a special mortar and layering it to create the structure.

[0426] Share your progress

[0427] The progress of construction is collected in real time by the server based on sensor and log data and provided to the user, allowing the user to check the progress of the construction at any time.

[0428] Specific examples

[0429] If a user inputs "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen," and the emotion engine detects the emotion of "expectation and excitement," the server collects this information as emotional data and desired specifications. Based on this, the server sends a prompt to the generative AI model: "Generate a modern, two-story house with four rooms, budget under 50 million yen. User feels excited and has high expectations." This generates a blueprint. An architect then reviews and revises the blueprint, and the final blueprint is visualized for the user in a virtual space. In this way, it is possible to provide a design that reflects the user's emotions.

[0430] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0431] Step 1:

[0432] A user logs into the system using a smartphone or smart glasses and inputs their preferences and specifications. The user's facial expressions are captured using a camera API, and their voice is picked up using a microphone. These data are sent to the server through a voice recognition API. Input data includes the number of rooms, design style, budget, and building site information. As output, the server receives the user's preferences and specifications data, as well as the captured facial and voice data.

[0433] Step 2:

[0434] The server passes the received facial and voice data to an emotion recognition AI tool (e.g., Microsoft Azure Emotion API, Google Cloud Vision). The emotion recognition AI analyzes this data and recognizes the user's emotions. The input is facial and voice data, and the output is emotion data (e.g., "expectation and excitement").

[0435] Step 3:

[0436] The server stores the user's preferences, specification data, and emotion data in a database. The stored data includes the number of rooms, design style, budget, construction site information, and emotion data. The stored data is generated as an output.

[0437] Step 4:

[0438] The server generates a prompt sentence based on the collected data and passes it to an architecture-specific generative AI (e.g., GPT-4, DALL-E). An example prompt sentence is "Generate a modern, two-story house with 4 rooms, budget under 50 million yen. User feels excited and has high expectations." The input is the saved user specifications and emotional data, and the output is the generated prompt sentence.

[0439] Step 5:

[0440] The generative AI model automatically generates a blueprint for a building based on the given prompt. The input is the prompt, and the output is the automatically generated blueprint. The generated blueprint is then sent back to the server.

[0441] Step 6:

[0442] The server sends the generated blueprints to the architect's terminal, where the architect checks them from legal and technical perspectives and makes corrections as necessary. The input is the automatically generated blueprint, and the output is the corrected blueprint.

[0443] Step 7:

[0444] The modified blueprint is sent back to the server and provided to the user for confirmation. The user checks the blueprint in the virtual space using a head-mounted display. The input is the modified blueprint, and the output is the user's feedback and confirmation information.

[0445] Step 8:

[0446] After user confirmation, the final blueprint is stored on the server and sent to the 3D printer, which then creates a building based on the blueprint. The input is the final confirmed blueprint, and the output is the actual building.

[0447] Step 9:

[0448] The server collects sensor data from the 3D printer to provide real-time information to the user. This information is periodically updated and sent to the user's device. The input is sensor data, and the output is progress notification to the user.

[0449] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0450] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0451] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0452] [Second embodiment]

[0453] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0454] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0455] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0456] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0457] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0458] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0459] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0460] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0461] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0462] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0463] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0464] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0465] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. The invention combines building-specific generation AI and 3D printing technology to efficiently generate buildings.

[0466] System Overview

[0467] 1. Obtaining user information and gathering requirements

[0468] User: Logs into the system and enters the necessary information for construction through the interface, including the desired number of rooms, design style, budget, and construction site information.

[0469] Server: Takes user input and stores it in a database, formatting it and converting it into a format that can be easily used for further processing.

[0470] 2. Automatic generation of blueprints

[0471] Server: Retrieves user requirements data from the database and passes it to the building-specific generation AI.

[0472] Generative AI: Automatically generates optimal design drawings based on user requirements. This process involves creating plans while referencing certain design standards and past design data.

[0473] Server: Temporarily stores the generated blueprints and later sends them to the architect.

[0474] 3. Check and correct the design drawings

[0475] Server: Sends the generated blueprints to the architect's device.

[0476] Terminal (Architect): Checks the blueprints from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprints to the server.

[0477] Server: Re-saves the modified blueprint and sends it to the user for confirmation.

[0478] 4. Final Review and Approval

[0479] User: Checks the design and gives final approval, which is sent to the server.

[0480] Server: Officially sends the user-approved design to the 3D printing system.

[0481] 5. 3D Printed Architecture

[0482] 3D printer: Based on blueprint data, a special mortar is continuously dispensed by moving the nozzle horizontally, forming layers to form buildings. The printer adjusts the layering pattern and amount of material used, progressing the construction according to the plan.

[0483] 6. Share your progress

[0484] 3D printer: Uses sensors and logs data to record construction progress.

[0485] Server: Collects progress data in real time and provides it to the user's device, allowing the user to check the progress of the construction at any time.

[0486] Specific examples

[0487] 1. Example of user information entry

[0488] User: Enters into the system, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen."

[0489] 2. Automatic generation and checking of blueprints

[0490] Server: Requests a design plan from the generative AI based on the user's data.

[0491] Generative AI: Generates a plan step by step, automatically creating a blueprint with a living room, kitchen, and bathroom on the first floor, and three bedrooms and a balcony on the second floor.

[0492] Terminal (Architect): Checks blueprints and confirms and modifies building standards and safety. For example, modifies the number of columns based on earthquake resistance standards.

[0493] 3. Final Review and Approval

[0494] User: Checks the revised design drawings and gives final approval, saying, "Please proceed with this design."

[0495] 4. 3D Printed Architecture

[0496] 3D printer: Based on the approved blueprint, construction proceeds from the ground up. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day.

[0497] 5. Share your progress

[0498] Server: Notifies the user in real time, "The foundation for the first floor has been completed. Construction of the second floor is currently underway."

[0499] This is the implementation form of this system. Designs that meet the user's needs are provided quickly and efficiently, and the construction progress can be checked in real time, which enables significant cost and time savings.

[0500] The processing flow will be explained below.

[0501] Step 1:

[0502] User: Logs in to the system and enters their architectural wishes and specifications, such as the number of rooms required, design style, budget, and construction site information.

[0503] Step 2:

[0504] Server: Collects input data from users and saves it in a database. Each input item is stored in the database in the specified format.

[0505] Step 3:

[0506] Server: Retrieves user requirements data from the database and passes it to the architecture-specific generation AI. It extracts the user requirements and converts them into a format that the AI ​​can understand.

[0507] Step 4:

[0508] Generation AI (on the server): Automatically generates blueprints based on the user's requirements. During generation, it references a database of past data, design standards, and regional characteristics to create the optimal plan.

[0509] Step 5:

[0510] Server: Temporarily stores the generated blueprints and sends them to the architect for review. The blueprint data and related information are sent as a package.

[0511] Step 6:

[0512] Terminal (Architect): Review blueprints and perform legal and technical checks. View blueprints and perform checks using checklists based on structural stability and building codes.

[0513] Step 7:

[0514] Terminal (Architect): After checking, if any corrections are necessary, make the necessary changes to the blueprint. Send the corrected blueprint to the server.

[0515] Step 8:

[0516] Server: Receives the modified blueprint and sends it to the user for confirmation.

[0517] Step 9:

[0518] User: Review and approve the blueprint. Review the blueprint and add comments if necessary.

[0519] Step 10:

[0520] Server: Sends the design, which has received the user's final approval, to the 3D printing system. It analyzes the design data and converts it into a format that can be sent to the printer.

[0521] Step 11:

[0522] 3D printer: Based on a blueprint, a nozzle moves horizontally to dispense a special mortar, layering it up to form a building. The printer determines the order in which each layer is formed and calculates the amount of mortar to be used.

[0523] Step 12:

[0524] 3D printer: The construction progress is collected based on sensors and log data, and the progress is recorded sequentially, allowing the printer to move on to the next step.

[0525] Step 13:

[0526] Server: Periodically collects progress data and provides it to the user's device in real time. It records the progress of each building part in detail and provides it to the user in text and graphic format.

[0527] Step 14:

[0528] User: See progress in real time on their device, track progress and send feedback to the server if necessary.

[0529] Example 1

[0530] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0531] A major issue with traditional construction projects is the significant time and cost required from the start of design to the actual completion of construction. In particular, it is difficult to quickly respond to diverse user requests and specifications, making the design and revision process cumbersome and inefficient. Another problem is that progress management is time-consuming, making it difficult for users to grasp the status in real time.

[0532] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0533] In this invention, the server includes: a means for inputting user requests and specifications for a building; a means for collecting the input data and saving it in an information database; a means for a building-specific generation AI to automatically generate blueprints based on the saved data; a means for sending prompts to the generation AI and generating blueprints; a means for sending the generated blueprints to an architect for legal and technical review and correction; a means for saving the corrected blueprints and allowing the user to review them; a means for creating a building using a 3D printer based on the blueprints; and a means for providing the user with real-time construction progress updates. This allows for quick and efficient response to user requests and specifications, significantly reducing the time and cost from design to construction. Furthermore, real-time progress management allows users to constantly monitor the progress of construction.

[0534] "User" refers to the user of the system who inputs architectural wishes and specifications.

[0535] "Server" refers to a central system that collects, stores, and processes user information over the Internet.

[0536] "Desires and specifications" refers to the specific requirements for the building the user desires (number of rooms, design style, budget, construction site information, etc.).

[0537] "Information Database" refers to a digital storage system for storing collected user information and data related to the design process.

[0538] "Architecture-specialized generative AI" is an artificial intelligence program specialized in the field of architecture, and has the ability to automatically generate blueprints based on the user's wishes and specifications.

[0539] A "prompt sentence" refers to the input sentence when requesting a construction-specialized generation AI to generate a blueprint.

[0540] "Blueprints" refers to drawings or plans that show the design and structure of a building.

[0541] An "architect" is a specialist who checks the generated blueprints from a legal and technical perspective and makes any necessary corrections.

[0542] "Modification" refers to the process of making changes or revisions to the generated design drawings from legal and technical perspectives.

[0543] A "3D printer" is a device that creates actual buildings by layering materials such as mortar based on digital blueprints.

[0544] "Progress" refers to the progress of each stage of a construction project.

[0545] "Real-time" refers to the near-instantaneous reflection and display of ongoing activities and conditions.

[0546] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. The invention combines building-specific generation AI and 3D printing technology to efficiently generate buildings.

[0547] The system is implemented using the following hardware and software:

[0548] 1. Server:

[0549] The server plays a central role in receiving input from users, storing it in a database, and generating prompts for the generative AI.

[0550] 2. Terminal:

[0551] A device used by architects to check and correct blueprints, specifically a PC or tablet with CAD software installed.

[0552] 3. User Device:

[0553] The device that users use to access the system and enter their preferences and specifications. This can include smartphones, tablets, and PCs.

[0554] 4. Architecture-specific generative AI:

[0555] The AI ​​model automatically generates blueprints based on prompts sent from the server, and references past architectural design data and certain design standards.

[0556] 5. 3D Printer:

[0557] This refers to hardware that uses special mortar to form buildings based on submitted blueprints.

[0558] Implementation details

[0559] Obtaining user information and gathering requirements

[0560] Users log in to the system and enter the necessary information for construction through the interface, including the desired number of rooms, design style, budget, and construction site information.

[0561] Example: "I want to build a modern, two-story house with four rooms within a budget of 50 million yen."

[0562] The server receives user input and stores the data in an information database, where it is formatted and converted into a form that can be easily used for further processing.

[0563] Automatic generation of blueprints

[0564] The server retrieves the user's requirements data from the database and passes it to the building-specialized generation AI.

[0565] Example prompt: "The user's desired building is a two-story house with four rooms and a modern design. The budget is within 50 million yen."

[0566] The generative AI automatically generates optimal design drawings based on the user's requirements, and in this process creates plans while referencing certain design standards and past design data.

[0567] For example, the first floor will have a living room, kitchen and bathroom, while the second floor will have three bedrooms and a balcony.

[0568] The server temporarily stores the generated blueprints and later sends them to the architect.

[0569] Check and correct blueprints

[0570] The server transmits the generated design drawings to the architect's terminal.

[0571] The terminal (architect) checks the blueprint from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprint to the server.

[0572] Example: Modifying the number of columns based on seismic standards.

[0573] The server re-stores the modified blueprint and sends it to the user for confirmation.

[0574] Final review and approval

[0575] The user checks the design and gives final approval, which is then sent to the server.

[0576] For example: "Please proceed with this design."

[0577] The server officially sends the user-approved design to the 3D printing system.

[0578] 3D printed architecture

[0579] Based on blueprint data, the 3D printer forms a building by continuously ejecting and layering special mortar while moving the nozzle horizontally.

[0580] Example: Complete the foundation of the first floor in one day and build the second floor the next day.

[0581] Share your progress

[0582] The 3D printer uses sensors and logs data to record the construction progress.

[0583] The server collects progress data in real time and provides it to the user's terminal.

[0584] Example: "The foundations for the first floor are complete. Construction of the second floor is currently underway."

[0585] This system allows us to respond quickly and efficiently to the diverse needs and specifications of our users, significantly reducing the time and cost required from design to construction. Furthermore, it allows for real-time management of progress, allowing users to constantly monitor the progress of construction.

[0586] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0587] Step 1:

[0588] The user uses the interface to input their architectural preferences and specifications (number of rooms, design style, budget, construction site information, etc.). Specifically, the user logs in with their account, fills in the required information in the input form, and clicks the submit button. This input data is used for the next process.

[0589] Input: Your wishes and specifications

[0590] Output: Send data to the server

[0591] Step 2:

[0592] The server receives the user's input data and stores it in an information database, formatting the data and converting it into a format that is easy to handle for subsequent processing. Specifically, the server receives an HTTP request and executes a query to insert the data into the database.

[0593] Input: Data submitted by the user

[0594] Output: Formatted data stored in a database

[0595] Step 3:

[0596] The server retrieves the user's requirements data from the database and passes the data to the architecture-specific generation AI. Specifically, the server executes periodic queries, loads the necessary data into a cache, and sends prompts to the generation AI's API.

[0597] Input: Formatted data stored in the database

[0598] Output: The prompt sent to the generation AI

[0599] Step 4:

[0600] The AI ​​automatically generates optimal blueprints based on the prompts. During this process, the AI ​​creates plans while referencing certain design standards and past design data. Specifically, the AI ​​uses its internal algorithms to generate blueprints and sends them back to the server in digital format.

[0601] Input: Prompt text sent from the server

[0602] Output: Generated blueprint

[0603] Step 5:

[0604] The server temporarily stores the generated blueprints and later sends them to the architect. Specifically, the server stores the blueprint data in temporary storage and prepares an HTTP request to the architect's terminal for the next step.

[0605] Input: Blueprint sent from the generation AI

[0606] Output: Temporarily saved blueprint data

[0607] Step 6:

[0608] The server sends the generated design data to the architect's terminal. Specifically, the server encodes the data and executes an HTTP request to the architect's terminal.

[0609] Input: Temporarily saved blueprint data

[0610] Output: Blueprint data sent to the architect's terminal

[0611] Step 7:

[0612] The terminal (architect) checks the blueprint from legal and technical perspectives and makes any necessary corrections. Specifically, the architect opens the blueprint using CAD software and makes any necessary corrections. Once the corrections are complete, the corrected blueprint data is uploaded to the server.

[0613] Input: Blueprint data sent from the server

[0614] Output: Modified blueprint data

[0615] Step 8:

[0616] The server stores the modified blueprint data again and sends it to the user for confirmation. Specifically, the server stores the modified data in the database and then sends a notification to the user's terminal.

[0617] Input: Modified blueprint data

[0618] Output: The revised design is sent to the user's device.

[0619] Step 9:

[0620] The user checks the revised design and gives final approval. The approval information is sent to the server. Specifically, the user previews the design on the interface and clicks the "Approve" button. This action is sent as data to the server.

[0621] Input: Modified design notified to user

[0622] Output: Authorization information sent to the server

[0623] Step 10:

[0624] The server officially sends the user-approved design to the 3D printing system. Specifically, the server encodes the design data and sends an HTTP request to the 3D printer's control system.

[0625] Input: Authorization information sent by the user

[0626] Output: Design data sent to the 3D printing system

[0627] Step 11:

[0628] The 3D printer creates buildings by continuously discharging special mortar while moving the nozzle horizontally based on the blueprint data, and layering it up. Specifically, the printer operates according to the blueprint data to form each layer.

[0629] Input: Blueprint data sent from the server

[0630] Output: Physical building constructed

[0631] Step 12:

[0632] The 3D printer uses sensors and log data to record the progress of the construction. Specifically, the 3D printer uses built-in sensors to collect data in real time and sends the log to a server.

[0633] Input: Sensor data collected during the building process

[0634] Output: Progress data sent to the server

[0635] Step 13:

[0636] The server collects progress data in real time and provides it to the user's terminal, and specifically, the server processes the collected data and displays it on the user's interface in real time.

[0637] Input: Progress data sent from the 3D printer

[0638] Output: Progress notification displayed on the user's terminal

[0639] The above are the details of the specific processing steps in this system. Each step is closely linked to realize a fast and efficient construction process based on the user's wishes.

[0640] (Application example 1)

[0641] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0642] In conventional construction processes, designing and constructing a building based on a user's wishes and specifications requires a great deal of time and money. Furthermore, making design changes and checking progress is time-consuming and burdensome for users. The purpose of this invention is to solve these problems and provide a system that allows users to easily customize building designs and check progress in real time.

[0643] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0644] In this invention, the server includes means for inputting building requests and specifications from users, means for collecting the input data and saving it in a database, means for a building-specialized generation AI to automatically generate blueprints based on the saved data, means for sending the generated blueprints to an architect for legal and technical checks and corrections, means for the user to review the blueprints after checking and corrections have been completed, means for forming a building using a 3D printer based on the blueprints, means for providing the user with real-time construction progress information, and means for the user to input requirements and check the construction progress via a smartphone, thereby enabling users to quickly and efficiently design and construct buildings.

[0645] "User" refers to a general user who inputs their wishes and specifications regarding the design and construction of a building and checks its progress.

[0646] "Architectural wishes and specifications" are specific requirements and conditions such as the number of rooms, design style, budget, and information about the construction site of the building desired by the user.

[0647] The "database" is an information management system for managing and storing architectural wishes and specifications entered by users.

[0648] "Architecture-specialized generative AI" is an artificial intelligence technology that automatically generates optimal blueprints based on the architectural wishes and specifications entered by the user.

[0649] "Blueprints" are detailed drawings used when designing a building, automatically generated by architecturally specialized generation AI and used by architects to check and correct.

[0650] An "architect" is a specialist who checks the generated blueprints from legal and technical perspectives and makes any necessary corrections.

[0651] A 3D printer is a device that forms buildings by continuously discharging and layering special mortar while moving a nozzle horizontally based on blueprint data.

[0652] "Progress" is information that indicates the current stage of the design and construction of a building, and is provided to the user in real time.

[0653] A "smartphone" is a portable information terminal device that allows users to input their wishes and specifications regarding construction and check the progress of construction.

[0654] The system for implementing this invention allows users to input their wishes and specifications via smartphone, and then a specialized architectural generation AI automatically generates blueprints based on that information, providing a process for actually creating the building using a 3D printer. This system is composed of multiple pieces of hardware and software, including a server, a user terminal, an architect terminal, and a 3D printer.

[0655] The server collects architectural specifications (such as the number of rooms, design style, budget, and construction site information) entered by the user via smartphone and stores them in a database. Next, a specialized architectural generation AI automatically generates blueprints based on this data. This AI generates a plan that best suits the user's requirements, referencing certain design standards and past design data.

[0656] The generated blueprints are sent to the architect's terminal and checked from legal and technical perspectives. During this process, it is confirmed whether the design complies with regulations and satisfies safety standards such as earthquake resistance. After the architect has completed the revisions, the blueprints are sent to the user via the server for confirmation.

[0657] The user can review the generated and revised blueprints via their smartphone and provide final approval. This approval information is then sent to the server, which then sends the blueprints to the 3D printing system. The 3D printer then moves the nozzle horizontally, continuously discharging a special mortar to layer the structure to create a building based on the blueprint.

[0658] The 3D printer also uses sensors and log data to record the progress of construction, and the server collects this data in real time and provides it to the user's smartphone, allowing the user to check the progress of construction at any time.

[0659] Specific examples

[0660] For example, a user might enter on their smartphone, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This information is collected and stored on the server, and a specialized architectural generation AI automatically generates a blueprint with a living room, kitchen, and bathroom on the first floor, and three bedrooms and a balcony on the second floor. The blueprint is then sent to an architect, who makes any necessary revisions after legal and technical checks, and the revised blueprint is then reviewed by the user again. Once the user has finally approved the blueprint, the 3D printer begins construction, and the user is notified of the progress in real time.

[0661] Prompt Sentence Examples

[0662] "User's desired building requirements:

[0663] Number of rooms: 4

[0664] Design Style: Modern

[0665] Budget: Under 50 million yen

[0666] Location: Tokyo

[0667] Generate the optimal design plan based on this.

[0668] In this way, by using this system, users can design and construct buildings quickly and efficiently, and can check the progress in real time, thereby reducing costs and time.

[0669] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0670] Step 1:

[0671] Users use their smartphones to input their wishes and specifications regarding the building. Specifically, the user enters requirements information such as "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen" into an input form on their smartphone. This input data is sent from the user to the server.

[0672] Step 2:

[0673] The server receives the data of the user's wishes and specifications and stores it in a database. During the storage process, the data is formatted and converted into the required format, making it easier to handle in subsequent processing.

[0674] Step 3:

[0675] The server retrieves the user's requirements data from the database and passes that data to the architecture-specialized generation AI. Specifically, requirements such as "number of rooms: 4, design style: modern, budget: within 50 million yen, location: Tokyo" are entered into the generation AI. The generation AI then automatically generates blueprints based on this data.

[0676] Step 4:

[0677] The generative AI model generates optimal design drawings based on the user's requirements data. In doing so, it automatically creates plans while referencing past design data and certain design standards. Once the design drawing data is generated, it is sent to a server and temporarily stored.

[0678] Step 5:

[0679] The server then sends the generated blueprint data to the architect's terminal. The architect then checks the blueprints received on the terminal from legal and technical perspectives and makes any necessary modifications. For example, the architect may increase the number of columns to comply with earthquake resistance standards or check legal regulations. The modified blueprints are then sent back to the server.

[0680] Step 6:

[0681] The server receives the revised blueprints sent by the architect and sends them to the user for confirmation. The user then checks the blueprints via their smartphone and performs final approval. If the user approves the blueprints, the information is sent back to the server.

[0682] Step 7:

[0683] The server then sends the approved design data to the 3D printing system. The 3D printer then moves the nozzle horizontally based on the design data, continuously discharging a special mortar and layering it to form the building. Specifically, it builds the foundation for the first floor, then stacks the second floor.

[0684] Step 8:

[0685] The 3D printer records the construction progress using sensors and log data. As the construction progresses, it sends the current progress status to the server, which collects this progress data in real time and provides it to the user.

[0686] Step 9:

[0687] Users can check the construction progress in real time via their smartphones. Specifically, they will receive updates on the construction status, such as "The foundations for the first floor have been completed. Construction of the second floor is currently underway."

[0688] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0689] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. In particular, it provides a system that enables architectural designs that are more in line with the preferences of individual users by combining it with an emotion engine that recognizes the user's emotions.

[0690] System Overview

[0691] 1. Acquiring user information and recognizing emotions

[0692] User: Logs in to the system and inputs their wishes and specifications, including the number of rooms required, design style, budget, and construction site information.

[0693] Emotion engine (on the server): Analyzes the user's input information and recognizes the user's emotions. Emotions are acquired using, for example, text analysis and facial expression recognition technology.

[0694] Server: Stores the emotion data collected by the emotion engine in a database along with the user's preferences and specifications.

[0695] 2. Automatic generation of blueprints

[0696] Server: Based on the user's wishes, specifications, and emotional data, it passes this to a specialized construction generation AI.

[0697] Generative AI: Automatically generates blueprints that better suit the user's preferences based on user requirements and sentiment data. This process references a database of past data, design standards, and local characteristics to create the optimal plan.

[0698] Server: Temporarily stores the generated blueprints and associated emotion data, then transmits them to the architect.

[0699] 3. Check and correct the design drawings

[0700] Server: Sends the generated blueprints to the architect's device.

[0701] Terminal (Architect): Checks the blueprints from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprints to the server.

[0702] Server: Save the modified blueprint again and send it to the user for confirmation.

[0703] 4. Final Review and Approval

[0704] User: Review the revised design and give final approval, for example by entering approval information and any additional comments.

[0705] Server: Officially sends the user-approved design to the 3D printing system.

[0706] 5. 3D Printed Architecture

[0707] 3D printer: Based on blueprint data, the nozzle moves horizontally to continuously dispense special mortar, layering it to form a building. The order in which each layer is formed and the amount of material used are automatically adjusted.

[0708] 6. Share your progress

[0709] 3D printer: Construction progress is collected based on sensors and log data.

[0710] Server: Collects progress data periodically and provides it to users in real time, allowing users to check the progress of their construction at any time.

[0711] Specific examples

[0712] 1. Example of user information entry

[0713] User: "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." At the same time, the emotion engine detects "feelings of anticipation and excitement" from the user's sentence.

[0714] 2. Automatic generation and checking of blueprints

[0715] Server: Requests a design plan from the generative AI based on user data and emotional data.

[0716] Generative AI: Reflects the user's positive emotions and automatically generates blueprints including a bright and spacious living room.

[0717] Terminal (Architect): Checks the blueprints and confirms and modifies building standards and safety. For example, modifies the number of columns based on earthquake resistance standards.

[0718] 3. Final Review and Approval

[0719] User: Checks the revised design drawings and gives final approval, saying, "Please proceed with this design."

[0720] 4. 3D Printed Architecture

[0721] 3D printer: Based on the approved blueprint, construction proceeds from the ground up. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day.

[0722] 5. Share your progress

[0723] Server: Notifies the user in real time, "The foundation for the first floor has been completed. Construction of the second floor is currently underway."

[0724] In this way, by combining the emotion engine, it becomes possible to design and build structures that better reflect the user's emotions and preferences, and to provide buildings that provide greater satisfaction. In addition, the progress of construction can be checked in real time, which increases the user's sense of security.

[0725] The processing flow will be explained below.

[0726] Step 1:

[0727] User: Logs into the system and enters their architectural wishes and specifications, such as the number of rooms required, design style, budget, and construction location.

[0728] Step 2:

[0729] Emotion engine (on the server): Analyzes user input information in real time and recognizes the user's emotions. For example, it performs text analysis and facial expression recognition to identify emotions such as "expectation" and "excitement."

[0730] Step 3:

[0731] Server: Collects user inputs such as preferences and specifications, as well as recognized emotional data, formats them, and stores them in a database.

[0732] Step 4:

[0733] Server: Obtains user preferences, specifications, and emotional data from the database and passes them to the specialized architectural generation AI.

[0734] Step 5:

[0735] Generative AI (on the server): Automatically generates blueprints based on the user's wishes and emotional data. For example, if a user requests a "bright living room" and the emotional engine detects the emotion of "expectation and excitement," it will create a blueprint that includes a living room with spacious windows and bright colors.

[0736] Step 6:

[0737] Server: Temporarily stores the generated blueprints and then sends them to the architect.

[0738] Step 7:

[0739] Terminal (architect): Receives blueprints and checks them from legal and technical perspectives. For example, checks whether they comply with the Building Standards Act and whether earthquake resistance is appropriate based on a checklist.

[0740] Step 8:

[0741] Terminal (architect): After checking, make any necessary modifications to the blueprint. For example, change the size of a window to improve safety. Once the modifications are complete, send the modified blueprint back to the server.

[0742] Step 9:

[0743] Server: Receives the modified blueprint and sends it to the user for confirmation.

[0744] Step 10:

[0745] User: Checks the design and gives final approval. For example, if the user views the design and is satisfied with the overall design, they submit a comment such as "Please proceed with this design" and their approval.

[0746] Step 11:

[0747] Server: After receiving the user's final approval, the design is officially sent to the 3D printing system.

[0748] Step 12:

[0749] 3D printer: Based on a blueprint, a nozzle moves horizontally to dispense special mortar, layering it up to form a building. For example, starting with the foundation, the first floor walls are constructed, followed by the second floor walls.

[0750] Step 13:

[0751] 3D printer: The progress of construction is collected based on sensors and log data. For example, when the first floor walls are completed, that information is collected and the next step is started.

[0752] Step 14:

[0753] Server: Periodically collects progress data and provides it to the user's device in real time. For example, it sends a notification such as, "The foundation of the first floor has been completed. Construction of the second floor is currently underway."

[0754] Step 15:

[0755] Users: View the construction progress in real time on their devices, for example, via a smartphone app or web interface, and provide comments and feedback as needed.

[0756] Example 2

[0757] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0758] Conventional architectural design systems often struggle to fully reflect the user's feelings and preferences, even when users input their wishes and specifications, resulting in low user satisfaction. Furthermore, there are limited ways to check the construction progress in real time, often resulting in a lack of security for users. Another issue is the time-consuming and cumbersome process of checking and correcting blueprints.

[0759] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for inputting the user's wishes and specifications regarding construction and the user's emotional data, a means for collecting the input data and emotional data and storing them in a database, and a means for the construction-specific generation AI to automatically generate blueprints based on the stored data and emotional data. This enables the automatic generation of blueprints that reflect the user's emotions and preferences, thereby improving user satisfaction. Furthermore, the system has a function for checking the construction progress in real time, which increases the user's sense of security. Furthermore, the overall time can be reduced by streamlining the process of checking and correcting blueprints by construction professionals.

[0760] A "user" is someone who uses the system to input information about a desired building, generate blueprints, and check the progress of construction.

[0761] "Emotion data" is data that indicates the user's emotions and preferences, analyzed from information entered by the user and facial expressions.

[0762] "Architecture-specialized generative AI" is an artificial intelligence model that automatically generates blueprints for buildings based on the user's wishes, specifications, and emotional data.

[0763] A "database" is an electronic storage device for storing user input information, emotional data, generated blueprints, and so on.

[0764] "Architectural professionals" are experts who check and correct the generated blueprints from legal and technical perspectives.

[0765] An "architectural professional terminal" is a computer or device used by an architectural professional to review and modify blueprints.

[0766] A "3D printer" is a device that continuously constructs buildings using layered materials based on blueprints.

[0767] "Laminated materials" are building materials used in 3D printers that are continuously ejected through a nozzle.

[0768] "Means of providing information in real time" refers to a system that collects information on the progress of construction as it occurs and notifies users immediately.

[0769] This invention relates to a system that provides buildings quickly and at low cost based on user wishes and specifications. In particular, it provides a system that enables architectural design according to individual user preferences by combining it with an emotion engine that recognizes user emotions. Specific embodiments of this invention are described below.

[0770] 1. Acquiring user information and recognizing emotions

[0771] User

[0772] A user logs into the system and inputs information about the building they want. For example, they might input, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This allows the system to obtain the user's specific wishes and specifications.

[0773] server

[0774] The server sends the information entered by the user to the emotion engine. The emotion engine uses natural language processing APIs, such as IBM Watson or Microsoft Azure Cognitive Services, to analyze the user's input text and facial expression data and recognize the user's emotions. For example, it detects "feelings of anticipation and excitement." Based on this, the server stores the user's wishes, specifications, and emotional data in a database.

[0775] 2. Automatic generation of blueprints

[0776] server

[0777] The server passes the user's wishes, specifications, and emotional data to a generative AI model specialized for architecture (e.g., OpenAI GPT-4) and requests a design plan. The generative AI then references this data, as well as past design data and regional characteristic data, to generate a design plan tailored to the user's preferences.

[0778] Generation AI

[0779] The generative AI automatically generates blueprints, including a bright and spacious living room, reflecting the user's positive emotions. This process utilizes a database of past data, design standards, and local characteristics. The generated blueprints and emotion data are temporarily stored on a server and then sent to the architect's device.

[0780] 3. Check and correct the design drawings

[0781] server

[0782] The server transmits the generated design drawings to the terminal of the construction professional.

[0783] Terminal (Architectural Professional)

[0784] The architect's terminal checks the blueprints from legal and technical standpoints and makes any necessary modifications, such as increasing the number of columns to comply with earthquake resistance standards. Once the modifications are complete, the blueprints are sent back to the server.

[0785] 4. Final Review and Approval

[0786] User

[0787] The user checks the revised design drawing and gives final approval by saying, "Please proceed with this design." The server receives the user's approval information and sends the approved design drawing data to the 3D printing system.

[0788] 5. 3D Printed Architecture

[0789] 3D printer

[0790] The 3D printer builds the building in order, starting from the base, based on the blueprint data. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day. The horizontal movement of the nozzle and the amount of material used are automatically adjusted. The server periodically records the 3D printer's operation log and progress.

[0791] 6. Share your progress

[0792] server

[0793] The server collects the construction progress status in real time based on the sensor and log data collected by the 3D printer. This allows the server to notify the user of the construction progress in real time. For example, the server may inform the user that "The foundation of the first floor has been completed. Construction of the second floor is currently underway." This allows the user to check the construction progress at any time, giving them peace of mind.

[0794] Specific examples

[0795] In response to the prompt, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen," the AI ​​automatically generates a blueprint that includes a bright and spacious living room. The blueprint is then revised by an architectural professional based on earthquake resistance standards, and once the user has approved it, construction begins using a 3D printer.

[0796] In this way, a system incorporating an emotion engine enables highly accurate architectural designs that reflect the user's emotions and preferences, and construction progress is shared in real time, greatly improving user satisfaction.

[0797] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0798] Step 1:

[0799] A user logs into the system and inputs their wishes and specifications for the building. For example, they might input, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This is sent as the initial input data. The server receives the wishes and specifications entered by the user and sends them to the emotion engine. The emotion engine performs text analysis and facial expression recognition to recognize the user's emotions. For example, "feelings of anticipation and excitement" are detected based on the text analysis. The server then stores the user's wishes, specifications, and emotion data in a database.

[0800] Input: User's wishes and specifications (e.g., "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen.")

[0801] Output: Desires, specifications, and emotional data are saved in a database

[0802] Step 2:

[0803] The server passes the user's wishes, specifications, and emotional data stored in the database to an architecture-specific generative AI model and requests a design plan. The generative AI model analyzes the input data and references past design data and regional characteristic data to automatically generate a blueprint tailored to the user's preferences. For example, the generative AI reflects positive emotions and generates a blueprint that includes a bright and spacious living room. The server temporarily stores the generated blueprint and emotional data, and then sends it to the architecture professional's device.

[0804] Input: User's wishes, specifications, and emotional data

[0805] Output: Automatically generated blueprints by generative AI

[0806] Step 3:

[0807] The server sends the generated blueprint to the architectural professional's terminal. The architectural professional reviews the blueprint from legal and technical perspectives and makes any necessary modifications, such as increasing the number of columns based on earthquake resistance standards. Once the modifications are complete, the blueprint is sent back to the server. The server stores the modified blueprint in a database and sends it to the user for confirmation.

[0808] Input: Auto-generated blueprint

[0809] Output: Blueprints revised by the architectural profession

[0810] Step 4:

[0811] The user checks the revised design drawing and gives final approval by saying, "Please proceed with this design." The server receives the user's approval information and sends the approved design drawing data to the 3D printing system.

[0812] Input: Modified blueprint

[0813] Output: User approval information and approved design data sent to the 3D printing system

[0814] Step 5:

[0815] The 3D printer builds the building from the ground up based on the blueprint data. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day. The horizontal movement of the nozzle and the amount of material used are automatically adjusted. The server regularly records the 3D printer's operation log and progress.

[0816] Input: Approved design data

[0817] Output: Physical construction, progress log data

[0818] Step 6:

[0819] The 3D printer collects construction progress information based on sensor and log data. The server collects progress data in real time and notifies the user. For example, the server may inform the user that "The foundations for the first floor have been completed. Construction of the second floor is currently underway." This allows the user to check the construction progress at any time.

[0820] Input: Progress log data

[0821] Output: Real-time notification to the user

[0822] (Application example 2)

[0823] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0824] In the traditional building design and construction process, while it was possible to reflect the user's wishes and specifications, it was difficult to propose designs that took the user's emotions into consideration. Furthermore, there was no user experience utilizing virtual space, and users lacked a means to visually confirm the contents of the blueprints. This created a high possibility that the final building would not meet the user's expectations, resulting in a decrease in satisfaction.

[0825] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0826] In this invention, the server includes a means for recognizing a user's emotions, a means for an architecture-specific generation AI to automatically generate blueprints based on the recognized emotion data and stored data, and a means for the user to visualize and experience the generated blueprints in a virtual space. This makes it possible to propose designs that reflect the user's emotions, and the user can visually check the blueprints in a virtual space, making it possible to provide buildings that are highly satisfying.

[0827] A "user" is an entity that uses the system to input the building's wishes and specifications.

[0828] "Specifications" refers to the specific conditions and requirements for the building desired by the user.

[0829] "Emotion" refers to the psychological state or state of mind that the user expresses when entering input, and is recognized by the system.

[0830] "Emotion recognition" refers to the technology of analyzing and understanding a user's psychological state from facial expressions, voice, etc.

[0831] "Architecture-specialized generative AI" refers to artificial intelligence technology specialized for automatically generating blueprints for buildings.

[0832] A "blueprint" is a drawing that shows the specific shape, structure, and layout of a building.

[0833] An "architect" is a specialist who checks the blueprints of buildings from legal and technical perspectives and makes corrections as necessary.

[0834] A "3D printer" is a machine that layers materials to create three-dimensional buildings and structures.

[0835] "Virtual space" refers to a space that is virtually constructed using computer graphics, etc.

[0836] "Real-time" refers to events being processed simultaneously with little delay after they occur.

[0837] "Visualization" is the conversion of data or information into a visible form such as graphics or images.

[0838] "User experience" refers to the experience and satisfaction that users gain from using a system.

[0839] This invention is a system that proposes and constructs buildings based on the user's wishes and specifications. In particular, it aims to increase user satisfaction by recognizing emotions and allowing users to visualize and experience blueprints in a virtual space. Specific embodiments are shown below.

[0840] System Configuration

[0841] This system mainly uses the following hardware and software:

[0842] Hardware: Smartphones, smart glasses, head-mounted displays, 3D printers

[0843] Software: Camera API, voice recognition API, emotion recognition AI tools (e.g., Microsoft Azure Emotion API, Google Cloud Vision), generative AI specialized for architecture (e.g., GPT-4, DALL-E), virtual space display software (e.g., Unity, Unreal Engine)

[0844] Acquiring user information and recognizing emotions

[0845] Users log in to the system using a smartphone or smart glasses and enter their preferences and specifications. When entering information, the device's camera captures the user's facial expressions, and the microphone accepts voice input. This data is acquired by the camera API and voice recognition API and sent to the emotion recognition AI tool. The emotion recognition AI tool analyzes the user's emotions in real time and stores them as emotion data on the server.

[0846] Automatic generation of blueprints

[0847] The server then passes the collected emotional data and the user's wishes and specifications to a generative AI specialized for architecture. The generative AI model (e.g., GPT-4, DALL-E) references past data and building standards to automatically generate blueprints that reflect the user's emotions. These blueprints are then stored on the server and sent to the architect.

[0848] Check and correct blueprints

[0849] The architect uses the terminal to check the submitted blueprints from legal and technical standpoints and make any necessary corrections. The corrected blueprints are then sent back to the server and provided to the user for review.

[0850] Final confirmation and virtual experience

[0851] Users visualize and experience the blueprint in a virtual space using a head-mounted display. They can visually review the design and request changes. The server receives this feedback and passes the data back to the generative AI model to generate revisions.

[0852] 3D printed architecture

[0853] Finally, the 3D printer creates the building based on the user-approved design. The 3D printer moves the nozzle horizontally, continuously discharging a special mortar and layering it to create the structure.

[0854] Share your progress

[0855] The progress of construction is collected in real time by the server based on sensor and log data and provided to the user, allowing the user to check the progress of the construction at any time.

[0856] Specific examples

[0857] If a user inputs "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen," and the emotion engine detects the emotion of "expectation and excitement," the server collects this information as emotional data and desired specifications. Based on this, the server sends a prompt to the generative AI model: "Generate a modern, two-story house with four rooms, budget under 50 million yen. User feels excited and has high expectations." This generates a blueprint. An architect then reviews and revises the blueprint, and the final blueprint is visualized for the user in a virtual space. In this way, it is possible to provide a design that reflects the user's emotions.

[0858] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0859] Step 1:

[0860] A user logs into the system using a smartphone or smart glasses and inputs their preferences and specifications. The user's facial expressions are captured using a camera API, and their voice is picked up using a microphone. These data are sent to the server through a voice recognition API. Input data includes the number of rooms, design style, budget, and building site information. As output, the server receives the user's preferences and specifications data, as well as the captured facial and voice data.

[0861] Step 2:

[0862] The server passes the received facial and voice data to an emotion recognition AI tool (e.g., Microsoft Azure Emotion API, Google Cloud Vision). The emotion recognition AI analyzes this data and recognizes the user's emotions. The input is facial and voice data, and the output is emotion data (e.g., "expectation and excitement").

[0863] Step 3:

[0864] The server stores the user's preferences, specification data, and emotion data in a database. The stored data includes the number of rooms, design style, budget, construction site information, and emotion data. The stored data is generated as an output.

[0865] Step 4:

[0866] The server generates a prompt sentence based on the collected data and passes it to an architecture-specific generative AI (e.g., GPT-4, DALL-E). An example prompt sentence is "Generate a modern, two-story house with 4 rooms, budget under 50 million yen. User feels excited and has high expectations." The input is the saved user specifications and emotional data, and the output is the generated prompt sentence.

[0867] Step 5:

[0868] The generative AI model automatically generates a blueprint for a building based on the given prompt. The input is the prompt, and the output is the automatically generated blueprint. The generated blueprint is then sent back to the server.

[0869] Step 6:

[0870] The server sends the generated blueprints to the architect's terminal, where the architect checks them from legal and technical perspectives and makes corrections as necessary. The input is the automatically generated blueprint, and the output is the corrected blueprint.

[0871] Step 7:

[0872] The modified blueprint is sent back to the server and provided to the user for confirmation. The user checks the blueprint in the virtual space using a head-mounted display. The input is the modified blueprint, and the output is the user's feedback and confirmation information.

[0873] Step 8:

[0874] After user confirmation, the final blueprint is stored on the server and sent to the 3D printer, which then creates a building based on the blueprint. The input is the final confirmed blueprint, and the output is the actual building.

[0875] Step 9:

[0876] The server collects sensor data from the 3D printer to provide real-time information to the user. This information is periodically updated and sent to the user's device. The input is sensor data, and the output is progress notification to the user.

[0877] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0878] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0879] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0880] [Third embodiment]

[0881] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0882] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0883] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0884] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0885] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0886] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0887] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0888] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0889] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0890] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0891] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0892] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0893] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. The invention combines building-specific generation AI and 3D printing technology to efficiently generate buildings.

[0894] System Overview

[0895] 1. Obtaining user information and gathering requirements

[0896] User: Logs into the system and enters the necessary information for construction through the interface, including the desired number of rooms, design style, budget, and construction site information.

[0897] Server: Takes user input and stores it in a database, formatting it and converting it into a format that can be easily used for further processing.

[0898] 2. Automatic generation of blueprints

[0899] Server: Retrieves user requirements data from the database and passes it to the building-specific generation AI.

[0900] Generative AI: Automatically generates optimal design drawings based on user requirements. This process involves creating plans while referencing certain design standards and past design data.

[0901] Server: Temporarily stores the generated blueprints and later sends them to the architect.

[0902] 3. Check and correct the design drawings

[0903] Server: Sends the generated blueprints to the architect's device.

[0904] Terminal (Architect): Checks the blueprints from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprints to the server.

[0905] Server: Re-saves the modified blueprint and sends it to the user for confirmation.

[0906] 4. Final Review and Approval

[0907] User: Checks the design and gives final approval, which is sent to the server.

[0908] Server: Officially sends the user-approved design to the 3D printing system.

[0909] 5. 3D Printed Architecture

[0910] 3D printer: Based on blueprint data, a special mortar is continuously dispensed by moving the nozzle horizontally, forming layers to form buildings. The printer adjusts the layering pattern and amount of material used, progressing the construction according to the plan.

[0911] 6. Share your progress

[0912] 3D printer: Uses sensors and logs data to record construction progress.

[0913] Server: Collects progress data in real time and provides it to the user's device, allowing the user to check the progress of the construction at any time.

[0914] Specific examples

[0915] 1. Example of user information entry

[0916] User: Enters into the system, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen."

[0917] 2. Automatic generation and checking of blueprints

[0918] Server: Requests a design plan from the generative AI based on the user's data.

[0919] Generative AI: Generates a plan step by step, automatically creating a blueprint with a living room, kitchen, and bathroom on the first floor, and three bedrooms and a balcony on the second floor.

[0920] Terminal (Architect): Checks blueprints and confirms and modifies building standards and safety. For example, modifies the number of columns based on earthquake resistance standards.

[0921] 3. Final Review and Approval

[0922] User: Checks the revised design drawings and gives final approval, saying, "Please proceed with this design."

[0923] 4. 3D Printed Architecture

[0924] 3D printer: Based on the approved blueprint, construction proceeds from the ground up. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day.

[0925] 5. Share your progress

[0926] Server: Notifies the user in real time, "The foundation for the first floor has been completed. Construction of the second floor is currently underway."

[0927] This is the implementation form of this system. Designs that meet the user's needs are provided quickly and efficiently, and the construction progress can be checked in real time, which enables significant cost and time savings.

[0928] The processing flow will be explained below.

[0929] Step 1:

[0930] User: Logs in to the system and enters their architectural wishes and specifications, such as the number of rooms required, design style, budget, and construction site information.

[0931] Step 2:

[0932] Server: Collects input data from users and saves it in a database. Each input item is stored in the database in the specified format.

[0933] Step 3:

[0934] Server: Retrieves user requirements data from the database and passes it to the architecture-specific generation AI. It extracts the user requirements and converts them into a format that the AI ​​can understand.

[0935] Step 4:

[0936] Generation AI (on the server): Automatically generates blueprints based on the user's requirements. During generation, it references a database of past data, design standards, and regional characteristics to create the optimal plan.

[0937] Step 5:

[0938] Server: Temporarily stores the generated blueprints and sends them to the architect for review. The blueprint data and related information are sent as a package.

[0939] Step 6:

[0940] Terminal (Architect): Review blueprints and perform legal and technical checks. View blueprints and perform checks using checklists based on structural stability and building codes.

[0941] Step 7:

[0942] Terminal (Architect): After checking, if any corrections are necessary, make the necessary changes to the blueprint. Send the corrected blueprint to the server.

[0943] Step 8:

[0944] Server: Receives the modified blueprint and sends it to the user for confirmation.

[0945] Step 9:

[0946] User: Review and approve the blueprint. Review the blueprint and add comments if necessary.

[0947] Step 10:

[0948] Server: Sends the design, which has received the user's final approval, to the 3D printing system. It analyzes the design data and converts it into a format that can be sent to the printer.

[0949] Step 11:

[0950] 3D printer: Based on a blueprint, a nozzle moves horizontally to dispense a special mortar, layering it up to form a building. The printer determines the order in which each layer is formed and calculates the amount of mortar to be used.

[0951] Step 12:

[0952] 3D printer: The construction progress is collected based on sensors and log data, and the progress is recorded sequentially, allowing the printer to move on to the next step.

[0953] Step 13:

[0954] Server: Periodically collects progress data and provides it to the user's device in real time. It records the progress of each building part in detail and provides it to the user in text and graphic format.

[0955] Step 14:

[0956] User: See progress in real time on their device, track progress and send feedback to the server if necessary.

[0957] Example 1

[0958] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0959] A major issue with traditional construction projects is the significant time and cost required from the start of design to the actual completion of construction. In particular, it is difficult to quickly respond to diverse user requests and specifications, making the design and revision process cumbersome and inefficient. Another problem is that progress management is time-consuming, making it difficult for users to grasp the status in real time.

[0960] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0961] In this invention, the server includes: a means for inputting user requests and specifications for a building; a means for collecting the input data and saving it in an information database; a means for a building-specific generation AI to automatically generate blueprints based on the saved data; a means for sending prompts to the generation AI and generating blueprints; a means for sending the generated blueprints to an architect for legal and technical review and correction; a means for saving the corrected blueprints and allowing the user to review them; a means for creating a building using a 3D printer based on the blueprints; and a means for providing the user with real-time construction progress updates. This allows for quick and efficient response to user requests and specifications, significantly reducing the time and cost from design to construction. Furthermore, real-time progress management allows users to constantly monitor the progress of construction.

[0962] "User" refers to the user of the system who inputs architectural wishes and specifications.

[0963] "Server" refers to a central system that collects, stores, and processes user information over the Internet.

[0964] "Desires and specifications" refers to the specific requirements for the building the user desires (number of rooms, design style, budget, construction site information, etc.).

[0965] "Information Database" refers to a digital storage system for storing collected user information and data related to the design process.

[0966] "Architecture-specialized generative AI" is an artificial intelligence program specialized in the field of architecture, and has the ability to automatically generate blueprints based on the user's wishes and specifications.

[0967] A "prompt sentence" refers to the input sentence when requesting a construction-specialized generation AI to generate a blueprint.

[0968] "Blueprints" refers to drawings or plans that show the design and structure of a building.

[0969] An "architect" is a specialist who checks the generated blueprints from a legal and technical perspective and makes any necessary corrections.

[0970] "Modification" refers to the process of making changes or revisions to the generated design drawings from legal and technical perspectives.

[0971] A "3D printer" is a device that creates actual buildings by layering materials such as mortar based on digital blueprints.

[0972] "Progress" refers to the progress of each stage of a construction project.

[0973] "Real-time" refers to the near-instantaneous reflection and display of ongoing activities and conditions.

[0974] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. The invention combines building-specific generation AI and 3D printing technology to efficiently generate buildings.

[0975] The system is implemented using the following hardware and software:

[0976] 1. Server:

[0977] The server plays a central role in receiving input from users, storing it in a database, and generating prompts for the generative AI.

[0978] 2. Terminal:

[0979] A device used by architects to check and correct blueprints, specifically a PC or tablet with CAD software installed.

[0980] 3. User Device:

[0981] The device that users use to access the system and enter their preferences and specifications. This can include smartphones, tablets, and PCs.

[0982] 4. Architecture-specific generative AI:

[0983] The AI ​​model automatically generates blueprints based on prompts sent from the server, and references past architectural design data and certain design standards.

[0984] 5. 3D Printer:

[0985] This refers to hardware that uses special mortar to form buildings based on submitted blueprints.

[0986] Implementation details

[0987] Obtaining user information and gathering requirements

[0988] Users log in to the system and enter the necessary information for construction through the interface, including the desired number of rooms, design style, budget, and construction site information.

[0989] Example: "I want to build a modern, two-story house with four rooms within a budget of 50 million yen."

[0990] The server receives user input and stores the data in an information database, where it is formatted and converted into a form that can be easily used for further processing.

[0991] Automatic generation of blueprints

[0992] The server retrieves the user's requirements data from the database and passes it to the building-specialized generation AI.

[0993] Example prompt: "The user's desired building is a two-story house with four rooms and a modern design. The budget is within 50 million yen."

[0994] The generative AI automatically generates optimal design drawings based on the user's requirements, and in this process creates plans while referencing certain design standards and past design data.

[0995] For example, the first floor will have a living room, kitchen and bathroom, while the second floor will have three bedrooms and a balcony.

[0996] The server temporarily stores the generated blueprints and later sends them to the architect.

[0997] Check and correct blueprints

[0998] The server transmits the generated design drawings to the architect's terminal.

[0999] The terminal (architect) checks the blueprint from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprint to the server.

[1000] Example: Modifying the number of columns based on seismic standards.

[1001] The server re-stores the modified blueprint and sends it to the user for confirmation.

[1002] Final review and approval

[1003] The user checks the design and gives final approval, which is then sent to the server.

[1004] For example: "Please proceed with this design."

[1005] The server officially sends the user-approved design to the 3D printing system.

[1006] 3D printed architecture

[1007] Based on blueprint data, the 3D printer forms a building by continuously ejecting and layering special mortar while moving the nozzle horizontally.

[1008] Example: Complete the foundation of the first floor in one day and build the second floor the next day.

[1009] Share your progress

[1010] The 3D printer uses sensors and logs data to record the construction progress.

[1011] The server collects progress data in real time and provides it to the user's terminal.

[1012] Example: "The foundations for the first floor are complete. Construction of the second floor is currently underway."

[1013] This system allows us to respond quickly and efficiently to the diverse needs and specifications of our users, significantly reducing the time and cost required from design to construction. Furthermore, it allows for real-time management of progress, allowing users to constantly monitor the progress of construction.

[1014] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1015] Step 1:

[1016] The user uses the interface to input their architectural preferences and specifications (number of rooms, design style, budget, construction site information, etc.). Specifically, the user logs in with their account, fills in the required information in the input form, and clicks the submit button. This input data is used for the next process.

[1017] Input: Your wishes and specifications

[1018] Output: Send data to the server

[1019] Step 2:

[1020] The server receives the user's input data and stores it in an information database, formatting the data and converting it into a format that is easy to handle for subsequent processing. Specifically, the server receives an HTTP request and executes a query to insert the data into the database.

[1021] Input: Data submitted by the user

[1022] Output: Formatted data stored in a database

[1023] Step 3:

[1024] The server retrieves the user's requirements data from the database and passes the data to the architecture-specific generation AI. Specifically, the server executes periodic queries, loads the necessary data into a cache, and sends prompts to the generation AI's API.

[1025] Input: Formatted data stored in the database

[1026] Output: The prompt sent to the generation AI

[1027] Step 4:

[1028] The AI ​​automatically generates optimal blueprints based on the prompts. During this process, the AI ​​creates plans while referencing certain design standards and past design data. Specifically, the AI ​​uses its internal algorithms to generate blueprints and sends them back to the server in digital format.

[1029] Input: Prompt text sent from the server

[1030] Output: Generated blueprint

[1031] Step 5:

[1032] The server temporarily stores the generated blueprints and later sends them to the architect. Specifically, the server stores the blueprint data in temporary storage and prepares an HTTP request to the architect's terminal for the next step.

[1033] Input: Blueprint sent from the generation AI

[1034] Output: Temporarily saved blueprint data

[1035] Step 6:

[1036] The server sends the generated design data to the architect's terminal. Specifically, the server encodes the data and executes an HTTP request to the architect's terminal.

[1037] Input: Temporarily saved blueprint data

[1038] Output: Blueprint data sent to the architect's terminal

[1039] Step 7:

[1040] The terminal (architect) checks the blueprint from legal and technical perspectives and makes any necessary corrections. Specifically, the architect opens the blueprint using CAD software and makes any necessary corrections. Once the corrections are complete, the corrected blueprint data is uploaded to the server.

[1041] Input: Blueprint data sent from the server

[1042] Output: Modified blueprint data

[1043] Step 8:

[1044] The server stores the modified blueprint data again and sends it to the user for confirmation. Specifically, the server stores the modified data in the database and then sends a notification to the user's terminal.

[1045] Input: Modified blueprint data

[1046] Output: The revised design is sent to the user's device.

[1047] Step 9:

[1048] The user checks the revised design and gives final approval. The approval information is sent to the server. Specifically, the user previews the design on the interface and clicks the "Approve" button. This action is sent as data to the server.

[1049] Input: Modified design notified to user

[1050] Output: Authorization information sent to the server

[1051] Step 10:

[1052] The server officially sends the user-approved design to the 3D printing system. Specifically, the server encodes the design data and sends an HTTP request to the 3D printer's control system.

[1053] Input: Authorization information sent by the user

[1054] Output: Design data sent to the 3D printing system

[1055] Step 11:

[1056] The 3D printer creates buildings by continuously discharging special mortar while moving the nozzle horizontally based on the blueprint data, and layering it up. Specifically, the printer operates according to the blueprint data to form each layer.

[1057] Input: Blueprint data sent from the server

[1058] Output: Physical building constructed

[1059] Step 12:

[1060] The 3D printer uses sensors and log data to record the progress of the construction. Specifically, the 3D printer uses built-in sensors to collect data in real time and sends the log to a server.

[1061] Input: Sensor data collected during the building process

[1062] Output: Progress data sent to the server

[1063] Step 13:

[1064] The server collects progress data in real time and provides it to the user's terminal, and specifically, the server processes the collected data and displays it on the user's interface in real time.

[1065] Input: Progress data sent from the 3D printer

[1066] Output: Progress notification displayed on the user's terminal

[1067] The above are the details of the specific processing steps in this system. Each step is closely linked to realize a fast and efficient construction process based on the user's wishes.

[1068] (Application example 1)

[1069] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1070] In conventional construction processes, designing and constructing a building based on a user's wishes and specifications requires a great deal of time and money. Furthermore, making design changes and checking progress is time-consuming and burdensome for users. The purpose of this invention is to solve these problems and provide a system that allows users to easily customize building designs and check progress in real time.

[1071] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1072] In this invention, the server includes means for inputting building requests and specifications from users, means for collecting the input data and saving it in a database, means for a building-specialized generation AI to automatically generate blueprints based on the saved data, means for sending the generated blueprints to an architect for legal and technical checks and corrections, means for the user to review the blueprints after checking and corrections have been completed, means for forming a building using a 3D printer based on the blueprints, means for providing the user with real-time construction progress information, and means for the user to input requirements and check the construction progress via a smartphone, thereby enabling users to quickly and efficiently design and construct buildings.

[1073] "User" refers to a general user who inputs their wishes and specifications regarding the design and construction of a building and checks its progress.

[1074] "Architectural wishes and specifications" are specific requirements and conditions such as the number of rooms, design style, budget, and information about the construction site of the building desired by the user.

[1075] The "database" is an information management system for managing and storing architectural wishes and specifications entered by users.

[1076] "Architecture-specialized generative AI" is an artificial intelligence technology that automatically generates optimal blueprints based on the architectural wishes and specifications entered by the user.

[1077] "Blueprints" are detailed drawings used when designing a building, automatically generated by architecturally specialized generation AI and used by architects to check and correct.

[1078] An "architect" is a specialist who checks the generated blueprints from legal and technical perspectives and makes any necessary corrections.

[1079] A 3D printer is a device that forms buildings by continuously discharging and layering special mortar while moving a nozzle horizontally based on blueprint data.

[1080] "Progress" is information that indicates the current stage of the design and construction of a building, and is provided to the user in real time.

[1081] A "smartphone" is a portable information terminal device that allows users to input their wishes and specifications regarding construction and check the progress of construction.

[1082] The system for implementing this invention allows users to input their wishes and specifications via smartphone, and then a specialized architectural generation AI automatically generates blueprints based on that information, providing a process for actually creating the building using a 3D printer. This system is composed of multiple pieces of hardware and software, including a server, a user terminal, an architect terminal, and a 3D printer.

[1083] The server collects architectural specifications (such as the number of rooms, design style, budget, and construction site information) entered by the user via smartphone and stores them in a database. Next, a specialized architectural generation AI automatically generates blueprints based on this data. This AI generates a plan that best suits the user's requirements, referencing certain design standards and past design data.

[1084] The generated blueprints are sent to the architect's terminal and checked from legal and technical perspectives. During this process, it is confirmed whether the design complies with regulations and satisfies safety standards such as earthquake resistance. After the architect has completed the revisions, the blueprints are sent to the user via the server for confirmation.

[1085] The user can review the generated and revised blueprints via their smartphone and provide final approval. This approval information is then sent to the server, which then sends the blueprints to the 3D printing system. The 3D printer then moves the nozzle horizontally, continuously discharging a special mortar to layer the structure to create a building based on the blueprint.

[1086] The 3D printer also uses sensors and log data to record the progress of construction, and the server collects this data in real time and provides it to the user's smartphone, allowing the user to check the progress of construction at any time.

[1087] Specific examples

[1088] For example, a user might enter on their smartphone, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This information is collected and stored on the server, and a specialized architectural generation AI automatically generates a blueprint with a living room, kitchen, and bathroom on the first floor, and three bedrooms and a balcony on the second floor. The blueprint is then sent to an architect, who makes any necessary revisions after legal and technical checks, and the revised blueprint is then reviewed by the user again. Once the user has finally approved the blueprint, the 3D printer begins construction, and the user is notified of the progress in real time.

[1089] Prompt Sentence Examples

[1090] "User's desired building requirements:

[1091] Number of rooms: 4

[1092] Design Style: Modern

[1093] Budget: Under 50 million yen

[1094] Location: Tokyo

[1095] Generate the optimal design plan based on this.

[1096] In this way, by using this system, users can design and construct buildings quickly and efficiently, and can check the progress in real time, thereby reducing costs and time.

[1097] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1098] Step 1:

[1099] Users use their smartphones to input their wishes and specifications regarding the building. Specifically, the user enters requirements information such as "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen" into an input form on their smartphone. This input data is sent from the user to the server.

[1100] Step 2:

[1101] The server receives the data of the user's wishes and specifications and stores it in a database. During the storage process, the data is formatted and converted into the required format, making it easier to handle in subsequent processing.

[1102] Step 3:

[1103] The server retrieves the user's requirements data from the database and passes that data to the architecture-specialized generation AI. Specifically, requirements such as "number of rooms: 4, design style: modern, budget: within 50 million yen, location: Tokyo" are entered into the generation AI. The generation AI then automatically generates blueprints based on this data.

[1104] Step 4:

[1105] The generative AI model generates optimal design drawings based on the user's requirements data. In doing so, it automatically creates plans while referencing past design data and certain design standards. Once the design drawing data is generated, it is sent to a server and temporarily stored.

[1106] Step 5:

[1107] The server then sends the generated blueprint data to the architect's terminal. The architect then checks the blueprints received on the terminal from legal and technical perspectives and makes any necessary modifications. For example, the architect may increase the number of columns to comply with earthquake resistance standards or check legal regulations. The modified blueprints are then sent back to the server.

[1108] Step 6:

[1109] The server receives the revised blueprints sent by the architect and sends them to the user for confirmation. The user then checks the blueprints via their smartphone and performs final approval. If the user approves the blueprints, the information is sent back to the server.

[1110] Step 7:

[1111] The server then sends the approved design data to the 3D printing system. The 3D printer then moves the nozzle horizontally based on the design data, continuously discharging a special mortar and layering it to form the building. Specifically, it builds the foundation for the first floor, then stacks the second floor.

[1112] Step 8:

[1113] The 3D printer records the construction progress using sensors and log data. As the construction progresses, it sends the current progress status to the server, which collects this progress data in real time and provides it to the user.

[1114] Step 9:

[1115] Users can check the construction progress in real time via their smartphones. Specifically, they will receive updates on the construction status, such as "The foundations for the first floor have been completed. Construction of the second floor is currently underway."

[1116] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1117] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. In particular, it provides a system that enables architectural designs that are more in line with the preferences of individual users by combining it with an emotion engine that recognizes the user's emotions.

[1118] System Overview

[1119] 1. Acquiring user information and recognizing emotions

[1120] User: Logs in to the system and inputs their wishes and specifications, including the number of rooms required, design style, budget, and construction site information.

[1121] Emotion engine (on the server): Analyzes the user's input information and recognizes the user's emotions. Emotions are acquired using, for example, text analysis and facial expression recognition technology.

[1122] Server: Stores the emotion data collected by the emotion engine in a database along with the user's preferences and specifications.

[1123] 2. Automatic generation of blueprints

[1124] Server: Based on the user's wishes, specifications, and emotional data, it passes this to a specialized construction generation AI.

[1125] Generative AI: Automatically generates blueprints that better suit the user's preferences based on user requirements and sentiment data. This process references a database of past data, design standards, and local characteristics to create the optimal plan.

[1126] Server: Temporarily stores the generated blueprints and associated emotion data, then transmits them to the architect.

[1127] 3. Check and correct the design drawings

[1128] Server: Sends the generated blueprints to the architect's device.

[1129] Terminal (Architect): Checks the blueprints from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprints to the server.

[1130] Server: Save the modified blueprint again and send it to the user for confirmation.

[1131] 4. Final Review and Approval

[1132] User: Review the revised design and give final approval, for example by entering approval information and any additional comments.

[1133] Server: Officially sends the user-approved design to the 3D printing system.

[1134] 5. 3D Printed Architecture

[1135] 3D printer: Based on blueprint data, the nozzle moves horizontally to continuously dispense special mortar, layering it to form a building. The order in which each layer is formed and the amount of material used are automatically adjusted.

[1136] 6. Share your progress

[1137] 3D printer: Construction progress is collected based on sensors and log data.

[1138] Server: Collects progress data periodically and provides it to users in real time, allowing users to check the progress of their construction at any time.

[1139] Specific examples

[1140] 1. Example of user information entry

[1141] User: "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." At the same time, the emotion engine detects "feelings of anticipation and excitement" from the user's sentence.

[1142] 2. Automatic generation and checking of blueprints

[1143] Server: Requests a design plan from the generative AI based on user data and emotional data.

[1144] Generative AI: Reflects the user's positive emotions and automatically generates blueprints including a bright and spacious living room.

[1145] Terminal (Architect): Checks the blueprints and confirms and modifies building standards and safety. For example, modifies the number of columns based on earthquake resistance standards.

[1146] 3. Final Review and Approval

[1147] User: Checks the revised design drawings and gives final approval, saying, "Please proceed with this design."

[1148] 4. 3D Printed Architecture

[1149] 3D printer: Based on the approved blueprint, construction proceeds from the ground up. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day.

[1150] 5. Share your progress

[1151] Server: Notifies the user in real time, "The foundation for the first floor has been completed. Construction of the second floor is currently underway."

[1152] In this way, by combining the emotion engine, it becomes possible to design and build structures that better reflect the user's emotions and preferences, and to provide buildings that provide greater satisfaction. In addition, the progress of construction can be checked in real time, which increases the user's sense of security.

[1153] The processing flow will be explained below.

[1154] Step 1:

[1155] User: Logs into the system and enters their architectural wishes and specifications, such as the number of rooms required, design style, budget, and construction location.

[1156] Step 2:

[1157] Emotion engine (on the server): Analyzes user input information in real time and recognizes the user's emotions. For example, it performs text analysis and facial expression recognition to identify emotions such as "expectation" and "excitement."

[1158] Step 3:

[1159] Server: Collects user inputs such as preferences and specifications, as well as recognized emotional data, formats them, and stores them in a database.

[1160] Step 4:

[1161] Server: Obtains user preferences, specifications, and emotional data from the database and passes them to the specialized architectural generation AI.

[1162] Step 5:

[1163] Generative AI (on the server): Automatically generates blueprints based on the user's wishes and emotional data. For example, if a user requests a "bright living room" and the emotional engine detects the emotion of "expectation and excitement," it will create a blueprint that includes a living room with spacious windows and bright colors.

[1164] Step 6:

[1165] Server: Temporarily stores the generated blueprints and then sends them to the architect.

[1166] Step 7:

[1167] Terminal (architect): Receives blueprints and checks them from legal and technical perspectives. For example, checks whether they comply with the Building Standards Act and whether earthquake resistance is appropriate based on a checklist.

[1168] Step 8:

[1169] Terminal (architect): After checking, make any necessary modifications to the blueprint. For example, change the size of a window to improve safety. Once the modifications are complete, send the modified blueprint back to the server.

[1170] Step 9:

[1171] Server: Receives the modified blueprint and sends it to the user for confirmation.

[1172] Step 10:

[1173] User: Checks the design and gives final approval. For example, if the user views the design and is satisfied with the overall design, they submit a comment such as "Please proceed with this design" and their approval.

[1174] Step 11:

[1175] Server: After receiving the user's final approval, the design is officially sent to the 3D printing system.

[1176] Step 12:

[1177] 3D printer: Based on a blueprint, a nozzle moves horizontally to dispense special mortar, layering it up to form a building. For example, starting with the foundation, the first floor walls are constructed, followed by the second floor walls.

[1178] Step 13:

[1179] 3D printer: The progress of construction is collected based on sensors and log data. For example, when the first floor walls are completed, that information is collected and the next step is started.

[1180] Step 14:

[1181] Server: Periodically collects progress data and provides it to the user's device in real time. For example, it sends a notification such as, "The foundation of the first floor has been completed. Construction of the second floor is currently underway."

[1182] Step 15:

[1183] Users: View the construction progress in real time on their devices, for example, via a smartphone app or web interface, and provide comments and feedback as needed.

[1184] Example 2

[1185] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1186] Conventional architectural design systems often struggle to fully reflect the user's feelings and preferences, even when users input their wishes and specifications, resulting in low user satisfaction. Furthermore, there are limited ways to check the construction progress in real time, often resulting in a lack of security for users. Another issue is the time-consuming and cumbersome process of checking and correcting blueprints.

[1187] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for inputting the user's wishes and specifications regarding construction and the user's emotional data, a means for collecting the input data and emotional data and storing them in a database, and a means for the construction-specific generation AI to automatically generate blueprints based on the stored data and emotional data. This enables the automatic generation of blueprints that reflect the user's emotions and preferences, thereby improving user satisfaction. Furthermore, the system has a function for checking the construction progress in real time, which increases the user's sense of security. Furthermore, the overall time can be reduced by streamlining the process of checking and correcting blueprints by construction professionals.

[1188] A "user" is someone who uses the system to input information about a desired building, generate blueprints, and check the progress of construction.

[1189] "Emotion data" is data that indicates the user's emotions and preferences, analyzed from information entered by the user and facial expressions.

[1190] "Architecture-specialized generative AI" is an artificial intelligence model that automatically generates blueprints for buildings based on the user's wishes, specifications, and emotional data.

[1191] A "database" is an electronic storage device for storing user input information, emotional data, generated blueprints, and so on.

[1192] "Architectural professionals" are experts who check and correct the generated blueprints from legal and technical perspectives.

[1193] An "architectural professional terminal" is a computer or device used by an architectural professional to review and modify blueprints.

[1194] A "3D printer" is a device that continuously constructs buildings using layered materials based on blueprints.

[1195] "Laminated materials" are building materials used in 3D printers that are continuously ejected through a nozzle.

[1196] "Means of providing information in real time" refers to a system that collects information on the progress of construction as it occurs and notifies users immediately.

[1197] This invention relates to a system that provides buildings quickly and at low cost based on user wishes and specifications. In particular, it provides a system that enables architectural design according to individual user preferences by combining it with an emotion engine that recognizes user emotions. Specific embodiments of this invention are described below.

[1198] 1. Acquiring user information and recognizing emotions

[1199] User

[1200] A user logs into the system and inputs information about the building they want. For example, they might input, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This allows the system to obtain the user's specific wishes and specifications.

[1201] server

[1202] The server sends the information entered by the user to the emotion engine. The emotion engine uses natural language processing APIs, such as IBM Watson or Microsoft Azure Cognitive Services, to analyze the user's input text and facial expression data and recognize the user's emotions. For example, it detects "feelings of anticipation and excitement." Based on this, the server stores the user's wishes, specifications, and emotional data in a database.

[1203] 2. Automatic generation of blueprints

[1204] server

[1205] The server passes the user's wishes, specifications, and emotional data to a generative AI model specialized for architecture (e.g., OpenAI GPT-4) and requests a design plan. The generative AI then references this data, as well as past design data and regional characteristic data, to generate a design plan tailored to the user's preferences.

[1206] Generation AI

[1207] The generative AI automatically generates blueprints, including a bright and spacious living room, reflecting the user's positive emotions. This process utilizes a database of past data, design standards, and local characteristics. The generated blueprints and emotion data are temporarily stored on a server and then sent to the architect's device.

[1208] 3. Check and correct the design drawings

[1209] server

[1210] The server transmits the generated design drawings to the terminal of the construction professional.

[1211] Terminal (Architectural Professional)

[1212] The architect's terminal checks the blueprints from legal and technical standpoints and makes any necessary modifications, such as increasing the number of columns to comply with earthquake resistance standards. Once the modifications are complete, the blueprints are sent back to the server.

[1213] 4. Final Review and Approval

[1214] User

[1215] The user checks the revised design drawing and gives final approval by saying, "Please proceed with this design." The server receives the user's approval information and sends the approved design drawing data to the 3D printing system.

[1216] 5. 3D Printed Architecture

[1217] 3D printer

[1218] The 3D printer builds the building in order, starting from the base, based on the blueprint data. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day. The horizontal movement of the nozzle and the amount of material used are automatically adjusted. The server periodically records the 3D printer's operation log and progress.

[1219] 6. Share your progress

[1220] server

[1221] The server collects the construction progress status in real time based on the sensor and log data collected by the 3D printer. This allows the server to notify the user of the construction progress in real time. For example, the server may inform the user that "The foundation of the first floor has been completed. Construction of the second floor is currently underway." This allows the user to check the construction progress at any time, giving them peace of mind.

[1222] Specific examples

[1223] In response to the prompt, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen," the AI ​​automatically generates a blueprint that includes a bright and spacious living room. The blueprint is then revised by an architectural professional based on earthquake resistance standards, and once the user has approved it, construction begins using a 3D printer.

[1224] In this way, a system incorporating an emotion engine enables highly accurate architectural designs that reflect the user's emotions and preferences, and construction progress is shared in real time, greatly improving user satisfaction.

[1225] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1226] Step 1:

[1227] A user logs into the system and inputs their wishes and specifications for the building. For example, they might input, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This is sent as the initial input data. The server receives the wishes and specifications entered by the user and sends them to the emotion engine. The emotion engine performs text analysis and facial expression recognition to recognize the user's emotions. For example, "feelings of anticipation and excitement" are detected based on the text analysis. The server then stores the user's wishes, specifications, and emotion data in a database.

[1228] Input: User's wishes and specifications (e.g., "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen.")

[1229] Output: Desires, specifications, and emotional data are saved in a database

[1230] Step 2:

[1231] The server passes the user's wishes, specifications, and emotional data stored in the database to an architecture-specific generative AI model and requests a design plan. The generative AI model analyzes the input data and references past design data and regional characteristic data to automatically generate a blueprint tailored to the user's preferences. For example, the generative AI reflects positive emotions and generates a blueprint that includes a bright and spacious living room. The server temporarily stores the generated blueprint and emotional data, and then sends it to the architecture professional's device.

[1232] Input: User's wishes, specifications, and emotional data

[1233] Output: Automatically generated blueprints by generative AI

[1234] Step 3:

[1235] The server sends the generated blueprint to the architectural professional's terminal. The architectural professional reviews the blueprint from legal and technical perspectives and makes any necessary modifications, such as increasing the number of columns based on earthquake resistance standards. Once the modifications are complete, the blueprint is sent back to the server. The server stores the modified blueprint in a database and sends it to the user for confirmation.

[1236] Input: Auto-generated blueprint

[1237] Output: Blueprints revised by the architectural profession

[1238] Step 4:

[1239] The user checks the revised design drawing and gives final approval by saying, "Please proceed with this design." The server receives the user's approval information and sends the approved design drawing data to the 3D printing system.

[1240] Input: Modified blueprint

[1241] Output: User approval information and approved design data sent to the 3D printing system

[1242] Step 5:

[1243] The 3D printer builds the building from the ground up based on the blueprint data. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day. The horizontal movement of the nozzle and the amount of material used are automatically adjusted. The server regularly records the 3D printer's operation log and progress.

[1244] Input: Approved design data

[1245] Output: Physical construction, progress log data

[1246] Step 6:

[1247] The 3D printer collects construction progress information based on sensor and log data. The server collects progress data in real time and notifies the user. For example, the server may inform the user that "The foundations for the first floor have been completed. Construction of the second floor is currently underway." This allows the user to check the construction progress at any time.

[1248] Input: Progress log data

[1249] Output: Real-time notification to the user

[1250] (Application example 2)

[1251] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1252] In the traditional building design and construction process, while it was possible to reflect the user's wishes and specifications, it was difficult to propose designs that took the user's emotions into consideration. Furthermore, there was no user experience utilizing virtual space, and users lacked a means to visually confirm the contents of the blueprints. This created a high possibility that the final building would not meet the user's expectations, resulting in a decrease in satisfaction.

[1253] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1254] In this invention, the server includes a means for recognizing a user's emotions, a means for an architecture-specific generation AI to automatically generate blueprints based on the recognized emotion data and stored data, and a means for the user to visualize and experience the generated blueprints in a virtual space. This makes it possible to propose designs that reflect the user's emotions, and the user can visually check the blueprints in a virtual space, making it possible to provide buildings that are highly satisfying.

[1255] A "user" is an entity that uses the system to input the building's wishes and specifications.

[1256] "Specifications" refers to the specific conditions and requirements for the building desired by the user.

[1257] "Emotion" refers to the psychological state or state of mind that the user expresses when entering input, and is recognized by the system.

[1258] "Emotion recognition" refers to the technology of analyzing and understanding a user's psychological state from facial expressions, voice, etc.

[1259] "Architecture-specialized generative AI" refers to artificial intelligence technology specialized for automatically generating blueprints for buildings.

[1260] A "blueprint" is a drawing that shows the specific shape, structure, and layout of a building.

[1261] An "architect" is a specialist who checks the blueprints of buildings from legal and technical perspectives and makes corrections as necessary.

[1262] A "3D printer" is a machine that layers materials to create three-dimensional buildings and structures.

[1263] "Virtual space" refers to a space that is virtually constructed using computer graphics, etc.

[1264] "Real-time" refers to events being processed simultaneously with little delay after they occur.

[1265] "Visualization" is the conversion of data or information into a visible form such as graphics or images.

[1266] "User experience" refers to the experience and satisfaction that users gain from using a system.

[1267] This invention is a system that proposes and constructs buildings based on the user's wishes and specifications. In particular, it aims to increase user satisfaction by recognizing emotions and allowing users to visualize and experience blueprints in a virtual space. Specific embodiments are shown below.

[1268] System Configuration

[1269] This system mainly uses the following hardware and software:

[1270] Hardware: Smartphones, smart glasses, head-mounted displays, 3D printers

[1271] Software: Camera API, voice recognition API, emotion recognition AI tools (e.g., Microsoft Azure Emotion API, Google Cloud Vision), generative AI specialized for architecture (e.g., GPT-4, DALL-E), virtual space display software (e.g., Unity, Unreal Engine)

[1272] Acquiring user information and recognizing emotions

[1273] Users log in to the system using a smartphone or smart glasses and enter their preferences and specifications. When entering information, the device's camera captures the user's facial expressions, and the microphone accepts voice input. This data is acquired by the camera API and voice recognition API and sent to the emotion recognition AI tool. The emotion recognition AI tool analyzes the user's emotions in real time and stores them as emotion data on the server.

[1274] Automatic generation of blueprints

[1275] The server then passes the collected emotional data and the user's wishes and specifications to a generative AI specialized for architecture. The generative AI model (e.g., GPT-4, DALL-E) references past data and building standards to automatically generate blueprints that reflect the user's emotions. These blueprints are then stored on the server and sent to the architect.

[1276] Check and correct blueprints

[1277] The architect uses the terminal to check the submitted blueprints from legal and technical standpoints and make any necessary corrections. The corrected blueprints are then sent back to the server and provided to the user for review.

[1278] Final confirmation and virtual experience

[1279] Users visualize and experience the blueprint in a virtual space using a head-mounted display. They can visually review the design and request changes. The server receives this feedback and passes the data back to the generative AI model to generate revisions.

[1280] 3D printed architecture

[1281] Finally, the 3D printer creates the building based on the user-approved design. The 3D printer moves the nozzle horizontally, continuously discharging a special mortar and layering it to create the structure.

[1282] Share your progress

[1283] The progress of construction is collected in real time by the server based on sensor and log data and provided to the user, allowing the user to check the progress of the construction at any time.

[1284] Specific examples

[1285] If a user inputs "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen," and the emotion engine detects the emotion of "expectation and excitement," the server collects this information as emotional data and desired specifications. Based on this, the server sends a prompt to the generative AI model: "Generate a modern, two-story house with four rooms, budget under 50 million yen. User feels excited and has high expectations." This generates a blueprint. An architect then reviews and revises the blueprint, and the final blueprint is visualized for the user in a virtual space. In this way, it is possible to provide a design that reflects the user's emotions.

[1286] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1287] Step 1:

[1288] A user logs into the system using a smartphone or smart glasses and inputs their preferences and specifications. The user's facial expressions are captured using a camera API, and their voice is picked up using a microphone. These data are sent to the server through a voice recognition API. Input data includes the number of rooms, design style, budget, and building site information. As output, the server receives the user's preferences and specifications data, as well as the captured facial and voice data.

[1289] Step 2:

[1290] The server passes the received facial and voice data to an emotion recognition AI tool (e.g., Microsoft Azure Emotion API, Google Cloud Vision). The emotion recognition AI analyzes this data and recognizes the user's emotions. The input is facial and voice data, and the output is emotion data (e.g., "expectation and excitement").

[1291] Step 3:

[1292] The server stores the user's preferences, specification data, and emotion data in a database. The stored data includes the number of rooms, design style, budget, construction site information, and emotion data. The stored data is generated as an output.

[1293] Step 4:

[1294] The server generates a prompt sentence based on the collected data and passes it to an architecture-specific generative AI (e.g., GPT-4, DALL-E). An example prompt sentence is "Generate a modern, two-story house with 4 rooms, budget under 50 million yen. User feels excited and has high expectations." The input is the saved user specifications and emotional data, and the output is the generated prompt sentence.

[1295] Step 5:

[1296] The generative AI model automatically generates a blueprint for a building based on the given prompt. The input is the prompt, and the output is the automatically generated blueprint. The generated blueprint is then sent back to the server.

[1297] Step 6:

[1298] The server sends the generated blueprints to the architect's terminal, where the architect checks them from legal and technical perspectives and makes corrections as necessary. The input is the automatically generated blueprint, and the output is the corrected blueprint.

[1299] Step 7:

[1300] The modified blueprint is sent back to the server and provided to the user for confirmation. The user checks the blueprint in the virtual space using a head-mounted display. The input is the modified blueprint, and the output is the user's feedback and confirmation information.

[1301] Step 8:

[1302] After user confirmation, the final blueprint is stored on the server and sent to the 3D printer, which then creates a building based on the blueprint. The input is the final confirmed blueprint, and the output is the actual building.

[1303] Step 9:

[1304] The server collects sensor data from the 3D printer to provide real-time information to the user. This information is periodically updated and sent to the user's device. The input is sensor data, and the output is progress notification to the user.

[1305] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1306] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1307] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1308] [Fourth embodiment]

[1309] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1310] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1311] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1312] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1313] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1314] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1315] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1316] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1317] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1318] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1319] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1320] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1321] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1322] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. The invention combines building-specific generation AI and 3D printing technology to efficiently generate buildings.

[1323] System Overview

[1324] 1. Obtaining user information and gathering requirements

[1325] User: Logs into the system and enters the necessary information for construction through the interface, including the desired number of rooms, design style, budget, and construction site information.

[1326] Server: Takes user input and stores it in a database, formatting it and converting it into a format that can be easily used for further processing.

[1327] 2. Automatic generation of blueprints

[1328] Server: Retrieves user requirements data from the database and passes it to the building-specific generation AI.

[1329] Generative AI: Automatically generates optimal design drawings based on user requirements. This process involves creating plans while referencing certain design standards and past design data.

[1330] Server: Temporarily stores the generated blueprints and later sends them to the architect.

[1331] 3. Check and correct the design drawings

[1332] Server: Sends the generated blueprints to the architect's device.

[1333] Terminal (Architect): Checks the blueprints from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprints to the server.

[1334] Server: Re-saves the modified blueprint and sends it to the user for confirmation.

[1335] 4. Final Review and Approval

[1336] User: Checks the design and gives final approval, which is sent to the server.

[1337] Server: Officially sends the user-approved design to the 3D printing system.

[1338] 5. 3D Printed Architecture

[1339] 3D printer: Based on blueprint data, a special mortar is continuously dispensed by moving the nozzle horizontally, forming layers to form buildings. The printer adjusts the layering pattern and amount of material used, progressing the construction according to the plan.

[1340] 6. Share your progress

[1341] 3D printer: Uses sensors and logs data to record construction progress.

[1342] Server: Collects progress data in real time and provides it to the user's device, allowing the user to check the progress of the construction at any time.

[1343] Specific examples

[1344] 1. Example of user information entry

[1345] User: Enters into the system, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen."

[1346] 2. Automatic generation and checking of blueprints

[1347] Server: Requests a design plan from the generative AI based on the user's data.

[1348] Generative AI: Generates a plan step by step, automatically creating a blueprint with a living room, kitchen, and bathroom on the first floor, and three bedrooms and a balcony on the second floor.

[1349] Terminal (Architect): Checks blueprints and confirms and modifies building standards and safety. For example, modifies the number of columns based on earthquake resistance standards.

[1350] 3. Final Review and Approval

[1351] User: Checks the revised design drawings and gives final approval, saying, "Please proceed with this design."

[1352] 4. 3D Printed Architecture

[1353] 3D printer: Based on the approved blueprint, construction proceeds from the ground up. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day.

[1354] 5. Share your progress

[1355] Server: Notifies the user in real time, "The foundation for the first floor has been completed. Construction of the second floor is currently underway."

[1356] This is the implementation form of this system. Designs that meet the user's needs are provided quickly and efficiently, and the construction progress can be checked in real time, which enables significant cost and time savings.

[1357] The processing flow will be explained below.

[1358] Step 1:

[1359] User: Logs in to the system and enters their architectural wishes and specifications, such as the number of rooms required, design style, budget, and construction site information.

[1360] Step 2:

[1361] Server: Collects input data from users and saves it in a database. Each input item is stored in the database in the specified format.

[1362] Step 3:

[1363] Server: Retrieves user requirements data from the database and passes it to the architecture-specific generation AI. It extracts the user requirements and converts them into a format that the AI ​​can understand.

[1364] Step 4:

[1365] Generation AI (on the server): Automatically generates blueprints based on the user's requirements. During generation, it references a database of past data, design standards, and regional characteristics to create the optimal plan.

[1366] Step 5:

[1367] Server: Temporarily stores the generated blueprints and sends them to the architect for review. The blueprint data and related information are sent as a package.

[1368] Step 6:

[1369] Terminal (Architect): Review blueprints and perform legal and technical checks. View blueprints and perform checks using checklists based on structural stability and building codes.

[1370] Step 7:

[1371] Terminal (Architect): After checking, if any corrections are necessary, make the necessary changes to the blueprint. Send the corrected blueprint to the server.

[1372] Step 8:

[1373] Server: Receives the modified blueprint and sends it to the user for confirmation.

[1374] Step 9:

[1375] User: Review and approve the blueprint. Review the blueprint and add comments if necessary.

[1376] Step 10:

[1377] Server: Sends the design, which has received the user's final approval, to the 3D printing system. It analyzes the design data and converts it into a format that can be sent to the printer.

[1378] Step 11:

[1379] 3D printer: Based on a blueprint, a nozzle moves horizontally to dispense a special mortar, layering it up to form a building. The printer determines the order in which each layer is formed and calculates the amount of mortar to be used.

[1380] Step 12:

[1381] 3D printer: The construction progress is collected based on sensors and log data, and the progress is recorded sequentially, allowing the printer to move on to the next step.

[1382] Step 13:

[1383] Server: Periodically collects progress data and provides it to the user's device in real time. It records the progress of each building part in detail and provides it to the user in text and graphic format.

[1384] Step 14:

[1385] User: See progress in real time on their device, track progress and send feedback to the server if necessary.

[1386] Example 1

[1387] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1388] A major issue with traditional construction projects is the significant time and cost required from the start of design to the actual completion of construction. In particular, it is difficult to quickly respond to diverse user requests and specifications, making the design and revision process cumbersome and inefficient. Another problem is that progress management is time-consuming, making it difficult for users to grasp the status in real time.

[1389] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1390] In this invention, the server includes: a means for inputting user requests and specifications for a building; a means for collecting the input data and saving it in an information database; a means for a building-specific generation AI to automatically generate blueprints based on the saved data; a means for sending prompts to the generation AI and generating blueprints; a means for sending the generated blueprints to an architect for legal and technical review and correction; a means for saving the corrected blueprints and allowing the user to review them; a means for creating a building using a 3D printer based on the blueprints; and a means for providing the user with real-time construction progress updates. This allows for quick and efficient response to user requests and specifications, significantly reducing the time and cost from design to construction. Furthermore, real-time progress management allows users to constantly monitor the progress of construction.

[1391] "User" refers to the user of the system who inputs architectural wishes and specifications.

[1392] "Server" refers to a central system that collects, stores, and processes user information over the Internet.

[1393] "Desires and specifications" refers to the specific requirements for the building the user desires (number of rooms, design style, budget, construction site information, etc.).

[1394] "Information Database" refers to a digital storage system for storing collected user information and data related to the design process.

[1395] "Architecture-specialized generative AI" is an artificial intelligence program specialized in the field of architecture, and has the ability to automatically generate blueprints based on the user's wishes and specifications.

[1396] A "prompt sentence" refers to the input sentence when requesting a construction-specialized generation AI to generate a blueprint.

[1397] "Blueprints" refers to drawings or plans that show the design and structure of a building.

[1398] An "architect" is a specialist who checks the generated blueprints from a legal and technical perspective and makes any necessary corrections.

[1399] "Modification" refers to the process of making changes or revisions to the generated design drawings from legal and technical perspectives.

[1400] A "3D printer" is a device that creates actual buildings by layering materials such as mortar based on digital blueprints.

[1401] "Progress" refers to the progress of each stage of a construction project.

[1402] "Real-time" refers to the near-instantaneous reflection and display of ongoing activities and conditions.

[1403] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. The invention combines building-specific generation AI and 3D printing technology to efficiently generate buildings.

[1404] The system is implemented using the following hardware and software:

[1405] 1. Server:

[1406] The server plays a central role in receiving input from users, storing it in a database, and generating prompts for the generative AI.

[1407] 2. Terminal:

[1408] A device used by architects to check and correct blueprints, specifically a PC or tablet with CAD software installed.

[1409] 3. User Device:

[1410] The device that users use to access the system and enter their preferences and specifications. This can include smartphones, tablets, and PCs.

[1411] 4. Architecture-specific generative AI:

[1412] The AI ​​model automatically generates blueprints based on prompts sent from the server, and references past architectural design data and certain design standards.

[1413] 5. 3D Printer:

[1414] This refers to hardware that uses special mortar to form buildings based on submitted blueprints.

[1415] Implementation details

[1416] Obtaining user information and gathering requirements

[1417] Users log in to the system and enter the necessary information for construction through the interface, including the desired number of rooms, design style, budget, and construction site information.

[1418] Example: "I want to build a modern, two-story house with four rooms within a budget of 50 million yen."

[1419] The server receives user input and stores the data in an information database, where it is formatted and converted into a form that can be easily used for further processing.

[1420] Automatic generation of blueprints

[1421] The server retrieves the user's requirements data from the database and passes it to the building-specialized generation AI.

[1422] Example prompt: "The user's desired building is a two-story house with four rooms and a modern design. The budget is within 50 million yen."

[1423] The generative AI automatically generates optimal design drawings based on the user's requirements, and in this process creates plans while referencing certain design standards and past design data.

[1424] For example, the first floor will have a living room, kitchen and bathroom, while the second floor will have three bedrooms and a balcony.

[1425] The server temporarily stores the generated blueprints and later sends them to the architect.

[1426] Check and correct blueprints

[1427] The server transmits the generated design drawings to the architect's terminal.

[1428] The terminal (architect) checks the blueprint from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprint to the server.

[1429] Example: Modifying the number of columns based on seismic standards.

[1430] The server re-stores the modified blueprint and sends it to the user for confirmation.

[1431] Final review and approval

[1432] The user checks the design and gives final approval, which is then sent to the server.

[1433] For example: "Please proceed with this design."

[1434] The server officially sends the user-approved design to the 3D printing system.

[1435] 3D printed architecture

[1436] Based on blueprint data, the 3D printer forms a building by continuously ejecting and layering special mortar while moving the nozzle horizontally.

[1437] Example: Complete the foundation of the first floor in one day and build the second floor the next day.

[1438] Share your progress

[1439] The 3D printer uses sensors and logs data to record the construction progress.

[1440] The server collects progress data in real time and provides it to the user's terminal.

[1441] Example: "The foundations for the first floor are complete. Construction of the second floor is currently underway."

[1442] This system allows us to respond quickly and efficiently to the diverse needs and specifications of our users, significantly reducing the time and cost required from design to construction. Furthermore, it allows for real-time management of progress, allowing users to constantly monitor the progress of construction.

[1443] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1444] Step 1:

[1445] The user uses the interface to input their architectural preferences and specifications (number of rooms, design style, budget, construction site information, etc.). Specifically, the user logs in with their account, fills in the required information in the input form, and clicks the submit button. This input data is used for the next process.

[1446] Input: Your wishes and specifications

[1447] Output: Send data to the server

[1448] Step 2:

[1449] The server receives the user's input data and stores it in an information database, formatting the data and converting it into a format that is easy to handle for subsequent processing. Specifically, the server receives an HTTP request and executes a query to insert the data into the database.

[1450] Input: Data submitted by the user

[1451] Output: Formatted data stored in a database

[1452] Step 3:

[1453] The server retrieves the user's requirements data from the database and passes the data to the architecture-specific generation AI. Specifically, the server executes periodic queries, loads the necessary data into a cache, and sends prompts to the generation AI's API.

[1454] Input: Formatted data stored in the database

[1455] Output: The prompt sent to the generation AI

[1456] Step 4:

[1457] The AI ​​automatically generates optimal blueprints based on the prompts. During this process, the AI ​​creates plans while referencing certain design standards and past design data. Specifically, the AI ​​uses its internal algorithms to generate blueprints and sends them back to the server in digital format.

[1458] Input: Prompt text sent from the server

[1459] Output: Generated blueprint

[1460] Step 5:

[1461] The server temporarily stores the generated blueprints and later sends them to the architect. Specifically, the server stores the blueprint data in temporary storage and prepares an HTTP request to the architect's terminal for the next step.

[1462] Input: Blueprint sent from the generation AI

[1463] Output: Temporarily saved blueprint data

[1464] Step 6:

[1465] The server sends the generated design data to the architect's terminal. Specifically, the server encodes the data and executes an HTTP request to the architect's terminal.

[1466] Input: Temporarily saved blueprint data

[1467] Output: Blueprint data sent to the architect's terminal

[1468] Step 7:

[1469] The terminal (architect) checks the blueprint from legal and technical perspectives and makes any necessary corrections. Specifically, the architect opens the blueprint using CAD software and makes any necessary corrections. Once the corrections are complete, the corrected blueprint data is uploaded to the server.

[1470] Input: Blueprint data sent from the server

[1471] Output: Modified blueprint data

[1472] Step 8:

[1473] The server stores the modified blueprint data again and sends it to the user for confirmation. Specifically, the server stores the modified data in the database and then sends a notification to the user's terminal.

[1474] Input: Modified blueprint data

[1475] Output: The revised design is sent to the user's device.

[1476] Step 9:

[1477] The user checks the revised design and gives final approval. The approval information is sent to the server. Specifically, the user previews the design on the interface and clicks the "Approve" button. This action is sent as data to the server.

[1478] Input: Modified design notified to user

[1479] Output: Authorization information sent to the server

[1480] Step 10:

[1481] The server officially sends the user-approved design to the 3D printing system. Specifically, the server encodes the design data and sends an HTTP request to the 3D printer's control system.

[1482] Input: Authorization information sent by the user

[1483] Output: Design data sent to the 3D printing system

[1484] Step 11:

[1485] The 3D printer creates buildings by continuously discharging special mortar while moving the nozzle horizontally based on the blueprint data, and layering it up. Specifically, the printer operates according to the blueprint data to form each layer.

[1486] Input: Blueprint data sent from the server

[1487] Output: Physical building constructed

[1488] Step 12:

[1489] The 3D printer uses sensors and log data to record the progress of the construction. Specifically, the 3D printer uses built-in sensors to collect data in real time and sends the log to a server.

[1490] Input: Sensor data collected during the building process

[1491] Output: Progress data sent to the server

[1492] Step 13:

[1493] The server collects progress data in real time and provides it to the user's terminal, and specifically, the server processes the collected data and displays it on the user's interface in real time.

[1494] Input: Progress data sent from the 3D printer

[1495] Output: Progress notification displayed on the user's terminal

[1496] The above are the details of the specific processing steps in this system. Each step is closely linked to realize a fast and efficient construction process based on the user's wishes.

[1497] (Application example 1)

[1498] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1499] In conventional construction processes, designing and constructing a building based on a user's wishes and specifications requires a great deal of time and money. Furthermore, making design changes and checking progress is time-consuming and burdensome for users. The purpose of this invention is to solve these problems and provide a system that allows users to easily customize building designs and check progress in real time.

[1500] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1501] In this invention, the server includes means for inputting building requests and specifications from users, means for collecting the input data and saving it in a database, means for a building-specialized generation AI to automatically generate blueprints based on the saved data, means for sending the generated blueprints to an architect for legal and technical checks and corrections, means for the user to review the blueprints after checking and corrections have been completed, means for forming a building using a 3D printer based on the blueprints, means for providing the user with real-time construction progress information, and means for the user to input requirements and check the construction progress via a smartphone, thereby enabling users to quickly and efficiently design and construct buildings.

[1502] "User" refers to a general user who inputs their wishes and specifications regarding the design and construction of a building and checks its progress.

[1503] "Architectural wishes and specifications" are specific requirements and conditions such as the number of rooms, design style, budget, and information about the construction site of the building desired by the user.

[1504] The "database" is an information management system for managing and storing architectural wishes and specifications entered by users.

[1505] "Architecture-specialized generative AI" is an artificial intelligence technology that automatically generates optimal blueprints based on the architectural wishes and specifications entered by the user.

[1506] "Blueprints" are detailed drawings used when designing a building, automatically generated by architecturally specialized generation AI and used by architects to check and correct.

[1507] An "architect" is a specialist who checks the generated blueprints from legal and technical perspectives and makes any necessary corrections.

[1508] A 3D printer is a device that forms buildings by continuously discharging and layering special mortar while moving a nozzle horizontally based on blueprint data.

[1509] "Progress" is information that indicates the current stage of the design and construction of a building, and is provided to the user in real time.

[1510] A "smartphone" is a portable information terminal device that allows users to input their wishes and specifications regarding construction and check the progress of construction.

[1511] The system for implementing this invention allows users to input their wishes and specifications via smartphone, and then a specialized architectural generation AI automatically generates blueprints based on that information, providing a process for actually creating the building using a 3D printer. This system is composed of multiple pieces of hardware and software, including a server, a user terminal, an architect terminal, and a 3D printer.

[1512] The server collects architectural specifications (such as the number of rooms, design style, budget, and construction site information) entered by the user via smartphone and stores them in a database. Next, a specialized architectural generation AI automatically generates blueprints based on this data. This AI generates a plan that best suits the user's requirements, referencing certain design standards and past design data.

[1513] The generated blueprints are sent to the architect's terminal and checked from legal and technical perspectives. During this process, it is confirmed whether the design complies with regulations and satisfies safety standards such as earthquake resistance. After the architect has completed the revisions, the blueprints are sent to the user via the server for confirmation.

[1514] The user can review the generated and revised blueprints via their smartphone and provide final approval. This approval information is then sent to the server, which then sends the blueprints to the 3D printing system. The 3D printer then moves the nozzle horizontally, continuously discharging a special mortar to layer the structure to create a building based on the blueprint.

[1515] The 3D printer also uses sensors and log data to record the progress of construction, and the server collects this data in real time and provides it to the user's smartphone, allowing the user to check the progress of construction at any time.

[1516] Specific examples

[1517] For example, a user might enter on their smartphone, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This information is collected and stored on the server, and a specialized architectural generation AI automatically generates a blueprint with a living room, kitchen, and bathroom on the first floor, and three bedrooms and a balcony on the second floor. The blueprint is then sent to an architect, who makes any necessary revisions after legal and technical checks, and the revised blueprint is then reviewed by the user again. Once the user has finally approved the blueprint, the 3D printer begins construction, and the user is notified of the progress in real time.

[1518] Prompt Sentence Examples

[1519] "User's desired building requirements:

[1520] Number of rooms: 4

[1521] Design Style: Modern

[1522] Budget: Under 50 million yen

[1523] Location: Tokyo

[1524] Generate the optimal design plan based on this.

[1525] In this way, by using this system, users can design and construct buildings quickly and efficiently, and can check the progress in real time, thereby reducing costs and time.

[1526] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1527] Step 1:

[1528] Users use their smartphones to input their wishes and specifications regarding the building. Specifically, the user enters requirements information such as "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen" into an input form on their smartphone. This input data is sent from the user to the server.

[1529] Step 2:

[1530] The server receives the data of the user's wishes and specifications and stores it in a database. During the storage process, the data is formatted and converted into the required format, making it easier to handle in subsequent processing.

[1531] Step 3:

[1532] The server retrieves the user's requirements data from the database and passes that data to the architecture-specialized generation AI. Specifically, requirements such as "number of rooms: 4, design style: modern, budget: within 50 million yen, location: Tokyo" are entered into the generation AI. The generation AI then automatically generates blueprints based on this data.

[1533] Step 4:

[1534] The generative AI model generates optimal design drawings based on the user's requirements data. In doing so, it automatically creates plans while referencing past design data and certain design standards. Once the design drawing data is generated, it is sent to a server and temporarily stored.

[1535] Step 5:

[1536] The server then sends the generated blueprint data to the architect's terminal. The architect then checks the blueprints received on the terminal from legal and technical perspectives and makes any necessary modifications. For example, the architect may increase the number of columns to comply with earthquake resistance standards or check legal regulations. The modified blueprints are then sent back to the server.

[1537] Step 6:

[1538] The server receives the revised blueprints sent by the architect and sends them to the user for confirmation. The user then checks the blueprints via their smartphone and performs final approval. If the user approves the blueprints, the information is sent back to the server.

[1539] Step 7:

[1540] The server then sends the approved design data to the 3D printing system. The 3D printer then moves the nozzle horizontally based on the design data, continuously discharging a special mortar and layering it to form the building. Specifically, it builds the foundation for the first floor, then stacks the second floor.

[1541] Step 8:

[1542] The 3D printer records the construction progress using sensors and log data. As the construction progresses, it sends the current progress status to the server, which collects this progress data in real time and provides it to the user.

[1543] Step 9:

[1544] Users can check the construction progress in real time via their smartphones. Specifically, they will receive updates on the construction status, such as "The foundations for the first floor have been completed. Construction of the second floor is currently underway."

[1545] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1546] This invention relates to a system that provides buildings quickly and at low cost based on the user's wishes and specifications. In particular, it provides a system that enables architectural designs that are more in line with the preferences of individual users by combining it with an emotion engine that recognizes the user's emotions.

[1547] System Overview

[1548] 1. Acquiring user information and recognizing emotions

[1549] User: Logs in to the system and inputs their wishes and specifications, including the number of rooms required, design style, budget, and construction site information.

[1550] Emotion engine (on the server): Analyzes the user's input information and recognizes the user's emotions. Emotions are acquired using, for example, text analysis and facial expression recognition technology.

[1551] Server: Stores the emotion data collected by the emotion engine in a database along with the user's preferences and specifications.

[1552] 2. Automatic generation of blueprints

[1553] Server: Based on the user's wishes, specifications, and emotional data, it passes this to a specialized construction generation AI.

[1554] Generative AI: Automatically generates blueprints that better suit the user's preferences based on user requirements and sentiment data. This process references a database of past data, design standards, and local characteristics to create the optimal plan.

[1555] Server: Temporarily stores the generated blueprints and associated emotion data, then transmits them to the architect.

[1556] 3. Check and correct the design drawings

[1557] Server: Sends the generated blueprints to the architect's device.

[1558] Terminal (Architect): Checks the blueprints from legal and technical points of view, makes any necessary corrections, and then sends the corrected blueprints to the server.

[1559] Server: Save the modified blueprint again and send it to the user for confirmation.

[1560] 4. Final Review and Approval

[1561] User: Review the revised design and give final approval, for example by entering approval information and any additional comments.

[1562] Server: Officially sends the user-approved design to the 3D printing system.

[1563] 5. 3D Printed Architecture

[1564] 3D printer: Based on blueprint data, the nozzle moves horizontally to continuously dispense special mortar, layering it to form a building. The order in which each layer is formed and the amount of material used are automatically adjusted.

[1565] 6. Share your progress

[1566] 3D printer: Construction progress is collected based on sensors and log data.

[1567] Server: Collects progress data periodically and provides it to users in real time, allowing users to check the progress of their construction at any time.

[1568] Specific examples

[1569] 1. Example of user information entry

[1570] User: "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." At the same time, the emotion engine detects "feelings of anticipation and excitement" from the user's sentence.

[1571] 2. Automatic generation and checking of blueprints

[1572] Server: Requests a design plan from the generative AI based on user data and emotional data.

[1573] Generative AI: Reflects the user's positive emotions and automatically generates blueprints including a bright and spacious living room.

[1574] Terminal (Architect): Checks the blueprints and confirms and modifies building standards and safety. For example, modifies the number of columns based on earthquake resistance standards.

[1575] 3. Final Review and Approval

[1576] User: Checks the revised design drawings and gives final approval, saying, "Please proceed with this design."

[1577] 4. 3D Printed Architecture

[1578] 3D printer: Based on the approved blueprint, construction proceeds from the ground up. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day.

[1579] 5. Share your progress

[1580] Server: Notifies the user in real time, "The foundation for the first floor has been completed. Construction of the second floor is currently underway."

[1581] In this way, by combining the emotion engine, it becomes possible to design and build structures that better reflect the user's emotions and preferences, and to provide buildings that provide greater satisfaction. In addition, the progress of construction can be checked in real time, which increases the user's sense of security.

[1582] The processing flow will be explained below.

[1583] Step 1:

[1584] User: Logs into the system and enters their architectural wishes and specifications, such as the number of rooms required, design style, budget, and construction location.

[1585] Step 2:

[1586] Emotion engine (on the server): Analyzes user input information in real time and recognizes the user's emotions. For example, it performs text analysis and facial expression recognition to identify emotions such as "expectation" and "excitement."

[1587] Step 3:

[1588] Server: Collects user inputs such as preferences and specifications, as well as recognized emotional data, formats them, and stores them in a database.

[1589] Step 4:

[1590] Server: Obtains user preferences, specifications, and emotional data from the database and passes them to the specialized architectural generation AI.

[1591] Step 5:

[1592] Generative AI (on the server): Automatically generates blueprints based on the user's wishes and emotional data. For example, if a user requests a "bright living room" and the emotional engine detects the emotion of "expectation and excitement," it will create a blueprint that includes a living room with spacious windows and bright colors.

[1593] Step 6:

[1594] Server: Temporarily stores the generated blueprints and then sends them to the architect.

[1595] Step 7:

[1596] Terminal (architect): Receives blueprints and checks them from legal and technical perspectives. For example, checks whether they comply with the Building Standards Act and whether earthquake resistance is appropriate based on a checklist.

[1597] Step 8:

[1598] Terminal (architect): After checking, make any necessary modifications to the blueprint. For example, change the size of a window to improve safety. Once the modifications are complete, send the modified blueprint back to the server.

[1599] Step 9:

[1600] Server: Receives the modified blueprint and sends it to the user for confirmation.

[1601] Step 10:

[1602] User: Checks the design and gives final approval. For example, if the user views the design and is satisfied with the overall design, they submit a comment such as "Please proceed with this design" and their approval.

[1603] Step 11:

[1604] Server: After receiving the user's final approval, the design is officially sent to the 3D printing system.

[1605] Step 12:

[1606] 3D printer: Based on a blueprint, a nozzle moves horizontally to dispense special mortar, layering it up to form a building. For example, starting with the foundation, the first floor walls are constructed, followed by the second floor walls.

[1607] Step 13:

[1608] 3D printer: The progress of construction is collected based on sensors and log data. For example, when the first floor walls are completed, that information is collected and the next step is started.

[1609] Step 14:

[1610] Server: Periodically collects progress data and provides it to the user's device in real time. For example, it sends a notification such as, "The foundation of the first floor has been completed. Construction of the second floor is currently underway."

[1611] Step 15:

[1612] Users: View the construction progress in real time on their devices, for example, via a smartphone app or web interface, and provide comments and feedback as needed.

[1613] Example 2

[1614] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1615] Conventional architectural design systems often struggle to fully reflect the user's feelings and preferences, even when users input their wishes and specifications, resulting in low user satisfaction. Furthermore, there are limited ways to check the construction progress in real time, often resulting in a lack of security for users. Another issue is the time-consuming and cumbersome process of checking and correcting blueprints.

[1616] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for inputting the user's wishes and specifications regarding construction and the user's emotional data, a means for collecting the input data and emotional data and storing them in a database, and a means for the construction-specific generation AI to automatically generate blueprints based on the stored data and emotional data. This enables the automatic generation of blueprints that reflect the user's emotions and preferences, thereby improving user satisfaction. Furthermore, the system has a function for checking the construction progress in real time, which increases the user's sense of security. Furthermore, the overall time can be reduced by streamlining the process of checking and correcting blueprints by construction professionals.

[1617] A "user" is someone who uses the system to input information about a desired building, generate blueprints, and check the progress of construction.

[1618] "Emotion data" is data that indicates the user's emotions and preferences, analyzed from information entered by the user and facial expressions.

[1619] "Architecture-specialized generative AI" is an artificial intelligence model that automatically generates blueprints for buildings based on the user's wishes, specifications, and emotional data.

[1620] A "database" is an electronic storage device for storing user input information, emotional data, generated blueprints, and so on.

[1621] "Architectural professionals" are experts who check and correct the generated blueprints from legal and technical perspectives.

[1622] An "architectural professional terminal" is a computer or device used by an architectural professional to review and modify blueprints.

[1623] A "3D printer" is a device that continuously constructs buildings using layered materials based on blueprints.

[1624] "Laminated materials" are building materials used in 3D printers that are continuously ejected through a nozzle.

[1625] "Means of providing information in real time" refers to a system that collects information on the progress of construction as it occurs and notifies users immediately.

[1626] This invention relates to a system that provides buildings quickly and at low cost based on user wishes and specifications. In particular, it provides a system that enables architectural design according to individual user preferences by combining it with an emotion engine that recognizes user emotions. Specific embodiments of this invention are described below.

[1627] 1. Acquiring user information and recognizing emotions

[1628] User

[1629] A user logs into the system and inputs information about the building they want. For example, they might input, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This allows the system to obtain the user's specific wishes and specifications.

[1630] server

[1631] The server sends the information entered by the user to the emotion engine. The emotion engine uses natural language processing APIs, such as IBM Watson or Microsoft Azure Cognitive Services, to analyze the user's input text and facial expression data and recognize the user's emotions. For example, it detects "feelings of anticipation and excitement." Based on this, the server stores the user's wishes, specifications, and emotional data in a database.

[1632] 2. Automatic generation of blueprints

[1633] server

[1634] The server passes the user's wishes, specifications, and emotional data to a generative AI model specialized for architecture (e.g., OpenAI GPT-4) and requests a design plan. The generative AI then references this data, as well as past design data and regional characteristic data, to generate a design plan tailored to the user's preferences.

[1635] Generation AI

[1636] The generative AI automatically generates blueprints, including a bright and spacious living room, reflecting the user's positive emotions. This process utilizes a database of past data, design standards, and local characteristics. The generated blueprints and emotion data are temporarily stored on a server and then sent to the architect's device.

[1637] 3. Check and correct the design drawings

[1638] server

[1639] The server transmits the generated design drawings to the terminal of the construction professional.

[1640] Terminal (Architectural Professional)

[1641] The architect's terminal checks the blueprints from legal and technical standpoints and makes any necessary modifications, such as increasing the number of columns to comply with earthquake resistance standards. Once the modifications are complete, the blueprints are sent back to the server.

[1642] 4. Final Review and Approval

[1643] User

[1644] The user checks the revised design drawing and gives final approval by saying, "Please proceed with this design." The server receives the user's approval information and sends the approved design drawing data to the 3D printing system.

[1645] 5. 3D Printed Architecture

[1646] 3D printer

[1647] The 3D printer builds the building in order, starting from the base, based on the blueprint data. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day. The horizontal movement of the nozzle and the amount of material used are automatically adjusted. The server periodically records the 3D printer's operation log and progress.

[1648] 6. Share your progress

[1649] server

[1650] The server collects the construction progress status in real time based on the sensor and log data collected by the 3D printer. This allows the server to notify the user of the construction progress in real time. For example, the server may inform the user that "The foundation of the first floor has been completed. Construction of the second floor is currently underway." This allows the user to check the construction progress at any time, giving them peace of mind.

[1651] Specific examples

[1652] In response to the prompt, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen," the AI ​​automatically generates a blueprint that includes a bright and spacious living room. The blueprint is then revised by an architectural professional based on earthquake resistance standards, and once the user has approved it, construction begins using a 3D printer.

[1653] In this way, a system incorporating an emotion engine enables highly accurate architectural designs that reflect the user's emotions and preferences, and construction progress is shared in real time, greatly improving user satisfaction.

[1654] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1655] Step 1:

[1656] A user logs into the system and inputs their wishes and specifications for the building. For example, they might input, "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen." This is sent as the initial input data. The server receives the wishes and specifications entered by the user and sends them to the emotion engine. The emotion engine performs text analysis and facial expression recognition to recognize the user's emotions. For example, "feelings of anticipation and excitement" are detected based on the text analysis. The server then stores the user's wishes, specifications, and emotion data in a database.

[1657] Input: User's wishes and specifications (e.g., "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen.")

[1658] Output: Desires, specifications, and emotional data are saved in a database

[1659] Step 2:

[1660] The server passes the user's wishes, specifications, and emotional data stored in the database to an architecture-specific generative AI model and requests a design plan. The generative AI model analyzes the input data and references past design data and regional characteristic data to automatically generate a blueprint tailored to the user's preferences. For example, the generative AI reflects positive emotions and generates a blueprint that includes a bright and spacious living room. The server temporarily stores the generated blueprint and emotional data, and then sends it to the architecture professional's device.

[1661] Input: User's wishes, specifications, and emotional data

[1662] Output: Automatically generated blueprints by generative AI

[1663] Step 3:

[1664] The server sends the generated blueprint to the architectural professional's terminal. The architectural professional reviews the blueprint from legal and technical perspectives and makes any necessary modifications, such as increasing the number of columns based on earthquake resistance standards. Once the modifications are complete, the blueprint is sent back to the server. The server stores the modified blueprint in a database and sends it to the user for confirmation.

[1665] Input: Auto-generated blueprint

[1666] Output: Blueprints revised by the architectural profession

[1667] Step 4:

[1668] The user checks the revised design drawing and gives final approval by saying, "Please proceed with this design." The server receives the user's approval information and sends the approved design drawing data to the 3D printing system.

[1669] Input: Modified blueprint

[1670] Output: User approval information and approved design data sent to the 3D printing system

[1671] Step 5:

[1672] The 3D printer builds the building from the ground up based on the blueprint data. For example, the first floor foundation can be completed in one day, and the second floor can be constructed the next day. The horizontal movement of the nozzle and the amount of material used are automatically adjusted. The server regularly records the 3D printer's operation log and progress.

[1673] Input: Approved design data

[1674] Output: Physical construction, progress log data

[1675] Step 6:

[1676] The 3D printer collects construction progress information based on sensor and log data. The server collects progress data in real time and notifies the user. For example, the server may inform the user that "The foundations for the first floor have been completed. Construction of the second floor is currently underway." This allows the user to check the construction progress at any time.

[1677] Input: Progress log data

[1678] Output: Real-time notification to the user

[1679] (Application example 2)

[1680] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1681] In the traditional building design and construction process, while it was possible to reflect the user's wishes and specifications, it was difficult to propose designs that took the user's emotions into consideration. Furthermore, there was no user experience utilizing virtual space, and users lacked a means to visually confirm the contents of the blueprints. This created a high possibility that the final building would not meet the user's expectations, resulting in a decrease in satisfaction.

[1682] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1683] In this invention, the server includes a means for recognizing a user's emotions, a means for an architecture-specific generation AI to automatically generate blueprints based on the recognized emotion data and stored data, and a means for the user to visualize and experience the generated blueprints in a virtual space. This makes it possible to propose designs that reflect the user's emotions, and the user can visually check the blueprints in a virtual space, making it possible to provide buildings that are highly satisfying.

[1684] A "user" is an entity that uses the system to input the building's wishes and specifications.

[1685] "Specifications" refers to the specific conditions and requirements for the building desired by the user.

[1686] "Emotion" refers to the psychological state or state of mind that the user expresses when entering input, and is recognized by the system.

[1687] "Emotion recognition" refers to the technology of analyzing and understanding a user's psychological state from facial expressions, voice, etc.

[1688] "Architecture-specialized generative AI" refers to artificial intelligence technology specialized for automatically generating blueprints for buildings.

[1689] A "blueprint" is a drawing that shows the specific shape, structure, and layout of a building.

[1690] An "architect" is a specialist who checks the blueprints of buildings from legal and technical perspectives and makes corrections as necessary.

[1691] A "3D printer" is a machine that layers materials to create three-dimensional buildings and structures.

[1692] "Virtual space" refers to a space that is virtually constructed using computer graphics, etc.

[1693] "Real-time" refers to events being processed simultaneously with little delay after they occur.

[1694] "Visualization" is the conversion of data or information into a visible form such as graphics or images.

[1695] "User experience" refers to the experience and satisfaction that users gain from using a system.

[1696] This invention is a system that proposes and constructs buildings based on the user's wishes and specifications. In particular, it aims to increase user satisfaction by recognizing emotions and allowing users to visualize and experience blueprints in a virtual space. Specific embodiments are shown below.

[1697] System Configuration

[1698] This system mainly uses the following hardware and software:

[1699] Hardware: Smartphones, smart glasses, head-mounted displays, 3D printers

[1700] Software: Camera API, voice recognition API, emotion recognition AI tools (e.g., Microsoft Azure Emotion API, Google Cloud Vision), generative AI specialized for architecture (e.g., GPT-4, DALL-E), virtual space display software (e.g., Unity, Unreal Engine)

[1701] Acquiring user information and recognizing emotions

[1702] Users log in to the system using a smartphone or smart glasses and enter their preferences and specifications. When entering information, the device's camera captures the user's facial expressions, and the microphone accepts voice input. This data is acquired by the camera API and voice recognition API and sent to the emotion recognition AI tool. The emotion recognition AI tool analyzes the user's emotions in real time and stores them as emotion data on the server.

[1703] Automatic generation of blueprints

[1704] The server then passes the collected emotional data and the user's wishes and specifications to a generative AI specialized for architecture. The generative AI model (e.g., GPT-4, DALL-E) references past data and building standards to automatically generate blueprints that reflect the user's emotions. These blueprints are then stored on the server and sent to the architect.

[1705] Check and correct blueprints

[1706] The architect uses the terminal to check the submitted blueprints from legal and technical standpoints and make any necessary corrections. The corrected blueprints are then sent back to the server and provided to the user for review.

[1707] Final confirmation and virtual experience

[1708] Users visualize and experience the blueprint in a virtual space using a head-mounted display. They can visually review the design and request changes. The server receives this feedback and passes the data back to the generative AI model to generate revisions.

[1709] 3D printed architecture

[1710] Finally, the 3D printer creates the building based on the user-approved design. The 3D printer moves the nozzle horizontally, continuously discharging a special mortar and layering it to create the structure.

[1711] Share your progress

[1712] The progress of construction is collected in real time by the server based on sensor and log data and provided to the user, allowing the user to check the progress of the construction at any time.

[1713] Specific examples

[1714] If a user inputs "I want to build a two-story house with four rooms and a modern design within a budget of 50 million yen," and the emotion engine detects the emotion of "expectation and excitement," the server collects this information as emotional data and desired specifications. Based on this, the server sends a prompt to the generative AI model: "Generate a modern, two-story house with four rooms, budget under 50 million yen. User feels excited and has high expectations." This generates a blueprint. An architect then reviews and revises the blueprint, and the final blueprint is visualized for the user in a virtual space. In this way, it is possible to provide a design that reflects the user's emotions.

[1715] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1716] Step 1:

[1717] A user logs into the system using a smartphone or smart glasses and inputs their preferences and specifications. The user's facial expressions are captured using a camera API, and their voice is picked up using a microphone. These data are sent to the server through a voice recognition API. Input data includes the number of rooms, design style, budget, and building site information. As output, the server receives the user's preferences and specifications data, as well as the captured facial and voice data.

[1718] Step 2:

[1719] The server passes the received facial and voice data to an emotion recognition AI tool (e.g., Microsoft Azure Emotion API, Google Cloud Vision). The emotion recognition AI analyzes this data and recognizes the user's emotions. The input is facial and voice data, and the output is emotion data (e.g., "expectation and excitement").

[1720] Step 3:

[1721] The server stores the user's preferences, specification data, and emotion data in a database. The stored data includes the number of rooms, design style, budget, construction site information, and emotion data. The stored data is generated as an output.

[1722] Step 4:

[1723] The server generates a prompt sentence based on the collected data and passes it to an architecture-specific generative AI (e.g., GPT-4, DALL-E). An example prompt sentence is "Generate a modern, two-story house with 4 rooms, budget under 50 million yen. User feels excited and has high expectations." The input is the saved user specifications and emotional data, and the output is the generated prompt sentence.

[1724] Step 5:

[1725] The generative AI model automatically generates a blueprint for a building based on the given prompt. The input is the prompt, and the output is the automatically generated blueprint. The generated blueprint is then sent back to the server.

[1726] Step 6:

[1727] The server sends the generated blueprints to the architect's terminal, where the architect checks them from legal and technical perspectives and makes corrections as necessary. The input is the automatically generated blueprint, and the output is the corrected blueprint.

[1728] Step 7:

[1729] The modified blueprint is sent back to the server and provided to the user for confirmation. The user checks the blueprint in the virtual space using a head-mounted display. The input is the modified blueprint, and the output is the user's feedback and confirmation information.

[1730] Step 8:

[1731] After user confirmation, the final blueprint is stored on the server and sent to the 3D printer, which then creates a building based on the blueprint. The input is the final confirmed blueprint, and the output is the actual building.

[1732] Step 9:

[1733] The server collects sensor data from the 3D printer to provide real-time information to the user. This information is periodically updated and sent to the user's device. The input is sensor data, and the output is progress notification to the user.

[1734] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1735] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1736] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1737] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1738] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1739] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1740] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1741] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1742] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1743] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1744] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1745] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1746] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1747] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1748] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1749] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1750] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1751] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1752] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1753] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1754] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1755] The following is further disclosed regarding the above embodiment.

[1756] (Claim 1)

[1757] A means for users to input their architectural wishes and specifications;

[1758] a means for collecting and storing the entered data in a database;

[1759] A means for a specialized construction generation AI to automatically generate blueprints based on the saved data,

[1760] The means to send the generated design drawings to the architect for legal and technical checks and corrections;

[1761] a means for allowing a user to confirm the design drawing after the checking and correction has been completed;

[1762] A means of creating buildings using a 3D printer based on blueprints,

[1763] a means of providing users with real-time information about the construction progress;

[1764] A system including:

[1765] (Claim 2)

[1766] 10. The system of claim 1, further comprising means including an architect terminal by which an architect can check and modify the blueprints.

[1767] (Claim 3)

[1768] The system of claim 1, wherein the 3D printer includes a means for continuously discharging and layering special mortar while horizontally moving the nozzle based on a design drawing.

[1769] "Example 1"

[1770] (Claim 1)

[1771] A means for users to input their architectural wishes and specifications;

[1772] means for collecting and storing the input data in an information database;

[1773] A means for a specialized construction generation AI to automatically generate blueprints based on the saved data,

[1774] A means for sending a prompt to the generation AI to generate a blueprint;

[1775] The means to send the generated design drawings to the architect for legal and technical checks and corrections;

[1776] a means for saving the modified design drawing and allowing the user to confirm it;

[1777] A means of creating buildings using a 3D printer based on blueprints,

[1778] a means of providing users with real-time information about the construction progress;

[1779] A system including:

[1780] (Claim 2)

[1781] 10. The system of claim 1, further comprising means including an architect terminal by which an architect can check and modify the blueprints.

[1782] (Claim 3)

[1783] The system of claim 1, wherein the 3D printer includes a means for continuously discharging and layering special mortar while horizontally moving the nozzle based on a design drawing.

[1784] "Application Example 1"

[1785] (Claim 1)

[1786] A means for users to input their architectural wishes and specifications;

[1787] a means for collecting and storing the entered data in a database;

[1788] A means for a specialized construction generation AI to automatically generate blueprints based on the saved data,

[1789] The means to send the generated design drawings to the architect for legal and technical checks and corrections;

[1790] a means for allowing a user to confirm the design drawing after the checking and correction has been completed;

[1791] A means of creating buildings using a 3D printer based on blueprints,

[1792] a means of providing users with real-time information about the construction progress;

[1793] A means for users to input requirements and check the construction progress via smartphone;

[1794] A system including:

[1795] (Claim 2)

[1796] 10. The system of claim 1, further comprising means including an architect terminal by which an architect can check and modify the blueprints.

[1797] (Claim 3)

[1798] The system of claim 1, wherein the 3D printer includes a means for continuously discharging and layering special mortar while horizontally moving the nozzle based on a design drawing.

[1799] "Example 2: Combining Emotion Engines"

[1800] (Claim 1)

[1801] A means for users to input their architectural wishes and specifications;

[1802] A means for collecting input data and user emotion data and storing them in a database;

[1803] A means for a specialized construction generation AI to automatically generate blueprints based on the stored data and emotional data,

[1804] The means to send the generated blueprints to the architectural profession for legal and technical checks and corrections;

[1805] a means for allowing a user to confirm the design drawing after the checking and correction has been completed;

[1806] A means of creating buildings using a 3D printer based on blueprints,

[1807] a means of providing users with real-time information about the construction progress;

[1808] A system including:

[1809] (Claim 2)

[1810] 10. The system of claim 1, further comprising means including an architectural professional terminal by which architectural professionals can check and modify blueprints.

[1811] (Claim 3)

[1812] The system of claim 1, wherein the 3D printer includes a means for continuously ejecting and layering the layer material while horizontally moving the nozzle based on a design drawing.

[1813] "Application example 2 when combining emotion engines"

[1814] (Claim 1)

[1815] A means for users to input their architectural wishes and specifications;

[1816] a means for collecting and storing the entered data in a database;

[1817] means for recognizing a user's emotion;

[1818] A means for a construction-specific generative AI to automatically generate blueprints based on the recognized emotion data and stored data,

[1819] The means to send the generated design drawings to the architect for legal and technical checks and corrections;

[1820] a means for allowing a user to confirm the design drawing after the checking and correction has been completed;

[1821] a means for forming a building using a 3D printer based on the blueprint after confirmation by the user;

[1822] a means of providing users with real-time information about the construction progress;

[1823] A means for users to visualize and experience the blueprints generated in virtual space,

[1824] A system including:

[1825] (Claim 2)

[1826] 10. The system of claim 1, further comprising means for an architect to check and correct the blueprints.

[1827] (Claim 3)

[1828] The system of claim 1, wherein the 3D printer includes a means for continuously discharging and layering special mortar while horizontally moving the nozzle based on a design drawing. [Explanation of symbols]

[1829] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for users to input their architectural wishes and specifications; a means for collecting and storing the entered data in a database; A means for a specialized construction generation AI to automatically generate blueprints based on the saved data, The means to send the generated design drawings to the architect for legal and technical checks and corrections; a means for allowing a user to confirm the design drawing after the checking and correction has been completed; A means of creating buildings using a 3D printer based on blueprints, a means of providing users with real-time information about the construction progress; A system including:

2. 2. The system of claim 1, further comprising means including an architect terminal for allowing an architect to check and modify the design drawings.

3. The system of claim 1, wherein the 3D printer includes a means for continuously discharging and layering special mortar while horizontally moving the nozzle based on a design drawing.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A